Skip to main content
Welcome to Deloitte
If we have selected the wrong experience for you, please change it above.

AI Architecture in Banking: Architecture Before Agents

Why the AI-enabled bank will be shaped less by the intelligence it deploys than by the architecture beneath

Executive Summary

  • In banking, agentic AI is ultimately an architecture challenge, where success is defined less by the number of agents deployed and more by whether the underlying architecture can support autonomy in a traceable, governable and resilient way.
  • We see banks moving between two broad postures: “AI as overlay” and “AI by design.” Overlay approaches can deliver fast gains but inherit the weaknesses of legacy systems, while AI by design embeds autonomy from the outset.
  • Safe autonomy depends on four architectural layers, each of which ensures that autonomous decisions can be traced to reliable data, governed through policy-enforcing workflows, escalated or overridden by accountable humans and protected against third-party, cloud, model and operational failures.
  • As agentic systems spread across different areas of the bank (e.g., risk, operations, customer servicing and liquidity workflows) interactions may produce feedback loops, correlated actions or other emergent behaviours, requiring scenario testing, monitoring and circuit breakers.
  • Leaders should ask a range of practical governance questions around traceability, live orchestration, modernisation bottlenecks, stress testing, third-party dependencies and whether the right governance roles are in place.

Much of the market conversation around agentic AI still focuses on the agent itself, be that the use case, the interface or the promised productivity gains. In banking, that is only part of the story.

The harder question is whether the architecture beneath those systems can support autonomy in a way that is traceable, governable and resilient. Many institutions have demonstrated promising pilots. Far fewer can show, in real time, how an autonomous action can be traced to a data source, a model version, a control point or an accountable owner.

This architectural challenge will separate banks that compound value from AI and those that add complexity at a pace that outstrips their ability to apply the necessary controls. Importantly, this is also a problem that cannot be solved post-deployment. Suitable architecture must be engineered in from the outset.

The AI-enabled bank will be defined less by how many agents it deploys than by whether its architecture can support autonomy safely at scale

Two architectural postures – and the gap between them

Most institutions today sit somewhere between two broad architectural postures.

AI as overlay

AI by design

Here, agents are layered on top of existing systems to accelerate specific processes such as reconciliation, fraud triage or customer servicing. The gains can be real and the time to value fast. But these systems inherit the weaknesses of systems sitting beneath them. Fragmented data, uneven controls and brittle integrations all limit how far autonomy can safely extend. In this model, capability typically scales faster than confidence.

Here, data flows, controls and workflows are designed with autonomy in mind. Orchestration layers manage hand-offs and policy enforcement. Human checkpoints are designed into decision paths. Here, the question is not simply what can be deployed, but under what conditions intelligent systems can be trusted.

The distance between these two postures is not primarily a technology gap, it is an architectural one. Closing it requires deliberate sequencing across four layers that will help determine whether agentic capability strengthens resilience or quietly introduces new operational and control risks.

The four architectural layers of safe autonomy

An agentic system is only as reliable as the data it consumes. Where the underlying data estate is fragmented, definitions are inconsistent, lineage is incomplete or source validation is weak, the result is not just lower performance. It is weaker explainability, auditability and control.

This is not simply a data management issue. In banking, governance, validation and monitoring all depend on institutions being able to understand the inputs to a decision, how they were transformed and where accountability sits. Where automated decisions have legal or similarly significant effects, firms also need to think carefully about explainability, contestability and documentation. None of that is achievable without well-governed data underneath.

The practical implication here is straightforward. In the AI enabled bank, data architecture is not just a reporting utility. Rather, it becomes part of the operational backbone for governable autonomy, with every material input into an autonomous decision having a traceable source, a documented transformation history and a monitored quality standard.

Illustrative failure mode

An AML agent flags a customer for enhanced due diligence (EDD). The compliance team cannot determine which underlying data source triggered the flag, because multiple upstream systems contain conflicting records with incomplete lineage. As a result, the decision can neither be explained clearly, nor defended with confidence.

Agentic systems do not operate in isolation. They interact across functions, workflows and, in some cases, organisational boundaries. That creates a need for orchestration: a layer capable of sequencing tasks, enforcing policy, managing hand-offs and escalating exceptions in real-time. Without it, autonomy does not eliminate inconsistency. It simply amplifies it at machine speed.

In a banking context, this matters for more than just operational efficiency. Firms need to show that customer outcomes, control requirements and escalation paths are being handled coherently across end-to-end processes. For example, UK regulators require, amongst other things, that institutions deliver fair, comprehensible outcomes for their retail customers and actively avoid foreseeable harms1. In that context, compliance cannot sit entirely after the event. It must also be expressed in workflow design, decision logic and intervention thresholds, designing control into the architecture itself.

Illustrative failure mode

An AML agent and a credit decisioning agent act on the same customer journey without a shared orchestration layer, reaching conflicting conclusions and triggering contradictory customer-facing actions before anyone at the bank can intervene.

Autonomy does not remove accountability. It raises the bar for how clearly accountability must be defined. In the UK, responsibility for all activities ultimately rests with named individuals, who must be able to demonstrate appropriate oversight and control of the areas they are responsible for. Regulated firms must understand for each AI enabled activity where that ultimate responsibility sits, how escalation works and when human intervention is required. That makes clear human-in-the-loop checkpoints, documented override paths and auditable decision logs essential.

The principle is simple: if a decision cannot be traced, it cannot be defended. And if it cannot be overridden, it cannot be governed. Oversight must also extend beyond initial validation. Model drift, changing data distributions and edge case behaviours are not one-off deployment issues. They are ongoing operational realities that require monitoring, review and escalation built into the architecture from the ground up.

Illustrative failure mode

A mortgage pre-approval agent performs well for several months, then begins declining an unusual proportion of applications from a particular customer segment. No alert is triggered because monitoring focuses on headline model performance rather than outcome patterns. The issue surfaces only later in review.

 

Agentic systems depend on APIs, shared data layers, cloud infrastructure and external model providers. As autonomy scales, so too does that web of dependency, bringing with it rising concentration risk, correlation risk and the greater possibility of cascading failure if one component behaves unexpectedly.

Regulators require firms to identify important business services and ensure they can withstand severe but plausible disruptions. For banks, resilience thinking therefore needs to extend far beyond infrastructure uptime. Firms also need to consider dependencies, fallback arrangements and failure points embedded in the logic of AI-enabled workflows.

A particular related issue is third-party concentration, with much of the market building on a relatively small number of cloud and model providers. That is not inherently a problem, but it does raise the stakes around testing, oversight, contingency planning and transparency concerning where common dependencies sit.

Illustrative failure mode

A third-party model provider releases an update that changes behaviour in a narrow set of edge cases. Several institutions using the same service for credit-related workflows see anomalous outputs before the issue is identified. In this scenario, the dependency is neither fully incorporated into resilience testing nor fallback planning.

The risk many architecture reviews still miss

Each of the four layers above addresses risk inside a given system. Yet one of the more important challenges facing institutions sits between systems rather than within them.

As agentic capability begins to span risk, operations, customer servicing and liquidity workflows, interaction effects – so-called ‘emergent behaviours’ – can arise. Systems that function acceptably in isolation may, in combination, generate feedback loops, correlated actions or self-reinforcing behaviours that no individual model would have produced on its own.

Banking institutions therefore need to think beyond model-by-model validation towards scenario testing across agent combinations, cross-agent monitoring for correlated outputs and ‘circuit breakers’ that can pause coordinated activity when unexpected patterns emerge. This remains an emerging discipline for many firms. Yet it is likely to become much more important as autonomous systems move from single use cases to enterprise workflows.

The challenge is not only validating individual models. It is stress-testing what happens when they act together.

Where are you on the architecture spectrum?

Use this diagnostic to locate your institution and identify what the next step requires:

Stage

Model

Diagnostic signal

Primary risk

1.

AI
Overlay

Agents deployed on legacy systems; governance largely point-in-time and review-based

Underlying fragility inherited from existing systems; explainability weakens as scale grows

2.

Governed Deployment

Human-in-the-loop (HITL) checkpoints defined; data lineage partially mapped; compliance and review processes integrated

Interaction risk between agents remains under-modelled; monitoring is reactive rather than anticipatory

3.

Architecture-native AI

Data estate designed for orchestration; controls embedded in workflows; active cross-agent monitoring 

Requires sustained investment, operating-model discipline and organisational change to maintain

The questions leaders should be asking

As institutions look to optimise their architectural design approach to autonomy, there are several questions that leaders within these organisations should ask themselves.

  • Can every material autonomous action be traced, in near real-time, to a data source, a model version and an accountable owner?
  • Is the data estate structured for live orchestration across workflows, or mainly for reporting and after-the-fact control?
  • Are core modernisation programmes designed with autonomous orchestration in mind, or will they become bottlenecks as agentic capability scales?
  • Are agent-to-agent interactions stress tested under severe but plausible scenarios, and who owns the test?
  • Are third-party AI and cloud dependencies formally embedded in resilience and cyber assurance frameworks?
  • Are the roles required to govern what the institution is building in place, from model risk specialists and workflow designers to control owners and architecture leaders with responsibility for autonomous systems?

Building an AI-enabled bank is not simply a matter of adding a new technology layer. Institutions that treat agentic AI as an overlay may accelerate capability, but they also risk carrying forward fragilities that were otherwise manageable in a low-autonomy world. In contrast, those that build the architecture first are more likely to find that governance becomes an enabler of scale rather than a brake.

The AI-enabled bank will be definedless by how many agents it deploys than by whether its architecture is ready for them.

References

1. Our UK AI Hub provides space for Deloitte’s topic experts to publish their perspectives on the major transformation questions raised by AI adoption in banking and financial services: how institutions modernise their technology estates, redesign operating models, reshape workforces, strengthen governance and scale AI safely and effectively. Regulation is central to that agenda and is a substantial and rapidly evolving topic in its own right. The regulatory implications of AI depend heavily on use case, institution, type of customer or client affected, the jurisdictions involved and the ways in which technology is designed, deployed and controlled. For that reason, this series of article focuses on the transformation themes at hand. For detailed information on regulatory considerations related to AI, we direct readers to our European Centre for Regulatory Strategy (ECRS) for the latest regulatory developments in AI. https://www.deloitte.com/uk/en/blogs/ecrs.html