Highlights
Over the last year or so, almost every bank seems to have something to say about AI. The usual headlines are around user enablement, , productivity improvement, hours saved, advisor adoption, or AI agents deployed. These are useful numbers, no doubt. They show that the technology has been rolled out and people have started using it.
But in operations, the real discussion starts a little later. Once the go-live noise settles, people begin asking a simpler question: has the work actually become better?
A solution can be live and still leave teams dealing with exceptions, quality checks, process breaks, or cases that need manual handling. That is why I do not look at deployment numbers alone. I look at whether the operation is running better than it was earlier.
Followed by deployment, productivity numbers usually get the attention first, which is understandable.But operations teams often see a different picture when they get into the details.
Work may be moving faster in one area while backlog is still growing somewhere else. Manual effort may be reduced in one process, but teams may still spend time fixing issues the system could not handle. Sometimes the improvement is visible immediately. Sometimes it takes much longer.
Those discussions usually start coming up once the excitement around the deployment has settled down in the boardrooms.
That is when people start asking whether anything has really changed for customers, teams, or the business itself!
In my experience, I have seen the discussion change a few months after go-live. During the initial phase, everyone talks about adoption numbers and productivity improvements. Later, the conversation becomes much more practical.
For example, in dispute operations, people want to know whether cases are reaching closure sooner and whether exception handling has been reduced. In onboarding, they look at how smoothly KYC checks are progressing and whether customers are getting activated faster. Fraud teams focus on investigation turnaround time and backlog levels. They also look at broader measures such as customer response times, cost-to-serve, operational losses, regulatory performance, and whether frontline teams are spending more time with customers and less time on administrative work.
Ultimately, leadership teams are trying to understand something very simple: Is the operation performing better than it was before the investment was made? If teams are still battling the same delays, backlogs, and workarounds months later, the discussion quickly moves away from the technology and towards the outcomes being delivered. After all, nobody wants old wine in a new bottle!
After a new solution goes live, people naturally look at the same business metrics again.
That is fair because everyone wants to know the actual business outcome.
A few months later, the conversation usually changes. People across the firm and layers start looking at the numbers they have already been reviewing every day. Is backlog coming down? Are cases moving faster? Has the volume of rework been reduced? Are teams spending less time on manual checks? Has customer experience improved? Have the regulatory metrics improved?
These measures tend to remain relevant long after implementation is complete. If those numbers improve, the value usually becomes visible on its own.
There is nothing wrong with talking about user-enabled, agents deployed, productivity gains, or hours saved.
In fact, those measures are important. They tell us whether AI is being adopted, used, and scaled across the organisation.
The challenge is that they are leading indicators, not end outcomes.
Banks have spent decades investing in technologies that promised transformational benefits. Experience has shown that deployment alone is rarely enough. Real-world operations are influenced by process complexity, legacy systems, data quality, regulatory requirements, customer behaviour, and change management.
The same lesson applies to Agentic AI.
That is why I prefer looking at what has changed in the operation rather than what has been deployed. Are customers having a better experience? Is risk being managed more effectively? Is cost-to-serve improving? Are teams spending their time on higher-value activities?
When those measures improve, the value speaks for itself.
Agentic AI will continue becoming part of everyday banking operations. The bigger question is no longer whether banks are adopting AI. Most already are. The question is whether that adoption is creating measurable and sustainable improvement.
To me, that is the difference between implementation and transformation. Adoption starts the journey. Outcomes prove whether the journey is worth it. That is where the rubber meets the road, and that is when adoption starts becoming transformation.