# The missing pieces of workflow automation — Shirsha Chaudhuri, Thomson Reuters Labs AI Engineer · 2025-04-23 Shirsha Chaudhuri, head of co-innovation at Thomson Reuters Labs, identifies eight missing pieces preventing true AI workflow automation in the enterprise. She argues that while 71% of Fortune 500 companies still run mainframes and 68% of IT production workloads remain on mainframe, current agentic efforts lack connectors to bridge legacy systems, standardized agent architectures, and reliable ROI metrics. She highlights the need for domain experts to reimagine processes alongside AI practitioners, collaborative UX design, and AI governance that translates ethics into agent architecture. Control balance between deterministic and agent-driven steps remains unresolved, and the fast-evolving agent lifecycle lacks a clear update strategy. Drawing from Thomson Reuters' own journey—from a 2023 open AI arena through RAG and prompt engineering to 2024's agentic experiments—she calls for a reimagined workflow design rather than just task-level automation. ## Questions this episode answers ### What are the missing pieces for AI workflow automation in enterprises? Shirsha Chaudhuri identifies several missing pieces: connectors to bridge modern AI with legacy systems (e.g., mainframes still run 68% of IT workloads), reliability to justify replacing human labor, visionaries to reimagine workflows, standardization, unified data access, collaborative UX, AI governance, human control, and agent lifecycle management to keep pace with rapid evolution. [7:21](https://aie.addtry.com/3dccae0e-46ef-4dd5-bd66-f570b0468e9f?t=441000) ### What examples of workflows does Shirsha Chaudhuri use to illustrate AI reimagination needs? She presents a typical software support workflow—from customer call to ticket resolution—and a content creation workflow involving authors, editors, and publishers. Both contain many tasks suitable for AI agents, but she argues that simply plugging AI into existing steps misses the opportunity to fundamentally reimagine the entire process. [3:32](https://aie.addtry.com/3dccae0e-46ef-4dd5-bd66-f570b0468e9f?t=212000) ### Why are legacy mainframe systems a stumbling block for AI agents? Shirsha Chaudhuri notes that 71% of Fortune 500 companies still use mainframes and 68% of global IT production workloads run on them. This creates a wide technology gap between decades-old systems and modern agentic AI, making it difficult to connect these worlds and hampering workflow automation. [8:23](https://aie.addtry.com/3dccae0e-46ef-4dd5-bd66-f570b0468e9f?t=503000) ## Key moments - **[0:00] Intro** - [0:54] AI tools for jokes 'really suck' at enterprise humor, says Shirsha Chaudhuri - **[2:10] AI Journey** - [2:10] Thomson Reuters launched 'Open Arena' in 2023, a playground for employees to try large language models - **[3:32] Workflows** - [5:02] Automating individual tasks is not enough; entire workflows must be reimagined with AI, argues Chaudhuri - **[7:21] Connectors** - [8:23] 71% of Fortune 500 companies still use mainframes, and 68% of the world's IT production workloads run on them - **[9:14] ROI** - **[10:09] Visionaries** - [10:09] Practitioners need visionary subject matter experts to co-reimagine business processes with AI - **[10:53] Standardization** - **[11:14] Data & Systems** - **[12:06] Collaborative UX** - [12:06] Creating a collaborative UX where humans and AI agents support each other is a crucial missing piece - **[12:56] AI Governance** - **[13:17] Control** - **[13:37] Lifecycle** - [13:37] The agent lifecycle challenge: incorporating ever-evolving AI capabilities into already-deployed agents ## Speakers - **Shirsha Chaudhuri** (guest) ## Topics AI Strategy, Agent Evaluation ## Mentioned Thomson Reuters (company), Open Arena (product) ## Transcript ### Intro **Shirsha Chaudhuri** [0:17] I have before me the ominous task of making this presentation really interesting, with a topic which is going to sound like a crib: what are those missing pieces for workflow automation to happen with AI? And I'm going to tell you, really, an enterprise story. Is it dry? Is it just going to be about, "Now I'm going to find out who took my lunch sandwich"? We'll see. Um, and, you know, as I was preparing for this talk and I realized in the schedule that this is going to be just after lunch, I thought I should start off with a joke. And since for all our daily needs we go to AI tools, I tried to go to an AI tool for a joke, and they really suck. I couldn't find one decent joke. If you can tell me a good joke about, you know, using AI for your real-world enterprise needs, I'd be happy to squeeze it inright now. Ugh, clicker doesn't work. Can someone help me? Oh, okay. Yep. So the graph looks a little different from all the graphs that I've been seeing this morning. We took this journey in our worlds, in our enterprise worlds, um, as we explored. But before I dive into this, I think I should do an introduction. I'm Shirsha. I've come all the way from Bangalore to tell you the story that I see unfolding around me, not just in Thomson Reuters, where I work, trying to bring AI to my, um, to my, uh, you know, teams and, um, different business processes, but also the same story that I hear at meetups and, you know, um, different community events where, where I meet AI practitioners. ### AI Journey **Shirsha Chaudhuri** [2:10] Um, everyone started off trying to democratize the use of generative AI back in 2023. We have something called this Open Arena in, uh, Thomson Reuters, very similar to your, you know, um, playground where you can try different large language models. This is where it truly came home to, um, almost everybody in an enterprise to start using generative AI for their workflows. Further along, we got onto the rag, um, and, you know, prompt engineering world pretty quickly. We looked at, um, automating various knowledge-driven tasks with the use of RAG, and very soon we were answering questions, um, at the enterprise level on what is the ROI. Further along, in 2024, we started to play with tools and frameworks, and we heralded the rise of the agents. We are now here where we're looking at automating entire workflows with the use of AI/agents, and not just one task at a time,right? We are looking at a future where we want to reimagine business processes because just automating a task seems redundant. Okay. So what, what do we mean by workflow automation? And what I've got here is a very typical workflow for almost any company that's putting software out there. Customer calls you, calls your service desk, report a billing issue and invoice issue, or, uh, a product feature not working as expected. ### Workflows **Shirsha Chaudhuri** [3:54] Your customer support, um, is going to take the call. They are probably using RAG to sort of answer that question already, or they may be looking at, you know, internal tickets or connecting with, um, you know, uh, their, uh, hierarchy to see if the answer can, if the answer can be given. And if no answers are found, they then, you know, report a ticket to the IT ops teams,right? The internal IT ops teams do the level two support, and they're looking at, you know, launching investigations to support this. Further along, if this doesn't work, you've got your engineering teams doing the L3, L4 support, and a fix is likely going to be identified with the use of various observability tools. Scripts are launched to, you know, la create that new build. Tests, regression tests, integration tests are launched. And finally, you've got either the bug fixed or the billing question answered, your tickets are updated, and SLAs met. Needless to say, all of you can spot so many of these tasks that can be automated with the use of agents. But, you know, is automating each task the way we want to do this? Is there something that can be done differently in reimagining this workflow? We are there. We are trying to reimagine this workflow. Um, here's a slightly different take. Let's look at, um, a workflow where content is getting created,right? It starts off with authors or content specialists perhaps identifying an alert or a trigger that's going to launch that content workflow. You then have maybe approvals to say, "Yes, go ahead, do your research, find out what we want to write about this." And then you've got, you know, content getting created with research being done, and subsequently your editors and your, um, associate editors and reviewers reviewing that content. If it's, you know, very critical content, you, you will probably have several rounds of these reviews, and eventually the finalized content goes to the publisher, which then, you know, the, the publishing teams then launch their own formatting, styling-related workflows, and eventually the content is published. Here too, you will realize that so many of these tasks can be done by AI, can be done by agents, and of course humans being in the approval flow. But here again, something seems amiss. Should we stick to the same design of the workflow, or should we be doing this a little differently? Okay. So that's, that's where we are. We want to be able to reimagine these workflows because it's a new world, because we have new capabilities with these technologies, um, and not just plug in capabilities into an existing business process,right? But we are stuck. We are stuck. We are, um, missing certain parts of that reimagination. So what are we missing? The first thing that we're missing is connectors. Um, I, I spoke to a few of the, um, you know, the stalls, uh, yesterday, and a common theme was how around providing a good AI agentic solution, you always needed that layer which connected to your current IT systems,right? ### Connectors **Shirsha Chaudhuri** [7:43] And, and connectors are a very, very much a missing part of reimagining these business processes. Um, I also want to say that, you know, I come from a world where, uh, you know, technology is not altogether new. We've been, you know, we've been doing AI, we've been doing NLP for several decades at Thomson Reuters. And even, even in the different companies that, um, uh, that developers come from in the different meetups and communities that I attend, they are also supporting IT systems of some of the, you know, different technology companies of our world. Believe it or not, 71% of Fortune 500 companies still use mainframe. 68% of the world's IT production workloads still run on mainframe,right? And some of your major credit card, um, transactions still happen on the mainframe, which means we are that distant,right? Like that technology spectrum, if you were to measure from the mainframe to, to an agentic workflow, how do we connect these worlds,right? And so that's one of, one of our major stumbling blocks, I believe, where, you know, how do you connect the worlds of the technology, um, stable technology stacks that exist with, um, with, with, with the power of AI agentic workflows. ### ROI **Shirsha Chaudhuri** [9:14] The second thing is something that, um, I struggle with as I take new ideas to different stakeholders. And I see, you know, several startups whom I meet on a regular basis, them struggling as well. It comes back to the question of ROI. It comes to the question of, you know, um, reliability,right? How will I be sure that my agent will be able to perform? And often with stakeholders and, you know, from, from a business impact standpoint, it's a zero or one call,right? Am I going to continue to need to have to pay manual hours, or can I consider that not needed anymore if I'm going to pay for the agent, AI agent,right? And so reliability becomes a big factor and a stumbling block for us. ### Visionaries **Shirsha Chaudhuri** [10:09] The third thing that we are finding missing as practitioners is to have visionaries who are able to reimagine this world with us. It's, um, you know, as a practitioner, as somebody who's deeply entrenched in AI, you can only go that far in reimagining this world. You need the subject matter experts. You need the specialists from that specific domain to sort of do this together with them to be able to, you know, reimagine your business processes. The, the fourth thing that, you know, we need, and I'm sure many of you will agree based on conversations that I've had, is we need a certain level of standardization,right? We need to be able to say, "This is how agents will be built. This is how they are packaged. This is how they're deployed." It's too nascent yet, um, you know, in a, in a established tech ecosystem to say, uh, this, we are going to replace these, these bits with agents. ### Data & Systems **Shirsha Chaudhuri** [11:14] Data and systems. For an agent to truly, you know, um, get its full power, we need to give it access to context. The context is today distributed across different IT systems, business systems. It is probably, um, partially located in logs. It is probably there in, um, chat messages or, you know, IT tickets and, you know, different, um, you know, di-different siloed systems,right? Sometimes which are spread across different parts of the organization. And so bringing them together and even identifying which of these systems will have what, and how do you correlate a single transaction across these systems becomes often a stumbling part of, you know, getting the AI in. The sixth thing is one that, you know, I've, I personally feel very strongly about is creating a collaborative UX. Agents are going to be assistants. So what is the role of the human defining that and creating systems in which humans can support the work of the agents and vice versa is, I think, a very important part of, um, creating, creating those workflows. ### Collaborative UX **Shirsha Chaudhuri** [12:32] And so what makes sense from a col-collaborative UX is something that, you know, I'm waiting to hear from, from any of you, fresh ideas on,right? AI governance. We, we saw, um, in one of the talks about how different parts of di-different aspects of security testing go down into parts of your agentic workflows. ### AI Governance **Shirsha Chaudhuri** [12:56] And, and so, you know, aspects of your AI governance, which we'd established all this while around ethics and responsibility, how do you translate that into different levels of your agent architecture,right? The next thing is control. We still want to give the human control. ### Control **Shirsha Chaudhuri** [13:17] We want to have certain steps which are deterministic and certain steps which the agent can control on its own, or, you know, how, how do you balance that, um, need for control, uh, between, between the agent and the human and give the human theright, um, you know,right time to act? ### Lifecycle **Shirsha Chaudhuri** [13:37] And finally, what is the life cycle for the agent? All of you've, you know, spoken about that exponential growth of, um, evolution in our space. How do we bring the capability, the latest capability into what we've already got deployed and that one that's ever-changing? So that, that's what I had to share. Um, we are just at the start. A lot of good work from all of you. I'm waiting to bridge from the world that I'm seeing around me to the world that I come from. And so happy to have your questions and ideas, suggestions, feedback. Thank you. --- This library is powered by PodHood (https://podhood.com), the podcast website platform.