When enterprise AI finally works, it won’t look like AI

In an article a couple of weeks ago, I argued that the failure of enterprise AI was not really about enthusiasm, adoption, or even model capability. It was architectural: large language models were never built to run a company. Companies run on memory, context, feedback, and constraints, while LLMs remain, at their core, systems for predicting text. In a second one, I argued that the answer was not “better prompts,” but a deeper shift: from tools to systems, from answers to outcomes, from copilots to systems of action, and from prompts to constraints. Enterprise AI cannot be session-based. It has to remember. That argument now needs a third step, because something important is starting to happen: the systems that are beginning to work in enterprise AI don’t look like better chatbots, better copilots, or even better prompt chains. They look like something else entirely. And if you look closely, the evidence is already there. The shift from tools to systems is no longer theoretical For the last two years, the AI industry has mostly optimized the visible layer: bigger models, better interfaces, more polished copilots, and now, more ambitious agents. But the clearest signals of value are not coming from that visible layer alone: they are coming from organizations that are redesigning workflows, embedding AI into processes, and treating intelligence less like a tool and more like infrastructure. McKinsey’s latest global survey says it plainly: AI use is broad, but most organizations still have not embedded it deeply enough into workflows and processes to create material enterprise-level benefits. It also finds that workflow redesign is one of the strongest contributors to meaningful business impact. That matters because it confirms the core argument of my first two articles: the problem was never just whether models could answer well. The problem was where we were putting them. The organizations getting further are not simply “using more AI.” They are redesigning the com