Insights
Engineering Strategy Oct 2023

The Quiet Reality of Enterprise AI Pilots: Why 89% Don't Reach Production

Industry surveys keep finding the same pattern - most enterprise AI pilots never reach production. After running a fair share of them, we think the reasons are less mysterious than the headlines suggest.

The Problem

Industry research has been consistent through 2025 and into 2026: of intended agentic AI use cases enterprises set out to deploy, only about one in ten makes it into production. The rest stall, get reframed, or get quietly shelved.

We've worked on enough of these to see the pattern from the inside. The failure mode is rarely the AI itself. The model works. The demo works. What doesn't work is everything around it.

What "Reaching Production" Actually Means

The gap between pilot and production isn't a single threshold. It's a sequence of checkpoints, each of which kills a percentage of projects.

A pilot needs to demonstrate value on a handful of test cases. Production needs to handle the long tail - the cases the pilot deliberately scoped out. A pilot can be evaluated by the team that built it. Production needs SLAs and incident response. A pilot can use a static set of seed data. Production needs an ingestion pipeline that keeps the data current without manual intervention.

Each of these steps adds engineering work that wasn't in the original pilot estimate. Cumulatively, they often double or triple the timeline. That's when projects start to slip into the "we'll revisit next quarter" category.

The Four Patterns We See

In post-mortems on stalled projects - both ours and the ones we've been brought in to rescue - four recurring patterns account for most of the gap.

1. Data readiness was underestimated. The pilot used a curated extract. Production needs the live system, with its inconsistent encoding, late-arriving records and a permissions model nobody documented. We've seen six-week pilots followed by twelve-week data pipeline projects.

2. Integration debt was deferred. "We'll wire it into the CRM later" works for a demo. In production, "the CRM" turns out to be three CRMs, two of which exchange data via a nightly file drop. The integration work was never in the pilot scope, so it never had a budget.

3. The human workflow wasn't redesigned. The pilot showed a faster way to do step three of a seven-step process. Production needs the other six steps to know that step three is now AI-assisted. If the downstream team still expects a human-authored handoff document, the AI's output gets manually reformatted - and the productivity gain evaporates.

4. Ownership was unclear. Pilots are often run by an innovation team. Production needs an owner who is on the hook when things go wrong at 2 a.m. If no operational team takes the handoff, the project lives in pilot limbo indefinitely.

What Worked in the Projects That Shipped

The 10-15% of projects we've seen reach production shared a few characteristics.

They scoped to a complete workflow, not a step. Successful projects automated something end-to-end - "draft the response, route it for approval, send it, log it" - rather than just "draft the response." The end-to-end framing forced the integration and handoff work to be in scope from day one.

They had a named operational owner before the pilot started. Not the innovation team. The team that would run it after launch. That team's constraints shaped the pilot.

They evaluated on production-shaped data, not curated data. The eval set was sampled from the live system, including the messy cases. If the pilot couldn't handle them, that was a finding, not a deferred problem.

They budgeted for a hardening phase explicitly. The plan had a pilot phase and a separate, named, funded hardening phase. The hardening phase was typically 1-2x the length of the pilot. When that phase was in the original budget, it didn't feel like scope creep.

What We'd Tell Clients Earlier

The pilot is the easy bit. If a project can't articulate, on day one, who the operational owner is, what the end-to-end workflow looks like and how production data differs from the pilot extract, the chance of reaching production is low - regardless of how well the model performs.

We've started asking those three questions before we accept the engagement.

Takeaway

The 89% who don't reach production aren't being defeated by AI limitations. They're being defeated by ordinary enterprise software realities - data, integration, workflow design and ownership. Treat AI projects as integration projects with a model attached and the production rate goes up dramatically.