Back to Insights
AI Strategy8 min read1 July 2025

What Is an AI Operating Model — and Why Most Organisations Don't Have One

Most organisations have AI pilots. Few have an operating model to scale them. Here's what an AI Operating Model actually is, what it contains, and why the absence of one is the single biggest barrier to enterprise AI maturity.

AA

Agraj Agranayak

Founder & CEO, Imagine Works · About · LinkedIn

Key Takeaways

  • An AI Operating Model defines how an organisation structures people, processes, technology, and governance to deliver AI at scale.
  • Only around 8% of organisations have successfully embedded AI as a core operational capability — the gap is almost always a missing operating model.
  • An AI strategy tells you where to go. An AI Operating Model tells you how to organise yourself to get there. Most organisations have the first; almost none have the second.
  • Organisations with AI operating models in place are three times more likely to sustain AI deployment across the business (McKinsey, 2023).
  • The design process typically takes 4–8 weeks and produces an organisational blueprint — not a technology roadmap.

An AI Operating Model defines how an organisation structures its people, processes, technology, and governance to deliver AI at scale — not as isolated experiments, but as a core operational capability.

McKinsey's 2023 State of AI survey found that 55% of organisations have now adopted AI in at least one business function. Yet the same survey revealed that fewer than half report measurable value from those investments at scale. The gap between adoption and value creation is where most organisations find themselves today — and an absent operating model is almost always the reason.

What an AI Operating Model Contains

Framework Reference

The AI Operating Model — Four Interconnected Layers

Each layer must be designed before AI deployment can scale

01

Strategic Layer

Where does AI create value? Which use cases are prioritised? How does AI investment align to commercial strategy?

AI portfolio prioritisationValue mappingInvestment sequencing
02

Organisational Layer

Who owns AI across the business? How are capabilities distributed? Where does centralisation help vs. create bottlenecks?

AI ownership modelCentre of ExcellenceCapability distribution
03

Workflow Layer

How do human and AI teams work together? Where does AI augment human judgement and where does it replace effort?

Human–AI collaborationTask redesignAugmentation vs. automation
04

Governance Layer

Who is accountable for AI outputs? How are models monitored and updated? What happens when a system behaves unexpectedly?

AI accountabilityModel monitoringIncident response
All four layers are interdependent

Imagine Works AI Operating Model framework. A strong governance layer without a workflow layer produces compliance overhead with no productivity gain.

A mature AI Operating Model addresses four interconnected layers:

1. Strategic Layer — Where does AI create value in this organisation? What is the sequencing of AI adoption? How does AI investment align to commercial priorities?

2. Organisational Layer — Who owns AI strategy? How are AI capabilities distributed across the business? Where does centralisation create efficiency and where does it create bottlenecks?

3. Workflow Layer — How do human and AI teams work together? Where does AI augment human judgement and where does it replace effort? What does the new human-AI workflow look like in practice?

4. Governance Layer — Who is accountable for AI outputs? How are models monitored and updated? What happens when an AI system behaves unexpectedly?

These four layers are interdependent. A strong governance layer without a clear workflow layer produces compliance overhead with no productivity gain. A strong strategic layer without an organisational layer produces a roadmap that nobody owns.

How to Tell You Don't Have One

The absence of an AI Operating Model is rarely obvious from the inside. These are the diagnostic signals:

  • No single person or team owns AI strategy across the organisation
  • Different business units are evaluating the same AI vendors independently
  • AI initiatives are funded and governed the same way as IT infrastructure projects
  • There is no agreed process for deciding which AI use cases to prioritise
  • AI spend is growing, but leadership cannot point to proportionate business outcomes
  • The organisation has an "AI strategy" document but no plan for who executes it and how

If three or more of these apply, the operating model is missing — even if the organisation has significant AI activity underway.

AI Strategy vs. AI Operating Model

These two things are frequently conflated, but they are not the same.

An AI strategy answers: what do we want to achieve with AI, and which use cases create the most value? It is a directional document. Most organisations either have one or are actively developing one.

An AI Operating Model answers: how do we organise ourselves to deliver that strategy? It defines the structures, processes, accountabilities, and capabilities required to turn direction into operational reality.

The analogy is straightforward. A growth strategy tells you where to grow. A sales operating model tells you how the sales function is structured, resourced, and managed to deliver that growth. You cannot execute the first without the second.

Why Most Organisations Don't Have One

The absence of an AI Operating Model is almost always the result of how AI adoption started — bottom-up, tool-first, and opportunistic. A team found a useful tool and implemented it. Then another team found a different tool. Then a third.

Each implementation was rational in isolation. But no one designed the system that should govern all of them together.

McKinsey's research consistently identifies the lack of a clear AI operating model as the primary reason AI initiatives fail to scale. Organisations with operating models in place are three times more likely to sustain AI deployment across the business than those without one.

What It Takes to Build One

Designing an AI Operating Model is a strategic exercise, not a technical one. It requires:

  • A clear assessment of current AI maturity across the organisation
  • Alignment at the leadership level on what AI is for — and what it is not for
  • A workforce architecture that maps AI capabilities to human roles
  • A governance framework that defines accountability without stifling adoption
  • A sequenced implementation plan that builds capability progressively

The output is not a technology roadmap. It is an organisational blueprint: a clear picture of what the organisation looks like when AI is embedded as a core capability, and a sequenced plan for getting there.

The design process typically takes four to eight weeks. The result is a document that leadership can own, a plan that teams can execute, and a governance structure that scales as AI use grows.

Imagine Works designs AI Operating Models for enterprise organisations. If your organisation has AI pilots but no operating model, get in touch.

Related Service

AI Strategy & Operating Model

Designing the AI strategy, vision, and operating model that aligns your entire organisation — from the boardroom to the workflow layer.

Explore this service