Supervision load
The human attention an AI system still consumes — context supply, review, approval, correction and exception handling — measured per dependable, completed unit of work.
Automation can remove execution and leave the work. When an AI system takes over the doing, the human work does not vanish; it moves into prompting, supplying context, reviewing, approving, correcting and handling exceptions. Supervision load names that remainder.
The useful way to measure it is per completed unit of work: how much human attention does one dependable outcome require? Not how long the agent ran, and not how many minutes it saved on the visible task.
Four questions
- How much attention does one dependable outcome require?
- Why is the human involved? Separate mandatory judgment, such as regulatory approval, from preventable repair, such as fixing a recurring hallucination.
- How concentrated is the attention? Ten predictable minutes is not the same as ten scattered interruptions.
- What happens as volume rises? If completed work doubles and so does human attention, there is little operating leverage.
Why it matters
Measure it alongside automation rate. Deeper autonomy shifts the bottleneck from execution to supervision, and the metric should expire when the runtime changes. It also separates a human staying in the loop from a human becoming the loop.
Read more in The hidden metric in AI automation is supervision.
Related terms
Dependable outcome
A result from an AI-assisted workflow that is actually usable without further repair — the right denominator for measuring the human attention and cost AI automation really consumes.
Human in the loop
A design where a person reviews, approves or corrects an AI system's work at defined points. In practice it can mean a person with real judgment, or a person who has become the loop.
Automation rate
The share of work an AI system completes without a person doing it. A useful headline number that says nothing on its own about the human attention left behind.
Recovery distance
The amount of human and system work needed to get from an AI failure back to a safe, correct state — a cost that belongs in the business case, not just the demo.
Used in these essays
The wrong questions about AI right now
Many of the questions that helped us orient ourselves around generative AI are now too blunt to be useful. The harder work is no longer asking what AI is in the abstract, but specifying where it works, where it fails, what authority it should have, and what the whole system costs.
The hidden metric in AI automation is supervision
As AI moves from assisting work to leading it, hours saved stop telling the whole story. The scarce resource shifts to human supervision: approvals, exceptions, context and judgment.