Berk Bayri

Human in the loop

A design where a person reviews, approves or corrects an AI system's work at defined points. In practice it can mean a person with real judgment, or a person who has become the loop.

"Human in the loop" means that a person takes part in an AI system's process: reviewing outputs, approving actions, handling exceptions or correcting errors. It is often presented as the safety net that makes automation acceptable.

The phrase hides two very different situations. A human staying in the loop applies judgment at moments that matter: approving a consequential action, resolving an ambiguous case, setting policy. A human becoming the loop is consumed by supplying context, checking every output and repairing mistakes, so the person is effectively doing the work through the machine.

Telling them apart

Measure supervision load: how much human attention a dependable outcome requires, and why the human is involved. Mandatory judgment, such as a regulatory approval, is a very different investment than preventable repair of a recurring error.

A well-designed loop also needs somewhere for uncertain cases to go, which is the role of abstention, and it should be reported next to automation rate, not hidden by it.

Read more in The hidden metric in AI automation is supervision.

Used in these essays

AI Agents & Systems13 min read

AI agent governance: what executives must decide first

AI agent governance is a short list of leadership decisions about authority, ownership, evidence and supervision that have to be made before an agent acts.

AI Strategy & Transformation7 min read

The question your board should ask about AI is not “what are we doing?”

A list of AI projects tells a board what management chose to launch. It does not show where AI already shapes decisions nobody approved.

Creative Technology7 min read

Who should have the first idea? Human planning in AI-assisted creativity

Putting a human at the end of an AI creative workflow is not the same as letting them shape its possibilities.

Problem Framing & Decision Design13 min read

The safest answer your AI team can give you may be “we should not automate this”

The responsible AI decision is not always a deployment. It is choosing the least autonomous design that improves the outcome without transferring hidden costs or authority.

AI Agents & Systems13 min read

AI agents are exposing your org chart as fiction

An org chart tells you who manages whom. An agent can reveal who actually authorizes a decision, rescues an exception, and carries the consequences.

AI Strategy & Transformation10 min read

Most AI strategies are software procurement plans with better typography

A vendor shortlist can specify what a company will buy. It cannot decide which work the company will stop, which decisions will change, or who will own the consequences.

AI Strategy & Transformation11 min read

Five AI metrics I would remove from an executive dashboard

Licenses, prompts, pilots, hours saved and benchmark scores can all rise while the business stands still. The executive dashboard needs a different contract.

AI Strategy & Transformation11 min read

AI is removing the coordination tax. The next bottleneck is authority

As AI reduces the cost of moving work between teams and systems, many organizations will discover that the remaining delay is not coordination. It is permission to decide.

AI Strategy & Transformation12 min read

Your AI agent estate is becoming a capital allocation problem

Once agents multiply across workflows, the management problem changes: which agents deserve more capacity, which should be merged or constrained, and which should be retired?

AI Governance & Evaluation12 min read

An AI agent should get authority per task, not permissions per role

A person's role describes standing access across many situations. An AI agent should receive a narrower authority envelope for the task it is executing now.

AI Agents & Systems11 min read

Design systems need an interaction policy layer for AI

Components can keep an AI experience visually on-system while the agent is behaviorally off-policy. Design systems now need reusable rules for what AI may present, decide, execute, defer, expose as uncertain, confirm, reverse and escalate.

AI Governance & Evaluation13 min read

Your AI agent can follow the objective and still break the company

AI agents can satisfy a local objective while violating the organization’s broader constraints. The control problem is not only model alignment; it is management design.

AI Agents & Systems14 min read

OpenAI Decisions API turns probability into policy

The provocative part of OpenAI's Decisions API is not that AI can make choices. It is that a model score can quietly become an action — and an action can quietly become policy.

Problem Framing & Decision Design10 min read

Cahit Arf’s 1959 question about thinking machines

In a 1959 text on thinking machines, Cahit Arf moved from clocks and relays to a harder question: what happens when a machine meets a problem that was not anticipated when it was built?

AI Strategy & Transformation9 min read

A cheaper AI model can move the cost instead of removing it

A lower model bill can hide a higher workflow bill. The useful AI TCO question is not only what got cheaper, but where the cost moved.

Innovation & Capability10 min read

The hidden metric in AI automation is supervision

As AI moves from assisting work to leading it, hours saved stop telling the whole story. The scarce resource shifts to human supervision: approvals, exceptions, context and judgment.

AI Agents & Systems9 min read

The next AI interface may never be seen

Agents are turning software capabilities into an interface of their own. The next enterprise design problem is deciding what should be callable, by whom, and under which boundaries.

AI Strategy & Transformation9 min read

Your AI data agent is creating a second dataset

AI data agents do more than answer business questions. At scale, the pattern of questions, corrections and dead ends becomes a new signal: a map of what the organization is trying to understand, where its definitions are weak, and which decisions deserve better infrastructure.