Berk Bayri

NIST AI RMF

The NIST AI Risk Management Framework: a voluntary, use-case-agnostic US framework for managing AI risks. NIST's related work also stresses monitoring deployed AI systems after launch.

The NIST AI Risk Management Framework is guidance published by the US National Institute of Standards and Technology to help organizations identify, assess and manage risks from AI systems. It is voluntary and intentionally use-case agnostic: it describes outcomes and practices rather than prescribing controls for one industry.

Monitoring after deployment

NIST's work on monitoring deployed AI makes a point that is directly relevant to operations: post-deployment monitoring is crucial because AI systems can show variability and unpredictable behavior in real-world settings, and the monitoring problem is still fragmented. That makes preserving field evidence more important, not less.

How it relates

A framework like this tells an organization what to govern. It does not replace operational practice such as AI incident reporting, where first reports keep an observation record before the root cause is known, or concrete guardrails. Company-specific disclosure processes from AI vendors are not enterprise standards; a broad framework such as this one is a better reference for an enterprise program.

Read more in The first AI incident report should be incomplete.

Used in these essays

AI Agents & Systems13 min read

AI agent governance: what executives must decide first

AI agent governance is a short list of leadership decisions about authority, ownership, evidence and supervision that have to be made before an agent acts.

AI Strategy & Transformation7 min read

The question your board should ask about AI is not “what are we doing?”

A list of AI projects tells a board what management chose to launch. It does not show where AI already shapes decisions nobody approved.

AI Strategy6 min read

AI is making intelligence cheap. Judgment is not getting cheaper.

Better and more accessible AI answers do not settle which questions matter, which evidence counts, or who owns a decision.

AI Agents & Systems6 min read

What AI agents actually do, and where autonomy should stop

An AI agent is a system that can pursue a goal by choosing and using tools. That does not mean it should be allowed to choose its own authority.

AI Agents & Systems13 min read

AI agents are exposing your org chart as fiction

An org chart tells you who manages whom. An agent can reveal who actually authorizes a decision, rescues an exception, and carries the consequences.

Problem Framing & Decision Design12 min read

How to tell if an AI pilot deserves to survive

A pilot earns another investment only when its result can survive ordinary work, a credible alternative, and an owner who can carry it without the pilot team.

AI Strategy & Transformation10 min read

Most AI strategies are software procurement plans with better typography

A vendor shortlist can specify what a company will buy. It cannot decide which work the company will stop, which decisions will change, or who will own the consequences.

Problem Framing & Decision Design10 min read

A pilot with no kill criteria is not an experiment

A pilot is not an experiment if every result can be used to justify continuing. The missing design element is the authority to stop.

AI Governance & Evaluation12 min read

An AI agent should get authority per task, not permissions per role

A person's role describes standing access across many situations. An AI agent should receive a narrower authority envelope for the task it is executing now.

AI Agents & Systems11 min read

Design systems need an interaction policy layer for AI

Components can keep an AI experience visually on-system while the agent is behaviorally off-policy. Design systems now need reusable rules for what AI may present, decide, execute, defer, expose as uncertain, confirm, reverse and escalate.

Problem Framing & Decision Design14 min read

The wrong questions about AI right now

Many of the questions that helped us orient ourselves around generative AI are now too blunt to be useful. The harder work is no longer asking what AI is in the abstract, but specifying where it works, where it fails, what authority it should have, and what the whole system costs.

AI Strategy & Transformation7 min read

Make the AI vendor demo fail

A polished AI demo proves that a system can succeed under prepared conditions. A buying decision needs different evidence: what happens when the system is wrong, blocked, uncertain or halfway through an action.

AI Governance & Evaluation8 min read

The first AI incident report should be incomplete

OpenAI's new misalignment disclosure framework exposes a useful enterprise design principle: record anomalous AI behavior before the organization has finished explaining it. Otherwise incident systems quietly become filters for what teams already understand.

AI Agents & Systems9 min read

The next AI interface may never be seen

Agents are turning software capabilities into an interface of their own. The next enterprise design problem is deciding what should be callable, by whom, and under which boundaries.