Capability is only the first question

AI can classify, summarize, rank, recommend, detect patterns, generate options, and increasingly take actions. That makes it tempting to frame automation as a capability question: can the model do this task?

But operational design needs a second question: should this decision be delegated under these conditions?

A technically possible decision may still be a poor candidate for autonomy if the cost of error is high, the context is unstable, or the result is difficult to reverse.

The goal is not maximum automation. The goal is the right allocation of judgment.Working principle

Look at risk, reversibility, and observability

Decisions are easier to automate when the objective is clear, the inputs are reliable, the rules are stable, the impact of an error is limited, and the outcome can be monitored.

Human involvement becomes more important when consequences are significant, values are contested, context is incomplete, exceptions are common, or the decision changes a person's rights, opportunities, safety, or access.

Decision rule

As impact and irreversibility increase, raise the level of human review. As rules become stable and outcomes become easy to observe and reverse, automation becomes easier to justify.

AI can play more than one role

The choice is not only 'AI decides' or 'human decides.' AI can prepare information, flag anomalies, generate options, estimate risk, recommend an action, execute a low-risk step, or monitor what happened afterward.

Breaking the workflow into roles often produces a better design than trying to automate the entire decision at once.

Decision patternAI roleHuman role
Low impact, repetitive, reversibleAutomate or executeMonitor exceptions
Moderate impact, clear criteriaRecommend / rankApprove or override
High impact, ambiguous contextPrepare evidence / optionsDecide and own outcome
High impact, difficult to reverseAssist onlyExplicit human accountability

Keep accountability visible

When an AI-assisted decision matters, the organization should still know who owns the outcome. A model can produce a recommendation, but responsibility should not disappear into the phrase 'the system decided.'

Useful governance makes the input, recommendation, action, override, and result traceable enough for review.

Closing thought

AI should not be judged by how many decisions it can take away from people. It should be judged by whether the combined human-and-machine system produces better outcomes with appropriate control.

Sometimes that means full automation. Sometimes it means a recommendation. Sometimes the correct role for AI is simply to make the human decision better informed.

Related thinking

Why Good Systems Still Fail

Why strong processes can still break when incentives, context, feedback, and human behavior are ignored.

Systems · 8 min read