Oversight modes
Design patterns for human control: **in the loop** (approve each act), **on the loop** (supervise & intervene), **out of the loop** (monitor after the fact)—matched to risk. PAIR patterns emphasize supervising automation, giving control ...
What it is
Design patterns for human control: in the loop (approve each act), on the loop (supervise & intervene), out of the loop (monitor after the fact)—matched to risk. PAIR patterns emphasize supervising automation, giving control back when automation fails, and balancing user control vs automation. HAX guidelines include efficient invocation, dismissal, correction, and global controls.
<!-- IMAGE: three lanes: approve each / supervise / audit later -->
Visual Spec & Architecture Diagram
Oversight modes spectrum: human-in-the-loop approve every action; human-on-the-loop monitor+intervene; human-out-of-the-loop with post-hoc audit. Traffic-light autonomy.
Why it matters
Wrong mode causes bottlenecks or disasters. Stanford HAI discussions contrast algorithm-only management vs human review paths (e.g., delivery-driver monitoring examples in conference coverage)—process design is part of HAI.
How it works (plain)
- Map actions by irreversibility and blast radius.
- Assign oversight mode.
- Measure override rates and time-to-intervene.
- Adjust thresholds and UI affordances.
- Pair with Course 10 permissions.
Everyday example
Autopilot on a plane still has pilots on the loop—not “no humans forever.”
Try it
Classify 5 actions in a product into the three modes. Mark one that is currently under-supervised.
Myths
- ⚠️ Myth: Full autonomy is always the goal.
- ✓ Reality: Appropriate autonomy is the goal.
- ⚠️ Myth: A human somewhere in the company counts as HITL.
- ✓ Reality: Mode refers to the interaction path for that action.
Sources
- PAIR patterns: https://pair.withgoogle.com/guidebook-v2/patterns ↗
- HAX Guidelines: https://www.microsoft.com/en-us/haxtoolkit/ai-guidelines/ ↗
- Stanford HAI piece: https://hai.stanford.edu/news/how-do-we-design-and-develop-human-centered-ai ↗
- NIST AI RMF: https://www.nist.gov/itl/ai-risk-management-framework ↗
- Course 10 permissions
