Definition
When a system’s power exceeds the maturity of its controls, making failures likely even without malicious intent. Capability overhang shows up as strong automation but weak stoppability or reversibility.
Hypothetical example
- A model can auto-approve loans, but rollback and auditing are manual and slow.
References
- Mechanisms catalog · Reference