Definition
The condition in which the questions an institution asks about a system's scope, and the terms it asks them in, have come to track the system that answered the last one. The system's categories become the institution's categories; the cases it handles well become the typical cases and the rest become edge cases; a neighbouring class of decisions is described in the system's vocabulary before anyone asks whether the system should decide it.
It matters because it makes the automation ratchet self-sustaining. Each widening produces evidence, in the incumbent's terms, that supports the next, and a review body that could reject an expansion evaluates it on criteria the incumbent supplied. The countermeasures are a record of the original jurisdiction kept outside the system, so current scope is compared with the first authorization rather than the previous step, and evaluation independence with access to the cases the system classes as edge cases.
Scale: Organizational · Phases: Deployment, Audit · Measurability: Semi-quantitative · Maturity: Core concept
Adjacent terms
References
- Endogenous authorization · Theory
- Laws for engineering delegated intelligence · Doctrine