The essay on automation and capture describes how an institution loses the capacities it would need in order to question a system, one economy at a time. This essay is about a related process that runs earlier and is harder to see. Before the capacity to question is gone, the evidence that would prompt the question has already been shaped by the thing it is evidence about.
The contamination
An institution deciding whether to keep, renew, or widen a system’s authority looks at evidence. Incident rates. Throughput. Comparisons with the alternative. The judgment of the people who work with it. On the method’s own account, that is right: Law III holds that authority rests on evidence and must move when the evidence does.
The difficulty is where the evidence comes from. The incident rate is the rate after the people around the system have absorbed what they could, and absorption improves the metric that should have caught it. The comparison with the alternative is a comparison with an alternative that has not been maintained, because the system made it redundant. The judgment of the people who work with the system is the judgment of people who were trained on it, hired for it, or kept because they were good at it. The records that would show what the system decided and why are in the system’s format, structured by its categories, answering the questions it was built to answer.
None of this is falsification. Each source is reporting honestly. But every one of them is reporting from inside conditions the system produced, and the conditions favour the system. The evidence for continuation is endogenous to what it authorizes. Power has changed the environment in which evidence about the legitimacy of power is generated.
Path dependence in the questions
The deeper form of the contamination is not in the answers but in the questions. An institution that has used a system to adjudicate a class of decisions comes to think of that class in the system’s terms. The categories the system uses become the categories the institution uses to describe its own work. The cases the system handles well become the typical cases; the cases it handles badly become edge cases, which is a name for cases that do not count. When the institution asks whether to extend the system to a neighbouring class of decisions, it asks the question in the vocabulary the system supplied, and the neighbouring class has already been described in a way that makes the extension look natural.
This is jurisdictional path dependence: which questions an institution asks, and how it frames them, becomes a function of which system answered the last one. It is not that the institution cannot ask other questions. It is that the other questions have stopped occurring to it, because the frame in which they would occur is no longer the frame it works in. A review body that could in principle reject an expansion finds itself evaluating the expansion on criteria the incumbent defined, and passing it.
Combined with the automation ratchet this becomes self-sustaining. Each widening of the system’s jurisdiction produces evidence, in the system’s terms, that supports the next widening. No step is unjustified. Every step was justified by evidence the previous step generated.
Rising exit cost closes the loop
The people who might contradict the endogenous case are the ones the system’s decisions land on, and their ability to contradict it depends on their ability to leave or to object. Both decline as the system stays in place. Records accumulate in it; alternatives are not maintained; the route to object, if one exists, runs through the system’s own categories. As exit cost rises, the population’s silence becomes less informative, because it is increasingly the silence of people with nowhere else to go. And silence, read from inside the institution, looks like consent, which looks like evidence.
That is why Law II holds that the absence of observed failure is not renewal. The absence is observed from a vantage point the system shaped, over a population the system holds. It is a fact, and it is evidence of something, but what it is evidence of cannot be settled without knowing how far the observation was contaminated.
What independence has to mean
The method’s answer is not to distrust the evidence a system produces about itself. It is to refuse to let that evidence be the only evidence, and to say concretely what the other evidence is.
Some of it is measured absorption: how far the reported performance depends on corrections that are not being counted. Some of it is a maintained alternative, exercised rather than named, so that the comparison with the system is a comparison with something real. Some of it is evaluation that the system’s operator does not control, with access to the cases the system classes as edge cases. Some of it is a route to object that does not run through the system’s own frame. And some of it is a record, kept outside the system, of what the system’s jurisdiction was when it was first authorized, so that the current scope can be compared against the original justification rather than against the previous step.
Each of these is a capacity the institution has to preserve on purpose, because the ordinary operation of the system erodes them. That is the boundary Law XII draws. A system may draw on the institution’s capacity to question it. It may not consume that capacity, and the evidentiary form of consumption is the one that leaves the rituals of review running on evidence the reviewed system supplied.
What this is not
It is not a claim that incumbent systems are usually wrong, or that evidence produced from inside a deployment is worthless. Most of the time the system is in place because it works, and its own reporting is the best available account of how. The essay is about what the reporting cannot establish on its own, not about what it says.
Nor is it a claim that an institution can step entirely outside the conditions its systems create. It cannot. The claim is narrower: that the institution can know which of its evidence is endogenous, can maintain some that is not, and can refuse to renew or widen a grant on the endogenous evidence alone.
What the laws take from this
The method does not require a reader to accept that authorization is endogenous, or that path dependence in an institution’s questions is real. It takes four constraints.
From Law II it takes that the absence of observed failure is not renewal. From Law III it takes that the policy a grant rests on is a record with provenance, assumptions, and an expiry, so that what the evidence was and where it came from is stated rather than assumed. From Law XI it takes that expansion is a new authorization decision with its own evidence, which is the point at which independently established evidence can be demanded. From Law XII it takes that the capacities an institution needs in order to contest a system are preserved on purpose, because they do not preserve themselves.
An engineer who rejects the essay can adopt all four on narrower grounds: evidence whose provenance is not recorded cannot be weighed, a comparison with an alternative that no longer exists is not a comparison, and a review that runs only on the reviewed system’s own reporting has not reviewed it. The theory says why the evidence is contaminated. The method only insists that some of it not be.