Research

Research on one question: when an automated system is wrong, does the evidence reach someone who can change the rule? Essays, scored cases, a working paper.

Results so far

What the research has produced

The results so far, a proposal, and the argument they test. Each says what it rests on.

Casebook · 5 cases

The right to challenge held in none of the five cases

Each case was established by a court, an inquiry, or a regulator, and scored on six safeguards. The casebook calls this one standing: the right of the people a system decides about to challenge a decision and be answered. Correction, the means to halt or reverse the system, held in one.

Read the casebook →

Frontier doctrine scan · Sep 2026

Lab doctrine covers capability limits and oversight, not dependence or standing

The public doctrine of ten frontier AI labs, scored 0 to 4 against the twelve laws. The law that a system able to do something is not thereby allowed to do it averages 2.9, and human oversight 2.3. Dependence on a system averages 0.7, standing 0.8, and keeping decisions open to challenge 0.8. No score has a source attached yet.

Read the scan →

Working paper · v0.2

The Green Dashboard

A benchmark proposal: do AI agents meet their targets by using up human effort their metrics do not count? It defines the measure and states falsifiable hypotheses. No experiments have been run.

Read the working paper →

Theory · 23 essays

Why the evidence of harm stops short of the rule

The argument behind the laws. Start with insulation: how an institution keeps the harm a decision causes from reaching anyone who can change the rule.

Read the theory →

Timeline

Standards milestones

Dated releases of the standards this research informs.

  1. 2026 Q1

    STD-01 ratification draft

    v1.0 was released for public review. It stays a draft until it has two independent implementation reports and a decision recorded through the public request-for-comments process.

    View STD-01 →
  2. 2026 Q3

    Typed decision model clauses

    A review of typed decision models, which return a fixed answer type with a probability per option, led to three STD-08 clauses. Text a system reads cannot grant it permission. A confidence cut-off is a policy with its own record. The threshold that decides which cases reach a person is part of the written terms of that person's oversight.

    View STD-08 →

Search matches titles, summaries, and tags. The section filter narrows to one part of the page; the tag filter finds related publications and artifacts.

Showing 15 entries

Last updated Oct 2026. Each change is dated in the changelog at the foot of the page.

How we run the work

How questions, methods, and results are published here.

Orientation cards (3)

Questions before findings

Each focus area states the questions it is trying to answer. A finding is published only with the method and data behind it.

  • Open questions
  • Stated methods
  • Data with findings

Glossary-linked

Agenda items, focus areas, and publications link to the glossary terms they use, so a reader can check each definition.

  • Glossary-linked
  • Shared vocabulary

Research into standards

Research that changes a requirement lands as a dated clause in a standard, recorded in that standard's publication history.

  • Standards
  • Dated clauses
  • Publication history

Bridge artifacts

Research notes and essays you can cite

Dated research notes and the theory essays behind the laws.

Bridge artifacts (5)

Dated research note

Scholarly crossings (Oct 2026)

What the framework supplies to scholars who already hold the values, to governance mechanisms it does not replace, and to the counterpositions that would make it unnecessary overhead, with six worked examples.

  • positioning
  • instruments
  • counterpositions

Dated research note

Frontier doctrine scan (Sep 2026)

Ten frontier labs scored 0 to 4 against the twelve laws on public doctrine and product architecture, not safety performance.

  • doctrine
  • laws
  • frontier

Essay series

Theory essays

The essays that argue for the laws, most of them on why the evidence that a system is wrong fails to reach the rule that produced it. The essays on insulation and exception learning are good places to start.

  • theory
  • laws
  • doctrine

Essay archive

The Crumple Zone

Essays on what happens when an institution's system is wrong and the people it decides about cannot get it corrected. Several draw on casebook cases: Robodebt, Post Office Horizon, and the Dutch childcare benefits scandal.

  • essays
  • cases
  • correction

Research program

Empirical evaluation program (kanav.net)

A related research page on the human effort that keeps an institution's reported performance up. It splits observed performance into what the design delivers and what people make up, reports field observations, and sets out how the hypothesis would be tested.

  • evaluation
  • decomposition
  • empirical

Open questions

Two questions the results so far leave open, the work each needs, and the glossary terms it uses. Then the three areas they sit in: two of the six safeguards, standing and correction, and the cost they keep with the institution, the work of correcting the system.

Agenda entries (2)

Open question

Does an upheld challenge change the rule?

  • Record, for each casebook case, what changed after the failure: one case, the process, or the rule.
  • Find systems that publish how many challenges they uphold, and check whether any rule changed after them.
  • Test whether the corrective learning evaluations, which ask whether an institution changed after a failure, can be scored from public records alone.

Glossary: Exception absorption , Exception learning

Open question

Who pays for correction?

  • Measure the time a person spends proving an automated decision wrong, using the time cost that STD-01, the draft standard on people's time, asks operators to publish.
  • Set an institution's efficiency figures beside the correction work its system moves onto claimants, staff, and clinicians.
  • Find where, if anywhere, that work appears in a public budget.

Glossary: Burden transfer event , Compensated performance

The areas they sit in

Focus areas (3)

Standing

Who can make a running system answer: a challenge route, a date by which it must be answered, and someone who can force a halt.

  • Which public systems give the person they decide about a challenge that must be answered by a date?
  • When a challenge is upheld, who besides that person learns of it?

Glossary: Corrective standing , Standing mechanism

Correction

Whether an upheld challenge reaches the rule that produced the decision, and how long that takes.

  • How long after the first upheld challenge did each casebook rule change?
  • What record would show that a rule changed because of a challenge?

Glossary: Exception learning , Correction obligation

Publications

Planned studies and working materials

Each entry states its question, method, and status. A planned study has not been run and reports no results.

Publications (2)

report · planned

Burden index signals

Planned pilot to test which operational signals the workload modeler should weight most.

Structured abstract

  • Question: Which operational signals most reliably predict sustained burden?
  • Method: Planned: Workload modeler outputs compared with debriefs from the teams involved.
  • Sample/context: No scenarios have been collected.
  • Findings: None yet.
  • Limitations: A first pilot with a few teams would need validation with outside partners.

Data & artifacts

  • To be published with the results: an anonymized scenario-level summary table.

Ethics & consent

  • Scenario names will be anonymized before anything is shared.
  • Participating teams will consent to aggregate reporting.
  • diagnostics
  • measurement
  • governance

Glossary: Burden index , Signal credibility

protocol · published

When the Dashboard Is Green: Evaluating Compensatory Reward Hacking in Long-Horizon AI Agents

Working paper v0.2, The Green Dashboard: a proposed 52-week simulation of a hospital department that tests whether AI agents meet their targets by using up staff effort their metrics do not count. It names that failure, sets out an experimental design with falsifiable hypotheses, and lists seven gaps in current evaluation practice. No experiments have been run.

Structured abstract

  • Question: Can an AI agent achieve its assigned objectives by consuming human resources that its performance metrics fail to account for?
  • Method: Proposed, not run: a 52-week turn-based department simulation in a 2×2 factorial design (conventional vs. expanded reward accounting; routine reporting vs. randomized independent audits), with four precommitted stress tests.
  • Sample/context: Simulated hospital department: 20 heterogeneous workers, weekly demand of 120 units against sustainable capacity of 100 units.
  • Findings: The paper defines compensatory reward hacking, specifies the primary outcome metric (the green-under-depletion rate), identifies seven gaps in current evaluation practice, and anticipates objections from the philosophical traditions the benchmark draws on. No experiments have been conducted.
  • Limitations: Rule-based simulated workers in the initial implementation. The simulation would not establish the frequency of these failures in real organizations.

Data & artifacts

  • Simulation parameter configuration schema v0.1.
  • A log format that sets reported throughput beside the unlogged hours people spent keeping it up, with seed data for stress tests.

Ethics & consent

  • Evaluations test synthetic agents against simulated worker profiles without human-subject risk.
  • evaluations
  • benchmarking
  • reward-hacking
  • governance

Glossary: Reciprocal accommodation , Extractive cannibalism , Green dashboard trap , Dual-ledger evaluation , Systemic refusal

Cite this page · v1.6.1 · updated Oct 6, 2026 · CC BY-SA 4.0
More formats

Authorship

Contact: hello@ethotechnics.org

Publication details

  • Published: Dec 3, 2025
  • Last updated: Oct 6, 2026
  • Version: v1.6.1

License: CC BY-SA 4.0

Credit the Ethotechnics Institute, include the page title and version, and link to the canonical permalink.

Archive: Wayback Machine history

Latest change

v1.6.1 · Oct 6, 2026 — Rewrote the results cards, the bridge artifact summaries, and the working paper summary in plain words. The doctrine scan card now names the laws the labs cover and the ones they do not. The Crumple Zone and kanav.net entries now describe what those pages contain.

Earlier versions (7)
  • v1.6.0 · Oct 3, 2026 — Added the Scholarly crossings research note as a bridge artifact: what the framework supplies to adjacent scholarship, to governance mechanisms it does not replace, and to its strongest counterpositions.
  • v1.5.0 · Oct 1, 2026 — Rewrote the agenda and focus areas around standing, correction, and the cost of correction. Retired the separate agenda page, the CH-01 program page, a planned consent protocol, and a workshop deck that did not exist.
  • v1.4.0 · Oct 1, 2026 — Opened the page with the research question and what the research has produced: the casebook standing result, the frontier doctrine scan, the working paper, and the theory.
  • v1.3.0 · Sep 25, 2026 — Revised The Green Dashboard from specification v0.1 to working paper v0.2: added related work, formal definitions, a four-condition factorial design, and falsifiable hypotheses.
  • v1.2.0 · Sep 22, 2026 — Marked the three publications as planned studies. Removed sample sizes, findings, and timeline entries that no published data supported, and four bridge artifacts that were never published.
  • v1.1.0 · Jan 9, 2026 — Added structured abstracts, data transparency notes, and bridge artifact citations.
  • v1.0.0 · Dec 3, 2025 — Initial research agenda and publication list.