Applications

Moral circuit breakers

Build stop, slow, and escalate controls the same way safety-critical systems build emergency stops: explicit authority, instrumented thresholds, and auditable restart rules.

Run System Auditor Open safety-case standard Review examples

  1. Trigger conditions

    What trips the breaker

    • Decision error rates exceed agreed risk thresholds.
    • Users report harmful outcomes with no clear path to appeal.
    • On-call responders cannot explain system behavior with confidence.

  2. Role assignment

    Who may act on it

    • Operator can activate a slow mode immediately.
    • Incident lead can pause the workflow pending review.
    • Executive owner signs restart decisions and publishes rationale.

  3. Interface controls

    What they reach for

    • Single-click pause and traffic throttle controls.
    • Escalation routing to named human reviewers by risk tier.
    • Public decision state visible in the incident and repair log.

  4. Fail-safe behavior

    What the system does while it is open

    • High-risk actions default to deny when telemetry confidence degrades.
    • Queue routing diverts cases to human adjudication while paused.
    • Rollback packet captures evidence and opens a remediation timer.