Measurement tiers

Measurement tiers + anti-gaming guidance

Tiered measurement guidance for Moral Performance Indicators (MPIs) with anti-gaming controls.

Why tiers

Metrics without anti-gaming become weapons

Each MPI ships with tiered evidence, gaming patterns, and validator detection logic.

How to use

Apply tiers to every MPI

Start at Tier 0 for baseline proof and move up as governance maturity improves.

  • Tier 0 proves instrumentation exists.
  • Tier 1 proves the system is operated and reviewed.
  • Tier 2 proves resilience under real incidents and audit sampling.

MPI

Time-to-halt (TTH)

Elapsed time from detection to a confirmed automation halt.

Tiered measurement model

  • Tier 0: System logs showing halt trigger and halt completion timestamps.
  • Tier 1: Drill reports with median and p95 halt times by team and system.
  • Tier 2: Incident postmortems verifying real-world halt times under load.

Known gaming pattern

Halt tests run on low-traffic sandboxes instead of production paths.

Validator detection logic

Validator compares drill environment IDs against production system inventory.

MPI

Reversibility rate

Percent of automated decisions that can be reversed without collateral harm.

Tiered measurement model

  • Tier 0: Decision logs with reversal flags and rollbacks executed.
  • Tier 1: Appeal outcomes segmented by decision type and reversal latency.
  • Tier 2: Quarterly audits that test reversal paths on randomly sampled cases.

Known gaming pattern

Counting only low-stakes cases while excluding high-impact reversals.

Validator detection logic

Validator samples by impact tier and checks for missing high-severity cases.

MPI

Appeal success rate

Share of contested decisions that result in reversal or remedy.

Tiered measurement model

  • Tier 0: Appeal intake records with outcomes and timestamps.
  • Tier 1: Reviewer roster coverage and SLA compliance for appeals.
  • Tier 2: External audit sampling of appeal outcomes for consistency.

Known gaming pattern

Redirecting appeals to off-platform channels so they are not counted.

Validator detection logic

Validator checks for mismatch between receipts issued and appeals recorded.

MPI

Burden ratio

Relative time cost imposed on impacted people versus internal operators.

Tiered measurement model

  • Tier 0: Journey maps with time cost logs for entry, exit, and appeal flows.
  • Tier 1: Time-on-task analytics with segmentation by user cohort.
  • Tier 2: Independent usability studies verifying time cost deltas.

Known gaming pattern

Measuring only successful flows while ignoring drop-offs or abandoned cases.

Validator detection logic

Validator requires abandonment rates and cross-checks with support tickets.