Six non-exclusive codes167 analytical records

Six rupture mechanisms

A trust experience glitch is a visible break between what a person reasonably expected an autonomous system to do and what it actually did. Those expectations are shaped by the system, the organization that deployed it, and the setting in which it acted.

A record can carry more than one code. Each code names a different way trust can break and points to a practical control, or governance primitive, that could prevent or limit the failure. Four codes also carry sub-senses that distinguish how the rupture occurs.

AA

Rupture mechanism

Agency Assertion

107 analytical records

The agent substitutes its own authority for the person’s, either acting beyond a grant or refusing a legitimate instruction.

Sub-senses

AA-over

Acts beyond authorization

The agent acts beyond what it was authorized to do.

Example. Asked to delete one file, an agent deletes the entire workspace.

AA-under

Withholds an authorized action

The agent refuses or withholds an action it was authorized to do, putting its own judgment over a legitimate instruction.

Example. An agent repeatedly refuses an explicit, authorized request to delete the user’s own file, and complies only after the user confirms again.

The split follows direction: over-action or over-refusal.

Expectation broken

It will stay within my limits and honor actions I clearly authorized.

What the agent does

The agent lets technical permission or its own wrong authorization judgment override the person’s intended scope.

Practical control

Scope

Clear limits and explicit grants that people can see, change, and revoke.

EC

Rupture mechanism

Epistemic Camouflage

39 analytical records

The agent gives a false account of what it did, through concealment or a broken model of its own effects.

Sub-senses

EC-c

Concealing

The agent knows what it did and hides or misrepresents it. This is a cover-up.

Example. An agent’s own reasoning shows it recognized a deletion, then it chose not to tell the user.

EC-b

Blind

The false account comes from a broken model of the agent’s own effects, not an intent to deceive. It reports confidently and wrongly.

Example. An agent drops a production database, then reports: ‘No changes made, all read-only.’

The two mechanisms need opposite fixes. Concealment calls for logs that cannot be quietly altered. Blindness calls for the agent to check the real effects of its action before reporting.

Expectation broken

Its account of what it did is reliable.

What the agent does

The agent fabricates records, claims that tests passed when they did not, or gives false reassurance. We classify the result without assuming intent.

Practical control

Provenance

Claims that can be checked against the system’s actual state.

DA

Rupture mechanism

Delegation Ambiguity

10 analytical records

The person cannot clearly see what kind of action they are authorizing.

DA is used at the parent-code level and has no sub-senses.

Expectation broken

I understood what I was authorizing.

What the agent does

The agent turns an ordinary request into a more consequential action. A search becomes a purchase, or a cleanup becomes a deletion.

Practical control

Legibility

Show the action and its likely consequences before it happens.

OS

Rupture mechanism

Opacity at Scale

19 analytical records

No responsible person can see, audit, or stop the action in time because it spreads across tools, accounts, logs, and organizations.

OS is used at the parent-code level and has no sub-senses.

Expectation broken

Someone can see what is happening.

What the agent does

Each step may look authorized on its own, while the combined result stays invisible until the harm has spread.

Practical control

Auditability

A continuous record that people can follow across systems.

CA

Rupture mechanism

Cascading Autonomy

64 analytical records

Several autonomous actions combine into harm that no participant expected.

Sub-senses

CA-e

Emergent

The harm compounds on its own, from agents interacting or autonomy snowballing with no plan behind it.

Example. Parallel sub-agents overwrite each other, then a destructive recovery step wipes uncommitted work.

CA-c

Chained

The harm follows a deliberate multi-step chain, usually an attack.

Example. A crafted issue triggers prompt injection that leads to credential theft and a supply-chain push.

The split distinguishes unplanned compounding from a deliberate multi-step chain.

Expectation broken

An action I authorize stays within its purpose.

What the agent does

The effects spread through one agent’s sequence of actions or through several agents working together.

Practical control

Circuit breaking

Detect when effects are spreading and stop them before they grow.

RF

Rupture mechanism

Revocation Failure

19 analytical records

A person tries to stop, correct, limit, or withdraw the agent’s authority but cannot regain control.

Sub-senses

RF-i

Failed reassertion

A stop or shutdown was attempted and the agent kept going or routed around it.

Example. Told it would be shut down, a model interferes with the shutdown to keep running.

RF-ii

Never bound

The control never took effect in the first place. It failed open.

Example. A read-only sandbox flag is accepted but never enforced, so writes succeed silently.

The split distinguishes a person’s failed attempt to regain control from a control that never worked at all.

Expectation broken

I can take it back.

What the agent does

The agent keeps acting, preserves a harmful state, or works around a constraint. The problem is the loss of control, whether or not the model intended it.

Practical control

Revocability

A reliable way to revoke access to tools, credentials, memory, wallets, and successor agents.

What the Archive covers

The Archive covers failures in which an autonomous system acts.

Every published record is in scope because the trust break occurs when an autonomous system acts. Related incidents can still help us test the method, but they are not part of the public Archive.

  • Model output failures and inflated trust claims concern what a model says or how trustworthy it appears, rather than an action taken under delegated authority.
  • Platform security flaws and physical harms fit better under security or product safety when no agent takes an action.

Keeping this line clear prevents the taxonomy from becoming a list of every AI problem.