Protocol

Measure appropriate reliance as two errors, not one trust score

Good reliance means knowing both when to listen and when not to.

About 1 min read

Before you use it

Use when
  • A human-AI workflow is evaluated with one question such as 'Do users trust the AI?' or 'How often do they agree?'

Keep this limit in mind

  • Some outputs are not objectively binary correct/incorrect; define adjudication and uncertainty carefully.

An idea to explore.

Try this idea.

Inspect the example, try the idea in your situation, then check your next move.

Keep reading

Why it matters

Measure two behavioral mistakes separately: rejecting correct AI advice and accepting incorrect AI advice. Add task-specific costs because one error may be much worse than the other. Overall agreement can rise while appropriate reliance gets worse.

Steps

  1. The evaluation can distinguish under-reliance from over-reliance and connect each to real task cost.

An example

In data deletion support, accepting one wrong recommendation may matter more than rejecting several correct suggestions, so agreement rate is a poor primary metric.

Check your result

The evaluation can distinguish under-reliance from over-reliance and connect each to real task cost.

Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingMeasure appropriate reliance as two errors, not one trust score

Evidence and sources
Supports

The same 2026 study found decision performance depended on AI recommendation quality and that adopting poor advice could reduce performance.

Viewing advice without adopting it is behaviorally different from relying on it.

Who listens to ChatGPT and when should they? A two-study examination of AI-assisted decision making · Abstract highlights

Supports

Reliance quality should distinguish accepting correct advice from accepting incorrect advice rather than measuring trust or overall agreement alone.

The best metric depends on task costs and whether false acceptance and false rejection have different consequences.

More is not better: Visual uncertainty cues and the fragility of trust calibration in LLM-assisted decision making · Appropriate reliance and behavioral calibration results

All sources (2)
Edition and review

Version 0.1.0

No review details are supplied for this edition.

Read this idea as JSON · Release details