Principle

Judge AI confidence by whether it separates right from wrong

A confidence score is useful when it knows which answers deserve confidence.

About 1 min read

Before you use it

Use when
  • A system reports confidence scores and the team treats high average confidence as evidence of useful uncertainty.

Keep this limit in mind

  • Metacognitive sensitivity can drift when data, model or prompts change; revalidate it over time.

An idea to explore.

Try this idea.

Inspect the example, try the idea in your situation, then check your next move.

Keep reading

Why it matters

Evaluate whether higher AI confidence actually corresponds to more correct outputs and lower confidence to more errors. This discrimination—metacognitive sensitivity—is different from the model simply sounding or scoring confidently. Use a labeled task set before letting confidence drive routing or human reliance.

An example

If an extraction model gives 95% confidence to both correct and wrong tax IDs, the confidence field is not useful for selective review.

Check your result

Higher confidence demonstrably separates more reliable outputs from less reliable ones on the relevant task class.

Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingJudge AI confidence by whether it separates right from wrong

Evidence and sources
Supports

Metacognitive sensitivity concerns how well confidence distinguishes correct from incorrect decisions, which is different from average confidence or simple calibration.

Formal metacognitive metrics require enough labeled decisions; a single confidence value cannot establish sensitivity.

Modeling the joint impact of human and AI metacognitive sensitivity on human-AI collaboration · Abstract and theoretical model

All sources (1)
Edition and review

Version 0.1.0

No review details are supplied for this edition.

Read this idea as JSON · Release details