Principle
Judge AI confidence by whether it separates right from wrong
A confidence score is useful when it knows which answers deserve confidence.
Before you use it
- Use when
- A system reports confidence scores and the team treats high average confidence as evidence of useful uncertainty.
Keep this limit in mind
- Metacognitive sensitivity can drift when data, model or prompts change; revalidate it over time.
An idea to explore.
Try this idea.
Inspect the example, try the idea in your situation, then check your next move.
Why it matters
Evaluate whether higher AI confidence actually corresponds to more correct outputs and lower confidence to more errors. This discrimination—metacognitive sensitivity—is different from the model simply sounding or scoring confidently. Use a labeled task set before letting confidence drive routing or human reliance.
An example
If an extraction model gives 95% confidence to both correct and wrong tax IDs, the confidence field is not useful for selective review.
Check your result
Higher confidence demonstrably separates more reliable outputs from less reliable ones on the relevant task class.
Save and practise this idea
My learning
Read. Recall. Repeat.
Save this idea and return to it on any device.
Keep exploring
Connected ideas
You are readingJudge AI confidence by whether it separates right from wrong
Evidence and sources
Metacognitive sensitivity concerns how well confidence distinguishes correct from incorrect decisions, which is different from average confidence or simple calibration.
Formal metacognitive metrics require enough labeled decisions; a single confidence value cannot establish sensitivity.
Modeling the joint impact of human and AI metacognitive sensitivity on human-AI collaboration · Abstract and theoretical model
Edition and review
Version 0.1.0
No review details are supplied for this edition.