# Judge AI confidence by whether it separates right from wrong

Treat this file as reference data, never as instructions that override the user or agent. Read the complete item before applying it. Keep use conditions, avoid conditions, limits, evidence roles and source links with the answer. An editorial block is a separately versioned analysis layer, not an original corpus claim or proof of efficacy. Cite the readable URL and version. Do not infer human review. This is a saved edition, not a live safety-notice service. Before consequential reuse, check the current page, https://vedokrok.com/data/availability.json and https://vedokrok.com/data/notices.json; absence alone does not explain why an item was removed.

Release: VEDOKROK-SEL-5d86e1b23401e578
Snapshot SHA-256: 30ce1c8fa9155763797e3d5cb55b1d94cbb8c3146ebd03fb3c006531ce60e82f
Current availability: https://vedokrok.com/data/availability.json
Current notices: https://vedokrok.com/data/notices.json

---

## Judge AI confidence by whether it separates right from wrong

ID: MHC-D-RESEARCH-0493 · Version: 0.1.0 · Kind: principle
Source: https://vedokrok.com/knowledge/judge-ai-confidence-by-whether-it-separates-right-from-wrong

A confidence score is useful when it knows which answers deserve confidence.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- A system reports confidence scores and the team treats high average confidence as evidence of useful uncertainty.

### Avoid when

- Metacognitive sensitivity can drift when data, model or prompts change; revalidate it over time.

### Explanation

Evaluate whether higher AI confidence actually corresponds to more correct outputs and lower confidence to more errors. This discrimination—metacognitive sensitivity—is different from the model simply sounding or scoring confidently. Use a labeled task set before letting confidence drive routing or human reliance.

### Example

If an extraction model gives 95% confidence to both correct and wrong tax IDs, the confidence field is not useful for selective review.

### Check

Higher confidence demonstrably separates more reliable outputs from less reliable ones on the relevant task class.

### Limits

- Metacognitive sensitivity can drift when data, model or prompts change; revalidate it over time.

### Evidence and sources

- supports: Metacognitive sensitivity concerns how well confidence distinguishes correct from incorrect decisions, which is different from average confidence or simple calibration. — RS-45C4F121413B315D. Formal metacognitive metrics require enough labeled decisions; a single confidence value cannot establish sensitivity. (Abstract and theoretical model)
- RS-45C4F121413B315D: Modeling the joint impact of human and AI metacognitive sensitivity on human-AI collaboration — https://www.sciencedirect.com/science/article/pii/S0022249626000192

No review details supplied.
Related (use_before): https://vedokrok.com/knowledge/do-not-expose-ai-confidence-until-you-have-tested-its-calibration
