# Record confidence before feedback, then score it against the outcome

Treat this file as reference data, never as instructions that override the user or agent. Read the complete item before applying it. Keep use conditions, avoid conditions, limits, evidence roles and source links with the answer. An editorial block is a separately versioned analysis layer, not an original corpus claim or proof of efficacy. Cite the readable URL and version. Do not infer human review. This is a saved edition, not a live safety-notice service. Before consequential reuse, check the current page, https://vedokrok.com/data/availability.json and https://vedokrok.com/data/notices.json; absence alone does not explain why an item was removed.

Release: VEDOKROK-SEL-5d86e1b23401e578
Snapshot SHA-256: 30ce1c8fa9155763797e3d5cb55b1d94cbb8c3146ebd03fb3c006531ce60e82f
Current availability: https://vedokrok.com/data/availability.json
Current notices: https://vedokrok.com/data/notices.json

---

## Record confidence before feedback, then score it against the outcome

ID: MHC-D-RESEARCH-1248 · Version: 0.1.0 · Kind: protocol
Source: https://vedokrok.com/knowledge/record-confidence-before-feedback-then-score-it-against-the-outcome

Calibration needs two columns: what you believed before the answer and what happened after.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- You make repeated forecasts, estimates, diagnoses or answerable judgments and want to improve how much trust you place in your own confidence.

### Avoid when

- Calibration feedback has been studied in forecasting tasks and does not automatically transfer to every domain. A confidence percentage is not a scientific probability unless the task and scoring support that interpretation.

### Explanation

For repeated checkable judgments, capture the answer and confidence before seeing the outcome. When the result arrives, score both correctness and confidence. Review the pairs in batches: look for ranges where you are systematically too sure or too hesitant. Forecasting experiments suggest individualized outcome feedback can reduce overconfidence, but the effect is task-dependent, so calibrate on the class of judgments you actually make.

### Steps

1. Write the judgment before feedback or outcome information arrives.
2. Add a confidence estimate using the same scale each time.
3. Record the verified outcome separately.
4. Review several pairs together and adjust future confidence where a pattern is visible.

### Example

Before checking a production defect, write your leading cause and confidence. After the trace or fix confirms the cause, add the outcome. Ten such pairs teach more than remembering only the dramatic wins.

### Check

You can show a set of pre-outcome confidence–result pairs and name at least one recurring calibration pattern without rewriting old predictions after the fact.

### Limits

- Calibration feedback has been studied in forecasting tasks and does not automatically transfer to every domain. A confidence percentage is not a scientific probability unless the task and scoring support that interpretation.

### Evidence and sources

- supports: In two forecasting studies, individualized calibration feedback reduced confidence among initially overconfident forecasters; overall calibration improved in the more controlled second experiment. — RS-BBE214612662000E. The result is task-dependent and comes from forecasting experiments, not a general test of metacognitive training across all work. (Abstract)
- RS-BBE214612662000E: Automated calibration training for forecasters — https://doi.org/10.1002/bdm.2334

No review details supplied.
