Protocol
Practise the failure mode you cannot afford to discover live
Routine success does not train recovery from the edge case.
When it fits
- When a skill works on the happy path but predictable edge conditions could cause a serious miss.
When to avoid it
- Do not create dangerous real incidents for practice. Rare-case training can also overweight rare events, so preserve base-rate context.
Why it matters
List high-consequence but plausible failure modes, then build safe simulations or sanitized cases that require detection and recovery. Practice the cue and the response, not merely a warning about the risk. Keep rare-case drills proportionate to likelihood and consequence.
Steps
- Name a plausible failure mode and the earliest detectable cue.
- Create a safe simulation or sanitized case.
- Practise the decision or recovery step.
- Return to ordinary cases so rare scenarios do not distort base-rate judgment.
An example
A migration rehearsal includes a duplicate-key anomaly and asks the consultant to stop, diagnose and reconcile before continuing.
Check your result
The learner detects the injected failure and follows the intended recovery path without needing the answer.
Keep this limit in mind
- Do not create dangerous real incidents for practice. Rare-case training can also overweight rare events, so preserve base-rate context.
Evidence and sources
A meta-analysis of adaptive training found that effects varied by instructional intervention, with adaptive difficulty showing the strongest results among the examined categories.
The literature was heterogeneous and much of the context was military training; this does not validate every adaptive-learning product.
Adaptive training instructional interventions: A meta-analysis · Abstract
A meta-analysis found deliberate practice explained meaningful but limited variance in performance, with much smaller shares in education and professions than in games, music and sports.
The result argues against an hours-only expertise claim; it does not show that structured practice is useless.