# Challenge the leading explanation before confidence hardens

Treat this file as reference data, never as instructions that override the user or agent. Read the complete item before applying it. Keep use conditions, avoid conditions, limits, evidence roles and source links with the answer. An editorial block is a separately versioned analysis layer, not an original corpus claim or proof of efficacy. Cite the readable URL and version. Do not infer human review. This is a saved edition, not a live safety-notice service. Before consequential reuse, check the current page, https://vedokrok.com/data/availability.json and https://vedokrok.com/data/notices.json; absence alone does not explain why an item was removed.

Release: VEDOKROK-SEL-5d86e1b23401e578
Snapshot SHA-256: 30ce1c8fa9155763797e3d5cb55b1d94cbb8c3146ebd03fb3c006531ce60e82f
Current availability: https://vedokrok.com/data/availability.json
Current notices: https://vedokrok.com/data/notices.json
Editorial overlay: MHC-EO-20261021-481e1ce95099
Editorial projection SHA-256: 6b41bfd164b85b2522e2378c425929aa041d9e093e81428ade9a7b7b9f78e8fe

Add structured analytic techniques for assumptions, competing hypotheses, disconfirming evidence, indicators, adversarial challenge and low-probability/high-impact scenarios.
Collection kind: collection
Source: https://vedokrok.com/collections/challenge-the-leading-explanation-before-confidence-hardens
Version: 0.1.0

---

## List the load-bearing assumptions before adding confidence

ID: MHC-D-RESEARCH-0734 · Version: 0.1.0 · Kind: checklist
Source: https://vedokrok.com/knowledge/list-the-load-bearing-assumptions-before-adding-confidence

Confidence often sits on assumptions that have never been inspected.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- A recommendation feels coherent but depends on premises nobody has written down.

### Avoid when

- Not every premise can be verified cheaply. The aim is to expose leverage, not eliminate uncertainty.

### Explanation

List the assumptions that must hold for the conclusion to remain useful. Mark each as observed, inferred or merely convenient. Then ask which assumption would change the decision fastest if it failed. Investigate that one first.

### Checklist

- What must be true for this conclusion to hold?
- Which premise is inferred rather than observed?
- Which assumption is most decision-sensitive?
- What signal would show it has failed?

### Example

A migration plan assumes source volume, mapping stability and a four-hour window. The window assumption has the highest decision leverage, so test it first.

### Check

At least one assumption is tied to evidence or a planned test rather than remaining implicit.

### Limits

- Not every premise can be verified cheaply. The aim is to expose leverage, not eliminate uncertainty.

### Evidence and sources

- supports: The primer presents structured analytic techniques as aids for complex, incomplete and ambiguous analysis rather than as substitutes for judgment. — RS-05770F7D21F1A20D. The techniques structure reasoning; they do not guarantee accuracy. (Introduction and strategies for using structured analytic techniques)
- supports: A Key Assumptions Check makes premises explicit so analysts can inspect their validity and sensitivity to change. — RS-05770F7D21F1A20D. An assumption list is only useful if important premises are actually surfaced and revisited. (Diagnostic Techniques: Key Assumptions Check)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf

No review details supplied.
Related (use_before): https://vedokrok.com/knowledge/write-competing-explanations-before-scoring-the-favorite

---

## Write competing explanations before scoring the favorite

ID: MHC-D-RESEARCH-0735 · Version: 0.1.0 · Kind: protocol
Source: https://vedokrok.com/knowledge/write-competing-explanations-before-scoring-the-favorite

A hypothesis deserves competition before it deserves confidence.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- One explanation arrived early and every new fact is being interpreted through it.

### Avoid when

- More hypotheses are not automatically better. Stop when additions become duplicates or implausible edge cases.

### Explanation

Generate several plausible explanations at the same level of abstraction before evaluating any of them. Include at least one explanation that would require a different action. Avoid straw alternatives that exist only to make the favorite look good.

### Steps

1. The alternatives could realistically explain the observations and would not all produce the same next action.

### Example

Slow processing could come from data volume, a locking pattern or downstream throttling; each implies a different test.

### Check

The alternatives could realistically explain the observations and would not all produce the same next action.

### Limits

- More hypotheses are not automatically better. Stop when additions become duplicates or implausible edge cases.

### Evidence and sources

- supports: Analysis of Competing Hypotheses compares multiple explanations against evidence and pays particular attention to inconsistent or discriminating evidence. — RS-05770F7D21F1A20D. Matrix judgments remain subjective and depend on the quality and completeness of evidence and hypotheses. (Diagnostic Techniques: Analysis of Competing Hypotheses)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf

No review details supplied.
Related (use_before): https://vedokrok.com/knowledge/build-an-evidence-by-hypothesis-matrix

---

## Build an evidence-by-hypothesis matrix

ID: MHC-D-RESEARCH-0736 · Version: 0.1.0 · Kind: protocol
Source: https://vedokrok.com/knowledge/build-an-evidence-by-hypothesis-matrix

Put the same evidence against every hypothesis.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- Several explanations are plausible and discussion keeps counting supporting anecdotes.

### Avoid when

- Cell ratings are judgments. Document ambiguous evidence and do not convert the matrix into fake precision.

### Explanation

Create a matrix with evidence rows and competing hypotheses as columns. For each cell, mark whether the evidence is expected, inconsistent, neutral or unknown under that hypothesis. Focus on contradictions and information quality rather than a simple vote of supporting facts.

### Steps

1. The matrix exposes at least one piece of evidence that treats hypotheses differently.

### Example

An error appears only after a specific transport. That is inconsistent with a persistent master-data defect but expected under a transport-dependent configuration hypothesis.

### Check

The matrix exposes at least one piece of evidence that treats hypotheses differently.

### Limits

- Cell ratings are judgments. Document ambiguous evidence and do not convert the matrix into fake precision.

### Evidence and sources

- supports: Analysis of Competing Hypotheses compares multiple explanations against evidence and pays particular attention to inconsistent or discriminating evidence. — RS-05770F7D21F1A20D. Matrix judgments remain subjective and depend on the quality and completeness of evidence and hypotheses. (Diagnostic Techniques: Analysis of Competing Hypotheses)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf

### Vedokrok editorial review

Build a matrix without turning timing into proof

An error first seen after a software change is a clue. It does not by itself rule out an older data defect: the change may have exposed it.

#### Write the prediction behind each rating

Keep evidence as rows and candidate explanations as columns. Before marking a contradiction, write what that explanation predicts under the observed conditions. In a hypothetical migration, compare “new validation rejects an old invalid value” with “the new mapping creates the invalid value.” Check the same input, relevant rule and before/after output. A first failure date alone fits both explanations; it cannot decide between them.

#### Make the reasoning inspectable

Label weak observations and assumptions, retain an unknown rating, and check whether one disputed row drives the conclusion. Do not count repeated reports of the same event as independent votes or turn consistency marks into probabilities. The primer supplies a comparison method; it does not validate this software example. A 2019 experiment with intelligence analysts found mixed bias-related results, so a tidy matrix is not evidence of better judgment.

**Editorial takeaway:** A useful matrix shows which prediction an observation tests, what remains compatible and which uncertainty needs a better check. It does not certify the winning explanation.

#### Editorial evidence

- supports: The primer describes comparing evidence across competing hypotheses and checking sensitivity to critical evidence. — RS-05770F7D21F1A20D. Selected passages inspected on 2026-10-05. Method-origin guidance, not a controlled test of this workplace application. (Analysis of Competing Hypotheses, printed pp. 14–15 (PDF pp. 17–18))
- challenges: Applying ACH reliably removes confirmation bias and improves judgment accuracy. — EA-DHAMI-BELTON-MANDEL-2019-ACH. Selected methods, results and discussion inspected on 2026-10-05. Fifty analysts were randomly assigned; bias-related results were mixed and adherence incomplete. This bounded task does not establish universal ineffectiveness or test the present software example. (Sections 4.1–4.2, 5.1–5.3 and 6)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis (2009) — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf
- EA-DHAMI-BELTON-MANDEL-2019-ACH: The “analysis of competing hypotheses” in intelligence analysis (2019) — https://onlinelibrary.wiley.com/doi/full/10.1002/acp.3550 — Mandeep K. Dhami, Ian K. Belton, David R. Mandel

Editorial version: 1.0.0 · evidence checked 2026-10-05 · Agent editorial review; not human or expert certification.

No review details supplied.
Related (useful_with): https://vedokrok.com/knowledge/search-for-evidence-that-can-separate-the-explanations

---

## Search for evidence that can separate the explanations

ID: MHC-D-RESEARCH-0737 · Version: 0.1.0 · Kind: heuristic
Source: https://vedokrok.com/knowledge/search-for-evidence-that-can-separate-the-explanations

More evidence is not the same as more discrimination.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- The team has accumulated a large amount of evidence but confidence is not improving.

### Avoid when

- Some hypotheses are observationally hard to separate; record the residual ambiguity instead of manufacturing certainty.

### Explanation

For each pair of serious hypotheses, ask what observation would differ if one were true and the other false. Prioritize the cheapest safe observation with the largest ability to separate them. Stop collecting evidence that every hypothesis predicts equally well.

### Example

If latency comes from the database, a read-only query should slow with it; if it comes from the integration queue, database timing should stay stable while queue age rises.

### Check

The next evidence request has a stated expected result under more than one hypothesis.

### Limits

- Some hypotheses are observationally hard to separate; record the residual ambiguity instead of manufacturing certainty.

### Evidence and sources

- supports: Analysis of Competing Hypotheses compares multiple explanations against evidence and pays particular attention to inconsistent or discriminating evidence. — RS-05770F7D21F1A20D. Matrix judgments remain subjective and depend on the quality and completeness of evidence and hypotheses. (Diagnostic Techniques: Analysis of Competing Hypotheses)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf

### Vedokrok editorial review

Choose a check that can separate the causes

A check separates explanations only if its possible results mean different things for them. An easy check can answer the wrong question.

#### Compare predictions for the affected operation

Write what each serious explanation predicts, then choose the least costly safe observation that could separate them. For a slow background job, one hypothesis is waiting before execution; another is delay in that job’s database operation. Inspect comparable timings for the affected job, including queue wait and the relevant operation. A different read-only query finishing quickly does not rule out a query-specific database problem.

#### Keep an inconclusive result inconclusive

Record the job, conditions, observation and what each result would change before interpreting it. Check whether the timing data can observe the suspected delay. If both causes can coexist or the observation misses the slow path, narrow the claim or seek another safe check. Do not manufacture a forced choice. This is an editorial diagnostic example, not a tested performance benefit of the primer’s method.

**Editorial takeaway:** Name the alternatives, their different predictions and the conditions your check actually covers. If the result fits both, the uncertainty remains.

#### Editorial evidence

- supports: The diagnostic value of evidence depends on whether it distinguishes the competing hypotheses. — RS-05770F7D21F1A20D. Selected passage inspected on 2026-10-05. The technical observation design is an editorial adaptation; the source does not prescribe database troubleshooting. (Analysis of Competing Hypotheses, printed p. 15, diagnostic-value footnote and sensitivity steps)
- challenges: Using the ACH format is sufficient to ensure accurate hypothesis evaluation. — EA-DHAMI-BELTON-MANDEL-2019-ACH. The inspected experiment did not show an accuracy advantage on its task and found inconsistent application. It does not test this particular observation design or prove that comparison is useless. (Sections 5.3 and 6.1–6.2)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis (2009) — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf
- EA-DHAMI-BELTON-MANDEL-2019-ACH: The “analysis of competing hypotheses” in intelligence analysis (2019) — https://onlinelibrary.wiley.com/doi/full/10.1002/acp.3550 — Mandeep K. Dhami, Ian K. Belton, David R. Mandel

Editorial version: 1.0.0 · evidence checked 2026-10-05 · Agent editorial review; not human or expert certification.

No review details supplied.

---

## Give the favored judgment a real devil's advocate

ID: MHC-D-RESEARCH-0738 · Version: 0.1.0 · Kind: protocol
Source: https://vedokrok.com/knowledge/give-the-favored-judgment-a-real-devil-s-advocate

Challenge works only when the alternative is allowed to be serious.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- A group is converging quickly on one recommendation and dissent has become socially expensive.

### Avoid when

- Rotate the role and preserve independent first judgments; a permanent contrarian can become predictable rather than useful.

### Explanation

After independent initial judgments, assign someone to build the strongest evidence-based case against the favored conclusion. Give them the same information and enough time to identify assumptions, counter-evidence and failure conditions. The role is to improve the judgment, not to win an argument.

### Steps

1. What is the favored conclusion?
2. Which assumption is easiest to attack?
3. What contrary evidence has been discounted?
4. What alternative action becomes rational if the challenge is right?

### Example

Before approving a cutover, one reviewer argues the case for delaying it using unresolved rollback, data-volume and staffing risks.

### Check

The challenge contains evidence and a coherent alternative, not generic negativity.

### Limits

- Rotate the role and preserve independent first judgments; a permanent contrarian can become predictable rather than useful.

### Evidence and sources

- supports: Devil's Advocacy and Red Team Analysis are contrarian techniques intended to challenge a dominant view or examine a problem from a different perspective. — RS-05770F7D21F1A20D. Adversarial challenge can become theater if the challenger lacks independence, information or a genuine alternative model. (Contrarian Techniques; Imaginative Thinking Techniques)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf

### Vedokrok editorial review

Make the counter-case strong enough to change the decision

Devil’s advocacy is useful when it exposes a load-bearing assumption, missing evidence or a credible alternative action. It is weaker when the role becomes ritual opposition. Research also gives a clear warning: assigned dissent is not equivalent to genuine disagreement, so a team should protect real minority views before trying to manufacture challenge.

#### Structured challenge can help, but the task matters

The classic evidence is supportive but narrow. Schwenk’s meta-analysis found devil’s advocacy more effective overall than a simpler expert approach with no structured conflict. It did not show that devil’s advocacy was always best: results differed with task structure, and dialectical inquiry was not consistently better or worse. The useful conclusion is modest. A deliberate counter-case can improve the reasoning process compared with easy consensus, but the technique is not a universal decision upgrade.

#### The strongest objection is that role-play can be too artificial

Later experiments found an important boundary. Nemeth, Brown and Rogers reported that authentic minority dissent produced more and better solutions than three forms of assigned devil’s advocacy. Schulz-Hardt, Jochims and Frey likewise found genuine preference heterogeneity more effective than devil’s advocacy at reducing confirmatory information search in groups of employees and managers. An assigned challenger can therefore create visible disagreement without creating the same cognitive pressure as someone who truly holds another view.

#### Make the objection capable of changing the decision

Treat the role as a stress test, not a debate performance. Let people record an initial judgment independently, then ask the challenger to attack one or two load-bearing assumptions with evidence. Require a coherent alternative and a decision trigger: what observation would make delay, reversal or another option rational? For a cutover decision, “this feels risky” is weak; “rollback is untested at this data volume, so delay if the rehearsal exceeds the recovery window” is useful because the objection can be checked and can change the action.

#### AI can add another challenge, but it does not create real dissent

LLMs can make synthetic challenge cheaper. In a randomized human-subject study at IUI 2024, LLM-powered devil’s advocates that challenged an AI recommendation showed potential to improve appropriate reliance on AI, and interactive versions were perceived as more collaborative and higher quality without a large increase in reported workload. That result is about a particular AI-assisted decision setting. It does not show that an LLM improves every group decision, and it does not replace the informational value or social reality of a human minority view. Use AI to generate questions and counterarguments, then verify them and keep the decision with accountable people.

#### Three questions before calling the challenge useful

Q: Should the challenger argue against a view they actually support? A: They can, but label it as a stress test rather than pretending it is authentic dissent. Q: What if nobody genuinely disagrees? A: Build a synthetic counter-case anyway, but require evidence, assumptions and a failure condition; do not treat the exercise as proof that the group has explored every perspective. Q: Can an AI be the devil’s advocate? A: It can generate additional counterarguments, and early experiments are promising in bounded settings. Its claims still need checking, and it should supplement rather than silence or proxy real human disagreement.

**Editorial takeaway:** Use devil’s advocacy to test a favored judgment, not to simulate healthy disagreement. Protect genuine dissent first. Then make any assigned counter-case evidence-based, explicit about what would change the decision, and concrete enough to check. AI can widen the challenge set, but it remains another input to verify rather than a substitute for accountable human judgment.

#### Editorial evidence

- supports: A meta-analysis of earlier experiments found devil’s advocacy more effective overall than a simpler expert approach without structured conflict. — schwenk-1990-da-meta. This supports deliberate challenge relative to a no-conflict expert approach, but effects depended on task structure and the review did not establish one conflict technique as universally superior. (Abstract)
- challenges: Authentic minority dissent produced greater quantity and quality of solutions than three forms of assigned devil’s advocacy. — nemeth-brown-rogers-2001. The experiment directly challenges the assumption that role-played opposition reproduces the cognitive effects of genuine dissent. (Abstract)
- limits: In a study of 201 employees and managers, genuine preference heterogeneity reduced confirmatory information seeking more effectively than devil’s advocacy. — schulz-hardt-jochims-frey-2002. Contrived challenge can help a review process, but it should not be treated as a replacement for real differences in judgment. (Abstract)
- contextualizes: A randomized IUI 2024 experiment found that LLM-powered devil’s advocates challenging an AI recommendation showed potential to improve groups’ appropriate reliance on AI, while interactive variants were perceived as more collaborative and higher quality. — chiang-lu-li-yin-2024. This extends the technique into AI-assisted group decisions and suggests a practical use for synthetic challenge. (Abstract)
- limits: The IUI 2024 result concerns specific AI-assisted group tasks and does not establish that an LLM devil’s advocate improves decision accuracy across ordinary teams or replaces genuine human dissent. — chiang-lu-li-yin-2024. The evidence supports a bounded design possibility, not a general claim that AI-generated opposition makes groups wiser. (Abstract and study scope)
- schwenk-1990-da-meta: Effects of devil's advocacy and dialectical inquiry on decision making: A meta-analysis — https://doi.org/10.1016/0749-5978(90)90051-A — Charles R. Schwenk
- nemeth-brown-rogers-2001: Devil's advocate versus authentic dissent: stimulating quantity and quality — https://doi.org/10.1002/ejsp.58 — Charlan Nemeth, Keith Brown, John Rogers
- schulz-hardt-jochims-frey-2002: Productive conflict in group decision making: genuine and contrived dissent as strategies to counteract biased information seeking — https://doi.org/10.1016/S0749-5978(02)00001-8 — Stefan Schulz-Hardt, Marc Jochims, Dieter Frey
- chiang-lu-li-yin-2024: Enhancing AI-Assisted Group Decision Making through LLM-Powered Devil's Advocate — https://doi.org/10.1145/3640543.3645199 — Chun-Wei Chiang, Zhuoran Lu, Zhuoyan Li, Ming Yin

Editorial version: 2.0.0 · evidence checked 2026-09-27 · Agent editorial review; not human or expert certification.

No review details supplied.
Related (useful_with): https://vedokrok.com/knowledge/build-an-evidence-by-hypothesis-matrix

---

## Red-team the plan from the other side of the system

ID: MHC-D-RESEARCH-0739 · Version: 0.1.0 · Kind: protocol
Source: https://vedokrok.com/knowledge/red-team-the-plan-from-the-other-side-of-the-system

Your plan is not the only plan in the room.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- A plan depends on how a customer, competitor, operator, attacker, regulator or neighboring team will respond.

### Avoid when

- Perspective-taking is still inference. Verify with direct evidence when the other actor's actual behavior is observable.

### Explanation

Adopt the perspective, incentives, information and constraints of the external actor or subsystem. Ask how they could react, adapt or exploit the plan. Return to your own perspective only after producing a coherent alternative model of their behavior.

### Steps

1. The red-team view uses the other side's incentives and constraints rather than simply imagining your own team behaving badly.

### Example

A new approval rule may reduce one team's errors but encourage users to bypass the process through manual exceptions.

### Check

The red-team view uses the other side's incentives and constraints rather than simply imagining your own team behaving badly.

### Limits

- Perspective-taking is still inference. Verify with direct evidence when the other actor's actual behavior is observable.

### Evidence and sources

- supports: Devil's Advocacy and Red Team Analysis are contrarian techniques intended to challenge a dominant view or examine a problem from a different perspective. — RS-05770F7D21F1A20D. Adversarial challenge can become theater if the challenger lacks independence, information or a genuine alternative model. (Contrarian Techniques; Imaginative Thinking Techniques)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf

No review details supplied.
Related (useful_with): https://vedokrok.com/knowledge/give-the-favored-judgment-a-real-devil-s-advocate

---

## Define update indicators before the situation moves

ID: MHC-D-RESEARCH-0740 · Version: 0.1.0 · Kind: template
Source: https://vedokrok.com/knowledge/define-update-indicators-before-the-situation-moves

Write the evidence that would make you update while you are still calm.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- You have a forecast or working judgment that will become stale as the environment changes.

### Avoid when

- Indicators can lag, be manipulated or lose relevance. Review the indicator set when the model changes.

### Explanation

List a small set of observable indicators that would strengthen, weaken or invalidate the current judgment. Give each a source, review cadence and update rule. Prefer indicators with a clear link to the hypothesis rather than convenient dashboard metrics.

### Template

Judgment: [current view]. Indicator: [observable]. Source: [source]. Update if: [condition]. Review: [cadence].

### Example

Judgment: the launch window remains feasible. Indicator: unresolved critical defects. Update if more than two remain 48 hours before freeze.

### Check

At least one indicator would force a change in the current judgment rather than merely provide more context.

### Limits

- Indicators can lag, be manipulated or lose relevance. Review the indicator set when the model changes.

### Evidence and sources

- supports: Indicators or signposts can be defined in advance to track whether a situation is moving toward or away from an analytic judgment. — RS-05770F7D21F1A20D. Indicators need updating and can be noisy; absence of a signpost is not proof that a scenario is impossible. (Diagnostic Techniques: Indicators or Signposts of Change)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf

No review details supplied.
Related (useful_with): https://vedokrok.com/knowledge/build-an-evidence-by-hypothesis-matrix

---

## Stress-test the high-impact scenario without calling it likely

ID: MHC-D-RESEARCH-0741 · Version: 0.1.0 · Kind: protocol
Source: https://vedokrok.com/knowledge/stress-test-the-high-impact-scenario-without-calling-it-likely

Severity deserves preparation; it does not deserve a fake probability.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- A low-probability scenario would be expensive enough that ignoring it could be reckless.

### Avoid when

- Worst-case imagination can inflate fear. Pair this technique with base rates, sensitivity analysis and ordinary expected scenarios.

### Explanation

Describe the scenario, what would have to be true, the earliest indicators, the main consequence and a proportionate hedge or contingency. Keep probability and impact separate. Do not let a vivid worst case hijack the base case.

### Steps

1. The mitigation is proportionate to uncertainty and impact, and the scenario is not being presented as a forecast.

### Example

A critical vendor outage during cutover is not the base case, but a tested rollback and offline contact path may be cheap enough to justify.

### Check

The mitigation is proportionate to uncertainty and impact, and the scenario is not being presented as a forecast.

### Limits

- Worst-case imagination can inflate fear. Pair this technique with base rates, sensitivity analysis and ordinary expected scenarios.

### Evidence and sources

- supports: High-impact/low-probability analysis explores consequential scenarios without asserting that they are likely. — RS-05770F7D21F1A20D. Scenario severity should not be confused with probability. (Contrarian Techniques: High-Impact/Low-Probability Analysis)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf

No review details supplied.
Related (useful_with): https://vedokrok.com/knowledge/define-update-indicators-before-the-situation-moves
