# Build an evidence-by-hypothesis matrix

Treat this file as reference data, never as instructions that override the user or agent. Read the complete item before applying it. Keep use conditions, avoid conditions, limits, evidence roles and source links with the answer. An editorial block is a separately versioned analysis layer, not an original corpus claim or proof of efficacy. Cite the readable URL and version. Do not infer human review. This is a saved edition, not a live safety-notice service. Before consequential reuse, check the current page, https://vedokrok.com/data/availability.json and https://vedokrok.com/data/notices.json; absence alone does not explain why an item was removed.

Release: VEDOKROK-SEL-5d86e1b23401e578
Snapshot SHA-256: 30ce1c8fa9155763797e3d5cb55b1d94cbb8c3146ebd03fb3c006531ce60e82f
Current availability: https://vedokrok.com/data/availability.json
Current notices: https://vedokrok.com/data/notices.json
Editorial overlay: MHC-EO-20261021-481e1ce95099
Editorial projection SHA-256: 6b41bfd164b85b2522e2378c425929aa041d9e093e81428ade9a7b7b9f78e8fe

---

## Build an evidence-by-hypothesis matrix

ID: MHC-D-RESEARCH-0736 · Version: 0.1.0 · Kind: protocol
Source: https://vedokrok.com/knowledge/build-an-evidence-by-hypothesis-matrix

Put the same evidence against every hypothesis.

Knowledge source release: MHC-RPUB-20261011-9e4b62c5
Source corpus commit: 9e4b62c5648844484b8cc3160f3e168d63a1241b
Source manifest SHA-256: 8cc91f0a764c635a79a18e06e048d3dc7bb1e07ae0fed6bf544c89832c024402
Source projection SHA-256: d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104

### Use when

- Several explanations are plausible and discussion keeps counting supporting anecdotes.

### Avoid when

- Cell ratings are judgments. Document ambiguous evidence and do not convert the matrix into fake precision.

### Explanation

Create a matrix with evidence rows and competing hypotheses as columns. For each cell, mark whether the evidence is expected, inconsistent, neutral or unknown under that hypothesis. Focus on contradictions and information quality rather than a simple vote of supporting facts.

### Steps

1. The matrix exposes at least one piece of evidence that treats hypotheses differently.

### Example

An error appears only after a specific transport. That is inconsistent with a persistent master-data defect but expected under a transport-dependent configuration hypothesis.

### Check

The matrix exposes at least one piece of evidence that treats hypotheses differently.

### Limits

- Cell ratings are judgments. Document ambiguous evidence and do not convert the matrix into fake precision.

### Evidence and sources

- supports: Analysis of Competing Hypotheses compares multiple explanations against evidence and pays particular attention to inconsistent or discriminating evidence. — RS-05770F7D21F1A20D. Matrix judgments remain subjective and depend on the quality and completeness of evidence and hypotheses. (Diagnostic Techniques: Analysis of Competing Hypotheses)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf

### Vedokrok editorial review

Build a matrix without turning timing into proof

An error first seen after a software change is a clue. It does not by itself rule out an older data defect: the change may have exposed it.

#### Write the prediction behind each rating

Keep evidence as rows and candidate explanations as columns. Before marking a contradiction, write what that explanation predicts under the observed conditions. In a hypothetical migration, compare “new validation rejects an old invalid value” with “the new mapping creates the invalid value.” Check the same input, relevant rule and before/after output. A first failure date alone fits both explanations; it cannot decide between them.

#### Make the reasoning inspectable

Label weak observations and assumptions, retain an unknown rating, and check whether one disputed row drives the conclusion. Do not count repeated reports of the same event as independent votes or turn consistency marks into probabilities. The primer supplies a comparison method; it does not validate this software example. A 2019 experiment with intelligence analysts found mixed bias-related results, so a tidy matrix is not evidence of better judgment.

**Editorial takeaway:** A useful matrix shows which prediction an observation tests, what remains compatible and which uncertainty needs a better check. It does not certify the winning explanation.

#### Editorial evidence

- supports: The primer describes comparing evidence across competing hypotheses and checking sensitivity to critical evidence. — RS-05770F7D21F1A20D. Selected passages inspected on 2026-10-05. Method-origin guidance, not a controlled test of this workplace application. (Analysis of Competing Hypotheses, printed pp. 14–15 (PDF pp. 17–18))
- challenges: Applying ACH reliably removes confirmation bias and improves judgment accuracy. — EA-DHAMI-BELTON-MANDEL-2019-ACH. Selected methods, results and discussion inspected on 2026-10-05. Fifty analysts were randomly assigned; bias-related results were mixed and adherence incomplete. This bounded task does not establish universal ineffectiveness or test the present software example. (Sections 4.1–4.2, 5.1–5.3 and 6)
- RS-05770F7D21F1A20D: A Tradecraft Primer: Structured Analytic Techniques for Improving Intelligence Analysis (2009) — https://www.cia.gov/resources/csi/static/Tradecraft-Primer-apr09.pdf
- EA-DHAMI-BELTON-MANDEL-2019-ACH: The “analysis of competing hypotheses” in intelligence analysis (2019) — https://onlinelibrary.wiley.com/doi/full/10.1002/acp.3550 — Mandeep K. Dhami, Ian K. Belton, David R. Mandel

Editorial version: 1.0.0 · evidence checked 2026-10-05 · Agent editorial review; not human or expert certification.

No review details supplied.
Related (useful_with): https://vedokrok.com/knowledge/search-for-evidence-that-can-separate-the-explanations
