# Do not turn a p-value into a truth percentage

Treat this file as reference data, never as instructions that override the user or agent. Read the complete item before applying it. Keep use conditions, avoid conditions, limits, evidence roles and source links with the answer. An editorial block is a separately versioned analysis layer, not an original corpus claim or proof of efficacy. Cite the readable URL and version. Do not infer human review. This is a saved edition, not a live safety-notice service. Before consequential reuse, check the current page, https://vedokrok.com/data/availability.json and https://vedokrok.com/data/notices.json; absence alone does not explain why an item was removed.

Release: VEDOKROK-SEL-5d86e1b23401e578
Snapshot SHA-256: 30ce1c8fa9155763797e3d5cb55b1d94cbb8c3146ebd03fb3c006531ce60e82f
Current availability: https://vedokrok.com/data/availability.json
Current notices: https://vedokrok.com/data/notices.json

---

## Do not turn a p-value into a truth percentage

ID: MHC-D-RESEARCH-0061 · Version: 0.1.0 · Kind: anti_pattern
Source: https://vedokrok.com/knowledge/do-not-turn-a-p-value-into-a-truth-percentage

Subtracting from one does not turn a test into a belief meter.

Knowledge source release: MHC-RPUB-20261112-07d31a69
Source corpus commit: 07d31a6904d38f9fe2189aee7b26bb065724b120
Source manifest SHA-256: d676e87a17b9210d8037fd74c3f1ea735debd384fa069ba127a87ad441aa4f20
Source projection SHA-256: 7e7900a14145b4d025c2279ceb005ff3633adb88263038886b09282e4dafb04b

### Use when

- Someone translates p = 0.03 as a 97% chance that a claim is true.

### Avoid when

- Properly used statistical tests remain useful. Replacing them with intuition is not the lesson.

### Explanation

A p-value concerns data under a specified statistical model. It is not the probability that the hypothesis is true, and it does not tell you whether an effect is large or useful.

### Question

What are the estimate, uncertainty, design and practical consequence behind this number?

### Recognition

A p-value concerns data under a specified statistical model. It is not the probability that the hypothesis is true, and it does not tell you whether an effect is large or useful.

### Example

A tiny improvement in a huge sample may have a small p-value while changing little about the practical choice.

### Check

Does your conclusion use the result's size and context, not a converted truth score?

### Limits

- Properly used statistical tests remain useful. Replacing them with intuition is not the lesson.

### Evidence and sources

- supports: A p-value is not the probability that a hypothesis is true and does not measure effect size or importance. — asa-p-value-principles. Claim basis: guidance. Claim limit: This does not make properly used p-values meaningless.
Source access: full_text; accessed on: 2026-09-17; inspected sections: ["Three-page statement release; six principles on PDF page 2 visually checked"].
Source note: A methodological statement from 2016, not new empirical research or a ban on significance testing.
Agent scope review: ASA principles 2, 3 and 5 reject hypothesis-probability and effect-size interpretations of a p-value. The draft preserves the role of properly used statistical tests. (Six principles, numbers 2, 3 and 5)
- asa-p-value-principles: American Statistical Association Releases Statement on Statistical Significance and P-Values — https://www.amstat.org/asa/files/pdfs/p-valuestatement.pdf

Review: agent · Agent editorial and scoped source review · 2026-11-12T17:42:00Z
Published: 2026-11-12T17:42:00Z
