Protocol
Check what the study planned to count as success
An interesting discovery deserves its real label, not a borrowed prediction.
Before you use it
- Use when
- A striking result receives emphasis but may not have been the original primary question.
Keep this limit in mind
- Exploration is legitimate. The problem is presenting a selected discovery as if it had been the sole pre-planned test.
An idea to explore.
Try this idea.
Inspect the example, try the idea in your situation, then check your next move.
Why it matters
Locate the protocol, registration or dated analysis plan and its primary outcome. Compare that plan with the reported outcome, time point and analysis; record explained changes and exploratory findings separately.
Steps
- Locate the protocol, registration or dated analysis plan and its primary outcome.
- Compare that plan with the reported outcome, time point and analysis; record explained changes and exploratory findings separately.
An example
A study planned to measure course completion but its headline celebrates a favourable subgroup's confidence score. Both may be informative, but they answer different questions.
Check your result
Is the advertised result planned, changed with explanation, or exploratory?
Save and practise this idea
My learning
Read. Recall. Repeat.
Save this idea and return to it on any device.
Keep exploring
Connected ideas
You are readingCheck what the study planned to count as success
Ideas that link here
These ideas link to this one. Check their conditions and limits before use.
Useful with this ideaWho knew the allocation when the outcome was measured?
Evidence and sources
Pre-specified outcomes and analyses help distinguish planned tests from result-selected findings.
Claim basis: guidance. Claim limit: Exploratory work can be valuable when clearly identified; registration alone does not prove quality. Source access: selected_html_passages; accessed on: 2026-09-17; inspected sections: ["8.2.2", "8.2.3 signalling questions", "8.3", "8.5", "8.6"]. Source note: The elements introduce questions for readers; they do not reproduce or claim to complete the RoB 2 assessment. Agent scope review: Cochrane 8.2.3 Table 8.2.a and 8.7 address prespecified analyses and selection of a reported result. The card keeps exploratory analysis legitimate when identified as such.
Chapter 8: Assessing risk of bias in a randomized trial · 8.2.3, selection-of-reported-result signalling questions
All sources (1)
Edition and review
Version 0.1.0 · Published
Edition checked · 2026-11-12