Protocol

Check what the study planned to count as success

An interesting discovery deserves its real label, not a borrowed prediction.

About 1 min read

Before you use it

Use when
  • A striking result receives emphasis but may not have been the original primary question.

Keep this limit in mind

  • Exploration is legitimate. The problem is presenting a selected discovery as if it had been the sole pre-planned test.

An idea to explore.

Try this idea.

Inspect the example, try the idea in your situation, then check your next move.

Keep reading

Why it matters

Locate the protocol, registration or dated analysis plan and its primary outcome. Compare that plan with the reported outcome, time point and analysis; record explained changes and exploratory findings separately.

Steps

  1. Locate the protocol, registration or dated analysis plan and its primary outcome.
  2. Compare that plan with the reported outcome, time point and analysis; record explained changes and exploratory findings separately.

An example

A study planned to measure course completion but its headline celebrates a favourable subgroup's confidence score. Both may be informative, but they answer different questions.

Check your result

Is the advertised result planned, changed with explanation, or exploratory?

Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingCheck what the study planned to count as success

Evidence and sources
Supports

Pre-specified outcomes and analyses help distinguish planned tests from result-selected findings.

Claim basis: guidance. Claim limit: Exploratory work can be valuable when clearly identified; registration alone does not prove quality. Source access: selected_html_passages; accessed on: 2026-09-17; inspected sections: ["8.2.2", "8.2.3 signalling questions", "8.3", "8.5", "8.6"]. Source note: The elements introduce questions for readers; they do not reproduce or claim to complete the RoB 2 assessment. Agent scope review: Cochrane 8.2.3 Table 8.2.a and 8.7 address prespecified analyses and selection of a reported result. The card keeps exploratory analysis legitimate when identified as such.

Chapter 8: Assessing risk of bias in a randomized trial · 8.2.3, selection-of-reported-result signalling questions

All sources (1)
Edition and review

Version 0.1.0 · Published

Edition checked · 2026-11-12

Read this idea as JSON · Release details