Collection

Read the study behind the promise

Identify what a result actually measures, who it concerns and what remains uncertain before using it in a decision.

Explore in any order.

What’s included

1 anti-pattern · 2 checklists · 3 concepts · 4 protocols · 6 questions · 2 templates

Narrow your search

18 ideas

Protocol

Translate the percentage into a same-sized group

Half of a small number is still worth identifying.

Read the idea
Template

Keep the clock attached to the risk

A risk percentage needs a time frame.

Read the idea
Question

Are these events or people?

One person can appear in an event log more than once.

Read the idea
Checklist

Count independent units before admiring the sample size

A thousand rows are not automatically a thousand independent chances to learn.

Read the idea
Question

What did the comparison group actually receive?

Better than waiting is a different claim from better than good existing care.

Read the idea
Concept

Random assignment does not recruit a representative population

A fair shuffle of volunteers does not change who volunteered.

Read the idea
Protocol

Follow the participants who disappeared from the result

The missing rows may have a story the average cannot tell.

Read the idea
Question

Who knew the allocation when the outcome was measured?

Ask where expectations could enter this particular result.

Read the idea
Protocol

Check what the study planned to count as success

An interesting discovery deserves its real label, not a borrowed prediction.

Read the idea
Question

Read the uncertainty beside the estimate

The decimal is not a promise of precision.

Read the idea
Anti-pattern

Do not turn a p-value into a truth percentage

Subtracting from one does not turn a test into a belief meter.

Read the idea
Concept

Give the number needed to treat its conditions back

The number travels badly without its luggage.

Read the idea
Checklist

Find out which way the scale points

Some scales reward going down.

Read the idea
Question

Look behind the pooled average

A summary is not a promise that all its ingredients agree.

Read the idea
Template

Write the applicability gap before adopting the result

Relevant is not the same as identical, and neither word should be guessed.

Read the idea
Concept

A changed biomarker is not automatically a changed life

The dashboard can move before the destination is established.

Read the idea
Question

Was safety measured, or merely not mentioned?

Silence has no sample size.

Read the idea
Protocol

Count studies, not publication wrappers

A second paper is not necessarily a second experiment.

Read the idea