Collection
Read the study behind the promise
Identify what a result actually measures, who it concerns and what remains uncertain before using it in a decision.
Explore in any order.
What’s included
1 anti-pattern · 2 checklists · 3 concepts · 4 protocols · 6 questions · 2 templates
18 ideas
Translate the percentage into a same-sized group
Half of a small number is still worth identifying.
Read the idea TemplateKeep the clock attached to the risk
A risk percentage needs a time frame.
Read the idea QuestionAre these events or people?
One person can appear in an event log more than once.
Read the idea ChecklistCount independent units before admiring the sample size
A thousand rows are not automatically a thousand independent chances to learn.
Read the idea QuestionWhat did the comparison group actually receive?
Better than waiting is a different claim from better than good existing care.
Read the idea ConceptRandom assignment does not recruit a representative population
A fair shuffle of volunteers does not change who volunteered.
Read the idea ProtocolFollow the participants who disappeared from the result
The missing rows may have a story the average cannot tell.
Read the idea QuestionWho knew the allocation when the outcome was measured?
Ask where expectations could enter this particular result.
Read the idea ProtocolCheck what the study planned to count as success
An interesting discovery deserves its real label, not a borrowed prediction.
Read the idea QuestionRead the uncertainty beside the estimate
The decimal is not a promise of precision.
Read the idea Anti-patternDo not turn a p-value into a truth percentage
Subtracting from one does not turn a test into a belief meter.
Read the idea ConceptGive the number needed to treat its conditions back
The number travels badly without its luggage.
Read the idea ChecklistFind out which way the scale points
Some scales reward going down.
Read the idea QuestionLook behind the pooled average
A summary is not a promise that all its ingredients agree.
Read the idea TemplateWrite the applicability gap before adopting the result
Relevant is not the same as identical, and neither word should be guessed.
Read the idea ConceptA changed biomarker is not automatically a changed life
The dashboard can move before the destination is established.
Read the idea QuestionWas safety measured, or merely not mentioned?
Silence has no sample size.
Read the idea ProtocolCount studies, not publication wrappers
A second paper is not necessarily a second experiment.
Read the idea