Question
Look behind the pooled average
A summary is not a promise that all its ingredients agree.
Before you use it
- Use when
- A meta-analysis is presented as one effect that should occur in every setting.
Keep this limit in mind
- Do not select the study you like best or delete inconvenient outliers. A few studies may not support a reliable explanation of variation.
An idea to explore.
Try this idea.
Inspect the example, try the idea in your situation, then check your next move.
A question to ask
How do the included populations, methods and effects differ?
Is a common summary meaningful, and how does the review describe uncertainty and between-study variation?
Why it matters
How do the included populations, methods and effects differ?
Is a common summary meaningful, and how does the review describe uncertainty and between-study variation?
An example
Studies of intensive supported courses are pooled with brief self-guided lessons. The overall average does not tell you which delivery you would actually receive.
Check your result
Can you describe the differences the review found and any uncertainty about what explains them?
Save and practise this idea
My learning
Read. Recall. Repeat.
Save this idea and return to it on any device.
Keep exploring
Connected ideas
You are readingLook behind the pooled average
Ideas that link here
These ideas link to this one. Check their conditions and limits before use.
Use before this ideaFind out which way the scale pointsUse before this idea
Count studies, not publication wrappersUseful with this idea
Compare subgroup effects, not their significance labels
Evidence and sources
A pooled average can conceal important between-study variation; random-effects analysis does not erase it.
Claim basis: guidance. Claim limit: Explaining variation reliably may be impossible with a few small studies. Source access: selected_html_passages; accessed on: 2026-10-01; inspected sections: ["10.2", "10.10.1-10.10.4", "10.11.3", "10.11.1-10.11.3.1", "MECIR Box 10.11.a", "10.11.5.2-10.11.5.6", "10.11.6"]. Source note: The chapter reports a November 2024 update. No single heterogeneity threshold is promoted as decisive. Separate source-access audit (2026-10-01): Chapter 10 still identifies November 2024 and version 6.5. The 2026-10-01 check covers its citation and sections 10.11.1-10.11.3.1, 10.11.5.2-10.11.5.6 and 10.11.6. The older 10.2/10.10 reading history is retained, not newly appraised. Overall Handbook updates do not change this chapter’s stated revision. No single heterogeneity threshold is promoted as decisive. Agent scope review: Cochrane 10.10.1–10.10.4 describe between-study variation and the limits of a random-effects summary. The example concerns the transfer of training formats.
Chapter 10: Analysing data and undertaking meta-analyses · 10.10.1-10.10.4
All sources (1)
Edition and review
Version 0.1.0 · Published
Edition checked · 2026-11-12