Question

Look behind the pooled average

A summary is not a promise that all its ingredients agree.

About 1 min read

Before you use it

Use when
  • A meta-analysis is presented as one effect that should occur in every setting.

Keep this limit in mind

  • Do not select the study you like best or delete inconvenient outliers. A few studies may not support a reliable explanation of variation.

An idea to explore.

Try this idea.

Inspect the example, try the idea in your situation, then check your next move.

Keep reading

A question to ask

How do the included populations, methods and effects differ?

Is a common summary meaningful, and how does the review describe uncertainty and between-study variation?

Why it matters

How do the included populations, methods and effects differ?

Is a common summary meaningful, and how does the review describe uncertainty and between-study variation?

An example

Studies of intensive supported courses are pooled with brief self-guided lessons. The overall average does not tell you which delivery you would actually receive.

Check your result

Can you describe the differences the review found and any uncertainty about what explains them?

Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingLook behind the pooled average

Evidence and sources
Supports

A pooled average can conceal important between-study variation; random-effects analysis does not erase it.

Claim basis: guidance. Claim limit: Explaining variation reliably may be impossible with a few small studies. Source access: selected_html_passages; accessed on: 2026-10-01; inspected sections: ["10.2", "10.10.1-10.10.4", "10.11.3", "10.11.1-10.11.3.1", "MECIR Box 10.11.a", "10.11.5.2-10.11.5.6", "10.11.6"]. Source note: The chapter reports a November 2024 update. No single heterogeneity threshold is promoted as decisive. Separate source-access audit (2026-10-01): Chapter 10 still identifies November 2024 and version 6.5. The 2026-10-01 check covers its citation and sections 10.11.1-10.11.3.1, 10.11.5.2-10.11.5.6 and 10.11.6. The older 10.2/10.10 reading history is retained, not newly appraised. Overall Handbook updates do not change this chapter’s stated revision. No single heterogeneity threshold is promoted as decisive. Agent scope review: Cochrane 10.10.1–10.10.4 describe between-study variation and the limits of a random-effects summary. The example concerns the transfer of training formats.

Chapter 10: Analysing data and undertaking meta-analyses · 10.10.1-10.10.4

All sources (1)
Edition and review

Version 0.1.0 · Published

Edition checked · 2026-11-12

Read this idea as JSON · Release details