Checklist

Count independent units before admiring the sample size

A thousand rows are not automatically a thousand independent chances to learn.

About 1 min read

Before you use it

Use when
  • A large observation count may come from a small number of people, teams or sites.

Keep this limit in mind

  • Do not simply discard repeated data; they can be valuable when analysed appropriately. Seek statistical help for consequential analyses.

An idea to explore.

Try this idea.

Inspect the example, try the idea in your situation, then check your next move.

Keep reading

Checklist

  • Identify what was assigned or sampled independently.
  • Find repeated measurements or shared clusters in the data.
  • Check that the reported analysis accounts for those dependencies.

Why it matters

Identify what was assigned or sampled independently. Find repeated measurements or shared clusters in the data. Check that the reported analysis accounts for those dependencies.

An example

Twenty people each supply fifty daily ratings. There are 1,000 ratings, but not 1,000 separately recruited people.

Check your result

Does the headline sample size describe participants, observations or clusters?

Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingCount independent units before admiring the sample size

Evidence and sources
Supports

Repeated or clustered observations must not be treated as independent participants.

Claim basis: guidance. Claim limit: A reader's count check does not replace a design-appropriate statistical analysis. Source access: selected_html_passages; accessed on: 2026-09-17; inspected sections: ["6.1-6.2", "6.4.1", "6.5.1 and MECIR C61"]. Source note: Handbook methodological guidance, not a recent intervention trial. Numerical examples in the elements are invented teaching examples. Agent scope review: Cochrane 6.2.1 and 6.2.4 explain dependence within clusters and repeated observations. The card identifies the independent unit without proposing an analysis for a particular study.

Chapter 6: Choosing effect measures and computing estimates of effect · 6.2, unit-of-analysis issues

All sources (1)
Edition and review

Version 0.1.0 · Published

Edition checked · 2026-11-12

Read this idea as JSON · Release details