Protocol

Build an outside-view reference class

Your plan is unique. Your kind of mistake often is not.

A situation to tryIllustrative example

Pick the comparison before seeing its answer.

Estimate a kitchen renovation using earlier jobs. A spectacular large renovation is not automatically a useful comparison.

A yellow tape measure, two quote folders and tile samples in an unfinished kitchen
The quotesThe actual work

What would you try?

Two ways to look at it
Current projectRoom size, plumbing changes and finish.
Candidate casesPast projects with different conditions.

Try either move. Compare what it can tell you.

Why preserve the inclusion rule?

So the class cannot quietly change after its result is known.

Reference classes depend on selection and comparability. A larger pile of weak comparisons is not automatically better.

Read the complete idea VedokrokSee a situation. Try a different move.

Before you use it

Use when
  • A project estimate is being built mainly from the current team's internal plan and assumptions.

Keep this limit in mind

  • Reference class forecasting is sensitive to class selection and data comparability; recent review work highlights unresolved methodological limitations.

Why it matters

Find a set of past projects that are comparable on the features that drive the outcome, then inspect the distribution of actual cost, duration or failure. Use that distribution as an outside-view anchor before adjusting for specific differences in the current case. Record the selection rule so the class cannot be quietly changed after seeing the answer.

Steps

  1. The forecast target is defined consistently across cases.
  2. Reference projects share the drivers relevant to that target.
  3. Actual outcomes, not original plans, are used.
  4. The inclusion rule is written before inspecting the desired percentile.
  5. Case-specific adjustments are explicit and separately justified.

An example

Estimate a data-migration duration from comparable migrations with similar volume, interfaces and testing scope, not from the current task breakdown alone.

Check your result

The forecast can show both the historical outcome distribution and the explicit reasons for departing from it.

A small scene. Your next move.

Try this idea.

Make a move, see what changes, then bring it to your own situation.

Keep reading
Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingBuild an outside-view reference class

Evidence and sources
Supports

Reference class forecasting uses outcomes from comparable past projects as an outside view, but recent review work highlights unresolved issues around reference-class selection and applicability.

A badly chosen class can give a confident but irrelevant base rate.

Reference class forecasting: promises, problems, and a research agenda moving forward · Systematic literature review and limitations

All sources (1)
Edition and review

Version 0.1.0

No review details are supplied for this edition.

Read this idea as JSON · Release details