Protocol

Decompose the judgment before scoring the whole

A single number can hide five different arguments.

About 1 min read

Before you use it

Use when
  • A complex case receives one holistic score and reviewers disagree without knowing which part drove the difference.

Keep this limit in mind

  • Do not decompose away an emergent property that genuinely depends on the whole pattern; leave room for a documented holistic check.

An idea to explore.

Try this idea.

Inspect the example, try the idea in your situation, then check your next move.

Keep reading

Why it matters

Break the judgment into a small set of components that jointly matter, score or assess those components before the overall verdict, then integrate them using the agreed process. Decomposition makes inconsistency inspectable and prevents one vivid feature from silently dominating everything else.

Steps

  1. When two reviewers disagree overall, the team can locate the component where their judgments diverge.

An example

Assess deployment risk separately for reversibility, blast radius, observability and data integrity before assigning the overall risk level.

Check your result

When two reviewers disagree overall, the team can locate the component where their judgments diverge.

Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingDecompose the judgment before scoring the whole

Evidence and sources
Supports

A century of selection research reviewed by Annual Reviews supports decomposing complex judgments into components and applying standards consistently to reduce noise.

Decomposition can omit emergent qualities when components do not capture the real judgment target.

Improving Workplace Judgments by Reducing Noise: Lessons Learned from a Century of Selection Research · Structuring judgment process

All sources (1)
Edition and review

Version 0.1.0

No review details are supplied for this edition.

Read this idea as JSON · Release details