Protocol

Discuss the reasons, then re-rate privately

Discussion is useful for finding what you missed; consensus is not its only valid output.

About 1 min read

Before you use it

Use when
  • Independent reviewers disagree and discussion may expose missed evidence but can also create conformity.

Keep this limit in mind

  • Discussion can still influence private rerating; the method reduces but does not eliminate social effects.

An idea to explore.

Try this idea.

Inspect the example, try the idea in your situation, then check your next move.

Keep reading

Why it matters

After independent ratings are collected, compare reasons and evidence rather than arguing immediately for one number. Let reviewers ask questions and inspect overlooked information. Then end discussion and have each person submit a final judgment privately. Compare what changed and which disagreements remain.

Steps

  1. Reveal the distribution and key reasons after independent scoring.
  2. Discuss evidence, definitions and overlooked considerations rather than negotiating an average.
  3. End the discussion before final ratings are entered.
  4. Collect final ratings privately.
  5. Distinguish corrected oversights from remaining principled disagreement.

An example

Security reviewers discuss why two people scored a threat differently, then each privately revises or keeps their rating.

Check your result

The process can show which judgments changed because of new information and which disagreements survived informed discussion.

Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingDiscuss the reasons, then re-rate privately

Evidence and sources
Supports

In AMP, participants discussed perspectives and then completed a final review independently so discussion could reveal oversights without requiring consensus.

Private re-rating does not remove prestige, persuasion or shared-information effects that already occurred during discussion.

Analysis from multiple perspectives (AMP): Applying decision hygiene to analysis of musical structure · Discussion and final independent review

Supports

The AMP proof of concept found that structured independent analysis, information sharing and private re-evaluation reduced self-identified errors or oversights while preserving meaningful differences in perspective.

The result is context-specific and does not prove the exact procedure improves accuracy in unrelated domains.

Analysis from multiple perspectives (AMP): Applying decision hygiene to analysis of musical structure · Abstract results

All sources (1)
Edition and review

Version 0.1.0

No review details are supplied for this edition.

Read this idea as JSON · Release details