Checklist
Use the same rubric for comparable cases
A standard that changes with the case is not doing much standardizing.
Before you use it
- Use when
- Repeated cases should be judged consistently but reviewers rely on a shifting intuitive standard.
Keep this limit in mind
- Shared rubrics can be inappropriate where multiple legitimate perspectives are the object of inquiry rather than noise to eliminate.
An idea to explore.
Try this idea.
Inspect the example, try the idea in your situation, then check your next move.
Checklist
- Criteria are written before the current case is scored.
- Scale anchors describe observable differences rather than vague adjectives.
- Comparable cases use the same current rubric version.
- Rubric changes are recorded with a reason.
- Material changes trigger a decision about re-rating earlier cases.
Why it matters
Define the criteria and scale anchors before reviewing the batch, then apply them to each comparable case. Include examples near category boundaries when possible. If the rubric must change, version it and decide whether earlier cases need re-rating under the new rule.
An example
All enhancement requests use the same impact, urgency, reversibility and evidence anchors instead of a new interpretation for each requester.
Check your result
A reviewer can explain why two similar cases received different scores using the rubric rather than personal preference.
Save and practise this idea
My learning
Read. Recall. Repeat.
Save this idea and return to it on any device.
Keep exploring
Connected ideas
You are readingUse the same rubric for comparable cases
Evidence and sources
The same workplace judgment review supports agreeing on standards and applying them consistently across comparable cases as a noise-reduction strategy.
A common standard is useful only when the relevant perspective is intended to be shared; some creative or exploratory judgments legitimately differ.
Improving Workplace Judgments by Reducing Noise: Lessons Learned from a Century of Selection Research · Agreed standards and consistent application
Edition and review
Version 0.1.0
No review details are supplied for this edition.