Heuristic

Inspect failed data checks

The small failed slice may be the part that matters.

About 1 min read

Before you use it

Use when
  • A new validation reports 99.9% passing records.

Keep this limit in mind

  • Sampling can miss rare issues; increase examination where consequences are high.

An idea to explore.

Try this idea.

Inspect the example, try the idea in your situation, then check your next move.

Keep reading

Why it matters

Inspect a bounded sample of failures by business impact and upstream source. Look for false positives, repeat causes and severe cases hidden by the rate. Pair a numerical threshold with example-level review before declaring success.

Steps

  1. Review representative failing records and the highest-risk failures.
  2. Check whether the rule rejected a valid edge case.

An example

A tax-number format rule flags just three customers, but all are in a legally critical flow.

Check your result

The report includes tested examples and follow-up ownership, not only a percentage.

Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingInspect failed data checks

Evidence and sources
Supports

The issues framework recommends defining a data purpose, quality rules and targets before measuring performance, then prioritising below-target issues using purpose importance, failure impact and performance.

Claim limit: Practical prioritisation guidance, not evidence that its suggested scores or tolerances are universally optimal. Its date-range example is labelled accuracy; this source supports prioritisation here, not the validity/accuracy distinction set out in the companion guidance. Explicit denominators and regression examples are authored adaptations, not requirements established by this page. Source reading history: selected_passages; 2026-10-11; Rules and purpose, importance/impact, targets and priority; 16 April 2026 update. Official page was opened on 2026-10-10 and identified sections inspected. This verifies a narrow reference basis, not the effectiveness or completeness of independently drafted practice steps. On 2026-10-11 these prioritisation sections were read again. The date-range example uses accuracy where the companion guidance distinguishes validity; this limited source use does not adopt that example’s terminology. Agent release review: PostgreSQL 18 table expressions, NULL comparisons and aggregates, the UK Government Data Quality Framework and Microsoft Power Query profiling documentation were checked at the cited sections. The original examples and scope limits remain attached.

Data quality issues framework · What data quality rules and issues are; Determine importance and impact; Set targets; Assign priority

All sources (1)
Edition and review

Version 0.1.0 · Published

Edition checked · 2026-11-12

Read this idea as JSON · Release details