Protocol

Use known-good papers as a search test

A search that cannot find the paper on your desk deserves suspicion.

About 1 min read

Before you use it

Use when
  • You already know several directly relevant high-quality papers and want to check whether the query is behaving.

Keep this limit in mind

  • Passing a known-item test does not prove completeness; it only exposes obvious retrieval failures.

An idea to explore.

Try this idea.

Inspect the example, try the idea in your situation, then check your next move.

Keep reading

Why it matters

Choose a small set of relevant records known before finalizing the strategy. Run the search and verify whether it retrieves them for the expected reasons. If not, inspect missing terminology, indexing and overly restrictive concepts. Do not tune only to those papers; add other validation checks so the query does not overfit.

Steps

  1. Known items were selected before final query tuning.
  2. Each missed known item is investigated.
  3. Changes are based on generalizable terminology or indexing gaps.
  4. The strategy is not narrowed around one favored paper.
  5. Additional relevant records are still being discovered.

An example

If your AI-confidence query misses a landmark paper because it uses 'metacognitive sensitivity,' update the terminology map rather than manually adding the title.

Check your result

The finalized search retrieves known relevant items without becoming a title-specific lookup.

Save and practise this idea

My learning

Read. Recall. Repeat.

Save this idea and return to it on any device.

Use email
Keep exploring

Connected ideas

You are readingUse known-good papers as a search test

Evidence and sources
Supports

Current review-search guidance recommends validating a search strategy rather than assuming a syntactically correct query is comprehensive.

No finite validation proves complete recall.

How to search for literature in systematic reviews and meta-analyses: A comprehensive step-by-step guide · Search validation checks

All sources (1)
Edition and review

Version 0.1.0

No review details are supplied for this edition.

Read this idea as JSON · Release details