Template
Benchmark human plus AI against the stronger solo mode
Beating the human baseline is not the same as beating the best available workflow.
Before you use it
- Use when
- An AI-assisted workflow beats the old human process and the improvement is being treated as proof that the collaboration itself is best.
- Avoid when
- Do not remove required human accountability, legal review or safety controls merely because AI-alone scores well. Performance metrics must include the consequences of important error types, not just average accuracy.
An idea to explore.
Try this idea.
Inspect the example, try the idea in your situation, then check your next move.
A template to use
Task: [task]. Human alone: [human metrics]. AI alone: [AI metrics]. Human + AI: [combined metrics]. Strongest baseline: [mode]. Combination adds: [benefit]. Combination costs: [review or coordination]. Decision: [keep, delegate or redesign].
Why it matters
A large meta-analysis found that human-AI combinations improved on humans alone on average yet still underperformed whichever solo baseline—human or AI—was stronger. For representative tasks, compare three modes when feasible: human alone, AI alone and human plus AI. Use the same acceptance criteria and include review cost. Keep the combined workflow only when the combination earns its extra coordination.
An example
If AI can classify a routine request accurately on its own, adding a human approval step may make the process slower without improving the outcome. If the human catches costly edge cases, the combined mode may still earn its place.
Check your result
The AI-assisted workflow has been compared with both relevant solo alternatives, not only with the old human process.
Keep this limit in mind
- Do not remove required human accountability, legal review or safety controls merely because AI-alone scores well. Performance metrics must include the consequences of important error types, not just average accuracy.
My learning
Read. Recall. Repeat.
Save this idea and return to it on any device.
Connected ideas
Useful withMap the task to the current AI frontierUseful with
Keep a human baseline for important AI tasks
These ideas link to this one. Check their conditions and limits before use.
Useful with this ideaSegment AI gains by experience before standardizing the workflow
Evidence and sources (1)
A preregistered meta-analysis of 106 experiments found that human-AI combinations outperformed humans alone on average but performed worse than the better of the human-alone and AI-alone baselines.
The review covered studies published through June 2023 and reported high heterogeneity, so the pooled estimate does not establish that a particular current workflow will underperform the stronger solo mode.
When combinations of humans and AI are useful: A systematic review and meta-analysis · Abstract and Overall levels of human-AI synergy
Edition and review
Version 0.2.0 · Published
No review details are supplied for this edition.