Protocol
Use AI to expose expert patterns, then test whether the skill transfers
A useful copilot should leave some capability behind.
Before you use it
- Use when
- You want AI assistance to shorten onboarding or spread strong practices, not merely finish today's task faster.
- Avoid when
- The cited learning signal came from repeated customer-support work in a stable product domain. Open-ended expertise, rare edge cases and rapidly changing technical domains may require much more deliberate practice and feedback.
An idea to explore.
Try this idea.
Inspect the example, try the idea in your situation, then check your next move.
Why it matters
The customer-support field study found evidence that AI suggestions spread communication patterns associated with stronger agents and helped newer workers move down the experience curve faster. Turn that mechanism into an explicit learning design: make the pattern visible, ask the learner to choose or adapt it, and periodically remove the assistance. If unaided performance does not improve, you built dependency or throughput—not yet learning.
Steps
- Name the expert pattern the AI is meant to surface.
- Show why the suggestion fits this case instead of presenting only a finished answer.
- Require the learner to adapt, explain or choose the suggestion where learning matters.
- After repeated exposure, run a comparable case without AI.
- Keep the learning claim only if unaided performance improves.
An example
During SAP incident triage, AI can suggest the diagnostic sequence used in strong past cases. After several assisted cases, give the consultant a new incident without the copilot and check whether they can reproduce the sequence and adapt it.
Check your result
The workflow measures later unaided performance on the target pattern, not only assisted throughput.
Keep this limit in mind
- The cited learning signal came from repeated customer-support work in a stable product domain. Open-ended expertise, rare edge cases and rapidly changing technical domains may require much more deliberate practice and feedback.
My learning
Read. Recall. Repeat.
Save this idea and return to it on any device.
Connected ideas
Useful withTest retention later without AI
These ideas link to this one. Check their conditions and limits before use.
Useful with this ideaFade support when unaided performance becomes reliable
Evidence and sources (1)
The customer-support study found evidence consistent with AI disseminating patterns used by high-performing agents and helping newer agents move down the experience curve faster.
The learning evidence is tied to a stable support domain with repeated interactions and does not show that AI automatically builds transferable expertise in open-ended knowledge work.
Generative AI at Work · Introduction, learning results and conclusion
All sources (1)
Vedokrok editorial review
Check what people can do after AI assistance is removed
Faster work with a copilot can be useful. A learning claim needs evidence about what remains when the suggestions disappear.
Make the learning target observable
Name one pattern the learner should be able to use independently. Ask them to explain or adapt an AI suggestion, then later give them a comparable new case without the tool. For an incident-triage exercise, check whether they select and explain the next diagnostic step, including when to seek help. Compare with a baseline and assess correctness as well as speed. This is a proposed learning design, not a training method validated by the cited study.
Interpret the result narrowly
The customer-support study found a learning signal in faster chat handling during AI outages. Those estimates were noisy, could reflect differences in the chats encountered, and did not measure resolution at that level. If your unaided check shows no gain, report that learning has not been demonstrated on that measure. That result alone does not establish dependency, lost skill or even improved assisted throughput.
Editorial takeaway
Keep assisted performance, retained skill and transfer to a new task as separate claims. Repeat comparable checks and inspect quality before broadening the learning claim beyond the task tested.
What we checked
The study examined unaided work during system outages and reported shorter chat duration after AI exposure.
Selected published passages. This is evidence concerning retained task performance in one support setting, not direct validation of the proposed training exercise.
Generative AI at Work · Section VI.B, Worker Learning; Figure VII and accompanying discussion
Outage estimates were noisy, could reflect chat-mix differences, and used duration because chat-level resolution data were unavailable.
Faster outage-period chats do not independently establish preserved resolution quality or broad transfer. A null result on a local check does not by itself identify dependency.
Generative AI at Work · Section VI.B, paragraphs introducing Figure VII and discussing Panel B
The authors restrict generalization to the particular tool, firm and occupation and note their relatively stable product setting.
The task-specific interpretation is retained; neither human learning certification nor universal AI-training effectiveness is claimed.
Generative AI at Work · Section VIII, Conclusion: first caveat
Editorial sources (1)
Edition and review
Version 0.2.0 · Published
No review details are supplied for this edition.