{
  "schema": "vedokrok.public-item.v1",
  "release_id": "MHC-RPUB-20261011-9e4b62c5",
  "url": "/knowledge/use-ai-to-expose-expert-patterns-then-test-whether-the-skill-transfers",
  "id": "MHC-D-RESEARCH-9189",
  "version": "0.2.0",
  "title": "Use AI to expose expert patterns, then test whether the skill transfers",
  "summary": "A useful copilot should leave some capability behind.",
  "kind": "protocol",
  "body": "The customer-support field study found evidence that AI suggestions spread communication patterns associated with stronger agents and helped newer workers move down the experience curve faster. Turn that mechanism into an explicit learning design: make the pattern visible, ask the learner to choose or adapt it, and periodically remove the assistance. If unaided performance does not improve, you built dependency or throughput—not yet learning.",
  "limits": [
    "The cited learning signal came from repeated customer-support work in a stable product domain. Open-ended expertise, rare edge cases and rapidly changing technical domains may require much more deliberate practice and feedback."
  ],
  "topics": [
    "union-human-ai-collaboration-benchmarks"
  ],
  "intents": [],
  "evidence": [
    {
      "claim": "The customer-support study found evidence consistent with AI disseminating patterns used by high-performing agents and helping newer agents move down the experience curve faster.",
      "role": "supports",
      "note": "The learning evidence is tied to a stable support domain with repeated interactions and does not show that AI automatically builds transferable expertise in open-ended knowledge work.",
      "locator": "Introduction, learning results and conclusion",
      "source_id": "RS-5512E42A86444868ED6F"
    }
  ],
  "use_when": [
    "You want AI assistance to shorten onboarding or spread strong practices, not merely finish today's task faster."
  ],
  "avoid_when": [
    "The cited learning signal came from repeated customer-support work in a stable product domain. Open-ended expertise, rare edge cases and rapidly changing technical domains may require much more deliberate practice and feedback."
  ],
  "example": "During SAP incident triage, AI can suggest the diagnostic sequence used in strong past cases. After several assisted cases, give the consultant a new incident without the copilot and check whether they can reproduce the sequence and adapt it.",
  "check": "The workflow measures later unaided performance on the target pattern, not only assisted throughput.",
  "source_ids": [
    "RS-5512E42A86444868ED6F"
  ],
  "published_at": "2026-10-01T14:27:00Z",
  "steps": [
    "Name the expert pattern the AI is meant to surface.",
    "Show why the suggestion fits this case instead of presenting only a finished answer.",
    "Require the learner to adapt, explain or choose the suggestion where learning matters.",
    "After repeated exposure, run a comparable case without AI.",
    "Keep the learning claim only if unaided performance improves."
  ],
  "editorial_overlay": {
    "overlay_id": "MHC-EO-20261011-00360116702e",
    "base_release_id": "MHC-RPUB-20261011-9e4b62c5",
    "base_projection_sha256": "d03d10dd52b53dec1ed850b7706847ba5b200e60f24c4fbda4518c2004356104",
    "manifest_sha256": "1af39e42a7b7ccbfde195d224c6fbad13dce1a65ab7f6ddb47f3c1fa37a79d65",
    "projection_sha256": "e27e1d2e266ff386bcbddbb10b8c7b7c28974666a9c81627e41141954c2c73f0",
    "authority_kind": "verified_composition",
    "authority_id": "MHC-EO-20261011-00360116702e",
    "authority_sha256": "9014ef57d1b0b7887c35349e0c486e26d062afb822e7e981218f1f17572647b9",
    "imported_at": "2026-10-11T19:08:10.621Z",
    "projection_schema": "vedokrok.editorial-composition.v1",
    "components": [
      {
        "overlay_id": "MHC-EO-20261006-e26f917f42eb",
        "manifest_sha256": "fefe97de681b48ba61ccae0ed28cbbcd6b7080764c2aad16270a7c7a0de151da",
        "projection_sha256": "e24f066f64697d0ca24179c73eb2675b736ca8813e8956568e4556a5ed2ed604",
        "authority": {
          "kind": "exact_approval",
          "id": "MHC-EO-20261006-e26f917f42eb",
          "sha256": "2a91d5d824ee38e8580f2527d40938edc31ca8eb298139e06c52c7572008778e"
        }
      },
      {
        "overlay_id": "MHC-EO-20261011-0959fc4ead8b",
        "manifest_sha256": "2f0c3654cb8888cfeef289bcf33389bd3645966a0ca1a325cf601ccd7fa15f8c",
        "projection_sha256": "42b8a1c802ffed6bed398b48c36af5d5f52e539d1b54ba97856e8fa44d343726",
        "authority": {
          "kind": "standing_policy",
          "id": "MHC-EOP-20260922-v1",
          "sha256": "e56ed8ad609a682580ab40bc7e98f6cdb770fca55a5d0048e091ee3741a6c032"
        }
      }
    ]
  },
  "editorial": {
    "item_id": "MHC-D-RESEARCH-9189",
    "item_version": "0.2.0",
    "source_item_sha256": "93338479c8c068d050b4cd188bd60a242284d852322f9d85f94562e9905d887e",
    "editorial_version": "1.0.0",
    "freshness_date": "2026-10-04",
    "title": "Check what people can do after AI assistance is removed",
    "lead": "Faster work with a copilot can be useful. A learning claim needs evidence about what remains when the suggestions disappear.",
    "sections": [
      {
        "heading": "Make the learning target observable",
        "text": "Name one pattern the learner should be able to use independently. Ask them to explain or adapt an AI suggestion, then later give them a comparable new case without the tool. For an incident-triage exercise, check whether they select and explain the next diagnostic step, including when to seek help. Compare with a baseline and assess correctness as well as speed. This is a proposed learning design, not a training method validated by the cited study."
      },
      {
        "heading": "Interpret the result narrowly",
        "text": "The customer-support study found a learning signal in faster chat handling during AI outages. Those estimates were noisy, could reflect differences in the chats encountered, and did not measure resolution at that level. If your unaided check shows no gain, report that learning has not been demonstrated on that measure. That result alone does not establish dependency, lost skill or even improved assisted throughput."
      }
    ],
    "takeaway": "Keep assisted performance, retained skill and transfer to a new task as separate claims. Repeat comparable checks and inspect quality before broadening the learning claim beyond the task tested.",
    "sources": [
      {
        "id": "RS-5512E42A86444868ED6F",
        "title": "Generative AI at Work",
        "url": "https://doi.org/10.1093/qje/qjae044"
      }
    ],
    "evidence": [
      {
        "claim": "The study examined unaided work during system outages and reported shorter chat duration after AI exposure.",
        "source_id": "RS-5512E42A86444868ED6F",
        "role": "supports",
        "locator": "Section VI.B, Worker Learning; Figure VII and accompanying discussion",
        "note": "Selected published passages. This is evidence concerning retained task performance in one support setting, not direct validation of the proposed training exercise."
      },
      {
        "claim": "Outage estimates were noisy, could reflect chat-mix differences, and used duration because chat-level resolution data were unavailable.",
        "source_id": "RS-5512E42A86444868ED6F",
        "role": "limits",
        "locator": "Section VI.B, paragraphs introducing Figure VII and discussing Panel B",
        "note": "Faster outage-period chats do not independently establish preserved resolution quality or broad transfer. A null result on a local check does not by itself identify dependency."
      },
      {
        "claim": "The authors restrict generalization to the particular tool, firm and occupation and note their relatively stable product setting.",
        "source_id": "RS-5512E42A86444868ED6F",
        "role": "limits",
        "locator": "Section VIII, Conclusion: first caveat",
        "note": "The task-specific interpretation is retained; neither human learning certification nor universal AI-training effectiveness is claimed."
      }
    ],
    "review": {
      "kind": "agent",
      "label": "Agent editorial review; not human or expert certification.",
      "reviewed_at": "2026-10-04T09:06:03.711137Z"
    }
  },
  "notices": [],
  "sources": [
    {
      "id": "RS-5512E42A86444868ED6F",
      "title": "Generative AI at Work",
      "url": "https://doi.org/10.1093/qje/qjae044"
    }
  ],
  "relations": [
    {
      "from": "MHC-D-RESEARCH-9189",
      "to": "MHC-D-RESEARCH-0380",
      "type": "useful_with",
      "url": "/knowledge/test-retention-later-without-ai"
    }
  ],
  "collections": [
    {
      "id": "RC-5D6E88D3E78C09BE1FBC",
      "title": "Prove the human-AI combination, not just the AI assist",
      "url": "/collections/prove-the-human-ai-combination-not-just-the-ai-assist"
    }
  ],
  "topic_hubs": [],
  "solution_packs": []
}