Training Drift Report: support onboarding library
This is what a Training Drift Audit delivers. Every company, policy and number below is fictional; the structure is real.
1. Summary
Of 46 support-onboarding courses, 9 teach at least one rule that no longer matches its current source. Two findings are rated P0 because they could lead agents to breach a customer commitment: the P1 escalation window (30 → 15 minutes) and the refund approval limit ($500 → $250). Both are taught in several places, including assessments that currently mark the outdated answer as correct.
2. Scope & method
- Library: 46 courses (31 SCORM packages, 9 slide decks, 6 wiki pages).
- Sources: 14 current policies, runbooks and product docs supplied by the client, each with an owner.
- Method: extract instructional claims (rules, numbers, steps, names); match each to a source passage; classify as supported, out of date, conflicting or unsupported; rate by risk and reach.
- Review: every P0/P1 finding confirmed by a person against the source.
3. Library health
4. Findings, highest risk first
| Risk | Finding | Where | Source |
|---|---|---|---|
| P0 | Escalation window taught as 30 minutes; policy says 15. | Onboarding L3, Q14, Scenario 2, wiki job aid | Incident policy v15 §4.2 |
| P0 | Refund limit quoted as $500; policy says $250. | Billing basics L2, Q6 | Refund policy v9 §3 |
| P1 | Deprecated tool name in 6 screenshots and 2 scripts. | Product academy (3 courses) | Release notes 4.2 |
| P1 | No assessment covers the new data-retention rule. | Privacy essentials | Data retention standard v3 |
| P2 | Two courses teach different PTO approval steps. | Manager toolkit, HR 101 | Conflict: HR-12 vs manager guide |
| P3 | Reading level above target in 9 lessons. | Across library | Style guide |
5. Affected learning objects (P0 example)
Clause §4.2 of the incident policy is taught or tested in 7 objects reaching roughly 480 learners:
- Lesson 03 narration, paragraph 2
- Question 14 (marks the old answer correct)
- Scenario 2, branch B timer
- Wiki job aid "Escalation card"
- fr-FR and de-DE lesson 03
- Team-lead refresher deck, slide 7
6. Remediation plan
- Week 1: patch the two P0 rules everywhere they appear; current staff take a 3-minute delta lesson; new-hire onboarding updated in place.
- Weeks 2–4: P1 fixes; add an assessment item for the retention rule; replace deprecated screenshots.
- Month 2: resolve the PTO conflict with HR; set source owners and review dates for all 14 sources.
- Ongoing: re-run the audit after fixes; adopt change detection so the next policy change finds its courses automatically.
7. Limitations
An audit compares training with the sources the client supplies. It doesn't validate the sources themselves, assess legal compliance, or measure on-the-job behavior. Automated matching is reviewed by people, but no review is perfect; the client's experts make the final calls.
Want this for your library?
Limited places for early design partners.