Evaluation

Contrary to training myth and deep tradition, one-time training events in and of themselves do NOT deliver significant positive, bottom-line outcomes.

Are learners tested? Do questions and activities tie to the learning objectives?

Will Thalheimer’s Learning-Transfer Evaluation Model (LTEM) is the preferred evidence-based approach. Every learning solution should be measured at the highest tier possible.

Design for the highest tier possible...

Tier 8, the Effects of Transfer, includes measuring outcomes that affect learners, coworkers, the organization, the community, society, and the environs. A noble task indeed, but incredibly difficult to measure as it requires a rigorous method of assessing transfer’s causal impact—including positive and negative effects.

Constraints and Resources

At a minimum, we need to measure at Tier 4 - Knowledge. This level measure the learner’s ability to answer questions about facts and terminology. Whenever practical, we should measure both recitation and retention.

· Knowledge Recitation occurs during or right after the learning event.

· Knowledge Retention is measured several days or more after the event.

Note: both are considered inadequate because simply remembering does NOT enable performance.

We can and should measure Tier 5, Decision-Making Competence, where learners are given realistic scenarios. Like Tier 4, competence is measured during or right after the learning event—and after several days or more to adequately certify decision-making competence.

Note: consider using Adaptive Learning by providing corrective feedback to incorrect responses and then branch to additional questions that cover the learner’s identified weaknesses until they show competence. This method is highly researched and highly effective. And, we have the tools to do this!

Ultimately, we should strive for Tier 6, Task Competence, where the learner performs relevant and realistic actions and decision-making.

Including, task competence during or after the learning event but also remembered decision-making after several days or more. This is particularly useful during live ILT events; it is admittedly more difficult to measure activities remotely.

Have you created training or learning?