Imagine a bustling, sun-drenched coffee shop. Lisa, a dedicated HR manager, anxiously flips through a stack of training program reports. She’s sipping her coffee not for pleasure, but to calm her racing thoughts. How can she effectively prove the investment of time and resources in employee training and development was worthwhile?
If you can’t measure it, you can’t improve it. Lisa knows this, and that’s why she’s on a mission. She’s like a detective searching for clues. Determined to unlock the mysteries of a training program assessment. And just like Lisa, all HR managers are on a relentless quest for answers.
This is why we’ve put together this guide to employee training evaluation methods. It’s a go-to resource for evaluating training programs. Plus, a way to understand what’s making training efforts shine and what’s holding them back and improve it.
Let’s uncover the secrets of what’s making training programs successful, what’s not, and why. Get ready to explore the practical topics ahead and transform your organization by measuring training effectiveness, like:
When it comes to the evaluation of training programs, it’s best to start at the beginning. So before you decide what to measure, or how to measure it, choose the evaluation technique that’s most helpful for your needs.
Not sure which training evaluation techniques are on the menu? Here are some of the most popular methods used today.
There’s a long (and we mean long!) list of training evaluation techniques to choose from, and this can be overwhelming. But there are five techniques that are most often trusted by companies today. Some of these techniques are referred to as models, or training evaluation methods, and we’ll use these terms interchangeably.
This method of evaluating training programs might be one of the oldest, but it’s still one of the most well-loved. Why? Because it breaks the training evaluation process down into 4 simple levels—or rather, steps. Here’s how it works:
In modern times, professionals have suggested that this process should actually be reversed. After all, step 4 is the most important one. If you agree with this approach, start by identifying the results you want to achieve, and work backward from there.
Whichever direction you choose to apply the steps toward, the eLearning industry has come to rely on Kirkpatrick’s model for good reason. Its logical, staged approach is easy to apply for measuring training effectiveness, and once the evaluation is complete, you’ll have a deep and wide understanding of employee learning during training.
Looking for an eLearning platform to evaluate employee training?
Create training assessments and surveys with TalentLMS.
The training platform that users consistently rank #1.
This model is the same as Kirkpatrick’s (see technique above), but with an extra step. The fifth step of the Phillips ROI model is to evaluate the program’s Return On Investment (ROI). To do this, you need to measure the difference between your training cost and training results.
When the results of training are so great that they exceed the cost, then you’ve achieved a positive training ROI. You can pat yourself on the back and continue the great work.
When the cost of training is larger than the results, something needs to change. But what?
The amazing thing about using methods like the Phillips ROI model is that it’s easy to spot the areas that need improvement. Let’s look at an example:
Imagine that you measure positive results at steps 1 and 2 of the evaluation process, but not at steps 3 and up. This tells you that learners enjoyed the training experience (step 1), and that they demonstrated new knowledge and skills when they were tested after training (step 2). However, when it came to changing their behavior in the workplace (step 3), something went wrong.
You might do some investigation and discover after your training evaluation that managers aren’t encouraging employees to practice their new skills on the job. Maybe they’re even discouraging it. Once you fix that broken link in the chain by getting managers to support training, your ROI improves.
Kaufman’s model is another one of the training evaluation methods that takes Kirkpatrick’s approach a step further. You can think of this model as Kirkpatrick’s, but with a twist. This is what it looks like in practice:
The main advantage of using Kaufman’s Five Levels, rather than Kirkpatrick’s Four Levels, is Step 1a. Evaluating the benefits of training against the resources invested in training gives you ROI. And the great thing about ROI is that it can be a very persuasive tool when requesting more training resources from company leaders.
This model could be difficult to apply in reality, particularly when it comes to step 5. If you’re wondering how to evaluate a training program in a way that’s more focused on your business strategy than society as a whole, this next one’s for you.
This is one of the training managers’ favorite training evaluation methods for training, because it helps them keep their business strategy a priority. And what happens when your training directly supports your strategic priorities? Success!
The easiest way to explain this technique is with an example.
Imagine that a private healthcare facility only has enough staff and equipment to treat 100 patients with the level of care they promise. Now, suppose that their training manager develops a program to help the marketing team win new patients.
If the training is effective, and many new patients are admitted to the facility, the business is at risk of taking on too many patients. The increased volume might have a negative impact on the level of care patients receive, which could damage the facility’s reputation.
On the other hand, a training program that gives nurses the knowledge and skills to avoid waste, and thus reduce costs, would benefit the business. So, quite simply, this model ensures that training is delivered (and evaluated) where it’s needed the most.
If you’re interested in this technique, then follow the three stages of Anderson’s Model:
If you’re not satisfied with the ROI measured in stage 3, then it’s time to make some improvements to your training programs.
A thorough evaluation will give you the best insight into the drawbacks of your training. So, it’s important to know how to assess a training program both while it’s being developed (formative evaluation), and after it’s been delivered (summative evaluation).
Let’s dive a little deeper.
Formative techniques of training evaluation aim to catch problems (and fix them) early on, before they negatively impact learning. For example, before a new course is delivered, you might run a user-acceptance test to ensure that the platform is user-friendly. Or, you could ask a Subject Matter Expert to evaluate the course content against the difficulty level of training assessments.
Summative techniques are also known as post-training evaluation techniques, because they happen after training is completed. Typical examples include Kirkpatrick’s four levels of training evaluation and Anderson’s model of learning evaluation.
Evaluate employee training and help your teams reach success
Create post-training evaluation in no time with TalentLMS.
The training platform that users consistently rank #1.
This model consists of four steps: context, input, process, and product. It’s an evaluation method to assess and improve programs, including training programs. Daniel Stufflebeam developed this cyclical and iterative process to focus on evaluating programs while considering many aspects.
When the training evaluation at each stage is complete, the findings are used to make adjustments and improvements if necessary. This method allows managers and HR experts to ensure the training program remains responsive to changing needs. Or it is being continuously improved over time to achieve better outcomes and enhance the training effectiveness.
Here’s how it works:
This evaluation method focuses on understanding and interpreting non-numerical data. For example, interviews, focus group discussions, open-ended survey responses, written reflections, and other narrative data. The effectiveness of training programs is being evaluated by exploring participants’ experiences, perceptions, and qualitative changes in behavior or attitudes.
Qualitative data analysis offers a deep and rich understanding of participants’ experiences. It offers insights that quantitative methods may miss. Managers uncover the “why” and “how” behind changes in participants’ attitudes and behaviors. This contributes to a more comprehensive assessment of the training program’s effectiveness.
Let’s explore how qualitative data analysis works:
Before you evaluate the effectiveness of your employee training program, you need to decide what the indicators of “effectiveness” are. Is training a success when employees become better at their jobs? Or is a happier, healthier company culture a sign that training is working? Is it, maybe, both?
The point is, you’ll probably want to include more than one measure of training effectiveness. The more measures you include, the more information you’ll have to help you improve your program.
Let’s explore which are the training effectiveness measures you should focus on.
When it comes to learning, training is the pillar. For example, if you were training sales staff in persuasion techniques, you’d want them to be more persuasive when the training is over. This makes the acquisition of new skills and knowledge one of the top measures of training effectiveness.
The measure of knowledge and skills development is sometimes referred to as “learning performance” because it relates to an employee’s performance as a learner rather than their performance on the job. There are lots of easy ways to evaluate learner performance using a learning management system (LMS), but we’ll discuss those in the next section of this article.
One measure of training effectiveness that’s often overlooked, even when using the best types of training evaluation methods, is the learning experience. Why does this matter? Because when the learning experience is poor, employees are less likely to engage with training content, which means that they’re less likely to learn the skills that will make them better at their jobs.
This, of course, is a big problem. In fact, it could result in loads of time and resources being wasted on a training program that never achieved its objectives. So, be sure to measure employees’ perceptions of training delivery and content. Their post-training feedback could be one of the best ways to measure training effectiveness, offering the best tips for improving your training.
Did you know that for many employees, learning is the number one reason they feel happy at work? This is because learning helps employees to grow and develop, and often opens up new career opportunities, too. Wouldn’t that make you happy?
And the great thing about happy employees is that they tend to work harder, stay committed for longer, and produce better results. So, while employee happiness might sound like a strange indicator at first, it’s actually one of the best results you can hope to see for your business.
If you’ve never considered measuring the impact of training on your company’s culture, it’s time to start. Culture is the special ingredient that makes your business unique in a highly competitive world. So, you need to protect it with training that fosters workplace norms and values that are good for business.
When you deliver employee onboarding training, sensitivity training, or anything else that might impact culture, make sure to evaluate success based on culture. You can do this by looking for changes in the number of HR complaints (for example, harassment) after training, or assessing peer review scores for teamwork and positive attitudes.
So far we’ve mentioned four measures to use when you evaluate the impact of your employee training program, but none of them are business results. So, for this next measure we’ll look at the impact of training on the efficiency of employees or teams.
Efficiency can be measured in different ways depending on your industry and the specific department you’re training. For example, a manufacturing company might train their assembly line staff on new equipment, and then measure how many more units can be completed per day. On the other hand, an online tech business could measure how many tickets their customer support team closes after completing a training program.
Finally, it’s crucial to evaluate the real impact of a company’s employee training program on its financial position. The real economic impact of your training can be measured by changes in revenue and profit.
When training is successful, and all the measures of training effectiveness you use show positive results, then you should see an increase in sales and income, or a reduction in costs – or both. When it’s both, you’ll certainly also benefit from a rise in profits.
You wouldn’t measure length with a thermometer, right?
So, before you start collecting information about the results of your training, make sure that you have the right tools for the job. Here are some of the most common training evaluation tools to choose from. Feel free to use more than just one to measure training effectiveness and track employee training.
This is the process of observing employees as they complete a task or process, or engage in a team activity. Often, the observer will use a journal to record what they see (it’s true, even the best evaluators can’t remember everything!).
There are many advantages to using observation as a training evaluation tool. You get to observe learning and behavior changes in a real workplace setting, and it costs nothing more than the observer’s time. It also tends to be more accurate than self-report questionnaires which can be biased, or influenced by poor memory.
Still, this tool has some downsides. First, you need to find someone objective and knowledgeable with enough time on their hands to watch each employee for an hour or more. Then, even if you find an observer, there’s the risk that employee behavior will change simply because they know they’re being watched. This can skew the results.
Sometimes, though, observation is the best tool. This is especially true when behavior changes aren’t easy to measure quantitatively. For example, sales skills are easy to measure by the number of sales an employee makes. Creativity, on the other hand, is tough to measure on the job. So, observing an employee’s creative ideas and input during meetings is a good solution.
Tests are a great way to measure changes in knowledge and skills, and they come in all shapes and sizes. Written assignments can be time-consuming to grade, but luckily the right LMS will give you the tools to create automatically-graded quizzes that are fun and interactive, too.
Want to test learner knowledge and evaluate training?
Create automatically-graded, fun and interactive tests with TalentLMS.
The training platform that users consistently rank #1.
Perhaps the best part about tests is that you can measure a specific skill or knowledge area without the distraction of being observed. For example, you could measure a medical sales rep’s understanding of a new product with a few multiple-choice questions completed in a private and quiet environment. Plus, once you’ve set up a quiz on your LMS, you don’t have to invest any more time into this tool.
But there’s a catch. Tests usually don’t measure knowledge and skills in the same environment in which they’ll be used—the workplace, that is. So you won’t know whether an employee is able to apply what they’ve learned when there are other distractions and pressures at play.
It’s also worth mentioning that tests aren’t the best measure for skills like persuasion, which are better assessed in practice (think role-plays). And when it comes to skills for high-risk jobs, like pilots and surgeons, tests aren’t enough on their own. More realistic training assessments, like simulations, are necessary, too.
Perhaps one of the most common training evaluation tools and techniques used today is the survey. A survey, or training evaluation questionnaire, collects data through a series of questions, usually in the form of multiple choice.
Why are surveys so popular? Probably because they’re highly efficient to measure training effectiveness. You can design one survey, and send it out to millions of employees at the click of a button. If your survey is delivered via your employee training software, it gets even better, because you can access the results as an easy-to-interpret and downloadable report.
There’s just one important limitation that you should know about: not many people like questionnaires. 45% of people are not willing to spend more than 5 minutes filling out a feedback survey. So it’s important to explain to employees that surveys help you improve training, and that you really do want to hear their feedback.
Because surveys ask for people’s perceptions and opinions, rather than hard data, this tool is best suited to measuring how successful the learning experience was. You can ask employees what they liked about training, whether the platform was easy to use, and if the content was useful to improving their work.
Interviews can be conducted face-to-face or online for training evaluation. But either way, they’re as effective as questionnaires—and even more so. Why? Because not only can you ask employees a set of questions, but you can answer their questions and delve deeper into their responses, too. This flexibility often means that you get more valuable and detailed information from employees about their training.
Unfortunately, the same flexibility can result in a few problems for this evaluation tool. Each interview has to be conducted separately, which means that you lose valuable time that both the employee and the interviewer could be using to get work done. Plus, if each interview includes slightly different questions, it can become tricky to compare or summarize results.
Still, if you’re exploring the reasons behind other results, this is the tool to do it. For example, if most employees rate the learning experience poorly on a questionnaire, then interviews could help you find out why. Or, if they rate the learning experience favorably, but don’t improve on-the-job performance, you could use interviews to identify the reason for this gap.
Focus groups are carefully facilitated discussions among a small group of employees who all completed the same training. These are great tools for exploring what employees think and feel about training, and to get suggestions for future improvements.
Of course, focus groups are a little less time-consuming than interviews, because you can question a number of people at the same time. A group dialogue can also lead to deeper conversations about topics that might not have been explored in a one-to-one setting.
This makes interviews a particularly effective way to unpack obstacles to training success, and to explore ideas for improvement. Just watch out for group conflict or any other dynamics that could damage your ability to gather constructive information about training.
If training doesn’t improve job performance, it isn’t working. So, performance records are surely an important measure to include in any training evaluation. The performance records you choose to use will depend on your training. But some common examples are deals closed, support tickets solved, units made and customer satisfaction ratings.
The biggest advantage of performance records is that they’re based on numbers, not opinions. This makes them free from bias, and a trusted source of information to judge your training success by. Plus, if your LMS software integrates with your HR tool, you can compare training and performance records more easily.
The only downside when it comes to performance records is that they sometimes create more questions than they answer. Yup, performance data shows you where a problem exists, but not why it exists. So to get to the bottom of “why”, you’ll need to leverage more qualitative tools, like interviews or focus groups.
If excellent training results are a top priority for you, then you need to find ways to continuously improve your training program. Just follow the three steps in this article.
Start by deciding on a training evaluation method, then select your measurements, and choose the right training evaluation tools. Once you’ve set up the right method for you, it will be much easier to evaluate and improve your employee training program. And your colleagues will be celebrating your training success in no time!
Save time, frustration and money with TalentLMS, the most-affordable and user-friendly learning management system on the market. Try it for free for as long as you want and discover why our customers consistently give us 4.5 stars (out of 5!)
Originally published on: 13 Nov 2019 | Tags: Corporate Training,Employee Training
Elena blends real-world data and storytelling for impactful L&D and HR content. Always on trend, her engaging work addresses today's needs. More by Elena!
