SHIFT's eLearning Blog

Our blog provides the best practices, tips, and inspiration for corporate training, instructional design, eLearning and mLearning.

To visit the Spanish blog, click here
    All Posts

    Beyond Business Impact: Evaluate Whether Learning Objectives Are Being Met


    Discover the “AJA” insights behind learning impact evaluations. 

    After so much time and effort spent creating an eLearning course, one of the most critical steps following its creation is evaluation. Determining how well the course is performing and where it can be optimized is key to have a greater impact.

    It used to be enough to evaluate the course’s success through efficiency (course completion) and ROI (saved time and money in the development process). However, this traditional method is limited as it reveals very little about what is going on between the course and its learner.

    Our times allow for different methods of evaluation. In this post, we invite companies to consider going beyond ROI-only based metrics to LEARNING & PERFORMANCE based insights.



    SHIFT2-blog-images-evaluation

    1) If you wanna win the game, focus on the ball

    Depending solely on ROI will merely give you an overall take on whether the eLearning program is working as a whole. You won’t be able to leverage where the TRUE VALUE is coming from and worse than that, you won’t be able to see things on a granular level. So what’s bad can’t be bad, and what’s good can’t be built off or replicated.

    If you know program A and method B work, you can continue to use those formats and cut the rest.

    Some questions you might actually want to answer are:

    • What courses/modules are being taken by whom?
    • How often are they going back to review the course?
    • Which elements/approaches seemed most popular? Do they enjoy watching videos or prefer downloading podcasts?
    • Where are they accessing the learning? From smartphone, tablet or laptop?
    • Which courses/modules have the greatest completions?
    • What are the programs that are most leading to behavioral changes?
    • In what formats are those (more successful) programs in?

    For example, learning that the shorter (microlearning) courses have higher completion rates and better reviews by students provides direction for future formats and courses. Besides giving you insights on what your learners prefer, this can also result in a change in production hours and a drop in employee course hours, all of which will lead to lower costs and all of which will eventually be reflected on your bottom line. 

    We all love information because it gives us a better idea of where we stand. It’s from there that we can set goals and make an effort in a direction for the desired outcome. Things come up, and insights are required to make it work. 

    Some other examples of how granular insights can go a long way:

    • If you can identify where learners are trying to cheat the system, (aka. skipping through content), there is a learning opportunity there for you to make a change.
    • If you learn that there is particular day or time for incompletion rates, this provides an opportunity to able some easy changes that might reduce dropouts.

    The bird’s eye view of your efforts isn’t going to help you make the play by play decisions that you need to win the game.

    Recommended read:  E-Learning Evaluation: Did they like it, did they learn from it, did they change? 

     

    2) Evaluation: Before, During & After the Learning Event 

    Rest assured that there are different points of entry to establish a learning impact method of measurement.

    Before launching: You can create pre-evaluations (self-assessment surveys, pre-tests, blogs, reading assignments with questions) that will align the material with the learning objective.

    During learning: Placing evaluations after every lesson is very common in many of the learning apps that learners are already exposed to on their phones. Microlearning apps have done a great job of placing these formative evaluation tools right after learners receive information. This helps emphasize the objective of the lesson and requires an immediate recall.

    Post-learning: Design a summative evaluation for the learner to take after the entire lesson has been completed. This will help you gauge how each learner is performing. There are two commons ways of doing this: a checklist format measuring the number of questions answered or completed correctly or a rating scale, measuring what they achieved and how well this was done.

    Recommended read: How To Measure eLearning Performance: The New Way To Build Evaluation Into eLearning

    3) Advanced Evaluation Techniques

    Many instructional designers don’t move past the previous point, but once you establish the analysis above, you can consider taking things a bit further. Though assessments are excellent for evaluating recall, you are still not determining whether your learner is actually applying the skills correctly back at his/her job.

    You need to evaluate PERFORMANCE - how much trainees actually change their behavior based on what they learned when back on the job

    An example of how to do this:

    A simpler way to determine the applicability of the lesson is to ask learners to apply the skills/concepts that they have learned to resolve specific, real-life issues. Ask them to perform a punctual task when they finish the course to “force” them to put the knowledge into practice.

    Think what are some of the precise job-related scenarios that you can present so they can apply what they’ve learned?

    Then evaluate:

    • Were the knowledge and skills shared with learners reapplied in their roles?
    • Did this training contribute to the overall improvement of their everyday tasks?
    • Were there noticeable changes in performance after the training? Surveying supervisors on employee improvement can be a way to verify this.
    • Was the new information applied and sustained? Measure employee performance 3 to 6 months after training to make sure that these learnings are long-term adjustments. 

    Applying these exercises will open a window to “AJA” moments that will help you know how your employees and your training are clashing or aligning. 

    Also read: 

    Do You Know How Successful Your eLearning Program Really Is?



    There are many reasons that companies focus on ROI to measure impact. Many stick to this method because it’s what they’ve always done. Others don’t know how to make the shift. Though valid, these are still just barriers to knowing what you are investing in and how to improve that investment. Going beyond ROI might help the ROI go up.

    Winning eLearning



     

    Related Posts

    The Forgetting Curve: Why Your Training Is Erased Within a Week — and How to Stop It

    Learning Science & Retention Your people don't have a motivation problem. They have a memory problem — and a 140-year-old experiment maps it precisely. Here's what the science says, and what to do about it on Monday morning. Picture the last mandatory training your organization ran. The completion dashboard glowed green. People passed the quiz. Leadership checked the box. Now ask an uncomfortable question: how much of it could those same employees actually use two weeks later? If the honest answer is “not much,” you're not looking at a failure of effort or attention. You're looking at a fundamental property of the human brain — one that was measured, plotted, and published before the light bulb was in common use. It's called the forgetting curve, and until your learning strategy accounts for it, you are quietly paying to fill a bucket that has a hole in the bottom. A 19th-Century Experiment That Still Governs Your Training Budget In the 1880s, a German psychologist named Hermann Ebbinghaus decided to do something no one had tried: measure memory itself. He created hundreds of meaningless three-letter syllables, memorized them, and then tested how much he could recall after 20 minutes, an hour, a day, and beyond. He plotted the results. What he found has a shape every executive would recognize as a problem: memory doesn't fade gently and evenly. It collapses fast at first — the steepest loss happens within hours of learning — and then the decline slows as whatever survives settles in. Draw it on a graph and you get a cliff, not a gentle slope. Here is the version that matters to anyone responsible for a workforce: 100% 75% 50% 25% 0% Knowledge retained Day 0 Day 1 Day 3 Day 7 Day 30 Time after training review review review One-and-done training Training + spaced reinforcement The red line is what most corporate training buys: a steep drop-off in the days after the session. The green line shows the same content reinforced at spaced intervals. Each review lifts retention back up — and each time, the memory decays more slowly than before. The curve gets flatter with every touch. The important detail isn't the exact numbers on the axis — those vary by person, by material, and by how meaningful the content is. The important detail is the shape. Learning delivered once, then never revisited, follows the red line down. And no amount of polish on the original session changes that trajectory. A beautifully produced course that is never reinforced forgets just as fast as a boring one. This Isn't a Theory. It Has Been Replicated for 140 Years. It would be fair to be skeptical of a result from the 1880s built on one person memorizing nonsense syllables. So it's worth knowing that Ebbinghaus's curve is one of the most durable findings in all of psychology. A rigorous 2015 replication reproduced his forgetting curve closely, confirming that the basic shape holds up under modern methods. More importantly for organizations, the solution the curve implies has been tested far more broadly than the curve itself. A landmark scientific review synthesized 317 experiments on how the timing of practice affects memory. The conclusion is one of the most consistent in learning science: spreading learning out over time produces dramatically better long-term retention than cramming it into a single session. Same content, same total time — different result, purely because of when it was delivered. 317 separate experiments, synthesized in one landmark review, point to the same conclusion: spaced learning beats massed learning for durable retention. This is not a trend or a vendor claim — it is settled science. “The single most under-used lever in corporate learning isn't better content or bigger budgets. It's timing. When you deliver training is as decisive as what you deliver.” Why the Standard Corporate Training Model Fights the Brain Most organizational learning is designed almost perfectly to sit on the wrong line of that graph. Consider how a typical program works: 1 It's an event, not a process A half-day workshop, an annual compliance module, a one-time onboarding marathon. The brain treats a single exposure as low-priority information and prunes it — exactly as the curve predicts. 2 It front-loads everything Cramming a year's worth of policy into one sitting feels efficient and is the opposite. Massed delivery is the single fastest way to guarantee the steep red curve. 3 It measures completion, not retention A 95% completion rate tells you people sat through the content. It says nothing about whether they'll remember it when the moment to apply it arrives — which is the only thing that affects performance. 4 It never comes back Without a deliberate second, third, and fourth touch, there is no mechanism to interrupt forgetting. The reinforcement that flattens the curve simply never happens. The result is an expensive illusion of learning. The activity is real. The lasting capability is not. And because the forgetting happens quietly, weeks after the training when no one is looking, the loss rarely shows up on any report. What Working With the Curve Looks Like Instead The good news hidden in the forgetting curve is that it also hands you the fix. Every time a memory is retrieved and reinforced, it decays more slowly afterward. So the entire game becomes: interrupt the drop-off, at the right moments, with the least possible friction. Here is how that translates into practice. The event model (fights the curve) The reinforcement model (works with it) One long session, then silence A short initial session, then spaced follow-ups over days and weeks Passive re-reading of slides Active recall — a quick question that forces the brain to retrieve the answer Everyone reviews everything People revisit what they got wrong, not what they already know Training lives in a separate portal Reinforcement arrives in the flow of work, in two-minute doses Success = course completed Success = knowledge still there weeks later, and visible in behavior 1. Turn the event into a sequence The most powerful change costs almost nothing: stop thinking of training as a day and start thinking of it as a campaign. A 40-minute course followed by three short reinforcement touches over the next month will outperform a two-hour course followed by nothing — with less total seat time. 2. Make people retrieve, not re-read Reinforcement works because the brain has to pull the answer out, not because it sees the content again. A single well-placed question — “What's the first step if you spot this?” — does more for retention than re-watching the whole module. Build retrieval into every touch. 3. Space the touches, then widen the gaps Revisit new material soon after the first exposure, then let the intervals grow — a day, then several days, then a couple of weeks. As the memory strengthens, it needs reinforcing less often. Each cycle buys a flatter curve and a longer runway. 4. Personalize what gets reviewed Forcing a top performer to review what they already know wastes their time and erodes goodwill. Reinforcement should concentrate on each person's weak spots. This is where the reinforcement model stops being a scheduling exercise and starts requiring a system that can adapt to the individual. Key Takeaway The forgetting curve is not a reason to spend more on training. It's a reason to spend differently. The organizations that win aren't the ones with the biggest course libraries — they're the ones that reinforce a smaller amount of content at the right moments, so it actually survives. The Business Case Is Simpler Than It Looks Strip away the neuroscience and the argument for organizations is blunt. If most of what you teach is gone within a week, then the true cost of one-and-done training isn't the price of the course. It's the price of the course plus everything that goes wrong because the knowledge wasn't there when it counted — the compliance miss, the safety lapse, the sales conversation that fell flat, the new hire who takes twice as long to become productive. Reinforcement doesn't just improve a training metric. It's the difference between learning that changes what people do and learning that briefly changes what they can recite. For any leader who has ever wondered why a well-run training program didn't move performance, the forgetting curve is usually the answer — and the reinforcement model is usually the remedy. How SHIFT Helps You Beat the Curve This is precisely the problem SHIFT was built to solve. For nearly three decades, we've helped global organizations move learning off the steep red line and onto the flatter green one — not with more content, but with smarter delivery. Our AI-powered ecosystem is designed around how memory actually works: create engaging learning fast, then reinforce it with spaced, retrieval-based touches that adapt to each learner and reach them in the flow of work. Instead of a single event that fades by Friday, you get a sequence engineered to make knowledge stick — and the measurement to prove it did. 1 Built for reinforcement, not just delivery Learning is designed as a sequence of well-timed touches, so retention is engineered in from the start rather than hoped for after the fact. 2 Adaptive by design Each learner spends their time on what they haven't yet mastered — the personalization that makes reinforcement efficient instead of tedious. 3 Proven at global scale Six million people trained across more than 43 countries, backed by nearly 30 years of eLearning expertise and roughly 20 industry awards. This is battle-tested, not experimental. Stop paying to be forgotten. See how SHIFT turns one-and-done training into learning that survives the forgetting curve — and shows up in performance. Request a Demo The Bottom Line Ebbinghaus proved something in the 1880s that most organizations still ignore in the 2020s: without reinforcement, learning evaporates, fast. The forgetting curve isn't a footnote in a psychology textbook. It's a line item in your budget — the invisible cost of every program that ends the moment the session does. You can't switch off forgetting. But you can decide which curve your people ride. The question isn't whether your training is being forgotten. It's whether you're going to do anything about it. Sources: Ebbinghaus, H., Über das Gedächtnis (1885) • Murre, J.M.J. & Dros, J., “Replication and Analysis of Ebbinghaus' Forgetting Curve,” PLOS ONE (2015) • Cepeda, N.J., Pashler, H., Vul, E., Wixted, J.T. & Rohrer, D., “Distributed Practice in Verbal Recall Tasks,” Psychological Bulletin (2006)

    Every Employee Now Has a Tutor That Never Sleeps. The Question Is Who Controls It.

    The most important shift artificial intelligence brings to corporate learning is not that it can generate a course in minutes. It is that, for the first time, every employee in your organization can have something that used to be reserved for executives and elite athletes: a patient, always-available coach that answers the exact question they have, at the exact moment they have it.

    Your Best Knowledge Shouldn't Train Someone Else's Model

    Every organization is quietly sitting on a body of knowledge it spent years and serious money to build: the way it onboards people, the methods that make its training work, the hard-won answers to questions customers actually ask, the playbooks that separate it from competitors. For most companies, that knowledge lives scattered across documents, courses, recorded sessions, and the heads of a few experienced people.

    {{ footer_js() }} {{ js_integration_body_end() }}