Custom eLearning Custom eLearning
  1. What We Do
    Custom eLearning Learning Consultancy Performance Campaigns Mobile Learning Performance Support Microlearning
    Video and Animation Rapid eLearning Games & Gamification Flash-to-HTML ILT and VILT Value Added Services
  2. Our Work
  3. Insights
    Ebooks Whitepapers Reports Presentations Case Studies Webinars Infographics Newsletters
  4. Who We Are
    About Us Leadership Awards Press Releases Clients Career Contact Us
  5. Let's Talk
  • What We Do
    • Custom eLearning
    • Learning Consultancy
    • Performance Campaigns
    • Mobile Learning
    • Performance Support
    • Microlearning
    • Video and Animation
    • Rapid Learning
    • Games & Gamification
    • Flash-to-HTML
    • ILT and VILT
    • Value Added Services
  • What We Are
    • About Us
    • Leadership
    • Awards
    • Press Releases
    • Clients
    • Careers
    • Contact Us
  • Our Work
  • Insights
    • Ebooks
    • Whitepapers
    • Reports
    • Presentations
    • Case Studies
    • Webinars
    • Infographics
    • Newsletters

Stop Evaluating Training!

Amit Garg  |  May 2, 2013  |  eLearning

Home

Evaluating Training"So how do you evaluate the success of eLearning that you create?"

As a learning solutions vendor, I’ve been asked this question countless times and have also encountered it in many an RFP.

Proving the effectiveness of training and showing ROI is no walk in the park and still keeps L&D up at night.

Kirkpatrick’s evaluation model has long been the holy grail of training effectiveness measurement to businesses. My response to clients has typically been: If you are referring to Kirkpatrick Levels 1 & 2 it’s not very difficult; ‘smiley sheets’ will tell us about Reaction, and ‘assessments’ can help determine Learning. However, Levels 3 & 4 are not so easy to implement. Arriving at meaningful measures of behavioral change and demonstrating tangible results needs elimination of other influences on individual & business performance. Not to forget it takes months, if not years, to arrive at such conclusions with any certainty. Consequently, while many of our clients do ask, not many venture into it; and requiring organizational commitment and action as it does, it’s not something only we, as vendors, can entirely influence.

It is with this background that I found Professor Robert O. Brinkerhoff’s (who I had an opportunity to listen to at the AITD conference in Melbourne in April 2013) arguments very compelling. The key message from his talk was to Stop Evaluating Training the way we currently tend to.

Rather, he advises organizations to align training with business goals and evaluate all elements that go into achieving those goals with a focus on improving the impact.

According to Professor Brinkerhoff, an alarming 57% of firms failed to effectively implement strategic initiatives over the last 3 years. He also says that research suggests that less than 20% of trainees actually apply their learning in their work in a way that produces concrete and worthwhile results aligned with business strategy. The rest is ‘unrealized value’ of training.

Why is this happening? Why are we unable to use training effectively to achieve organizational goals? Here are some reasons that training commonly fails.

Reasons For Training Failure
(From Professor Brinkerhoff’s Presentation)

Do any of these apply to your organization? If you find most of your reasons coming from the left or the right column, you’re not alone. Both these list crucial elements in helping training achieve its real goals.

So here’s what Professor Brinkerhoff recommends to improve the effective use of training in our workplaces.

  1. Clearly communicate strategic goals and associated linkages throughout the organization. Each individual should know how their task fits into the bigger picture.
  2. Don’t just offload training responsibility and accountability onto L&D. Look at training as a business driver rather than a staff benefit, and L&D as a consultant who truly wants to help you improve your department’s performance.
  3. Provide training that addresses the knowledge and skills required for the adoption of strategic initiatives and the execution of strategic change.
  4. Look at learning events differently. One of the biggest problems is being stuck in a mythical view where ‘training’ is seen as completely encompassed in learning events, based on which returns are expected.
learning-event-return
(From Professor Brinkerhoff’s Presentation)

But in reality, training comprises not just the learning events themselves, but also what comes before and after them.

before-after-training-event
(From Professor Brinkerhoff’s Presentation)
  • Before the learning event: A dialog between managers and trainees to establish an action plan for using the training.
  • After the learning event: Evaluation of training effectiveness through the Success Case Evaluation Method® in which training use and non-use cases are analyzed.

The diagram below summarizes Professor Brinkerhoff’s argument:

Learning to Performance Process

learning-to-performance-process

(From Professor Brinkerhoff’s Presentation)

You can read more about The Advantage WaySM Process and The Success Case Evaluation Method here.

And here’s Professor Brinkerhoff speaking at the Learning Technologies Show in London in 2013. It’s a 60-minute video but well worth your time.

The conclusion? If we continue to evaluate ONLY training the way we normally do, we’re not getting anywhere.

Upcoming Events

ASTD ICE 2013 | May 19 – 22 | Dallas, TX, USA | Stand #839

FREE eBook

Mobile Learning: A Quick Start Guide

Tweet
← Wearable Computing Technology In Learning 5 Reasons You Should Check Out Upside2Go’s New Version →

Comments ( One comment )

  1. Pingback: How do you evaluate the e-learning that you create? | Aspel Main

Write A Comment

Change text.

Subscribe for updates

Delivered by FeedBurner

Featured PostsTags
How to work together, be more creative, and think way ahead… Gamify!Shreyas KoradThe importance of gamification in an anxious workplaceAmit GargCuriosity keeps us alive, gaming and learningAmit GargMine the craft of gamification for business impactShreyas KoradFolding proteins as playShreyas KoradNew Brandon Hall eBook: Not Playing Around – Gamification of Workplace LearningMustafa HusainMicrolearning Thoughts – Conversations With Learning Leaders – Episode 3Amit GargMicrolearning Thoughts – Conversations With Learning Leaders – Episode 2Amit GargMicrolearning Thoughts – Conversations With Learning Leaders – Episode 1Amit Garg2020 – What a year!!!Mustafa HusainMicrolearning empowers your frontline to cope, convert and createAmit GargModel your measure on what fits you bestAmit GargThe mind science behind microlearningAmit GargA small nudge for the learner; a giant push to build a productive habitAmit GargeLearning Outsourcing: Key DriversAmit Garg… and they kept learning happily, safely ever afterAmit GargNick says learning needs serious unlearningAmit GargeLearning Outsourcing: Buyer-Provider PartnershipAmit GargA fresh new eBook: Microlearning – Go Beyond the HypeMustafa HusainNew eBook – The Learning Gauge: A Guide to Measuring the Business OutcomeMustafa HusainUpside Learning Certified as Smartchoice® Preferred Provider by Brandon Hall GroupMustafa HusainUpside Learning receives Great Place to Work – Certification™ for the second year runningSonal ShethWhy invest in learning when you don’t measure its returnsAmit GargeLearning Outsourcing: How to do it right?Amit GargNo More Dull, Drab, Boring Content!Mustafa HusainThe State of Learning MeasurementAmit GargThe overly abused and rarely understood world of leaderboardsShreyas KoradWhy Measure Impact of Learning Programs?Amit GargNew eBook to Super Charge your Sales TrainingMustafa HusainLXPs are possibly the Dungeons & Dragons of the Learning WorldShreyas KoradAll Aboard! Full Sales Ahead!Amit GargInteractive videos as an effective instructional tool!Sonal ShethWebinar: Going Beyond With Learning AnalyticsMustafa HusainExclusive Brandon Hall Report: Real Learning Measurement, Go Beyond Checking the BoxMustafa HusainWho will train the gig players?Amit GargBeing Viral: Our Top Content Releases (as per viewership) on Social ChannelsMustafa HusainUpside Learning Features in Training Industry’s Two Top 20 Companies Watch List for 2020Mustafa HusainConcept Maps as a VILT Teaching ToolSonal ShethImportance of Sharing Success Stories with Sales TeamVenkatesh ChandramowlyContent Presentation for a VILTSonal ShethUsing Gamification for Sales TrainingAmit YakhmiLearning as Survival Strategy after COVID-19Amit GargUpside Learning expands its footprint in EuropeSonal Sheth10 Things to Turn Your Boring Sales Training to an Online TriumphVikram TaydeFocusing on AudienceSonal ShethLearning the best way to get values training in playAmit GargWeighing eLearning vs. VILTSonal ShethViral Lessons About Compliance TrainingAmit GargChoosing to Conduct a VILTSonal ShethCan you play Flash after 2020? This is howShivaji Babar
Mobile Learning (140)eLearning (115)mLearning (98)Instructional Design (50)Game Based Learning (42)Technology (35)eLearning Development (35)Workplace Learning (33)Learning (26)Learning Games (26)Design (25)Upside Learning (24)Learning Design (22)eLearning Technology (21)Social Learning (20)ipad (19)DGBL (17)Best eLearning Links (16)augmented reality (15)eLearning Outsourcing (15)Games (14)HTML5 (14)Innovation (13)LMS (13)Responsive Authoring Tools (13)Mobile (13)UL Fun Cartoon (13)Future (12)IPhone (12)Future Learning (11)UL Fun e toons (11)Informal Learning (11)elearning weekly digest (11)Responsive eLearning (11)Flash (10)Development (10)Top eLearning Links (10)eLearning On Tablets (10)Learning Technology (10)Weekly Digest (9)Top eLearning Posts (9)Blended Learning (9)GBL (9)Mobile Learning Technology (9)eLearning Weekly Finds (8)Tablet Learning (8)Multi Device eLearning (8)eLearning Weekly Find (8)Mobility (8)elearning in a multi-device world (7)Learning and Development (7)Trends (7)Rapid Authoring (7)Training Outsourcing (7)Engaging eLearning (7)Custom eLearning (7)Performance Support (7)Mobile Technology (6)Casual Games (6)Serious Games (6)
eLearning Learning

Upcoming Events

Archives

Resources
Compliance Training: Stop Ticking the Box
Compliance Training: Stop Ticking the BoxesHave a compliance program that’s not as effective as you’d hoped? Or wondering where to start to design an effective one? Find the answers to all your queries in this eBook.
Read More and Download
The Ultimate Guide to migrating eLearning from Flash to HTML5
The Ultimate Guide to migrating eLearning from Flash to HTML5This eBook is meant for organizations who want to migrate their eLearning from Flash to HTML5.
View Recording
Tips for Designing, Testing and Delivering eLearning in a Multi-device World - eBook
Tips for Designing, Testing and Delivering eLearning in a Multi-device WorldA collection of highly useful tips on the various aspects of designing, testing and delivering multi-device/ responsive eLearning.
Read More and Download
  • Snow
  • Snow
  • Snow
  • Snow

GET INSIGHTS AND LEARNING DELIGHTS STRAIGHT TO YOUR INBOX, SUBSCRIBE TO UPSIDE LEARNING BLOG

Delivered by FeedBurner

Snow
Forest
Mountains
Mountains
Mountains

More from Our Resources

  • EBOOK

  • WHITEPAPERS

  • REPORTS

  • PRESENTATIONS

  • CASE STUDIES

  • WEBINARS

  • INFOGRAPHICS

  • NEWSLETTERS

WANT TO FIND OUT HOW OUR SOLUTIONS CAN IMPACT
YOUR ORGANISATION?
CLICK HERE TO GET IN TOUCH

Custom eLearning

Upside Learning Solutions Pvt. Ltd.

Punakar Complex, Survey No-117,
Bangalore Pune Highway, Warje,
Pune, India

Tel: +91-20-2523 6050 / 51 / 52

Email: elearning@upsidelearning.com

FOLLOW US

GO BEYOND
What is Go Beyond Compliance Training Sales Enablement Measuring Learning
Effectiveness
Mcrolearning Gamification
OUR PHILOSOPHY
Learning Strategy Solution Design and
Development
WHAT WE DO
Custom eLearning Learning Consultancy Performance Campaigns Mobile Learning Performance Support Microlearning Video and Animation Rapid eLearning Games & Gamification Flash-to-HTML Conversion ILT and VILT Value Added Services
WHAT WE ARE
About Us Our Work leadership Awards Press release Clients Careers Contact Us
QUICK LINKS
Insights Blog Submit a RFP Schedule A Call Client Login Privacy Policy

Copyright © 2021 Upside Learning Solutions Pvt. Ltd.