ISO Consultants Explain Why a Satisfaction Score Isn’t Evidence That Anyone Learned Anything

Ask an education or training provider how they measure quality and the answer is usually a number between four and five out of five.

It’s the most collected metric in the sector and one of the least informative. As ISO consultants, we see it in training files, supplier records and vendor proposals. Whether a company buys training in India, the Philippines or Nigeria, a score of 4.6 looks like proof of quality. It measures something else. 

What does a satisfaction score actually measure?

A satisfaction score measures experience: whether people felt the session was worthwhile, the trainer was engaging, the room was comfortable, and the coffee arrived. Those things affect attendance, completion and reputation. What the score doesn’t measure is acquisition, meaning whether anyone learned the skill and kept it.

A provider with poor scores has a real problem. But the link between enjoying a session and retaining its content is weak, and it sometimes runs the wrong way.

A well-known meta-analysis of face-to-face training found a correlation of just 0.02 between affective reactions and immediate learning. A later one found reactions were only modestly related to immediate knowledge and unrelated to delayed knowledge. 

Sessions that feel fluent and effortless can produce less durable learning than sessions that require struggle, because the struggle is part of the mechanism. In a randomised physics course study, students in active classrooms learned more but felt they had learned less. The authors argue that extra effort gets read as poor learning, while smooth lectures create an illusion of learning. That was a university course, not workplace training, but it’s a useful warning.

Why do training providers keep using satisfaction scores?

Because it’s easy, it’s immediate, and it usually produces a flattering number. You collect it at the end of the session while everyone’s in the room and feeling positive. Measuring learning takes more effort and more time, and the numbers are sometimes uncomfortable.

Reaction surveys are the most commonly used type of training evaluation. Kirkpatrick’s model assumes satisfaction leads to learning, yet tests show only limited support for that link. Buyers are increasingly aware of this. 

What should you measure instead of satisfaction?

Measure learning in four ways, in ascending order of usefulness: pre- and post-assessment, demonstrated competence, application at ninety days, and outcomes at organisation level. Each costs more than a survey and tells you more. Together they show whether training landed or evaporated.

Pre and post assessment. This is the simplest real measure. Assess the same capability before and after. The gap is the learning. It’s cheap to run and shows at once which parts of a programme work.

Demonstrated competence. The learner performs the task under observation against a defined standard. It costs more and convinces buyers far more. For practical skills, it’s the only sensible measure.

Application at ninety days. Ask the learner and their manager what has actually been used since. This is where training either landed or evaporated, and almost nobody measures it.

Outcome at the organisation level. Did the thing the training was meant to change actually change? It’s the hardest to attribute and the most valuable when you can.

What happens the first time you measure learning gain properly?

The results are usually mixed. Some modules produce strong gains and some produce almost none. That isn’t a failure of the measurement. It’s the measurement working, and it’s the information you need to improve the programme. Providers who stop at satisfaction never find out which parts of their offering carry the rest.

What do ISO 9001, ISO 14001 and ISO 45001 expect from training?

All three standards have a competence clause, 7.2 in the 2015 and 2018 editions. It asks you to take action to gain or keep competence, then evaluate whether the action worked. A satisfaction score doesn’t show that. ISO 45001 goes further: you need to show a worker can do the task safely.

Under ISO 9001 clause 7.2, you must evaluate the effectiveness of actions taken to make people competent. ISO 45001 clause 7.2 uses the same idea, asking you to take action to acquire and maintain competence and evaluate the effectiveness of those actions. In practice, that means checking whether training actually left the worker able to perform tasks safely and correctly. ISO 14001:2015 and ISO 45001:2018 both carry a clause 7.2 on competence.

The editions are moving. ISO 9001:2026 was published on 16 September 2026. Companies certified to 2015 have until 30 September 2029 to transition. A new edition of ISO 45001 is expected in 2027. Check the clause text in your own copy of each new edition. 

Which industries feel this most?

Medical device companies feel it most, because ISO 13485 clause 6.2 and the FDA’s QMSR both expect effectiveness checks. IT companies feel it under ISO 27001, where the effectiveness step is often missed. Manufacturers, importers, distributors and startups in India, the Philippines and Nigeria all face the same audit question.

ISO 13485 clause 6.2 asks you to evaluate the effectiveness of the actions you take to build competence. The standard doesn’t say how. That’s your call. A note says the method should be proportionate to the risk of the work. The FDA’s Quality Management System Regulation took effect on 2 February 2026 and incorporates ISO 13485 by reference. 

For IT teams, ISO 27001 clause 7.2 also requires you to evaluate the effectiveness of actions taken. Examples of a success check include an assessment score, a practical exercise such as a tabletop, or a supervisor sign-off after thirty days of observed application. That last one is the ninety-day idea in a different shape. 

What should you do with satisfaction data?

Keep collecting it, and report it as what it is: a measure of learner experience. Stop presenting it as evidence of educational quality. The buyers who matter have stopped accepting it, and the rest will soon. It still helps you spot problems with venue, pace and trainer delivery.

What advice do MSCi’s ISO consultants give?

Our advice is practical. Most weak training systems collect plenty of paper and very little proof.

• Define competence per role before you pick the course. Write down what the person must be able to do. Training comes second.

• Match the check to the risk. A quiz may suit a simple, low-risk task, while a high-risk activity needs a deeper test of understanding or performance. 

• Run a pre-test. If people already pass it, you may not need that module.

• Schedule a ninety-day check with the manager and file it in the training record.

• Keep satisfaction scores in a service-quality file, not in your compliance evidence.

• Expect the first results to be mixed. Treat weak modules as the finding, not the failure.

•

How can ISO consultants help you prove training works?

MSC Incorporation (MSCi) is an ISO consultancy with 40+ years of experience in ISO consultation. Our ISO 9001 consultants and ISO 45001 consulting services in India, Nigeria & worldwide cover competence matrices, training effectiveness checks, gap reviews against an ISO 14001 readiness checklist, and internal audits. Check out the free ISO 14001 checklist at: https://mscincorporation.com/iso-14001-2015-readiness-checklist-free/ 

We prepare your company for the audit. We don’t issue certificates. An independent accredited certification body does that.

5. Frequently Asked Question answered by an MSCi’s Expert Consultants

Does ISO 9001 require me to evaluate training?

Yes. Clause 7.2 in the 2015 edition asks you to evaluate whether actions taken to build competence worked. ISO 9001 consultants usually look for a test, an observed task or a manager sign-off.

How do I show training worked for ISO 45001?

Show that the worker can perform the task safely, not only that they attended. Observation against a defined standard is the strongest evidence.

What should an ISO 14001 readiness checklist cover for training?

It should cover competence for the people whose work affects your significant aspects, with proof the training worked. Add a date for the follow-up check.

How do ISO certification consultants review training records?

They look for defined competence by role, proof the training happened, and proof it worked. A signed attendance sheet shows an action was taken, not that competence resulted. 

Does this apply if I hire ISO consultants in the Philippines?

The competence clauses read the same wherever you’re certified. Local regulators and export markets add their own rules, so check which ones apply to you.

Can MSCi help with training evidence?

Yes. MSCi’s ISO consultants build competence matrices and effectiveness checks, then test them in a gap review before your certification audit. 

ISO 14001:2026 (official): https://www.iso.org/standard/92300.html

ISO 14001:2015 (official, now withdrawn): https://www.iso.org/standard/60857.html