Having plenty of data doesn’t necessarily mean you know the answer. The dashboard looks good. People are logging in. Attendance is reasonable. Completion rates are moving in the right direction. Learner satisfaction is positive.
So is the English training working? Possibly.
Organisations investing in English training now have access to more information than ever. Platforms can tell us who logged in, how long they studied, which activities they completed and how they performed. Providers can report attendance, progression, satisfaction and completion.
All of that can be useful. The difficulty isn’t always a lack of information.
Sometimes it’s that the information comes from different places, measures different things and is interpreted by people who are understandably looking at the programme from different perspectives.
And that can make a surprisingly simple question difficult to answer: Is this actually working for us?
Start with why the training exists
Perhaps the most useful reference point is the reason the organisation invested in English in the first place. What was supposed to change? Employees dealing with international customers more confidently? Greater participation in meetings? Students being better prepared for academic study? International teams communicating more effectively? People becoming able to take on roles that previously required stronger English?
If the original purpose isn’t clear, almost any positive measure can begin to look like success. High attendance sounds good. So does completion. So does learner satisfaction.
But a programme can perform well against all three and still fail to address the reason it was bought.
A good programme can still be the wrong programme
This distinction matters. The teachers may be excellent. The learning design may be educationally sound. The technology may be impressive. The content may be engaging and professionally produced. None of those things guarantees that the provision is right for a particular organisation and its learners.
Employees who need to handle a relatively narrow range of workplace situations may be following a broad general-English programme. Learners may have been given an independent self-study solution when many need considerably more structure and support.
A programme may be excellent but scheduled in a way that makes meaningful participation unrealistic. Or people with very different roles, starting points and objectives may have been placed into broadly the same learning journey. Quality matters. So does fit.
Participation tells us something — not everything
If nobody participates, even excellent provision is unlikely to achieve very much. So attendance, activation, platform usage and completion all deserve attention. But they describe activity more readily than they demonstrate learning.
Someone can attend every lesson and make limited progress. Someone can use a platform regularly while concentrating on familiar or easier activities. A learner can complete a course because completion is expected without becoming noticeably more capable of using English where it matters.
The reverse is possible too. A relatively modest amount of highly relevant learning may change somebody’s confidence or ability to perform a particular task quite significantly. Participation is part of the story. It isn’t the whole story.
Satisfaction has its limits too
Learner feedback matters. If people dislike the experience, find it irrelevant or struggle to access it, an organisation should want to know. Positive feedback is encouraging.
But satisfied learners aren’t necessarily progressing learners. A course can be enjoyable without being sufficiently demanding. A popular teacher can create an excellent experience while wider programme outcomes remain unclear.
And the learner, provider and organisation may quite reasonably define success differently. Those perspectives don’t need to compete.They do need to be understood.
Who is telling you that it’s working?
This may be one of the more useful questions an organisation can ask. The provider may have evidence of progress. The platform may show high engagement. Learners may report that they’re enjoying the programme. Managers may notice changes at work. HR or L&D may be looking at participation and completion. Procurement may be looking at whether the service delivered what was contracted.
Each may be completely accurate. They’re simply looking through different windows.
A confident judgement about effectiveness may require those views to be brought together rather than allowing one measure—or one stakeholder—to stand for the whole programme.
What has actually changed?
Eventually, some of the evidence needs to lead outside the course itself.
What can people now do that they couldn’t do—or couldn’t do as well—before? Are employees participating more confidently in international meetings? Are customer interactions improving? Can students cope more effectively with the language demands placed upon them? Are managers noticing a relevant difference? Do learners feel able to do things they previously avoided?
Some of these changes are harder to measure than attendance or completion. That doesn’t make them less important. It may make them closer to the reason the investment was made.
The learners who struggle matter too
Some learners will progress quickly. Others won’t. Some will disengage. Others may participate enthusiastically but make less progress than expected.
Those experiences shouldn’t simply disappear from the success story. They can tell an organisation something important. Perhaps the learning doesn’t fit. Perhaps workload or timing is the problem. Perhaps more support is needed. Perhaps the original expectations were unrealistic.
A programme shouldn’t only be understood through the people for whom it works most easily.
More reporting may not produce more understanding
When effectiveness is uncertain, asking for more data can feel like the obvious response. Sometimes more evidence is exactly what’s needed.
But another dashboard doesn’t necessarily provide another answer. There may already be plenty of information. What may be missing is a coherent view of the original purpose, the learners, the learning experience, the different stakeholder perspectives and what has actually changed.
And occasionally the evidence simply isn’t sufficient. That is a legitimate finding.
Sometimes the most useful answer is: “We don’t yet have enough evidence to know.”
Recognising uncertainty is considerably more useful than creating confidence from information that doesn’t support it. So how confident are you?
There isn’t one number that proves an English programme is effective.
Test scores contribute something. So do attendance, completion, learner satisfaction, usage data, manager observations and evidence of what learners can actually do.
The useful judgement comes from understanding how those pieces fit together. An organisation may therefore have a great deal of information about its English provision and still be unable to say confidently whether it is the right provision, for the right people, producing the changes that matter.
That isn’t necessarily a sign that the programme is failing. It may simply mean the organisation needs to look at what it already knows differently. Before asking for another report, there may be a more useful place to start:
How confident are we that the evidence we have actually tells us whether this is working?
