How to Measure the Impact of Leadership Training

Organisations measure the impact of leadership training by looking at what managers do differently afterwards and whether the team and the organisation change as a result, not by how participants rated the sessions.

Impact, in this sense, is the observable change in how managers lead, and the effect of that change on the people and results they are responsible for. Attendance records and feedback forms can show that training happened and was liked. They cannot show that leadership changed.

Why do most organisations measure the wrong thing?

Because the easy things to measure are the ones that sit closest to the training room. A feedback form takes five minutes to design and a day to collect, and it produces numbers that look reassuring. Whether a manager now delegates properly, handles a difficult conversation sooner or lets a team member make a decision takes planning, observation and patience, so it is often left unmeasured.

The result is a familiar situation. Leadership budgets are approved, programmes are delivered, participants say they enjoyed them, and a year later nobody can say whether the managers lead any differently. That leaves HR and L&D teams with little to say when a senior leader asks whether the training worked.

What are the four layers of leadership training impact?

The most widely used way to think about training evaluation is the Kirkpatrick model, which separates impact into four layers.

1. The first is reaction: whether participants found the training relevant and worthwhile. This is useful for improving delivery, but it is weak evidence of impact.
2. The second is learning: whether understanding or skill increased, which can be checked through assessments and exercises.
3. The third is behaviour: whether managers lead differently once they are back at work.
4. The fourth is results: whether outcomes for the team or organisation change.

Each layer builds on the one before it, and the third is where most training succeeds or fails. When training is said to have had no effect, the usual explanation is that learning happened and behaviour did not follow.

How can behaviour change actually be measured?

By comparing what managers do before and after the training, using observation against criteria that were set in advance. Self-ratings are useful, but they should not be the only evidence, because people tend to be generous about their own conduct. A more reliable picture comes from combining several sources.

1. The first is a baseline, so that there is something to compare against.

2. The second is observation of managers in realistic situations, such as scenarios, simulations and projects, where what they actually do can be seen and not just reported.

3. The third is feedback from the people around the manager, including the manager's own boss and team.

4. The fourth is a repeat of the same observation after an agreed period.

The criteria themselves should come from the organisation's needs, not from a generic checklist, so a company struggling with delegation measures delegation, and one struggling with accountability measures that.

Why does training sometimes appear to have no impact?

Often because the organisation did not give the developed traits anywhere to function. Training can build a skill or strengthen a habit, but impact only shows up when the manager has room to use it and a reason to keep using it.

Take a manager who leaves a programme with a much stronger grasp of delegation and returns to a role where every decision still needs the director's approval. The trait has been developed, but the avenue for it to work is closed, so the measurement shows no change.

Motivation works the same way. If behaving differently earns no recognition, or if the manager's own boss prefers the old way of working, the new behaviour fades. In both cases, the measurement is accurate, but the cause is not the training alone.

This is why measurement belongs inside a wider look at the organisation. The same pattern appears when responsibility grows faster than the organisation's ability to lead, which is described in how to know when a team needs leadership training.

Which business results can reasonably be linked to leadership training?

Team-level indicators that managers influence directly. Examples include how often decisions escalate to senior leaders, staff turnover within a manager's team, engagement or pulse survey scores, and whether work is delivered on time.

Team engagement is a sensible choice, since Gallup's research attributes about 70 percent of the variance in team engagement to the manager.

There is a limit to what can be claimed. Many things affect turnover, engagement and delivery besides one training programme, so the honest approach is to look for a direction and a pattern against the baseline, and, where possible, against a comparable group that did not take part.

A precise return-on-investment figure is rarely credible for leadership training, and a clear set of behavioural and team indicators is usually more convincing to senior leaders than a number that cannot be defended.

What does the research say about training that can be measured?

A 2017 meta-analysis in the Journal of Applied Psychology, covering 335 samples, found that leadership training improved outcomes across all four layers: reactions, learning, behaviour and results.

It also found that the strength of the effect depended on how the training was built. Needs analysis, feedback, multiple delivery methods (especially practice) and spaced sessions were all associated with stronger results.

The design features that make training effective also make it measurable. A programme built around practice and feedback produces behaviour that can be observed. A single lecture produces very little to observe, so there is little to measure.

How should measurement be set up before training starts?

Measurement is far easier to build in at the start than to attach afterwards. A workable sequence looks like this:

1. Identify the need. A short assessment such as the Leadership Capacity Check gives an early picture of where managers stand.
2. Choose two or three behaviours that should change, and describe what each looks like in observable terms.
3. Capture a baseline before the training begins.
4. Agree who will observe, when, and how feedback from the manager's boss and team will be gathered.
5. Check that managers have the decision rights and support to use the new behaviour, so that the traits developed have somewhere to function.

Keeping the list short matters. Two or three well-chosen behaviours, observed properly, tell an organisation more than twenty measures nobody follows up.

Where Penthouse fits

Penthouse builds measurement into the programme from the start. The Corporate Edition begins with a survey, and the criteria used to assess managers are set from the organisation's own needs.

The practical work then follows one loop: a realistic scenario, a decision, an action, observation by facilitators, and a report that turns what was observed into practical feedback and, where appropriate, structured reports for the organisation.

The Storytelling Leadership Simulation, an internal Penthouse learning project, shows how this works. Three teams spent two weeks creating a product and a story around the same ordinary object, and were observed on collaboration, creativity, persuasion and how they organised themselves and handled disagreement.

It illustrates how a leadership objective becomes observable, not the results an organisation should expect.

Organisations that want this kind of evidence for their own managers can look at Penthouse's leadership training for managers, or book a conversation with Penthouse about starting with a pilot.

Frequently asked questions

How do you measure the effectiveness of leadership training? By comparing what managers do before and after the training against criteria set in advance, using observation and feedback from the manager's boss and team, and then checking whether team-level indicators such as engagement, turnover or delivery move in the expected direction.

How long before leadership training shows results? There is no fixed answer. Early changes in behaviour can often be observed within weeks of practising, while team-level results usually take longer, so measurement should be planned over months and not days.

Can the ROI of leadership training be measured? Sometimes, but with care. Many factors affect the same outcomes, so a single figure is hard to defend. Tracking a few behaviours and team indicators against a baseline is usually more credible.

Why might leadership training show no impact? Often because the organisation has not given managers room to use what they developed, or has not rewarded the new behaviour. The training can build the trait, but impact depends on whether there is an avenue for it to function.