Home › Blog › Evaluating Youth Employment Programmes: Attribution, Contribution and Counterfactuals
Youth Development

Evaluating Youth Employment Programmes: Attribution, Contribution and Counterfactuals

November 16, 2026 · Youth Development · 4 min read

Written by MATSH Research & Editorial Team · Last updated

Evaluating Youth Employment Programmes: Attribution, Contribution and Counterfactuals
MATSH insight on evaluating youth employment programmes

A youth employment programme can improve placement rates and still leave one crucial question unanswered: did the programme cause the improvement, contribute to it, or simply operate during a better labour market?

Evaluation design is about choosing evidence strong enough for the decision being made. A programme manager deciding whether to improve case management may need different evidence from a donor deciding whether to scale a costly intervention nationally. Strong evaluation starts with the decision, the causal question and the realistic comparison available.

The 2026 ILO–World Bank review of active labour-market programmes for youth synthesises impact evaluations across many programme types and illustrates why design, targeting and context matter when interpreting employment effects. OECD evaluation guidance likewise stresses using evaluation criteria thoughtfully and matching methods to purpose.

Source: ILO–World Bank — Impact of Active Labour Market Programmes on Youth · Source: OECD — Applying Evaluation Criteria Thoughtfully

Do not start with “Which evaluation method should we use?” Start with “What decision must the evaluation inform, and what claim would we need evidence to support?”

1. Define the evaluation question

QuestionEvidence need
Was the programme delivered well?Implementation/process evidence
Did participants improve?Outcome monitoring / before-after evidence
Did the programme cause the improvement?Credible counterfactual / impact evaluation
Why did it work for some groups?Mixed-method mechanism analysis
Should it scale?Impact + cost + implementation + context evidence

2. Separate monitoring from impact evaluation

Monitoring tells you what happened to participants. Impact evaluation estimates what would have happened without the programme. Both are useful, but they answer different questions.

3. Build the theory of change first

Constraint

What blocks employment or earnings?

Intervention

Which mechanism addresses it?

Intermediate change

What should change before employment?

Outcome

Placement, retention, earnings, quality or progression.

4. Decide whether attribution is necessary

If a programme is piloting a new costly model or competing with other interventions for funding, causal evidence may be important. For routine service improvement, contribution evidence may be sufficient.

5. Understand the counterfactual

The counterfactual is the outcome participants would have experienced without the programme. Because that cannot be observed directly for the same person at the same time, impact evaluations use comparison strategies.

6. Choose a feasible comparison design

ApproachUse / caution
Randomised assignmentStrong causal design when ethical and operationally feasible
Regression discontinuityUseful where eligibility follows a clear threshold
Difference-in-differencesRequires credible comparison trends
Matching / weightingControls observed differences, not unobserved ones
Before-after onlyShows change, not attribution

7. Measure the right outcomes at the right time

Immediate placement may not show sustained value. Plan follow-up for retention, earnings, job quality, progression and enterprise survival where relevant.

8. Track implementation alongside outcomes

If impact is weak, you need to know whether the programme model failed or whether implementation failed. Measure service dose, quality, partner performance, employer engagement and participant take-up.

9. Test heterogeneity carefully

Outcomes may differ by gender, age, baseline disadvantage, location or programme pathway. Pre-specify important subgroup questions where possible and avoid over-interpreting small samples.

10. Measure spillovers and substitution where relevant

Wage subsidies, placements or entrepreneurship programmes can affect non-participants or shift opportunities. Programme impact should be interpreted at the right level.

11. Add cost evidence

Cost questionWhy it matters
Cost per participantOperational efficiency
Cost per additional outcomeCompares programme effect with resource use
Scale costTests whether unit economics change at larger size

12. Use qualitative evidence to explain mechanisms

Interviews with participants, employers, counsellors and partners can explain why outcomes differ and whether the theory of change is plausible.

13. Plan for labour-market change

Economic cycles, hiring shocks and policy changes can affect outcomes. Record contextual changes and avoid interpreting every improvement or decline as programme performance.

14. Define claims before seeing results

Agree what the design can support: description, association, contribution or attribution. This reduces pressure to overstate findings later.

Common evaluation mistakes

Calling before-and-after change programme impact.
Choosing a sophisticated method before clarifying the decision question.
Measuring placement once and ignoring retention or job quality.
Evaluating outcomes without implementation quality.
Scaling from a positive result without checking cost and context.

Create an outcome follow-up matrix that exposes missing evidence

For a hypothetical youth employment programme, organise a follow-up matrix by participant cohort, baseline situation, intervention received, follow-up timing and employment outcome. Record job type, hours, stability and relevant job-quality information where collection is appropriate. Keep training attendance separate from employment outcomes and distinguish self-employment from wage employment.

Before calculating a placement or retention rate, define the denominator and document participants lost to follow-up. Check whether the easiest-to-contact graduates differ from those missing. A positive result among respondents cannot automatically be generalized to every enrollee, and a before-and-after comparison alone does not establish that the programme caused the change.

Use the matrix to identify decisions: which employer partnerships merit closer review, which support services need adjustment and what evidence is still missing. Where a credible comparison design is feasible and ethical, plan it before delivery. Report uncertainty rather than filling gaps with assumed outcomes.

Match evaluation strength to the decision you need to make

MATSH’s Impact Measurement for Youth Employment Programmes Course helps teams design indicators, evaluation questions, comparison strategies, mixed methods and evidence-use systems without overstating causal claims.

Explore the course

Sources

About this article
Last updated: · Editorial and Research Standards
⏱
4 min read 861 words · practical and to the point
Upcoming Dates
View all upcoming dates →
More on This Topic
Employer Demand Mapping for Youth Employment Programmes 4 min read Youth Employment Programme Design in GCC and African Markets: What Must Be Localised 5 min read Young Women's Economic Empowerment Programmes: Designing the Employment–Enterprise–Finance Pathway 4 min read Green Jobs Programmes for Youth: Start With Employer Demand, Not Generic Green Skills 3 min read

Need In-House Training?

We run all our courses as private programmes for organisations across the GCC and Africa.

Request In-House →