{"id":11183,"date":"2026-11-16T11:00:00","date_gmt":"2026-11-16T07:00:00","guid":{"rendered":"https:\/\/matsh.co\/en\/?p=11183"},"modified":"2026-11-12T00:48:23","modified_gmt":"2026-11-11T20:48:23","slug":"evaluating-youth-employment-programmes-attribution-contribution-counterfactuals","status":"publish","type":"post","link":"https:\/\/matsh.co\/en\/evaluating-youth-employment-programmes-attribution-contribution-counterfactuals\/","title":{"rendered":"Evaluating Youth Employment Programmes: Attribution, Contribution and Counterfactuals"},"content":{"rendered":"<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1000\" height=\"563\" src=\"https:\/\/matsh.co\/en\/wp-content\/uploads\/2026\/11\/11183-featured.jpg\" alt=\"MATSH insight on evaluating youth employment programmes\" class=\"wp-image-16622\" srcset=\"https:\/\/matsh.co\/en\/wp-content\/uploads\/2026\/11\/11183-featured.jpg 1000w, https:\/\/matsh.co\/en\/wp-content\/uploads\/2026\/11\/11183-featured-300x169.jpg 300w, https:\/\/matsh.co\/en\/wp-content\/uploads\/2026\/11\/11183-featured-768x432.jpg 768w\" sizes=\"auto, (max-width: 1000px) 100vw, 1000px\" \/><\/figure>\n\n<style data-matsh-css-repair=\"2026-10-13\">\n.yev-hero{background:linear-gradient(135deg,#2f4054,#507394);border-radius:16px;padding:42px 40px;color:#fff;margin-bottom:34px}.yev-hero h2{margin:0 0 12px;color:#fff;font-size:1.5rem;line-height:1.3}.yev-hero p{margin:0;color:#fff;opacity:.94;line-height:1.82}.yev-section{border-left:4px solid #5c81a3;padding-left:14px;margin:42px 0 18px;font-size:1.35rem;color:#2f4054}.yev-pull{border-left:4px solid #5c81a3;background:#f0f5f9;padding:20px 26px;margin:28px 0;font-weight:650;color:#2f4054;line-height:1.72}.yev-grid{display:grid;grid-template-columns:repeat(auto-fit,minmax(220px,1fr));gap:14px;margin:22px 0 30px}.yev-card{border:1.5px solid #ccdae6;border-radius:13px;padding:20px;background:#fff}.yev-card strong{display:block;color:#2f4054;margin-bottom:7px}.yev-card p{margin:0;color:#52677a;font-size:.9rem;line-height:1.7}.yev-table{width:100%;border-collapse:collapse;margin:20px 0 30px;font-size:.91rem}.yev-table th{background:#2f4054;color:#fff;text-align:left;padding:13px 14px}.yev-table td{border:1px solid #d9e2e9;padding:13px 14px;vertical-align:top;line-height:1.58}.yev-table tr:nth-child(even) td{background:#f8fafc}.yev-fail{background:#faf2f5;border-left:4px solid #8c5264;border-radius:0 10px 10px 0;padding:16px 20px;margin:10px 0;color:#5b2638;line-height:1.68}.yev-cta{background:linear-gradient(135deg,#5c81a3,#2f4054);border-radius:16px;padding:36px 38px;margin:36px 0;color:#fff}.yev-cta h3{color:#fff;margin:0 0 10px}.yev-cta p{margin:0 0 20px;opacity:.92;line-height:1.7}.yev-cta a{display:inline-block;background:rgba(255,255,255,.16);border:1px solid rgba(255,255,255,.35);border-radius:8px;padding:10px 16px;color:#fff;text-decoration:none;font-weight:700}\n\n<\/style><div class=\"yev-hero\"><h2>A youth employment programme can improve placement rates and still leave one crucial question unanswered: did the programme cause the improvement, contribute to it, or simply operate during a better labour market?<\/h2><p>Evaluation design is about choosing evidence strong enough for the decision being made. A programme manager deciding whether to improve case management may need different evidence from a donor deciding whether to scale a costly intervention nationally. Strong evaluation starts with the decision, the causal question and the realistic comparison available.<\/p><\/div>\n\n<p>The 2026 ILO\u2013World Bank review of active labour-market programmes for youth synthesises impact evaluations across many programme types and illustrates why design, targeting and context matter when interpreting employment effects. OECD evaluation guidance likewise stresses using evaluation criteria thoughtfully and matching methods to purpose.<\/p>\n<p><a href=\"https:\/\/www.ilo.org\/publications\/impact-active-labour-market-programmes-youth\" target=\"_blank\" rel=\"noopener\">Source: ILO\u2013World Bank \u2014 Impact of Active Labour Market Programmes on Youth<\/a> \u00b7 <a href=\"https:\/\/www.oecd.org\/en\/publications\/applying-evaluation-criteria-thoughtfully_543e84ed-en.html\" target=\"_blank\" rel=\"noopener\">Source: OECD \u2014 Applying Evaluation Criteria Thoughtfully<\/a><\/p>\n\n<div class=\"yev-pull\">Do not start with \u201cWhich evaluation method should we use?\u201d Start with \u201cWhat decision must the evaluation inform, and what claim would we need evidence to support?\u201d<\/div>\n\n<h2 class=\"yev-section\">1. Define the evaluation question<\/h2>\n<table class=\"yev-table\"><thead><tr><th>Question<\/th><th>Evidence need<\/th><\/tr><\/thead><tbody>\n<tr><td>Was the programme delivered well?<\/td><td>Implementation\/process evidence<\/td><\/tr>\n<tr><td>Did participants improve?<\/td><td>Outcome monitoring \/ before-after evidence<\/td><\/tr>\n<tr><td>Did the programme cause the improvement?<\/td><td>Credible counterfactual \/ impact evaluation<\/td><\/tr>\n<tr><td>Why did it work for some groups?<\/td><td>Mixed-method mechanism analysis<\/td><\/tr>\n<tr><td>Should it scale?<\/td><td>Impact + cost + implementation + context evidence<\/td><\/tr>\n<\/tbody><\/table>\n\n<h2 class=\"yev-section\">2. Separate monitoring from impact evaluation<\/h2>\n<p>Monitoring tells you what happened to participants. Impact evaluation estimates what would have happened without the programme. Both are useful, but they answer different questions.<\/p>\n\n<h2 class=\"yev-section\">3. Build the theory of change first<\/h2>\n<div class=\"yev-grid\">\n<div class=\"yev-card\"><strong>Constraint<\/strong><p>What blocks employment or earnings?<\/p><\/div>\n<div class=\"yev-card\"><strong>Intervention<\/strong><p>Which mechanism addresses it?<\/p><\/div>\n<div class=\"yev-card\"><strong>Intermediate change<\/strong><p>What should change before employment?<\/p><\/div>\n<div class=\"yev-card\"><strong>Outcome<\/strong><p>Placement, retention, earnings, quality or progression.<\/p><\/div>\n<\/div>\n\n<h2 class=\"yev-section\">4. Decide whether attribution is necessary<\/h2>\n<p>If a programme is piloting a new costly model or competing with other interventions for funding, causal evidence may be important. For routine service improvement, contribution evidence may be sufficient.<\/p>\n\n<h2 class=\"yev-section\">5. Understand the counterfactual<\/h2>\n<p>The counterfactual is the outcome participants would have experienced without the programme. Because that cannot be observed directly for the same person at the same time, impact evaluations use comparison strategies.<\/p>\n\n<h2 class=\"yev-section\">6. Choose a feasible comparison design<\/h2>\n<table class=\"yev-table\"><thead><tr><th>Approach<\/th><th>Use \/ caution<\/th><\/tr><\/thead><tbody>\n<tr><td>Randomised assignment<\/td><td>Strong causal design when ethical and operationally feasible<\/td><\/tr>\n<tr><td>Regression discontinuity<\/td><td>Useful where eligibility follows a clear threshold<\/td><\/tr>\n<tr><td>Difference-in-differences<\/td><td>Requires credible comparison trends<\/td><\/tr>\n<tr><td>Matching \/ weighting<\/td><td>Controls observed differences, not unobserved ones<\/td><\/tr>\n<tr><td>Before-after only<\/td><td>Shows change, not attribution<\/td><\/tr>\n<\/tbody><\/table>\n\n<h2 class=\"yev-section\">7. Measure the right outcomes at the right time<\/h2>\n<p>Immediate placement may not show sustained value. Plan follow-up for retention, earnings, job quality, progression and enterprise survival where relevant.<\/p>\n\n<h2 class=\"yev-section\">8. Track implementation alongside outcomes<\/h2>\n<p>If impact is weak, you need to know whether the programme model failed or whether implementation failed. Measure service dose, quality, partner performance, employer engagement and participant take-up.<\/p>\n\n<h2 class=\"yev-section\">9. Test heterogeneity carefully<\/h2>\n<p>Outcomes may differ by gender, age, baseline disadvantage, location or programme pathway. Pre-specify important subgroup questions where possible and avoid over-interpreting small samples.<\/p>\n\n<h2 class=\"yev-section\">10. Measure spillovers and substitution where relevant<\/h2>\n<p>Wage subsidies, placements or entrepreneurship programmes can affect non-participants or shift opportunities. Programme impact should be interpreted at the right level.<\/p>\n\n<h2 class=\"yev-section\">11. Add cost evidence<\/h2>\n<table class=\"yev-table\"><thead><tr><th>Cost question<\/th><th>Why it matters<\/th><\/tr><\/thead><tbody>\n<tr><td>Cost per participant<\/td><td>Operational efficiency<\/td><\/tr>\n<tr><td>Cost per additional outcome<\/td><td>Compares programme effect with resource use<\/td><\/tr>\n<tr><td>Scale cost<\/td><td>Tests whether unit economics change at larger size<\/td><\/tr>\n<\/tbody><\/table>\n\n<h2 class=\"yev-section\">12. Use qualitative evidence to explain mechanisms<\/h2>\n<p>Interviews with participants, employers, counsellors and partners can explain why outcomes differ and whether the theory of change is plausible.<\/p>\n\n<h2 class=\"yev-section\">13. Plan for labour-market change<\/h2>\n<p>Economic cycles, hiring shocks and policy changes can affect outcomes. Record contextual changes and avoid interpreting every improvement or decline as programme performance.<\/p>\n\n<h2 class=\"yev-section\">14. Define claims before seeing results<\/h2>\n<p>Agree what the design can support: description, association, contribution or attribution. This reduces pressure to overstate findings later.<\/p>\n\n<h2 class=\"yev-section\">Common evaluation mistakes<\/h2>\n<div class=\"yev-fail\"><strong>Calling before-and-after change programme impact.<\/strong><\/div>\n<div class=\"yev-fail\"><strong>Choosing a sophisticated method before clarifying the decision question.<\/strong><\/div>\n<div class=\"yev-fail\"><strong>Measuring placement once and ignoring retention or job quality.<\/strong><\/div>\n<div class=\"yev-fail\"><strong>Evaluating outcomes without implementation quality.<\/strong><\/div>\n<div class=\"yev-fail\"><strong>Scaling from a positive result without checking cost and context.<\/strong><\/div>\n\n<h2 class=\"yev-section\">Create an outcome follow-up matrix that exposes missing evidence<\/h2>\n<p>For a hypothetical youth employment programme, organise a follow-up matrix by participant cohort, baseline situation, intervention received, follow-up timing and employment outcome. Record job type, hours, stability and relevant job-quality information where collection is appropriate. Keep training attendance separate from employment outcomes and distinguish self-employment from wage employment.<\/p><p>Before calculating a placement or retention rate, define the denominator and document participants lost to follow-up. Check whether the easiest-to-contact graduates differ from those missing. A positive result among respondents cannot automatically be generalized to every enrollee, and a before-and-after comparison alone does not establish that the programme caused the change.<\/p><p>Use the matrix to identify decisions: which employer partnerships merit closer review, which support services need adjustment and what evidence is still missing. Where a credible comparison design is feasible and ethical, plan it before delivery. Report uncertainty rather than filling gaps with assumed outcomes.<\/p>\n\n<div class=\"yev-cta\"><h3>Match evaluation strength to the decision you need to make<\/h3><p>MATSH\u2019s Impact Measurement for Youth Employment Programmes Course helps teams design indicators, evaluation questions, comparison strategies, mixed methods and evidence-use systems without overstating causal claims.<\/p><a href=\"\/en\/course\/impact-measurement-youth-employment-programmes-course\/\">Explore the course<\/a><\/div>\n\n<h2 class=\"yev-section\">Sources<\/h2><ul>\n<li><a href=\"https:\/\/www.ilo.org\/publications\/impact-active-labour-market-programmes-youth\" target=\"_blank\" rel=\"noopener\">ILO\u2013World Bank \u2014 The Impact of Active Labour Market Programmes on Youth, 2026<\/a><\/li>\n<li><a href=\"https:\/\/www.ilo.org\/resource\/other\/impact-active-labour-market-programmes-youth-annexes\" target=\"_blank\" rel=\"noopener\">ILO \u2014 ALMP Youth Impact Evaluation Annexes, 2026<\/a><\/li>\n<li><a href=\"https:\/\/www.oecd.org\/en\/publications\/applying-evaluation-criteria-thoughtfully_543e84ed-en.html\" target=\"_blank\" rel=\"noopener\">OECD \u2014 Applying Evaluation Criteria Thoughtfully<\/a><\/li>\n<\/ul>","protected":false},"excerpt":{"rendered":"<p>A practical guide to evaluating youth employment programmes, separating monitoring from impact evaluation and choosing credible comparison, cost and implementation evidence.<\/p>\n","protected":false},"author":0,"featured_media":16622,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[395],"tags":[],"class_list":["post-11183","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-youth-development"],"_links":{"self":[{"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/posts\/11183","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/comments?post=11183"}],"version-history":[{"count":4,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/posts\/11183\/revisions"}],"predecessor-version":[{"id":16623,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/posts\/11183\/revisions\/16623"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/media\/16622"}],"wp:attachment":[{"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/media?parent=11183"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/categories?post=11183"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/matsh.co\/en\/wp-json\/wp\/v2\/tags?post=11183"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}