Monday, May 23, 2022 |
8:00 – 9:00 | Registration |
9:00 – 9:30 | Welcoming Remarks — Introducing IE collaborative, Learning Priorities and WorkshopColin Andrews, Program Manager, PEI, World Bank
Patrick Premand, Senior Economist, DIME, World Bank
➜ Presentation
|
9:30 – 9:45 | Knowledge Exercise |
9:45 – 10:30 | Keynote: Impact Evaluation and Data Systems for Achieving ImpactArianna Legovini, Director, DIME, World Bank ➜ Presentation |
10:30 – 11:00 | COFFEE BREAK |
11:00 – 12:00 | Icebreaker — Opportunities and Challenges in Scaling up Economic Inclusion ProgrammingCountry reps from 6 participating projects introduce their delegation and provide a brief overview of their projects (1 slide), the innovations they are considering (1 slide) and the main opportunities or challenge they face in scaling up (1 slide). Each team will be allotted for 5 minutes to present, followed by Q&A. Session Lead: Sebastian Insfran Moreno, ET Consultant, DIME, World Bank
Chair: Hugo Brousset Chaman, Social Protection Specialist, PEI, World Bank ➜ Presentations: South Sudan | Cameroon | Ethiopia | Haiti | Angola | Malawi |
12:00 – 1:00 | LUNCH |
1:00 – 1:45 | Keynote: What have we learned from impact evaluations of economic inclusion and graduation programs, and what else do we most need to learn?Keynote: Dean Karlan, Professor of Economics and Finance, Northwestern University ➜ Presentation |
1:45 – 2:00 | Intro to Parallel Sessions on Clinics: Integrating Impact Evaluation into the Design of ProjectsSebastian Insfran Moreno, ET Consultant, DIME, World Bank ➜ Presentation |
2:00 – 3:30 Breakout Rooms | Methods: Experimental impact evaluation methodsEnglish — Benedetta Lerva, Economist, DIME, World Bank
French — Patrick Premand, Senior Economist, DIME, World Bank
Portuguese — Astrid Zwager, Research Officer, DIME, World Bank |
3:30 – 5:30 Breakout Rooms | Clinic 1: Objective and Theory of ChangeTeams will define their project objectives and theory of change. They will identify which constraints their programs aim to address, and which other potential binding constraints might remain. Key points will be recorded in the PowerPoint template which each project will use to present their impact evaluation design at the end of the workshop. |
Tuesday, May 24, 2022 |
9:00 – 9:05 | Recap from day 1 and overview of day aheadSarang Chaudhary, ET Consultant, PEI, World Bank |
9:05 – 9:45 | Icebreaker — Opportunities and Challenges in Scaling up Economic Inclusion ProgrammingCountry reps from 4 participating projects introduce their delegation and provide a brief overview of their projects (1 slide), the innovations they are considering (1 slide) and the main opportunities or challenge they face in scaling up (1 slide). Each team will be allotted for 5 minutes to present, followed by Q&A. Session Lead: Sebastian Insfran Moreno, ET Consultant, DIME, World Bank
Chair: Ananda Paez Rodas, ET Consultant, SPJ, World Bank ➜ Presentations: Ethiopia | Sierra Leone |
9:45 – 10:45 | Ignite Session: Testing how to optimize intervention bundles (10 min per case, followed by Q&A) Speakers provide brief presentations to illustrate key issues in testing how to optimize multi-faceted economic inclusion interventions. Session Lead: John Loeser, Economist, DIME, World Bank Chair: Boban Varghese Paul, Senior Social Protection Specialist, SPJ, World Bank - 1 slide framing the session, introducing speakers ➜ Presentation Presentations: - Which components are better delivered in cash? (John Loeser, Economist, DIME, World Bank)
➜ Presentation - Unpacking the value-added of capital and training in Zambia (Iona Botea, Social Protection Economist, SPJ, World Bank)
➜ Presentation - Unpacking a multi-faceted program to build sustainable income for the very poor (Dean Karlan, Professor of Economics and Finance, Northwestern University)
➜ Presentation
|
10:45 – 11:00 | COFFEE BREAK |
11:00 – 12:30 Breakout Rooms | Methods: Non-experimental Impact Evaluation MethodsEnglish — John Loeser, Economist, DIME, World Bank
French — Clara Delavallade, Senior Economist, Africa GIL, World Bank
Portuguese — Giulia Zane, ET Consultant, Poverty & Equity, World Bank |
12:30 – 1:30 | LUNCH |
1:30 – 2:30 | Ignite Session: Effectiveness at Scale(10 min per case, followed by Q&A) Speakers provide brief presentations to illustrate key issues in testing the effectiveness of economic inclusion programs at scale. Session Lead: Marcus Holmlund, Senior Economist, DIME, World Bank Chair: Margaux Vinez, Economist, SPJ, World Bank - 1 slide framing the session, introducing speakers ➜ Presentation Presentations: - Testing alternative coaching delivery models in Uganda and the Philippines (Emily Beam, Assistant Professor of Economics, University of Vermont)
➜ Presentation
- Spillovers to non-participants: Livelihood support for refugees and host communities in Uganda (Lasse Brune, Research Assistant Professor, Northwestern University)
➜ Presentation - General Equilibrium Effects of social protection interventions in Ethiopia and Kenya (Girum Tafera, Senior Economist, Africa GIL, World Bank)
➜ Presentation
|
2:30 – 3:00 | COFFEE BREAK |
3:00 – 3:45 Breakout Rooms | Clinic 2: Research Questions and Key OutcomesTeams determine the main policy research questions to be answered by the impact evaluation and the corresponding key outcome indicators. Key points will be recorded in the PowerPoint template which each project will use to present their impact evaluation design at the end of the workshop. |
3:45 – 5:30 Breakout Rooms | Clinic 3: Program Roll-out Plan and Impact Evaluation StrategyTeams will start to work on designing an impact evaluation strategy to answer the questions they have identified, and discuss identification strategy, data needs, and potential challenges. The proposed design will be recorded in the project's PowerPoint template. |
6:30 – 9:00 | Group Dinner — Restaurante Mar ao Largo (Largo Rafael Bordalo Pinheiro 28, Lisboa) |
Wednesday, May 25, 2022 |
9:00 – 9:05 | Recap from day 2 and overview of day aheadSarang Chaudhary, ET Consultant, PEI, World Bank |
9:05 – 10:30 | Mixed Methods: Overview and ExamplesSpeakers will provide examples on how embedding mix methods can be instrumental for better impact evaluation designs. They will explain how research teams can combine quantitative and qualitative methods to explore mechanisms or pathways for impact, and the role of process evaluation and outcome monitoring as part of impact evaluation tasks. Ines Arevalo Sanchez, Consultant, PEI, World Bank
Keetie Roelen, Research Fellow, Institute of Development Studies
(in liaison with Kathleen Beegle and Sebastian Insfran Moreno) ➜ Presentation |
10:30 – 11:30 | Ignite Session: Economic inclusion in rural areas, climate, resilience, and agriculture(10 min per case, followed by Q&A) Speakers provide brief presentations to illustrate key issues in testing the effectiveness of economic inclusion programs in rural areas, as well as their link to climate, resilience and agriculture. Session Lead: Benedetta Lerva, Economist, DIME, World Bank
(in liaison with Puja Dutta and Colin Andrews) Chair: Samik Adhikari, Economist, SPJ, World Bank - 1 slide framing the session, introducing speakers ➜ Presentation Presentations: - Testing how to support smallholder farmers’ market access and integration in value chains (Benedetta Lerva, Economist, DIME, World Bank)
➜ Presentation
- The effects of introducing mobile money in rural Mozambique (Catia Batista, Associate Professor of Economics, NOVA School of Business and Economics)
➜ Presentation
- Can productive safety nets help households manage climatic variability? (Patrick Premand, Senior Economist, DIME, World Bank)
➜ Presentation
|
11:30 – 12:00 | COFFEE BREAK |
12:00 – 12:45 | Ignite Session: Measuring Cost and Assessing Cost-effectiveness Over Time(10 min per case, followed by Q&A) Chair: Cornelia Tesliuc, Senior Social Protection Specialist, SPJ, World Bank - 1 slide framing the session, introducing speakers ➜ Presentation Presentations: - Measuring costs (Sarang Chaudhary, ET Consultant, PEI, World Bank)
➜ Presentation - Measuring cost-effectiveness (Nate Goldberg, Director of Sector Programs, Innovations for Poverty Action)
➜ Presentation
|
12:45 – 1:30 | LUNCH |
1:30 – 2:30 | Ignite Session: Women’s economic empowerment(10 min per case, followed by Q&A) Speakers provide brief presentations to illustrate key issues in linking economic inclusion and women’s economic empowerment. Session Lead: Kathleen Beegle, Research Manager, DECRG, World Bank Chair: Colin Andrews, Program Manager, PEI, World Bank - 1 slide framing the session, introducing speakers ➜ Presentation Presentations - Knowledge gaps on graduation and women’s economic empowerment (Clara Delavallade, Senior Economist, Africa GIL, World Bank)
➜ Presentation - Testing psychosocial interventions in economic inclusion programs (Catherine Thomas, PhD Candidate, Stanford University)
➜ Presentation - Measuring multiple dimensions of gender empowerment (Kathleen Beegle, Research Manager, DECRG, World Bank)
➜ Presentation
|
2:30 – 3:15pm | Designing and Implementing an impact evaluation from A to Z: The Sahel Case(30 min, 15 min Q&A) Robin Audy, Consultant, SPJ, World Bank
Patrick Premand, Senior Economist, DIME, World Bank
Kelsey Wright, PhD Candidate, Paris School of Economics The case study will illustrate the key steps to conduct an impact evaluation, in particular how to go from diagnostic to design to implementation. It will also highlight how to link the impact evaluation with monitoring data collection, implementation quality and process learning, in close coordination between the research and policy team. ➜ Presentation |
3:15 – 5:30 Breakout Rooms | Clinic 4: Implementation Plan and PresentationTeams will continue their work on designing an impact evaluation strategy to answer the questions they have identified, outline practical implementation plan of the impact evaluation (timeline, links to mixed methods, budget) and polish their PowerPoint presentation. |
Thursday, May 26, 2022 |
9:00 – 9:05 | Recap from day 3 and overview of day aheadSebastian Insfran Moreno, ET Consultant, DIME, World Bank |
9:05 – 9:20 | Knowledge Exercise |
9:20 – 10:45 | Clinic 5: Teams’ presentations15 min per team (10 min presentation, 5 min discussion) Chair: Dean Karlan, Professor of Economics and Finance, Northwestern University ➜ Presentations: Cameroon | Ethiopia Rural | Ethiopia Urban | Haiti |
10:45 – 11:15 | COFFEE BREAK |
11:15 – 12:40 | Clinic 5: Teams’ presentations15 min per team (10 min presentation, 5 min discussion) Chair: Arianna Legovini, Director, DIME, World Bank ➜ Presentations: Bangladesh | South Sudan | Angola | Sierra Leone | Malawi |
12:40 – 1:00 | Closing Ceremony, and how to collaborate moving forwardColin Andrews, Program Manager, PEI, World Bank
Patrick Premand, Senior Economist, DIME, World Bank |
1:00–2:00 | LUNCH |
