Skip to Main Navigation
Events
Image
Impact Evaluation in Governance
January 27-30, 2015Istanbul, Turkey

This workshop, hosted by Development Impact Evaluation (DIME) and the WB Governance Global Practice will bring together practitioners, subject matter experts, and researchers working to find solutions to challenges in governance through the use of IEs.

Impact Evaluation to Development Impact (i2i) is a new global platform building partnerships to expand the use of impact evaluation (IE) for evidence-based policy. Members work together to improve the effectiveness of development policies and empower policymakers to test innovations and scale-up solutions to their development problems. The i2i platform is managed by the Development Impact Evaluation (DIME) Unit. The United Kingdom's Department for International Development (DFID) is an i2i donor.

Development Impact Evaluation (DIME) is housed in the Research Group of the World Bank with a mandate to generate high-quality and operationally relevant impact evaluation research to transform development policy. DIME’s objectives are to increase the use of impact evaluation in the design and implementation of public policy, improve the quality of the World Bank’s operations, strengthen country institutions for evidence-based policy making, and generate knowledge in strategic development areas. 

ieGovern Program

Participating Projects Portfolio

Last Updated: Jan 26, 2015

 

DIME & GGP Impact Evaluation Workshop: Governance & Justice

January 27-30, 2015

Download Agenda

Monday (January 26)

5:45 - 6:30PM Welcome Session for Academics & TTLs
 

Chairs:

Arianna Legovini (DIME), Yongmei Zhou, Adviser, WB Governance GP

María Margarita "Paca" Zuleta, General Director, Colombia Compra Eficiente

  5:45pm: Welcome remarks from Arianna, Yongmei and Paca
6:00pm: Setting expectations for the week (Daniel Rogger, Economist, DIME)
6:30PM Dinner  
Tuesday (January 27)
8:00 - 8:30AM Registration  
8:30 - 8:45AM Welcome Remarks  
  Michael Roscitt, ieGovern Initiative, World Bank
8:45 - 9:15AM Tablet Orientation & Knowledge Test  
9:15 - 9:45AM Impact Evaluation for Real Time Policy Making
 

Arianna Legovini, Manager

Development Impact Evaluation (DIME), World Bank

9:45 - 10:15AM Evidence as a Tool for Public Sector Officials  
  María Margarita "Paca" Zuleta, General Director, Colombia Compra Eficiente
10:15 - 10:30AM Coffee Break  
10:30 - 11:30AM Designing Public Sector Interventions  
 

Yongmei Zhou, Adviser, WB Governance GP &

Oriana Bandiera (Professor of Economics, London School of Economics) - PPT

11:30AM - 12:15PM Team Introductions: "What is the problem?"   
(Small groups) Daniel Rogger, Economist, DIME
  Team introductions to academic partners; "What is the Problem" we have come to Istanbul to address
12:15 - 1:30PM Lunch  
  Teams sit with respective clusters & perform group introductions over lunch
1:30 - 2:45PM Measuring Impact I: Causal Inference & Quasi-Experimental Methods
(Language groups)

English I: Vincenzo Di Maro (Senior Economist, DIME);
English II: Laura Chioda (Senior Economist, Office of Chief Economist, LAC);
French: Eric Mvukiyehe (Economist, DIME)
Spanish: David Evans (Senior Economist, Office of Chief Economist, Africa);

English Presentation; Spanish Presentation

Causality / Causal Inference
Difference-in-Difference
Propensity Score Matching
Discontinuity Design
2:45 - 3:00PM Coffee Break  
3:00 - 3:15PM Integrating Impact Evaluations Into the Design of Projects
  Bilal Siddiqi, Economist, Development Impact Evaluation (DIME), World Bank
  Interactive guide for designing an impact evaluation based on a practical example.
Gives overview of group work sessions.
3:15 - 6:00PM Group Work I
(Small groups) Teams work individually within sector clusters; Faciliated by sector GGP & academic leads
  In this session, the group will establish a results chain & determine the research questions for their project. At the end of the session, each group will submit their output in an online template for submission
6:00PM Debriefing Session  
6:30PM Turkish Night: Dinner & Music Reception at Hotel  
Wednesday (January 28)
9:00 - 10:00AM The Challenges & Opportunities of Public Sector Reform
  Chair: Yongmei Zhou, Adviser, WB Governance GP
  HE Ato Alemayehu Gujo, State Minister of Public Finance
Federal Democratic Republic of Ethiopia
Hadeel Abdel Aziz, Executive Director, Justice Center for Legal Aid
Kingdom of Jordan
Mario Rodolfo Riveiro, Gerente de Planificación y Desarrollo Institucional
Republic of Guatemala
Dr. Paul Kimalu, Deputy Director Performance, Ministry of Justice
Republic of Kenya
10:00 - 11:00AM Governance Impact Evaluations in Practice
  Chair: Vivek Srivastava, Lead Public Sector Development Specialist, Governance Global Practice
  Phil Keefer, Inter-American Development Bank: The Realities of Evalution of Public Sector Reform
Justin Sandefur, Center for Global Development: The Scope of Public Sector Interventions: Examples from the Justice Sector
11:00 - 11:15AM Coffee Break  
11:15 - 12:30PM Measuring Impact II: Experimental Methods
(Language groups)

English I: Vincenzo Di Maro (Senior Economist, DIME);
English II: Laura Chioda (Senior Economist, Office of Chief Economist, LAC);
French: Eric Mvukiyehe (Economist, DIME)
Spanish: David Evans (Senior Economist, Office of Chief Economist, Africa);

English Presentation; Spanish Presentation

Impact Evaluation
Causality / Causal Inference
Randomization
12:30 - 1:30PM Lunch  
1:30 - 2:30PM Experimental Methods Practical Case Study
(Small groups) The theoretical concepts discussed up to now in the policy and techincal sessions will be reinforced through group work on a case study. The case study will focus on the various identification strategies and methods for constructing a counterfactual. Results of the exercise will discussed in groups.
3:30 - 3:45PM Coffee Break  
3:45 - 6:00PM Group Work 2
  Teams work individually within sector clusters; Faciliated by sector GGP & academic leads
  Teams work with their facilitator to design an impact evaluation strategy to answer the questions they have identified. The proposed design will be recorded in the online template.
6:00PM Debriefing Session  
6:30PM Dinner  
     
Thursday (January 29)
9:00 - 9:45AM Public Sector Impact Ignite I: Top-down: Effectively Driving Reform Across Government
 

Jurgen Blum, World Bank: Managing Change Effectively

Michael Best, Stanford University:
Systems Design: Hitting the Right Balance Between Autonomy & Control

9:45 - 10:15AM Public Sector Impact Ignite II: Bottom-up: Getting Citizens Engaged
  Martina Bjorkman, Stockholm School of Economics: Engaging Citizens in Public Sector Reforms
Guy Grossman, University of Pennsylvania: Convincing Politicians that Public Sector Reform Pays
10:15 - 11:00AM Measurement Issues in Public Sector Impact Evaluations
  Imran Rasul, Professor of Economics, University College London
11:00 - 11:15AM Coffee Break  
11:15AM - 12:00PM Power Calculations: What and How in the Public Sector?
  Cyrus Samii, Assistant Professor, New York University
12:30 - 12:45PM Group Picture  
12:45 - 1:45PM Lunch  
1:45 - 2:15PM Behavorial Aspects of Public Sector Interventions 
  Varun Gauri, Senior Economist, Co-director World Development Report 2015
2:15 - 3:15PM Group Work 3  
  Teams work individually within sector clusters; Faciliated by sector GGP & academic leads
  In this session, the group will work on possible outcome measures and practical implementation plan of the IE including budget, timeline and staffing.
 
     
3:15 - 3:30PM Coffee Break  
3:30 - 6:00PM Group Work 4  
  Teams work individually within sector clusters; Faciliated by sector GGP & academic leads
  In this session, teams will finalize their presentations and posters for tomorrow.
6:00PM Debriefing Session  
6:30PM Dinner  
Friday (January 30)
8:00 - 9:00AM Teams finalize presentations  
9:00 - 9:30AM Opportunities Ahead: Impact Evaluation to Development Impact (i2i)
  Marcus Holmlund (Economist, DIME)  
9:30AM - 12:00PM Impact Evaluation Designs: Team Presentations
 

Teams present as sector panel, with each panel opened by the GGP lead. Questions submitted via social media.

Procurement: Group1 - Swaziland, Brazil, Bangladesh, Colombia

Procurement: Group 2 - Lebanon-Palestine, Ethiopia, India, Guatemala

Justice: Group 1 - Jamaica, Azerbaijan, Kazakhstan

Justice Group 2 - Kenya, Pakistan, Kyrgyz Republic

Decentralization

Civil Service

12:00 - 2:00PM Poster Session + Q&A  
  Teams set up posters to allow visits and questions from workshop participants to discuss designs and collaboration opportunities. 
12:00PM Lunch (Served as part of poster session)  
2:00 - 2:30PM Consolidating Feedback  
  Teams meet to organize social media questions and provide initial feedback to be submitted along with project design.
2:30 - 3:15PM Certificates & Prize-Giving  
3:15 - 3:30PM Building Evidence for Better Governance  
  Yongmei Zhou, Adviser, WB Governance GP  
3:30 - 3:45PM Closing Remarks  
  Arianna Legovini, Manager, DIME  

Last Updated: Feb 06, 2015






Welcome