Title: Evaluation of the Chhattisgarh Tribal Development Programme
Funder: International Fund for Agricultural Development (IFAD), Status: Live, Dev researchers: Bereket Kebede, Maren Duvendack
Using a quantitative approach, this project evaluates the impact of the Chhattisgarh Tribal Development Programme in the state of Chhattisgarh, India. The programme aims to empower tribal people—who are among the poorest people in India—to participate in their own development through local self-government. Although the programme targets both tribal and non-tribal populations, the tribal population represents the largest share. Dr Kebede and Dr Duvendack also provide inputs to the second edition of the Independent Office of Evaluation of IFAD (IOE) evaluation manual.
Title: Evaluation of the Results Based Aid in Education Sector Rwanda
Funder: DFID, Status: Live, Dev researchers: Paul Clist, Bereket Kebede
This project evaluates the implementation of the results-based aid (RBA) three-year pilot in Rwandan education (2012-2014). Using a mixed-methods approach, the project provides insights into progress – and barriers to progress – with respect to completion and teachers’ competence in English. Combining quantitative modelling with qualitative fieldwork at district, sector, and school-level, the project examines what happens ‘on the ground’ in relation to the agreed RBA results.
Title: Technical support to three ex-post impact evaluations using mixed methods approaches across three countries: Laos, Ghana and Cambodia
Funder: International Fund for Agricultural Development (IFAD), Status: Live, Dev researchers: Bereket Kebede, Maren Duvendack, Jennifer Leavy
This project aims to enhance the delivery of public services for poor rural people in Cambodia, Laos, and Ghana. Using a mixed-methods approach, four IFAD-supported projects are evaluated with a specific focus on women’s empowerment, movements out of poverty, and economic resilience and adaptive capacity. Lessons learnt from the evaluation are extracted to strengthen public institutions’ impact evaluation and monitoring and evaluation capacity.
Title: Supporting Evaluation Capacity in Government and Civil Society in Uganda
Funder: GIZ, Status: Complete, Dev researchers: Maren Duvendack
To enhance the use of evaluation in policy-making in Uganda, this project developed national evaluation standards in collaboration with the Evaluation Sub-Committee (ESC) and the Uganda Evaluation Association (UEA) consisting of representatives of the Ministry of Finance, Planning and Economic Development, the Parliament of Uganda, and a number of NGOs and private sector actors. A short-term training course was provided for ministries, departments, agencies, Parliament and civil society.
Title: Evaluating Development Impact Bonds
Funder: DFID, Status: Complete, Dev researchers: Paul Clist
Being a new aid modality, Development Impact Bonds (DIBs) pose particular challenges for evaluation. Grounded on economic theory, this study presents concepts for understanding how data from evaluation of individual DIBs can be synthesised into an overall evidence base. Based on a review of relevant grey and academic literature and consultation of a number of key informants, a framework to use for evaluation of DIBs is presented.
Title: Valuing Progress: Gates Foundation: Development Progress II
Funder: Bill & Melinda Gates Foundation, Status: Complete, Dev researchers: Laura Camfield
The project explored ways of measuring development outcomes that are based on poor people's own values and priorities. Background research was undertaken on issues relating to Valuing Progress, including evaluation of methodologies for measuring wellbeing and constructing composite measures. A research proposal was developed to seek extension of Valuing Progress as a pilot project. The outputs of the project will be published in a book chapter in ‘Mixed methods research in poverty and vulnerability: sharing ideas and learning lessons.’ (Roelen, K. & Camfield, L. 2015) as well as in an Overseas Development Institute working paper.
Title: Impact of the irrigation improvement component of the Agricultural Sector Programme Loan (ASPL)
Funder: 3IE, Status: Complete, Dev researchers: Richard Palmer Jones
This observational study analysed the impact of the Mae Lao Irrigation Project in Thailand. Using a quasi-experimental design, farm plots within the irrigation project were compared to farm plots in neighbouring irrigation schemes not subject to the intervention. The study design exploited variation within irrigation schemes, between on-scheme irrigated and irrigable areas and off-scheme unirrigated areas, and between scheme variation in a cross-section survey. The full report can be found here.
Title: Child Development Grant (CDG) impact evaluation
Funder: ITAD CDG, Status: Live, Dev researchers: Laura Camfield
By providing peer review support, this project strengthens the Child Development Grant (CDG) impact evaluation process. Dr Camfield supports the Information Technology and Agricultural Development (ITAD) evaluation team to effectively integrate the three evaluation components: randomised controlled trial, process evaluation, and qualitative evaluation in a robust mixed methods approach.
Development of guide on how to apply Qualitative Comparative Analysis (QCA)
Funder: Swedish Expert Group for Aid Studies, Status: Live, Dev researchers: Laura Camfield
The Qualitative Comparative Analysis (QCA) is a method particularly well suited for systematic and rigorous comparisons and synthesis of information over a limited number of cases. Dr. Camfield is a member of the reference group convened by the Swedish Expert Group for Aid Studies (EBA) to develop a step-by-step guide on how to apply and quality-assure the application of QCA to real-life development evaluation, indicating the common mistakes and challenges for each step.
Title: Midline and Endline Study for Save the Children Girls’ Education Project
Funder: Save the Children, Status: Live, Dev researchers: Laura Camfield, Maren Duvendack
Using quantitative and qualitative research methods, this project conducts the midline and endline studies for Save the Children Girls’ Education Project in Mozambique. With a focus on the most marginalised girls’ school attendance and learning outcomes in the provinces of Gaza, Manica, and Tete, the components to be evaluated include: the project design and implementation, the impact on retention and learning, value for money, sustainability, and success in leveraging additional interest and investment.
Title: Evaluation to estimate the impact of mNutrition
Funder: DFID, Status: Live, Dev researchers: Laura Camfield
mNutrition is a global initiative supported by DFID, organized by GSMA, and implemented by in-country Mobile Network Operators to use mobile technology to improve the health and nutritional status of children and adults in the developing world. The potential to utilize mobile technology to change attitudes, knowledge, behaviours and practices around health and agriculture for improved nutrition status has been recognized for some time, but to date there have been no rigorous evaluations of m-services at scale. A consortium of researchers led by IDS will conduct a rigorous evaluation to estimate the impact of mNutrition on adults and children. Dr Camfield provides advisory on the qualitative components of the study.
Title: EU Expert Workshop on Research and Innovation Evaluation Methodologies
Funder: European Commission, Status: Live, Dev researchers: Laura Camfield
The legal base of the current EU Framework Programme for Research and Innovation
(Horizon 2020) has set out ambitious and challenging evaluation requirements including the assessment of longer-term impacts and EU added-value of the Programme. A workshop with leading evaluation experts was organised in order to map the most appropriate evaluation methodologies for measurement of macroeconomic and wider societal impacts of national and/or European research and innovation funding, as well as to define how these methodologies could be best applied in the area of research and innovation.
Title: BBC Media Action
Funder: BBC Media Action Global Grant, Status: Live, Dev researchers: Laura Camfield
The BBC Media Action Global Grant 2012-2016 targets to reach 200 million people in 14 countries living in poverty—especially women and girls—through mass media. By conveying knowledge about governance, health, and humanitarian crises, the aim is to enable people to make informed choices, take actions for their own development, and influence decision makers and hold them to account. As a member of the BBC Media Action Global Grant advisory group, Dr Camfield provides advisory on qualitative and mixed research methods in the evaluation of the BBC Global Grant.
Title: Evaluation of Poverty and Peace (POVPEACE) programme
Funder: The Research Council of Norway, Status: Live, Dev researchers: Laura Camfield
The Norwegian government’s Poverty and Peace research programme (PovPeace) 2005–2013 focused on research on international poverty issues and research relating to war, peace, and development. As member of a group of experts advising on the evaluation of PovPeace, Dr Camfield provides advisory and support provides advisory on qualitative and mixed research methods for the company Oxford Research that conducts the evaluation.
Title: Building Young Futures Longitudinal Survey Small-Scale Impact Assessment
Funder: UNICEF and Barclays, Status: Ongoing, Dev researchers: Laura Camfield
Applying quantitative and qualitative methods, this longitudinal study assessed the impact of the UNICEF UK and Barclays partnership programme “Building Young Futures”. With the use of surveys, focus group discussions and one-to-one interviews, the study determined in each programme country—Brazil, Egypt, India, Pakistan, Uganda, and Zambia—how young people perceived themselves and the progress they had made in becoming economically empowered. Dr Camfield joined as an advisor mid-way through the setting up of the qualitative research to support the quality of data generation, analysis and reporting (for example, through collaboratively developing guidelines).