Electronic versions

Documents

DOI

  • Emmanuel Jimenez
    International Initiative for Impact Evaluation,New Delhi
  • Hugh Waddington
    International Initiative for Impact Evaluation, London
  • Neeta Goel
    International Initiative for Impact Evaluation,New Delhi
  • Audrey Prost
    London School of Hygiene & Tropical Medicine
  • Andrew Pullin
  • Howard White
    Campbell Collaboration, Oslo
  • Shaon Lahiri
    George Washington University
  • Anmol Narain
    International Initiative for Impact Evaluation,New Delhi
Recent evaluations have begun to use qualitative data in a manner that helps improve the quality and relevance of studies through the inferences that are drawn from them, and their applicability to policy makers and programme implementers. This paper reviews this work and identifies good practices to integrate qualitative methods into quantitative impact evaluations (IEs) and systematic reviews (SRs). Using recent literature on the characteristics of such practices, we developed two tools to assess the methodological rigour and mixed methods integration of 40 IEs and 7 SRs, drawing upon previous approaches. Our findings are that successful mixed methods quantitative impact evaluations: (1) provide a clear rationale for integration of methods; (2) deploy multidisciplinary teams; (3) provide adequate documentation; and (4) acknowledge limitations to the generalisability of qualitative and quantitative findings. Successful integration tended to improve mixed methods impact evaluations by collecting better data to inform the study design and findings, which helped contextualise quantitative findings. Our main observation on the integration of mixed methods in the systematic reviews is that mixed methods systematic reviews bringing together literatures that answer different questions can go beyond the ‘sum of their parts’ to provide holistic answers about development effectiveness. The findings of this study inform several recommendations to improve the conduct and reporting of mixed methods impact evaluations and systematic reviews.
Original languageEnglish
Pages (from-to)400-421
JournalJournal of Development Effectiveness
Volume10
Issue number4
Early online date2 Nov 2018
DOIs
Publication statusPublished - 30 Nov 2018

Total downloads

No data available
View graph of relations