Electronic versions

Documents

DOI

  • B. Calonge
    Colorado School of Public Health
  • G.P. Shekelle
    University of California, Los Angeles
  • D.K. Owens
    Stanford University
  • M.S. Teutsch
    University of California, Los Angeles
  • A. Downey
    National Academies for Science, Engineering and Medicine
  • L. Brown
    National Academies for Science, Engineering and Medicine
  • Jane Noyes
Background
Despite research investment and a growing body of diverse evidence there has been no comprehensive review and grading of evidence for public health emergency preparedness and response practices comparable to those in medicine and other public health fields.

Aims
The National Academies of Sciences, Engineering, and Medicine convened an ad hoc committee to develop and use methods for grading and synthesizing diverse type of evidence to create a single certainty of intervention-related evidence to support recommendations for Public Health Emergency Preparedness and Response Research.

Methods
A 13 step consensus building method was used. Experts were first canvassed in public meetings, and a comprehensive review of existing methods was undertaken. Although aspects of existing review methodologies and evidence grading systems were relevant, none adequately covered all requirements for this specific context. Starting with a desire to synthesize diverse sources of evidence not usually included in systematic reviews and using GRADE for assessing certainty and confidence in quantitative and qualitative evidence as the foundation, we developed a mixed-methods synthesis review and grading methodology that drew on (and in some cases adapted) those elements of existing frameworks and methods that were most applicable. Four topics were selected as test cases. The process was operationalized with a suite of method-specific reviews of diverse evidence types for each topic. Further consensus building was undertaken through stakeholder engagement and feedback

Conclusion
The NASEM committee’s GRADE adaption for mixed-methods reviews will further evolve over time and has yet to be endorsed by the GRADE working group

Keywords

  • GRADE, GRADE CERQual, evidence synthesis, mixed-methods, systematic review
Original languageEnglish
Pages (from-to)36-51
Number of pages16
JournalResearch synthesis methods
Volume14
Issue number1
Early online date20 Jun 2022
DOIs
Publication statusPublished - Jan 2023

Total downloads

No data available
View graph of relations