A Framework for Synthesizing Intervention Evidence from Multiple Sources Into a Single Certainty of Evidence Rating: Methodological Developments from a US National Academies of Sciences, Engineering, and Medicine committee
Research output: Contribution to journal › Article › peer-review
Electronic versions
Documents
- 2022 - Calonge - A framework for synthesizing intervention evidence from multiple sources into
Final published version, 1.54 MB, PDF document
Licence: CC BY-NC-ND Show licence
DOI
Background
Despite research investment and a growing body of diverse evidence there has been no comprehensive review and grading of evidence for public health emergency preparedness and response practices comparable to those in medicine and other public health fields.
Aims
The National Academies of Sciences, Engineering, and Medicine convened an ad hoc committee to develop and use methods for grading and synthesizing diverse type of evidence to create a single certainty of intervention-related evidence to support recommendations for Public Health Emergency Preparedness and Response Research.
Methods
A 13 step consensus building method was used. Experts were first canvassed in public meetings, and a comprehensive review of existing methods was undertaken. Although aspects of existing review methodologies and evidence grading systems were relevant, none adequately covered all requirements for this specific context. Starting with a desire to synthesize diverse sources of evidence not usually included in systematic reviews and using GRADE for assessing certainty and confidence in quantitative and qualitative evidence as the foundation, we developed a mixed-methods synthesis review and grading methodology that drew on (and in some cases adapted) those elements of existing frameworks and methods that were most applicable. Four topics were selected as test cases. The process was operationalized with a suite of method-specific reviews of diverse evidence types for each topic. Further consensus building was undertaken through stakeholder engagement and feedback
Conclusion
The NASEM committee’s GRADE adaption for mixed-methods reviews will further evolve over time and has yet to be endorsed by the GRADE working group
Despite research investment and a growing body of diverse evidence there has been no comprehensive review and grading of evidence for public health emergency preparedness and response practices comparable to those in medicine and other public health fields.
Aims
The National Academies of Sciences, Engineering, and Medicine convened an ad hoc committee to develop and use methods for grading and synthesizing diverse type of evidence to create a single certainty of intervention-related evidence to support recommendations for Public Health Emergency Preparedness and Response Research.
Methods
A 13 step consensus building method was used. Experts were first canvassed in public meetings, and a comprehensive review of existing methods was undertaken. Although aspects of existing review methodologies and evidence grading systems were relevant, none adequately covered all requirements for this specific context. Starting with a desire to synthesize diverse sources of evidence not usually included in systematic reviews and using GRADE for assessing certainty and confidence in quantitative and qualitative evidence as the foundation, we developed a mixed-methods synthesis review and grading methodology that drew on (and in some cases adapted) those elements of existing frameworks and methods that were most applicable. Four topics were selected as test cases. The process was operationalized with a suite of method-specific reviews of diverse evidence types for each topic. Further consensus building was undertaken through stakeholder engagement and feedback
Conclusion
The NASEM committee’s GRADE adaption for mixed-methods reviews will further evolve over time and has yet to be endorsed by the GRADE working group
Keywords
- GRADE, GRADE CERQual, evidence synthesis, mixed-methods, systematic review
Original language | English |
---|---|
Pages (from-to) | 36-51 |
Number of pages | 16 |
Journal | Research synthesis methods |
Volume | 14 |
Issue number | 1 |
Early online date | 20 Jun 2022 |
DOIs | |
Publication status | Published - Jan 2023 |
Total downloads
No data available