RTI uses cookies to offer you the best experience online. By clicking “accept” on this website, you opt in and you agree to the use of cookies. If you would like to know more about how RTI uses cookies and how to manage them please view our Privacy Policy here. You can “opt out” or change your mind by visiting: http://optout.aboutads.info/. Click “accept” to agree.
Improving the utility of evidence synthesis for decision makers in the face of insufficient evidence
Murad, M. H., Chang, S. M., Fiordalisi, C. V., Lin, J. S., Wilt, T. J., Tsou, A. Y., Leas, B., Siddique, S., Zullo, A. R., Balk, E. M., Rutter, C. M., Robinson, K., Coleman, C., Costa, O., Helfand, M., Stoeger, E., & Viswanathan, M. (2021). Improving the utility of evidence synthesis for decision makers in the face of insufficient evidence. Journal of Clinical Epidemiology, 135, 170-175. https://doi.org/10.1016/j.jclinepi.2021.02.028
OBJECTIVE: To identify and suggest strategies to make insufficient evidence ratings in systematic reviews more actionable.
STUDY DESIGN AND SETTING: A workgroup comprising members from the Evidence-Based Practice (EPC) Program of the Agency for Healthcare Research and Quality convened throughout 2020. We conducted iterative discussions considering information from three data sources: a literature review for relevant publications and frameworks, a review of a convenience sample of past systematic reviews conducted by the EPCs, and an audit of methods used in past EPC technical briefs.
RESULTS: We identified five strategies for supplementing systematic review findings when evidence on benefits or harms is expected to be, or found to be, insufficient: 1) reconsider eligible study designs, 2) summarize indirect evidence, 3) summarize contextual and implementation evidence, 4) consider modelling, and 5) incorporate unpublished health system data in the evidence synthesis. While these strategies may not increase the strength of evidence, they may improve the utility of reports for decision makers. Adopting these strategies depends on feasibility, timeline, funding, and expertise of the systematic reviewers.
CONCLUSION: Throughout the process of evidence synthesis of early scoping, protocol development, review conduct, and review presentation, authors can consider these five strategies to supplement evidence with insufficient rating to make it more actionable for end-users.
