Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach

Zachary Munn, Micah D J Peters, Cindy Stern, Catalin Tufanaru, Alexa McArthur, Edoardo Aromataris, Zachary Munn, Micah D J Peters, Cindy Stern, Catalin Tufanaru, Alexa McArthur, Edoardo Aromataris

Abstract

Background: Scoping reviews are a relatively new approach to evidence synthesis and currently there exists little guidance regarding the decision to choose between a systematic review or scoping review approach when synthesising evidence. The purpose of this article is to clearly describe the differences in indications between scoping reviews and systematic reviews and to provide guidance for when a scoping review is (and is not) appropriate.

Results: Researchers may conduct scoping reviews instead of systematic reviews where the purpose of the review is to identify knowledge gaps, scope a body of literature, clarify concepts or to investigate research conduct. While useful in their own right, scoping reviews may also be helpful precursors to systematic reviews and can be used to confirm the relevance of inclusion criteria and potential questions.

Conclusions: Scoping reviews are a useful tool in the ever increasing arsenal of evidence synthesis approaches. Although conducted for different purposes compared to systematic reviews, scoping reviews still require rigorous and transparent methods in their conduct to ensure that the results are trustworthy. Our hope is that with clear guidance available regarding whether to conduct a scoping review or a systematic review, there will be less scoping reviews being performed for inappropriate indications better served by a systematic review, and vice-versa.

Keywords: Evidence-based healthcare; Scoping review; Systematic review.

Conflict of interest statement

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

All the authors are members of the Joanna Briggs Institute, an evidence-based healthcare research institute which provides formal guidance regarding evidence synthesis, transfer and implementation. Zachary Munn is a member of the editorial board of this journal. The authors have no other competing interests to declare.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

    1. Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 2010;7(9):e1000326. doi: 10.1371/journal.pmed.1000326.
    1. Chalmers I, Hedges LV, Cooper H. A brief history of research synthesis. Eval Health Prof. 2002;25(1):12–37. doi: 10.1177/0163278702025001003.
    1. Jordan Z, Munn Z, Aromataris E, Lockwood C. Now that we're here, where are we? The JBI approach to evidence-based healthcare 20 years on. Int J Evid Based Healthc. 2015;13(3):117–120. doi: 10.1097/XEB.0000000000000053.
    1. Munn Z, Stern C, Aromataris E, Lockwood C, Jordan Z. What kind of systematic review should I conduct? A proposed typology and guidance for systematic reviewers in the medical and health sciences. BMC Med Res Methodol. 2018;18(1):5. doi: 10.1186/s12874-017-0468-4.
    1. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32. doi: 10.1080/1364557032000119616.
    1. Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015;13(3):141–146. doi: 10.1097/XEB.0000000000000050.
    1. Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5(1):1. doi: 10.1186/1748-5908-5-69.
    1. Colquhoun HL, Levac D, O'Brien KK, et al. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014;67(12):1291–1294. doi: 10.1016/j.jclinepi.2014.03.013.
    1. Pham MT, Rajić A, Greig JD, Sargeant JM, Papadopoulos A, McEwen SA. A scoping review of scoping reviews: advancing the approach and enhancing the consistency. Res Synth Methods. 2014;5(4):371–385. doi: 10.1002/jrsm.1123.
    1. Tricco AC, Lillie E, Zarin W, et al. A scoping review on the conduct and reporting of scoping reviews. BMC Med Res Methodol. 2016;16:15. doi: 10.1186/s12874-016-0116-4.
    1. Pearson A. Balancing the evidence: incorporating the synthesis of qualitative data into systematic reviews. JBI Reports. 2004;2:45–64. doi: 10.1111/j.1479-6988.2004.00008.x.
    1. Aromataris E, Pearson A. The systematic review: an overview. AJN The American Journal of Nursing. 2014;114(3):53–58. doi: 10.1097/01.NAJ.0000444496.24228.2c.
    1. Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ (Clinical research ed) 2009;339:b2700. doi: 10.1136/bmj.b2700.
    1. Higgins J, Green S, eds. Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. ed: The Cochrane Collaboration 2011.
    1. Munn Z, Porritt K, Lockwood C, Aromataris E, Pearson A. Establishing confidence in the output of qualitative research synthesis: the ConQual approach. BMC Med Res Methodol. 2014;14:108. doi: 10.1186/1471-2288-14-108.
    1. Pearson A, Jordan Z, Munn Z. Translational science and evidence-based healthcare: a clarification and reconceptualization of how knowledge is generated and used in healthcare. Nursing research and practice. 2012;2012:792519. doi: 10.1155/2012/792519.
    1. Steinberg E, Greenfield S, Mancher M, Wolman DM, Graham R. Clinical practice guidelines we can trust. Institute of Medicine. Washington, DC: National Academies Press; 2011.
    1. Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Systematic Reviews. 2012;1:28. doi: 10.1186/2046-4053-1-28.
    1. Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Inf Libr J. 2009;26(2):91–108. doi: 10.1111/j.1471-1842.2009.00848.x.
    1. Tricco AC, Tetzlaff J, Moher D. The art and science of knowledge synthesis. J Clin Epidemiol. 2011;64(1):11–20. doi: 10.1016/j.jclinepi.2009.11.007.
    1. Armstrong R, Hall BJ, Doyle J, Waters E. ‘Scoping the scope’ of a cochrane review. J Public Health. 2011;33(1):147–150. doi: 10.1093/pubmed/fdr015.
    1. Anderson S, Allen P, Peckham S, Goodwin N. Asking the right questions: scoping studies in the commissioning of research on the organisation and delivery of health services. Health Research Policy and Systems. 2008;6(1):1. doi: 10.1186/1478-4505-6-7.
    1. Pearson A, Wiechula R, Court A, Lockwood C. The JBI model of evidence-based healthcare. International Journal of Evidence-Based Healthcare. 2005;3(8):207–215.
    1. Bragge P, Clavisi O, Turner T, Tavender E, Collie A, Gruen RL. The global evidence mapping initiative: scoping research in broad topic areas. BMC Med Res Methodol. 2011;11:92. doi: 10.1186/1471-2288-11-92.
    1. Chambers D, Wilson PM, Thompson CA, Hanbury A, Farley K, Light K. Maximizing the impact of systematic reviews in health care decision making: a systematic scoping review of knowledge-translation resources. Milbank Q. 2011;89(1):131–156. doi: 10.1111/j.1468-0009.2011.00622.x.
    1. Challen K, Lee AC, Booth A, Gardois P, Woods HB, Goodacre SW. Where is the evidence for emergency planning: a scoping review. BMC Public Health. 2012;12:542. doi: 10.1186/1471-2458-12-542.
    1. Schaink AK, Kuluski K, Lyons RF, et al. A scoping review and thematic classification of patient complexity: offering a unifying framework. Journal of comorbidity. 2012;2(1):1–9. doi: 10.15256/joc.2012.2.15.
    1. Hines Delaney, Modi Neena, Lee Shoo K., Isayama Tetsuya, Sjörs Gunnar, Gagliardi Luigi, Lehtonen Liisa, Vento Maximo, Kusuda Satoshi, Bassler Dirk, Mori Rintaro, Reichman Brian, Håkansson Stellan, Darlow Brian A., Adams Mark, Rusconi Franca, San Feliciano Laura, Lui Kei, Morisaki Naho, Musrap Natasha, Shah Prakesh S. Scoping review shows wide variation in the definitions of bronchopulmonary dysplasia in preterm infants and calls for a consensus. Acta Paediatrica. 2016;106(3):366–374. doi: 10.1111/apa.13672.
    1. Callary SA, Solomon LB, Holubowycz OT, Campbell DG, Munn Z, Howie DW. Wear of highly crosslinked polyethylene acetabular components. Acta Orthop. 2015;86(2):159–168. doi: 10.3109/17453674.2014.972890.
    1. Davy C, Harfield S, McArthur A, Munn Z, Brown A. Access to primary health care services for indigenous peoples: a framework synthesis. Int J Equity Health. 2016;15(1):163. doi: 10.1186/s12939-016-0450-5.
    1. Harfield S, Davy C, Kite E, et al. Characteristics of indigenous primary health care models of service delivery: a scoping review protocol. JBI Database System Rev Implement Rep. 2015;13(11):43–51. doi: 10.11124/jbisrir-2015-2474.
    1. Harfield SG, Davy C, McArthur A, Munn Z, Brown A, Brown N. Characteristics of indigenous primary health care service delivery models: a systematic scoping review. Glob Health. 2018;14(1):12. doi: 10.1186/s12992-018-0332-2.
    1. Peters MDJ LC, Munn Z, Moola S, Mishra RK (2015) , Protocol. Adelaide: the Joanna Briggs Institute UoA. What are people’s views and experiences of delivering and participating in microfinance interventions? A systematic review of qualitative evidence from South Asia.
    1. Peters MDJ LC, Munn Z, Moola S, Mishra RK People’s views and experiences of participating in microfinance interventions: A systematic review of qualitative evidence. London: EPPI-Centre: social science research unit, UCL Institute of education, University College London; 2016.
    1. Wagman P, Håkansson C, Jonsson H. Occupational balance: a scoping review of current research and identified knowledge gaps. J Occup Sci. 2015;22(2):160–169. doi: 10.1080/14427591.2014.986512.
    1. Peters MD. In no uncertain terms: the importance of a defined objective in scoping reviews. JBI Database System Rev Implement Rep. 2016;14(2):1–4. doi: 10.11124/jbisrir-2016-2838.
    1. Hetrick SE, Parker AG, Callahan P, Purcell R. Evidence mapping: illustrating an emerging methodology to improve evidence-based practice in youth mental health. J Eval Clin Pract. 2010;16(6):1025–1030. doi: 10.1111/j.1365-2753.2008.01112.x.
    1. Miake-Lye IM, Hempel S, Shanman R, Shekelle PG. What is an evidence map? A systematic review of published evidence maps and their definitions, methods, and products. Systematic reviews. 2016;5(1):1. doi: 10.1186/s13643-016-0204-x.
    1. Draper P. A critique of concept analysis. J Adv Nurs. 2014;70(6):1207–1208. doi: 10.1111/jan.12280.
    1. Gibson CH. A concept analysis of empowerment. J Adv Nurs. 1991;16(3):354–361. doi: 10.1111/j.1365-2648.1991.tb01660.x.
    1. Meeberg GA. Quality of life: a concept analysis. J Adv Nurs. 1993;18(1):32–38. doi: 10.1046/j.1365-2648.1993.18010032.x.
    1. Ream E, Richardson A. Fatigue: a concept analysis. Int J Nurs Stud. 1996;33(5):519–529. doi: 10.1016/0020-7489(96)00004-1.
    1. Tricco AC, Antony J, Zarin W, et al. A scoping review of rapid review methods. BMC Med. 2015;13:224. doi: 10.1186/s12916-015-0465-6.
    1. Ganann R, Ciliska D, Thomas H. Expediting systematic reviews: methods and implications of rapid reviews. Implement Sci. 2010;5:56. doi: 10.1186/1748-5908-5-56.
    1. Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in health technology assessments. Int J Evid Based Healthc. 2012;10(4):397–410. doi: 10.1111/j.1744-1609.2012.00290.x.
    1. Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Syst Rev. 2012;1:10. doi: 10.1186/2046-4053-1-10.
    1. Munn Z, Lockwood C, Moola S. The development and use of evidence summaries for point of care information systems: a streamlined rapid review approach. Worldviews Evid-Based Nurs. 2015;12(3):131–138. doi: 10.1111/wvn.12094.
    1. Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–473. doi: 10.7326/M18-0850.
    1. Munn Z, Aromataris E, Tufanaru C, Stern C, Porritt K, Farrow J, Lockwood C, Stephenson M, Moola S, Lizarondo L, McArthur A. The development of software to support multiple systematic review types: the Joanna Briggs institute system for the unified management, assessment and review of information (JBI SUMARI). Int J Evid Based Healthc. 2018. (in press)
    1. Stern C, Munn Z, Porritt K, et al. An international educational training course for conducting systematic reviews in health care: the Joanna Briggs Institute's comprehensive systematic review training program. Worldviews Evid-Based Nurs. 2018;15(5):401–408. doi: 10.1111/wvn.12314.

Source: PubMed

3
Abonnere