The contribution of benchmarking to quality improvement in healthcare. A systematic literature review

Claire Willmington, Paolo Belardi, Anna Maria Murante, Milena Vainieri, Claire Willmington, Paolo Belardi, Anna Maria Murante, Milena Vainieri

Abstract

Background: Benchmarking has been recognised as a valuable method to help identify strengths and weaknesses at all levels of the healthcare system. Despite a growing interest in the practice and study of benchmarking, its contribution to quality of care have not been well elucidated. As such, we conducted a systematic literature review with the aim of synthesizing the evidence regarding the relationship between benchmarking and quality improvement. We also sought to provide evidence on the associated strategies that can be used to further stimulate quality improvement.

Methods: We searched three databases (PubMed, Web of Science and Scopus) for articles studying the impact of benchmarking on quality of care (processes and outcomes). Following assessment of the articles for inclusion, we conducted data analysis, quality assessment and critical synthesis according to the PRISMA guidelines for systematic literature review.

Results: A total of 17 articles were identified. All studies reported a positive association between the use of benchmarking and quality improvement in terms of processes (N = 10), outcomes (N = 13) or both (N = 7). In the majority of studies (N = 12), at least one intervention, complementary to benchmarking, was undertaken to stimulate quality improvement. The interventions ranged from meetings between participants to quality improvement plans and financial incentives. A combination of multiple interventions was present in over half of the studies (N = 10).

Conclusions: The results generated from this review suggest that the practice of benchmarking in healthcare is a growing field, and more research is needed to better understand its effects on quality improvement. Furthermore, our findings indicate that benchmarking may stimulate quality improvement, and that interventions, complementary to benchmarking, seem to reinforce this improvement. Although this study points towards the benefit of combining performance measurement with interventions in terms of quality, future research should further analyse the impact of these interventions individually.

Keywords: Benchmarking; Healthcare quality; Outcome indicators; Performance indicators; Process indicator; Quality improvement.

Conflict of interest statement

The authors declare that they have no competing interests.

© 2022. The Author(s).

Figures

Fig. 1
Fig. 1
Flowchart of the literature review process
Fig. 2
Fig. 2
Scale of benchmarking initiatives (Panel A) and types of benchmarking developers (Panel B)

References

    1. Ettorchi - Tardy A, Levif M, Michel P. Benchmarking: A method for continuous quality improvement in health. Healthc Policy. 2012;7(4):101–119.
    1. Camp RC. The search for industry best practices that lead to superior performance. 1989. p. 320.
    1. Liebfried HJ, McNair CJ. In: Benchmarking: a tool for continuous improvement. Sons JW, editor. New York: John Wiley & sons; 1992.
    1. Watson GH. Strategic benchmarking: How to rate your comoany’s performance against the world’s best. John Wiley & Sons Incorporated, editor. Somerset: Wiley; 1993.
    1. Bowerman M, Francis G, Ball A, Fry J. The evolution of benchmarking in UK local authorities. Benchmarking An Int J. 2002;9(5):429–449.
    1. Doug M, Gift B. Collaborative Benchmarking in Healthcare. J Qual Improv. 1994;20:239–249.
    1. Camp RC, Tweet AG. Benchmarking applied to health care. Jt Comm J Qual Improv. 1994;20(5):229–238.
    1. Thonon F, Watson J, Saghatchian M. Benchmarking facilities providing care: an international overview of initiatives. SAGE Open Med. 2015;3:205031211560169.
    1. Wennberg JE. Understanding geographic variations in health care delivery. N Engl J Med. 1999;340(1):52–53.
    1. Arah OA, Klazinga NS, Delnoij DMJ, Ten Asbroek AHA, Custers T. Conceptual frameworks for health systems performance: a quest for effectiveness, quality, and improvement. Int J Qual Heal Care. 2003;15(5):377–398.
    1. Nuti S, Seghieri C. Is variation management included in regional healthcare governance systems? Some proposals from Italy. Health Policy (New York) 2014;114(1):71–78.
    1. Batalden PB, Davidoff F. What is “quality improvement” and how can it transform healthcare? Qual Saf Heal Care. 2007;16(1):2–3.
    1. Smith P, Mossialos E, Papanicolas I, Leatherman S. Performance measurement and professional improvement. Cambridge: Cambridge University Press; 2009. pp. 613–640.
    1. Expert Group on Health Systems Performance Assessment . So what? - Strategies across Europe to assess quality of care. European Union; 2016. pp. 92–107.
    1. Oliver TR. Population health rankings as policy indicators and performance measures. Prev Chronic Dis. 2010;7(5):A101.
    1. Klazinga N, Fischer C, Ten Asbroek A. Health services research related to performance indicators and benchmarking in Europe. J Heal Serv Res Policy. 2011;16(SUPPL. 2):38–47.
    1. Barbazza E, Klazinga NS, Kringos DS. Exploring the actionability of healthcare performance indicators for quality of care: a qualitative analysis of the literature, expert opinion and user experience. BMJ Quality & Safety 2021;30:1010–20.
    1. Nolte E. International benchmarking of healthcare quality: a review of the literature. Rand Heal Q. 2012;1(4):e1000097.
    1. Nuti S, Vainieri M. Handbook of Health Services Research. Boston: Springer Reference; 2014. Strategies and tools to manage variation in regional governance systems; p. 23.
    1. Codling S. In: Best practice benchmarking: a management guide. Gower Publishing L, editor. Aldershot: Gower Publishing, Ltd; 1995.
    1. Lober WB, Flowers JL. Consumer reports in health care: do they make a difference? Semin Oncol Nurs. 2011;27(3):169–182. doi: 10.1016/j.soncn.2011.04.002.
    1. Prang KH, Maritz R, Sabanovic H, Dunt D, Kelaher M. Mechanisms and impact of public reporting on physicians and hospitals’ performance: a systematic review (2000–2020) Plos One. 2021;16(2 February):1–24. doi: 10.1371/journal.pone.0247297.
    1. Hibbard JH, Stockard J, Tusler M. Does publicizing hospital performance stimulate quality improvement efforts? Health Aff. 2003;22(2):84–94.
    1. Bevan G, Fasolo B. Behavioural Public Policy. Cambridge: Cambridge University Press; 2013. Models of governance of public services: Empirical and behavioural analysis of ‘econs’ and ‘humans’; pp. 38–62.
    1. Bevan G, Wilson D. Does “naming and shaming” work for schools and hospitals? Lessons from natural experiments following devolution in England and Wales. Public Money Manag. 2013;33(4):245–252.
    1. Bevan G, Evans A, Nuti S. Reputations count: why benchmarking performance is improving health care across the world. Heal Econ Policy Law. 2019;14(2):141–161.
    1. World Health Organization . Health systems : improving performance. World Health Organization; 2000. p. 215.
    1. WHO, OECD . DAC guidelines and reference series: poverty and health. 2003. p. 55.
    1. Arah OA, Westert GP, Hurst J, Klazinga NS. A conceptual framework for the OECD health care quality indicators project. Int J Qual Heal Care. 2006;18(SUPPL. 1):5–13.
    1. Moher D, Liberati A, Tetzlaff J, Altman DG, Altman D, Antes G, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Plos Med. 2009;6(7).
    1. Sirriyeh R, Lawton R, Gardner P, Armitage G. Reviewing studies with diverse designs: the development and evaluation of a new tool. J Eval Clin Pract. 2012;18(4):746–752.
    1. Donabedian A. The Quality of Care: How Can It Be Assessed? JAMA. 1988;260(12):1743–8.
    1. Cronenwett JL, Likosky DS, Russell MT, Eldrup-Jorgensen J, Stanley AC, Nolan BW. A regional registry for quality assurance and improvement: the vascular study Group of Northern new England (VSGNNE) J Vasc Surg. 2007;46(6):1093–1103.
    1. Campion FX, Larson LR, Kadlubek PJ, Earle CC, Neuss MN. Advancing performance measurement in oncology. Am J Manag Care. 2011;17(Suppl 5):31–35.
    1. Stern M, Niemann N, Wiedemann B, Wenzlaff P. Benchmarking improves quality in cystic fibrosis care: a pilot project involving 12 centres. Int J Qual Heal Care. 2011;23(3):349–356.
    1. Hermans MP, Elisaf M, Michel G, Muls E, Nobels F, Vandenberghe H, et al. Benchmarking is associated with improvedquality of care in type 2 diabetes: the OPTIMISE randomized, controlled trial. Diabetes Care. 2013;36(11):3388–3395.
    1. Merle V, Moret L, Pidhorz L, Dujardin F, Gouin F, Josset V, et al. Does comparison of performance lead to better care? A pilot observational study in patients admitted for hip fracture in three French public hospitals. Int J Qual Heal Care. 2009;21(5):321–329.
    1. Hall BL, Hamilton BH, Richards K, Bilimoria KY, Cohen ME, Ko CY. Does surgical quality improve in the american college of surgeons national surgical quality improvement program: an evaluation of all participating hospitals. Ann Surg. 2009;250(3):363–374.
    1. Tepas JJ, Kerwin AJ, Devilla J, Nussbaum MS. Macro vs micro level surgical quality improvement: a regional collaborative demonstrates the case for a national NSQIP initiative. J Am Coll Surg. 2014;218(4):599–604. doi: 10.1016/j.jamcollsurg.2013.12.017.
    1. Nuti S, Vola F, Bonini A, Vainieri M. Making governance work in the health care sector: evidence from a “natural experiment” in Italy. Heal Econ Policy Law. 2016;11(1):17–38.
    1. Govaert JA, Van Dijk WA, Fiocco M, Scheffer AC, Gietelink L, Wouters MWJM, et al. Nationwide Outcomes Measurement in Colorectal Cancer Surgery: Improving Quality and Reducing Costs Presented at the European Society of Surgical Oncology 34th Congress, Liverpool, United Kingdom, October 2014. J Am Coll Surg. 2016;222(1):19–29.e2. doi: 10.1016/j.jamcollsurg.2015.09.020.
    1. Piccoliori G, Mahlknecht A, Abuzahra ME, Engl A, Breitenberger V, Vögele A, et al. Quality improvement in chronic care by self-audit, benchmarking and networking in general practices in South Tyrol, Italy: results from an interventional study. Fam Pract. 2021;38(3):253–258.
    1. Qvist P, Rasmussen L, Bonnevie B, Gjørup T. Repeated measurements of generic indicators: a Danish national program to benchmark and improve quality of care. Int J Qual Heal Care. 2004;16(2):141–148.
    1. Nuti S, Seghieri C, Vainieri M. Assessing the effectiveness of a performance evaluation system in the public health care sector: some novel evidence from the Tuscany region experience. J Manag Gov. 2013;17(1):59–69.
    1. Van Leersum NJ, Snijders HS, Henneman D, Kolfschoten NE, Gooiker GA, Ten Berge MG, et al. The dutch surgical colorectal audit. Eur J Surg Oncol. 2013;39(10):1063–1070. doi: 10.1016/j.ejso.2013.05.008.
    1. Margeirsdottir HD, Larsen JR, Kummernes SJ, Brunborg C, Dahl-Jørgensen K. The establishment of a new national network leads to quality improvement in childhood diabetes: implementation of the ISPAD guidelines. Pediatr Diabetes. 2010;11(2):88–95.
    1. Kodeda K, Johansson R, Zar N, Birgisson H, Dahlberg M, Skullman S, et al. Time trends, improvements and national auditing of rectal cancer management over an 18-year period. Color Dis. 2015;17(9):O168–O179.
    1. Pinnarelli L, Nuti S, Sorge C, Davoli M, Fusco D, Agabiti N, et al. What drives hospital performance? The impact of comparative outcome evaluation of patients admitted for hip fracture in two Italian regions. BMJ Qual Saf. 2012;21(2):127–134.
    1. Miyata H, Motomura N, Murakami A, Takamoto S. Effect of benchmarking projects on outcomes of coronary artery bypass graft surgery: challenges and prospects regarding the quality improvement initiative. J Thorac Cardiovasc Surg. 2012;143(6):1364–1369. doi: 10.1016/j.jtcvs.2011.07.010.
    1. World Bank . World Bank country and lending groups [internet] 2021.
    1. World Health Organization, World Bank Group O . Delivering quality health services. World Health Organization, World Bank Group, OECD; 2018. pp. 1–100.
    1. Kruk ME, Gage AD, Arsenault C, Jordan K, Leslie HH, Roder-DeWan S, et al. High-quality health systems in the sustainable development goals era: time for a revolution. Lancet Glob Heal. 2018;6(11):e1196–e1252.
    1. Clarke A, Taylor-Phillips S, Swan J, Gkeredakis E, Mills P, Powell J, et al. Evidence-based commissioning in the English NHS: who uses which sources of evidence? A survey 2010/2011. BMJ Open. 2013;3(5):1–6.
    1. Ivankovic D, Poldrugovac M, Garel P, Klazinga NS, Kringos DS. Why, what and how do European healthcare managers use performance data? Results of a survey and workshop among members of the European hospital and healthcare federation. Plos One. 2020;15(4):1–19. doi: 10.1371/journal.pone.0231345.
    1. De Lange DW, Dongelmans DA, De Keizer NF. Small steps beyond benchmarking. Rev Bras Ter Intensiva. 2017;29(2):128–130.
    1. Lied TR, Kazandjian VA. A Hawthorne strategy: implications for performance measurement and improvement. Clin Perform Qual Health Care. 1998;6(4):201–204.
    1. Braithwaite J, Yukihiro M, Johnson J. Healthcare reform, quality and safety: perspectives, participants, partnerships and prospects in 30 countries. Boca Raton, USA: CRC Press; 2017.
    1. Obit LJ. Oxford Textbook of Health Care. 1993. The measurement of health service outcomes.
    1. Goldstein, H., Spiegelhalter DJ. League Tables and Their Limitations : Statistical Issues in Comparisons of Institutional Performance Author ( s ): Harvey Goldstein and David J . Spiegelhalter Source : Journal of the Royal Statistical Society . Series A ( Statistics in Society ), Vol . 1. Society 2008;159(3):385–443.
    1. Lovaglio PG. Benchmarking strategies for measuring the quality of healthcare: Problems and prospects. Sci World J. 2012;2012(iii):606154.
    1. Vainieri M, Noto G, Ferre F, Rosella LC. A performance management system in healthcare for all seasons? Int J Environ Res Public Health. 2020;17(15):1–10.
    1. Borghini A, Corazza I, Nuti S. Learning from excellence to improve healthcare services: the experience of the maternal and child care pathway. Int J Environ Res Public Health. 2021;18(4):1–10.
    1. Vainieri M, Lungu DA, Nuti S. Insights on the effectiveness of reward schemes from 10-year longitudinal case studies in 2 Italian regions. Int J Health Plann Manag. 2018;33(2):e474–e484.

Source: PubMed

赞助者和合作者

医疗条件

药物干预

3
订阅