De-implementing wisely: developing the evidence base to reduce low-value care
Jeremy M Grimshaw, Andrea M Patey, Kyle R Kirkham, Amanda Hall, Shawn K Dowling, Nicolas Rodondi, Moriah Ellen, Tijn Kool, Simone A van Dulmen, Eve A Kerr, Stefanie Linklater, Wendy Levinson, R Sacha Bhatia, Jeremy M Grimshaw, Andrea M Patey, Kyle R Kirkham, Amanda Hall, Shawn K Dowling, Nicolas Rodondi, Moriah Ellen, Tijn Kool, Simone A van Dulmen, Eve A Kerr, Stefanie Linklater, Wendy Levinson, R Sacha Bhatia
Abstract
Choosing Wisely (CW) campaigns globally have focused attention on the need to reduce low-value care, which can represent up to 30% of the costs of healthcare. Despite early enthusiasm for the CW initiative, few large-scale changes in rates of low-value care have been reported since the launch of these campaigns. Recent commentaries suggest that the focus of the campaign should be on implementation of evidence-based strategies to effectively reduce low-value care. This paper describes the Choosing Wisely De-Implementation Framework (CWDIF), a novel framework that builds on previous work in the field of implementation science and proposes a comprehensive approach to systematically reduce low-value care in both hospital and community settings and advance the science of de-implementation.The CWDIF consists of five phases: Phase 0, identification of potential areas of low-value healthcare; Phase 1, identification of local priorities for implementation of CW recommendations; Phase 2, identification of barriers to implementing CW recommendations and potential interventions to overcome these; Phase 3, rigorous evaluations of CW implementation programmes; Phase 4, spread of effective CW implementation programmes. We provide a worked example of applying the CWDIF to develop and evaluate an implementation programme to reduce unnecessary preoperative testing in healthy patients undergoing low-risk surgeries and to further develop the evidence base to reduce low-value care.
Keywords: evaluation methodology; health services research; healthcare quality improvement; implementation science; patient-centred care.
Conflict of interest statement
Competing interests: EK serves as a clinical consultant for BIND Benefits Inc.; JMG holds a CIHR Tier 1 Canada Research Chair in Knowledge Transfer and Uptake and has a CIHR Foundation Grant (FDN-143269); WL is Chair of Choosing Wisely Canada.
© Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.
Figures
References
- Brownlee S, Chalkidou K, Doust J, et al. . Evidence for overuse of medical services around the world. The Lancet 2017;390:156–68. 10.1016/S0140-6736(16)32585-5
- Kirkham KR, Wijeysundera DN, Pendrith C, et al. . Preoperative testing before low-risk surgical procedures. Can Med Assoc J 2015;187:E349–58. 10.1503/cmaj.150174
- Canadian Institute for Health Information CIHI. unnecessary care in Canada: technical report. Ottawa, ON: CIHI, 2017.
- Institute of Medicine (IOM) Crossing the quality chasm: a new health system for the 21st century. Washington, DC: National Acadeemy Press, 2001.
- Mangione-Smith R, DeCristofaro AH, Setodji CM, et al. . The quality of ambulatory care delivered to children in the United States. N Engl J Med 2007;357:1515–23. 10.1056/NEJMsa064637
- Schuster MA, McGlynn EA, Brook RH. How good is the quality of health care in the United States? 1998. Milbank Q 2005;83:843–95. 10.1111/j.1468-0009.2005.00403.x
- Saini V, Brownlee S, Elshaug AG, et al. . Addressing overuse and underuse around the world. Lancet 2017;390:105–7. 10.1016/S0140-6736(16)32573-9
- Levinson W, Kallewaard M, Bhatia RS, et al. . ‘Choosing Wisely’: a growing international campaign. BMJ Qual Saf 2015;24:167–74. 10.1136/bmjqs-2014-003821
- Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. JAMA 2012;307:1801–2. 10.1001/jama.2012.476
- Bhatia RS, Levinson W, Shortt S, et al. . Measuring the effect of choosing wisely: an integrated framework to assess campaign impact on low-value care. BMJ Qual Saf 2015;24:523–31. 10.1136/bmjqs-2015-004070
- Choosing Wisely Our Mission—Facts and Figures 2019, 2019. Available: [Accessed 17 Jan 2019].
- Choosing Wisely Canada Facts about unnecessary tests, treatments, and procedures 2019, 2019. Available: [Accessed 17 Jan 2019].
- Levinson W, Born K, Wolfson D. Choosing wisely campaigns: a work in progress. JAMA 2018;319:1975–6. 10.1001/jama.2018.2202
- Lin Y, Cserti-Gazdewich C, Lieberman L, et al. . Improving transfusion practice with guidelines and prospective auditing by medical laboratory technologists. Transfusion 2016;56:2903–5. 10.1111/trf.13848
- Rosenberg A, Agiro A, Gottlieb M, et al. . Early trends among seven recommendations from the choosing wisely campaign. JAMA Intern Med 2015;175:1913–20. 10.1001/jamainternmed.2015.5441
- Mafi JN, Parchman M. Low-value care: an intractable global problem with no quick fix. BMJ Publishing Group Ltd, 2018.
- Grimshaw JM, Eccles MP, Lavis JN, et al. . Knowledge translation of research findings. Implement Sci 2012;7:50 10.1186/1748-5908-7-50
- Nieuwlaat R, Schwalm J-D, Khatib R, et al. . Why are we failing to implement effective therapies in cardiovascular disease? Eur Heart J 2013;34:1262–9. 10.1093/eurheartj/ehs481
- Kerr EA, Kullgren JT, Saini SD. Choosing wisely: how to fulfill the promise in the next 5 years. Health Aff 2017;36:2012–8. 10.1377/hlthaff.2017.0953
- Elsevier Taking action on overuse: creating the culture for change. healthcare, 2017.
- Norton WE, Chambers DA, Kramer BS. Conceptualizing De-Implementation in cancer care delivery. J Clin Oncol 2019;37:93–6. 10.1200/JCO.18.00589
- Dissemination and Implementation Research in Health Building the science of dissemination and implementation in the service of public health. Bethesda, Maryland, 2007.
- Prasad V, Ioannidis JP. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implement Sci 2014;9:1–5. 10.1186/1748-5908-9-1
- Ivers N, Jamtvedt G, Flottorp S, et al. . Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012:CD000259 10.1002/14651858.CD000259.pub3
- O'Brien MA, Rogers S, Jamtvedt G, et al. . Educational outreach visits: effects on professional practice and health care outcomes. The Cochrane Library, 2007.
- Ferlie EB, Shortell SM. Improving the quality of health care in the United Kingdom and the United States: a framework for change. Milbank Q 2001;79:281–315. 10.1111/1468-0009.00206
- Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implementation Sci 2010;5:5908–5. 10.1186/1748-5908-5-14
- Hrisos S, Eccles M, Johnston M, et al. . An intervention modelling experiment to change GPs’ intentions to implement evidence-based practice: using theory-based interventions to promote GP management of upper respiratory tract infection without prescribing antibiotics #2. BMC Health Serv Res 2008;8:10 10.1186/1472-6963-8-10
- French SD, Green SE, O'Connor DA, et al. . Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the theoretical domains framework. Implement Sci 2012;7:38 10.1186/1748-5908-7-38
- Patey AM, Hurt CS, Grimshaw JM, et al. . Changing behaviour ‘more or less’—do theories of behaviour inform strategies for implementation and de-implementation? A critical interpretive synthesis. Implement Sci 2018;13:134 10.1186/s13012-018-0826-6
- Michie S, Richardson M, Johnston M, et al. . The behavior change technique taxonomy (V1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013;46:81–95. 10.1007/s12160-013-9486-6
- Craig P, Dieppe P, Macintyre S, et al. . Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008;337:a1655 10.1136/bmj.a1655
- Michie S, Johnston M, Abraham C, et al. . Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care 2005;14:26–33. 10.1136/qshc.2004.011155
- Bussières AE, Patey AM, Francis JJ, et al. . Identifying factors likely to influence compliance with diagnostic imaging guideline recommendations for spine disorders among chiropractors in North America: a focus group study using the theoretical domains framework. Implement Sci 2012;7:82 10.1186/1748-5908-7-82
- Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci 2012;7:37 10.1186/1748-5908-7-37
- Malhotra A, Maughan D, Ansell J, et al. . Choosing wisely in the UK: reducing the harms of too much medicine. Br J Sports Med 2016;50:826–8. 10.1136/bjsports-2016-h2308rep
- Moynihan R. Preventing overdiagnosis: the myth, the music, and the medical meeting. BMJ 2015;350:h1370 10.1136/bmj.h1370
- Macdonald H, Loder E. Too much medicine: the challenge of finding common ground. British Medical Journal Publishing Group, 2015.
- Moynihan R, Glasziou P, Woloshin S, et al. . Winding back the harms of too much medicine. BMJ 2013;346:f1271 10.1136/bmj.f1271
- Choosing Wisely Canada Anesthesiology: five things physicians and patients should question, 2015. Available: [Accessed May 2019].
- Mutter TC, Bryson GL. Choosing wisely and preoperative hemoglobin A1c testing: what should it mean? Can J Anaesth 2016;63:1307–13. 10.1007/s12630-016-0743-6
- Davidoff F, Dixon-Woods M, Leviton L, et al. . Demystifying theory and its use in improvement. BMJ Qual Saf 2015;24:228–38. 10.1136/bmjqs-2014-003627
- Sniehotta FF, Araújo-Soares V, Brown J, et al. . Complex systems and individual-level approaches to population health: a false dichotomy? Lancet Public Health 2017;2:e396–7. 10.1016/S2468-2667(17)30167-6
- Cheung WJ, Patey AM, Frank JR, et al. . Barriers and enablers to direct observation of clinical performance—a qualitative study using the theoretical domains framework. Academic Medicine. In Press;2018.
- Patey AM, Curran JA, Sprague AE, et al. . Intermittent auscultation versus continuous fetal monitoring: exploring factors that influence birthing unit nurses’ fetal surveillance practice using theoretical domains framework. BMC Pregnancy Childbirth 2017;17:320 10.1186/s12884-017-1517-z
- Atkins L, Francis J, Islam R, et al. . A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci 2017;12:77 10.1186/s13012-017-0605-9
- Eccles M, Grimshaw J, Walker A, et al. . Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol 2005;58:107–12. 10.1016/j.jclinepi.2004.09.002
- Eccles M, Grimshaw J, Campbell M, et al. . Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Health Care 2003;12:47–52. 10.1136/qhc.12.1.47
- Grimshaw JM, Presseau J, Tetroe J, et al. . Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians' diabetic retinopathy referrals [Trial registration number ISRCTN72772651]. Implement Sci 2014;9:86 10.1186/1748-5908-9-86
- Rousseau N, et al. Practice based, longitudinal, qualitative interview study of computerised evidence based guidelines in primary care. BMJ 2003;326:314 10.1136/bmj.326.7384.314
- Moore GF, Audrey S, Barker M, et al. . Process evaluation of complex interventions: Medical Research Council guidance. BMJ 2015;350:h1258 10.1136/bmj.h1258
- Bero LA, Grilli R, Grimshaw JM, et al. . Getting research findings into practice: closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ 1998;317:465–8. 10.1136/bmj.317.7156.465
- Grimshaw JM, Thomas RE, MacLennan G, et al. . Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess 2004;8:iii-iv, 1-72 10.3310/hta8060
- Grimshaw JM, Shirran L, Thomas R, et al. . Changing provider behavior: an overview of systematic reviews of interventions. Med Care 2001;39:II2–45.
- Ellen ME, Wilson MG, Vélez M, et al. . Addressing overuse of health services in health systems: a critical interpretive synthesis. Health Res Policy Syst 2018;16:48 10.1186/s12961-018-0325-x
- Michie S, Atkins L, West R. The behaviour change wheel: a guide to designing interventions. 1st edn United Kingdom: Silverback Publishing, 2014.
- Michie S, Hyder N, Walia A, et al. . Development of a taxonomy of behaviour change techniques used in individual behavioural support for smoking cessation. Addict Behav 2011;36:315–9. 10.1016/j.addbeh.2010.11.016
- Taylor N, Lawton R, Moore S, et al. . Collaborating with front-line healthcare professionals: the clinical and cost effectiveness of a theory based approach to the implementation of a national guideline. BMC Health Serv Res 2014;14:648 10.1186/s12913-014-0648-4
- Patey AM, Islam R, Francis JJ, et al. . Anesthesiologists' and surgeons' perceptions about routine pre-operative testing in low-risk patients: application of the Theoretical Domains Framework (TDF) to identify factors that influence physicians' decisions to order pre-operative tests. Implement Sci 2012;7:52 10.1186/1748-5908-7-52
Source: PubMed