Electronic audit and feedback intervention with action implementation toolbox to improve pain management in intensive care: protocol for a laboratory experiment and cluster randomised trial

Wouter T Gude, Marie-José Roos-Blom, Sabine N van der Veer, Evert de Jonge, Niels Peek, Dave A Dongelmans, Nicolette F de Keizer, Wouter T Gude, Marie-José Roos-Blom, Sabine N van der Veer, Evert de Jonge, Niels Peek, Dave A Dongelmans, Nicolette F de Keizer

Abstract

Background: Audit and feedback is often used as a strategy to improve quality of care, however, its effects are variable and often marginal. In order to learn how to design and deliver effective feedback, we need to understand their mechanisms of action. This theory-informed study will investigate how electronic audit and feedback affects improvement intentions (i.e. information-intention gap), and whether an action implementation toolbox with suggested actions and materials helps translating those intentions into action (i.e. intention-behaviour gap). The study will be executed in Dutch intensive care units (ICUs) and will be focused on pain management.

Methods and design: We will conduct a laboratory experiment with individual ICU professionals to assess the impact of feedback on their intentions to improve practice. Next, we will conduct a cluster randomised controlled trial with ICUs allocated to feedback without or feedback with action implementation toolbox group. Participants will not be told explicitly what aspect of the intervention is randomised; they will only be aware that there are two variations of providing feedback. ICUs are eligible for participation if they submit indicator data to the Dutch National Intensive Care Evaluation (NICE) quality registry and agree to allocate a quality improvement team that spends 4 h per month on the intervention. All participating ICUs will receive access to an online quality dashboard that provides two functionalities: gaining insight into clinical performance on pain management indicators and developing action plans. ICUs with access to the toolbox can develop their action plans guided by a list of potential barriers in the care process, associated suggested actions, and supporting materials to facilitate implementation of the actions. The primary outcome measure for the laboratory experiment is the proportion of improvement intentions set by participants that are consistent with recommendations based on peer comparisons; for the randomised trial it is the proportion of patient shifts during which pain has been adequately managed. We will also conduct a process evaluation to understand how the intervention is implemented and used in clinical practice, and how implementation and use affect the intervention's impact.

Discussion: The results of this study will inform care providers and managers in ICU and other clinical settings how to use indicator-based performance feedback in conjunction with an action implementation toolbox to improve quality of care. Within the ICU context, this study will produce concrete and directly applicable knowledge with respect to what is or is not effective for improving pain management, and under which circumstances. The results will further guide future research that aims to understand the mechanisms behind audit and feedback and contribute to identifying the active ingredients of successful interventions.

Trial registration: ClinicalTrials.gov NCT02922101 . Registered 26 September 2016.

Keywords: Feedback; Intensive care; Medical audit; Quality improvement; Quality indicators; Randomised controlled trial.

Figures

Fig. 1
Fig. 1
Illustration of hypothesised role played by A&F to improve self-assessments of clinical performance and thus improvement intentions, and the action implementation toolbox to promote behaviour change. Adapted from Carver & Scheier’s Control Theory
Fig. 2
Fig. 2
The NICE dashboard: detailed insight in clinical performance on quality indicators
Fig. 3
Fig. 3
Study flow. ICU intensive care unit, RCT randomised controlled trial, A&F audit and feedback

References

    1. van de Klundert N, Holman R, Dongelmans DA, de Keizer NF. Data resource profile: the Dutch National Intensive Care Evaluation (NICE) registry of admissions to adult intensive care units. Int J Epidemiol. 2015;44:1850–1850h.
    1. Rotondi AJ, Chelluri L, Sirio C, Mendelsohn A, Schulz R, Belle S, et al. Patients’ recollections of stressful experiences while receiving prolonged mechanical ventilation in an intensive care unit*. Crit Care Med. 2013;30:746–52.
    1. Jacobi J, Fraser GL, Coursin DB, Riker RR, Fontaine D, Wittbrodt ET, et al. Clinical practice guidelines for the sustained use of sedatives and analgesics in the critically ill adult. Crit Care Med. 2002;30:119–41.
    1. Barr J, Fraser GL, Puntillo K, Ely EW, Gélinas C, Dasta JF, et al. Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit Care Med. 2013;41:263–306. doi: 10.1097/CCM.0b013e3182783b72.
    1. Payen JF, Bosson JL, Chanques G, Mantz J, Labarere J, DOLOREA Investigators Pain assessment is associated with decreased duration of mechanical ventilation in the intensive care unit: a post Hoc analysis of the DOLOREA study. Anesthesiology. 2009;111:1308–16. doi: 10.1097/ALN.0b013e3181c0d4f0.
    1. Schelling G, Stoll C, Haller M, Briegel J, Manert W, Hummel T, et al. Health-related quality of life and posttraumatic stress disorder in survivors of the acute respiratory distress syndrome. Crit Care Med. 1998;26(4):651–9. doi: 10.1097/00003246-199804000-00011.
    1. Jones C, Bäckman C, Capuzzo M, Flaatten H, Rylander C, Griffiths RD. Precipitants of post-traumatic stress disorder following intensive care: a hypothesis generating study of diversity in care. Intensive Care Med. 2007;33:978–85. doi: 10.1007/s00134-007-0600-8.
    1. Carroll KC, Atkins PJ, Herold GR, Mlcek CA, Shively M, Clopton P, et al. Pain assessment and management in critically ill postoperative and trauma patients: a multisite study. Am J Crit Care. 1999;8:105–17.
    1. Stanik-Hutt JA, Soeken KL, Belcher AE, Fontaine DK, Gift AG. Pain experiences of traumatically injured patients in a critical care setting. Am J Crit Care. 2001;10:252–9.
    1. Puntillo KA, Wild LR, Morris AB, Stanik-Hutt J, Thompson CL, White C. Practices and predictors of analgesic interventions for adults undergoing painful procedures. Am J Crit Care. 2002;11:415–31.
    1. Chanques MDG, Sebbane MDM, Barbotte MDE, Viel MDPDE, Eledjam MDPDJ-J, Jaber MDPDS. A prospective study of pain at rest: incidence and characteristics of an unrecognized symptom in surgical and trauma versus medical intensive care unit patients. Anesthesiology. 2007;107:858–60. doi: 10.1097/01.anes.0000287211.98642.51.
    1. van der Woude MCE, Bormans L, Hofhuis JGM, Spronk PE. Current use of pain scores in dutch intensive care units: a postal survey in the Netherlands. Anesth Analg. 2016;122:456–61. doi: 10.1213/ANE.0000000000000972.
    1. Tabah A, De Waele J, Lipman J, Zahar JR, Cotta MO, Barton G, et al. The ADMIN-ICU survey: a survey on antimicrobial dosing and monitoring in ICUs. J Antimicrob Chemother. 2015;70:2671–7. doi: 10.1093/jac/dkv165.
    1. Murphy DJ, Pronovost PJ, Lehmann CU, Gurses AP, Whitman GJR, Needham DM, et al. Red blood cell transfusion practices in two surgical intensive care units: a mixed methods assessment of barriers to evidence-based practice. Transfusion. 2014;54:2658–67. doi: 10.1111/trf.12718.
    1. Neto AS, Simonis FD, Barbas CS V, Biehl M, Determann RM, Elmer J, et al. Lung-protective ventilation with low tidal volumes and the occurrence of pulmonary complications in patients without acute respiratory distress syndrome: a systematic review and individual patient data analysis. Crit Care Med. 2015;43:2155–63. doi: 10.1097/CCM.0000000000001189.
    1. Oxman AD, Thomson MA, Davis DA, Haynes B. No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995;153:1423–31.
    1. Davis DA, Mazmanian PE, Fordis M, Harrison R Van, Thorpe KE, Perrier L. Accuracy of Physician self-assessment compared with observed measures of competence a systematic review. JAMA. 2006;296:1094–102.
    1. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane database Syst Rev. 2012 [cited 2014 Nov 18];6:CD000259.
    1. van der Veer SN, de Vos MLG, van der Voort PHJ, Peek N, Abu-Hanna A, Westert GP, et al. Effect of a multifaceted performance feedback strategy on length of stay compared with benchmark reports alone: a cluster randomized trial in intensive care*. Crit. Care Med. 2013;41:1893–904.
    1. de Vos MLG, van der Veer SN, Wouterse B, Graafmans WC, Peek N, de Keizer NF, et al. A multifaceted feedback strategy alone does not improve the adherence to organizational guideline-based standards: a cluster randomized trial in intensive care. Implement Sci. 2015;10:95.
    1. de Vos Maartje LG, van der Veer SN, Graafmans WC, de Keizer NF, Jager KJ, Westert GP, et al. Process evaluation of a tailored multifaceted feedback program to improve the quality of intensive care by using quality indicators. BMJ Qual Saf. 2013 [cited 2015 May 4];22:233–41.
    1. Hysong SJ. Meta-analysis: audit and feedback features impact effectiveness on care quality. Med Care. 2009 [cited 2014 Dec 10];47:356–63.
    1. Gardner B, Whittington C, McAteer J, Eccles MP, Michie S. Using theory to synthesise evidence from behaviour change interventions: The example of audit and feedback. Soc Sci Med. 2010 [cited 2014 Nov 27];70:1618–25.
    1. Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R. What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005 [cited 2014 Dec 10];5:50.
    1. Ivers NM, Grimshaw JM, Jamtvedt G, Flottorp S, O’Brien MA, French SD, et al. Growing literature, stagnant science? Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care. J Gen Intern Med. 2014;29(11):1534–41. doi: 10.1007/s11606-014-2913-y.
    1. Tuti T, Nzinga J, Njoroge M, Brown B, Peek N, English M, et al. A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory. Implement Sci. 2017; 12:61. doi:10.1186/s13012-017-0590-z
    1. Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, et al. No more “business as usual” with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9:14.
    1. Carver CS, Scheier MF. Control theory: a useful conceptual framework for personality-social, clinical, and health psychology. Psychol Bull. 1982;92:111–35.
    1. van der Veer SN, de Keizer NF, Ravelli ACJ, Tenkink S, Jager KJ. Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. Int. J. Med. Inform. 2010 [cited 2014 Dec 10];79:305–23.
    1. Kluger AN, DeNisi A. The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull. 119(2):254-284.
    1. Ivers N, Barnsley J, Upshur R, Tu K, Shah B, Grimshaw J, et al. My approach to this job is. One person at a time: perceived discordance between population-level quality targets and patient-centred care. Can Fam Physician. 2014;60:258–66.
    1. Ivers NM, Tu K, Young J, Francis JJ, Barnsley J, Shah BR, et al. Feedback GAP: pragmatic, cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care. Implement. Sci. 2013 [cited 2015 May 13];8:142.
    1. Gude WT, van Engen-Verheul MM, van der Veer SN, Kemps HMC, Jaspers MWM, de Keizer NF, et al. Effect of a web-based audit and feedback intervention with outreach visits on the clinical performance of multidisciplinary teams: a cluster-randomized trial in cardiac rehabilitation. Implement Sci. 2016;11:160.
    1. O’Brien MA, Rogers S, Jamtvedt G, Oxman A, Odgaard-Jensen J, Kristoffersen D, et al. Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2007;(4):CD000409.
    1. Ukoumunne OC, Guilliford MC, Chin S, Serne JAC, Burney PGJ, Donner A. Methods in health service research: evaluation of health interventions at area and organisation level. Br Med J. 1999;319:376–9.
    1. Dawson L, Zarin DA, Emanuel EJ, Friedman LM, Chaudhari B, Goodman SN. Considering usual medical care in clinical trial design. PLoS Med. 2009;6(9):e1000111. doi: 10.1371/journal.pmed.1000111.
    1. Eysenbach G. The law of attrition. J Med Internet Res. 2005;7(1):e11. doi: 10.2196/jmir.7.1.e11.
    1. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. Int J Surg. 2012;10:28–55. doi: 10.1016/j.ijsu.2011.10.001.
    1. Campbell MKM, Elbourne DDR, Altman DGD. CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328:702. Available from: .
    1. Zwarentein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. J Chinese Integr Med. 2009;7:392–7.
    1. de Keizer NF, Peute L, van der Zwan E, Jaspers M, de Jonge E. NICE Online; a web-based tool for monitoring performance measures in intensive care. Netherlands J Crit Care. 2011;15:131–6.
    1. Arts DGT, de Keizer NF, Scheffer G-J, Formulation M. Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inf. Assoc. 2002;9:600–11.
    1. Flodgren G, Parmelli E, Doumit G, Gattellari M, O’Brien MA, Grimshaw J, et al. Local opinion leaders: effects on professional practice and health care outcomes. Cochrane database Syst Rev. 2011;CD000125.
    1. Arts D, De Keizer N, Scheffer GJ, De Jonge E. Quality of data collected for severity of illness scores in the Dutch National Intensive Care Evaluation (NICE) registry. Intensive Care Med. 2002;28:656–9.
    1. Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, et al. Practice feedback interventions: 15 suggestions for optimizing effectiveness. Ann Intern Med. 2016;164:435–41.
    1. Fitch K, Bernstein SJ, Aguilar MD, Burnand B, LaCalle JR, Lazaro P, et al. The RAND/UCLA appropriateness method user’s manual. Transformation. 2001;109.
    1. Carayon P, Schoofs Hundt A, Karsh B-T, Gurses AP, Alvarado CJ, Smith M, et al. Work system design for patient safety: the SEIPS model. Qual Saf Health Care. 2006;15(Suppl 1):i50-8.
    1. Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW. Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. JAMA. 2001;285:2871–9. doi: 10.1001/jama.285.22.2871.
    1. Gude WT, van Engen-Verheul MM, van der Veer SN, de Keizer NF, Peek N. How does audit and feedback influence intentions of health professionals to improve practice? A laboratory experiment and field study in cardiac rehabilitation. BMJ Qual Saf. BMJ Publishing Group Ltd; 2017 [cited 2016 Jul 5];26:279–87.
    1. Grant AM, Guthrie B, Dreischulte T. Developing a complex intervention to improve prescribing safety in primary care: mixed methods feasibility and optimisation pilot study. BMJ Open. 2014 [cited 2015 Apr 13];4:e004153.
    1. Brown B, Balatsoukas P, Williams R, Sperrin M, Buchan I. Interface design recommendations for computerised clinical audit and feedback: hybrid usability evidence from a research-led system. Int J Med Inform. 2016;94:191–206.
    1. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–65. doi: 10.1001/jama.282.15.1458.
    1. Ajzen I, Netemeyer R, Ryn M Van, Ajzen I. The theory of planned behaviour. Organ Behav Hum Dec. 1991;50:179–211.
    1. Gude WT, Van Der Veer SN, Van Engen-Verheul MM, De Keizer NF, Peek N. Inside the black box of audit and feedback: a laboratory study to explore determinants of improvement target selection by healthcare professionals in cardiac rehabilitation. Stud Health Technol Inform. 2015;216:424-428.
    1. Roberts C, Torgerson DJ. Baseline imbalance in randomised controlled trials. BMJ. 1999;319:185.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008 [cited 2014 Jul 15];337:a1655.
    1. Gude WT, van der Veer SN, de Keizer NF, Coiera E, Peek N. Optimizing digital health informatics interventions through unobtrusive quantitative process evaluations. Stud Health Technol. Inform. 2016;228:594–8.
    1. Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, et al. A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implement. Sci. 2013;8:66.
    1. Landis-Lewis Z, Brehaut JC, Hochheiser H, Douglas GP, Jacobson RS. Computer-supported feedback message tailoring: theory-informed adaptation of clinical audit and feedback for learning and behavior change. Implement Sci. 2015 [cited 2015 May 4];10:12.
    1. Hysong SJ, Best RG, Pugh JA. Audit and feedback and clinical practice guideline adherence: making feedback actionable. Implement Sci. 2006;1:9. doi: 10.1186/1748-5908-1-9.
    1. Dowding D, Randell R, Gardner P, Fitzpatrick G, Dykes P, Favela J, et al. Dashboards for improving patient care: review of the literature. Int. J. Med. Inform. Elsevier; 2015 [cited 2015 Apr 17];84:87–100.
    1. Locke E a, Latham GP. Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. Am Psychol. 2002;57:705–17. doi: 10.1037/0003-066X.57.9.705.
    1. Ivers NM, Halperin IJ, Barnsley J, Grimshaw JM, Shah BR, Tu K, et al. Allocation techniques for balance at baseline in cluster randomized trials: a methodological review. Trials. 2012;13:120.
    1. Roos Blom MJ, Dongelmans D, Arbous MS, de Jonge E, de Keizer N. How to assist intensive care units in improving healthcare quality. Development of actionable quality indicators on blood use. Stud Health Technol Inform. 2015;210:429–33.

Source: PubMed

Patrocinadores e Colaboradores

Condições médicas

Intervenções de drogas

3
Se inscrever