Effect of enhancing audit and feedback on uptake of childhood pneumonia treatment policy in hospitals that are part of a clinical network: a cluster randomized trial

Philip Ayieko, Grace Irimu, Morris Ogero, Paul Mwaniki, Lucas Malla, Thomas Julius, Mercy Chepkirui, George Mbevi, Jacquie Oliwa, Ambrose Agweyu, Samuel Akech, Fred Were, Mike English, Clinical Information Network Authors, Timothy Tuti, David Gathara, Susan Gachau, Samuel Ngarngar, Ivan Injira, David Kimutai, Caren Emadau, Cecilia Mutiso, Charles Nzioki, Agnes Mithamo, Margaret Kuria, Sam Otido, Grace Wachira, Peris Njiiri, Rachel Inginia, Melab Musabi, Sande Charo, Grace Ochieng, Lydia Thuranira, Philip Ayieko, Grace Irimu, Morris Ogero, Paul Mwaniki, Lucas Malla, Thomas Julius, Mercy Chepkirui, George Mbevi, Jacquie Oliwa, Ambrose Agweyu, Samuel Akech, Fred Were, Mike English, Clinical Information Network Authors, Timothy Tuti, David Gathara, Susan Gachau, Samuel Ngarngar, Ivan Injira, David Kimutai, Caren Emadau, Cecilia Mutiso, Charles Nzioki, Agnes Mithamo, Margaret Kuria, Sam Otido, Grace Wachira, Peris Njiiri, Rachel Inginia, Melab Musabi, Sande Charo, Grace Ochieng, Lydia Thuranira

Abstract

Background: The World Health Organization (WHO) revised its clinical guidelines for management of childhood pneumonia in 2013. Significant delays have occurred during previous introductions of new guidelines into routine clinical practice in low- and middle-income countries (LMIC). We therefore examined whether providing enhanced audit and feedback as opposed to routine standard feedback might accelerate adoption of the new pneumonia guidelines by clinical teams within hospitals in a low-income setting.

Methods: In this parallel group cluster randomized controlled trial, 12 hospitals were assigned to either enhanced feedback (n = 6 hospitals) or standard feedback (n = 6 hospitals) using restricted randomization. The standard (network) intervention delivered in both trial arms included support to improve collection and quality of patient data, provision of mentorship and team management training for pediatricians, peer-to-peer networking (meetings and social media), and multimodal (print, electronic) bimonthly hospital specific feedback reports on multiple indicators of evidence guideline adherence. In addition to this network intervention, the enhanced feedback group received a monthly hospital-specific feedback sheet targeting pneumonia indicators presented in multiple formats (graphical and text) linked to explicit performance goals and action plans and specific email follow up from a network coordinator. At the start of the trial, all hospitals received a standardized training on the new guidelines and printed booklets containing pneumonia treatment protocols. The primary outcome was the proportion of children admitted with indrawing and/or fast-breathing pneumonia who were correctly classified using new guidelines and received correct antibiotic treatment (oral amoxicillin) in the first 24 h. The secondary outcome was the proportion of correctly classified and treated children for whom clinicians changed treatment from oral amoxicillin to injectable antibiotics.

Results: The trial included 2299 childhood pneumonia admissions, 1087 within the hospitals randomized to enhanced feedback intervention, and 1212 to standard feedback. The proportion of children who were correctly classified and treated in the first 24 h during the entire 9-month period was 38.2% (393 out of 1030) and 38.4% (410 out of 1068) in the enhanced feedback and standard feedback groups, respectively (odds ratio 1.11; 95% confidence interval [CI] 0.37-3.34; P = 0.855). However, in exploratory analyses, there was evidence of an interaction between type of feedback and duration (in months) since commencement of intervention, suggesting a difference in adoption of pneumonia policy over time in the enhanced compared to standard feedback arm (OR = 1.25, 95% CI 1.14 to 1.36, P < 0.001).

Conclusions: Enhanced feedback comprising increased frequency, clear messaging aligned with goal setting, and outreach from a coordinator did not lead to a significant overall effect on correct pneumonia classification and treatment during the 9-month trial. There appeared to be a significant effect of time (representing cumulative effect of feedback cycles) on adoption of the new policy in the enhanced feedback compared to standard feedback group. Future studies should plan for longer follow-up periods to confirm these findings.

Trial registration: US National Institutes of Health-ClinicalTrials.gov identifier (NCT number) NCT02817971 . Registered September 28, 2016-retrospectively registered.

Conflict of interest statement

Ethics approval and consent to participate

Scientific and ethical clearance to establish the CIN and conduct the trial was obtained from the Scientific and Ethics Review Unit of the Kenya Medical Research Institute that approved the use of de-identified patient data obtained through retrospective review of medical records without individual patient consent.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Flow diagram of progress of clusters and individuals through the cluster RCT
Fig. 2
Fig. 2
Correct classification and treatment of childhood pneumonia admissions according to duration of intervention and type of feedback intervention
Fig. 3
Fig. 3
Odds ratios for correctly classifying and treating pneumonia in enhanced compared to standard feedback hospitals. At each time point (months 1 to 9), we estimated the odds of correct classification and treatment for patients admitted during the immediately preceding one-month period that coincided with dissemination of the monthly enhanced feedback reports in the intervention arm. The odds ratios (95% CI) are then plotted at these monthly time points and show the predicted odds of correct classification and treatment of pneumonia admissions in the enhanced feedback trial arm compared to the standard feedback arm (adjusted for patient and hospital level factors)

References

    1. Leowski J. Mortality from acute respiratory infections in children under 5 years of age: global estimates. World Health Stat Q. 1986;39:138–144.
    1. Liu L, Johnson HL, Cousens S, Perin J, Scott S, Lawn JE, et al. Global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. 2012;379:2151–2161. doi: 10.1016/S0140-6736(12)60560-1.
    1. Liu L, Oza S, Hogan D, Chu Y, Perin J, Zhu J, et al. Global, regional, and national causes of under-5 mortality in 2000–15: an updated systematic analysis with implications for the sustainable development goals. Lancet. 2016;388:3027–3035. doi: 10.1016/S0140-6736(16)31593-8.
    1. World Health Organization, editor. Recommendations for management of common childhood conditions: evidence for technical update of pocket book recommendations: newborn conditions, dysentery, pneumonia, oxygen use and delivery, common causes of fever, severe acute malnutrition and supportiv. Geneva: World Health Organization; 2012.
    1. World Health Organisation. Integrated Management of Childhood Illness (IMCI). WHO recommendations on the management of diarrhoea and pneumonia in HIV-infected infants and children. Geneva: World Health Organisation; 2010.
    1. World Health Organisation . Management of the child with a serious infection or severe malnutrition: guidelines for care at the first-referral level in developing countries. Geneva: WHO; 2000.
    1. World Health Organisation . Recommendations for management of common childhood conditions, evidence for technical update of pocket book recommendations. Geneva: Geneva; 2012.
    1. Addo-Yobo E, Chisaka N, Hassan M, Hibberd P, Lozano JM, Jeena P, et al. Oral amoxicillin versus injectable penicillin for severe pneumonia in children aged 3 to 59 months: a randomised multicentre equivalency study. Lancet (London, England) 2004;364:1141–1148. doi: 10.1016/S0140-6736(04)17100-6.
    1. Addo-Yobo E, Anh DD, El-Sayed HF, Fox LM, Fox MP, MacLeod W, et al. Outpatient treatment of children with severe pneumonia with oral amoxicillin in four countries: the MASS study. Tropical Med Int Health. 2011;16:995–1006. doi: 10.1111/j.1365-3156.2011.02787.x.
    1. World Health Organisation. Pocket book of hospital care for children: guidelines for the management of common childhood illnesses. 2nd ed. Geneva: World Health Organisation; 2013.
    1. Agweyu A, Gathara D, Oliwa J, Muinga N, Edwards T, Allen E, et al. Oral amoxicillin versus benzyl penicillin for severe pneumonia among kenyan children: a pragmatic randomized controlled noninferiority trial. Clin Infect Dis. 2015;60:1216–1224. doi: 10.1093/cid/ciu1166.
    1. Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med. 2011;104:510–520. doi: 10.1258/jrsm.2011.110180.
    1. Gupta S, Granich R. When will sub-Saharan Africa adopt HIV treatment for all? South Afr J HIV med. AOSIS Publishing. 2016;17:1–6. doi: 10.4102/sajhivmed.v17i1.459.
    1. Chandler CIR, Jones C, Boniface G, Juma K, Reyburn H, Whitty CJM. Guidelines and mindlines: why do clinical staff over-diagnose malaria in Tanzania? A qualitative study. Malar J. 2008;7:53. doi: 10.1186/1475-2875-7-53.
    1. Maina M, Akech S, Mwaniki P, Gachau S, Ogero M, Julius T, et al. Inappropriate prescription of cough remedies among children hospitalised with respiratory illness over the period 2002-2015 in Kenya. Tropical Med Int Health. 2017;22:363–369. doi: 10.1111/tmi.12831.
    1. Amboko BI, Ayieko P, Ogero M, Julius T, Irimu G, English M, et al. Malaria investigation and treatment of children admitted to county hospitals in western Kenya. Malar J. 2016;15:506. doi: 10.1186/s12936-016-1553-6.
    1. Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, et al. No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9:14. doi: 10.1186/1748-5908-9-14.
    1. Hysong SJ, Teal CR, Khan MJ, Haidet P. Improving quality of care through improved audit and feedback. Implement Sci. BioMed Central. 2012;7:45. doi: 10.1186/1748-5908-7-45.
    1. Hysong SJ. Meta-analysis: audit and feedback features impact effectiveness on care quality. Med Care NIH Public Access. 2009;47:356–363. doi: 10.1097/MLR.0b013e3181893f6b.
    1. Kluger AN, DeNisi A. The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull. 1996;119:254–284. doi: 10.1037/0033-2909.119.2.254.
    1. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. In: Ivers N, et al., editors. Progress in translating policy changes such as these. Chichester: Wiley, Ltd; 2012. p. CD000259.
    1. Ayieko P, Ogero M, Makone B, Julius T, Mbevi G, Nyachiro W, et al. Characteristics of admissions and variations in the use of basic investigations, treatments and outcomes in Kenyan hospitals within a new clinical information network. Arch Dis Child. 2016;101:223–229. doi: 10.1136/archdischild-2015-309269.
    1. Tuti T, Bitok M, Paton C, Makone B, Malla L, Muinga N, et al. Innovating to enhance clinical data management using non-commercial and open source solutions across a multi-center network supporting inpatient pediatric care and research in Kenya. J Am Med Inform Assoc. 2016;23:184–192. doi: 10.1093/jamia/ocv028.
    1. Ministry of Health. Republic of Kenya. Basic paediatric protocols: for ages up to 5 years. 4th ed. Nairobi: Government of Kenya; 2016.
    1. Gachau S, Ayieko P, Gathara D, Mwaniki P, Ogero M, Akech S, et al. Does audit and feedback improve the adoption of recommended practices? Evidence from a longitudinal observational study of an emerging clinical network in Kenya. BMJ Glob Health. 2017;2:e000468. 10.1136/bmjgh-2017-000468.
    1. English M, Ayieko P, Nyamai R, Were F, Githanga D, Irimu G. What do we think we are doing? How might a clinical information network be promoting implementation of recommended paediatric care practices in Kenyan hospitals? Heal Res Policy Syst. 2017;15:4. doi: 10.1186/s12961-017-0172-1.
    1. Ayieko P, Irimu G, English M. Effect of enhanced feedback to hospitals that are part of an emerging clinical information network on uptake of revised childhood pneumonia treatment policy: study protocol for a cluster randomized trial. Trials. 2017;18:416. doi: 10.1186/s13063-017-2152-8.
    1. R Core Team . R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2017.
    1. Tuti T, Bitok M, Malla L, Paton C, Muinga N, Gathara D, et al. Improving documentation of clinical care within a clinical information network: an essential initial step in efforts to understand and improve care in Kenyan hospitals. BMJ Glob Heal. 2016;1:e000028. doi: 10.1136/bmjgh-2016-000028.
    1. Rabe-Hesketh S, Skrondal A. Multilevel and longitudinal modeling using stata. Stata Press; 2008.
    1. Li P, Redden DT. Comparing denominator degrees of freedom approximations for the generalized linear mixed model in analyzing binary outcome in small sample cluster-randomized trials. BMC Med Res Methodol. 2015;15:38. doi: 10.1186/s12874-015-0026-x.
    1. McNeish D. Estimation methods for mixed logistic models with few clusters. Multivariate Behav Res. 2016;51:790–804. doi: 10.1080/00273171.2016.1236237.
    1. Austin PC. Estimating multilevel logistic regression models when the number of clusters is low: a comparison of different statistical software procedures. Int J Biostat. 2010;6:Article 16. doi: 10.2202/1557-4679.1195.
    1. Rubin D. Multiple imputation for nonresponse in surveys. New York: Wiley; 2004.
    1. Institute of Medicine (US). Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical practice guidelines we can trust [internet]. Clinical practice guidelines we can trust. The National Academies Press; 2011. 10.17226/13058.
    1. Squires JE, Sullivan K, Eccles MP, Worswick J, Grimshaw JM. Are multifaceted interventions more effective than single-component interventions in changing health-care professionals’ behaviours? An overview of systematic reviews. Implement Sci BioMed Central. 2014;9:152. doi: 10.1186/s13012-014-0152-6.
    1. Ayieko P, Ntoburi S, Wagai J, Opondo C, Opiyo N, Migiro S, et al. A multifaceted intervention to implement guidelines and improve admission Paediatric Care in Kenyan District Hospitals: a cluster randomised trial. Rudan I, editor. PLoS Med. 2011;8:e1001018. doi: 10.1371/journal.pmed.1001018.
    1. Irimu G, Ogero M, Mbevi G, Agweyu A, Akech S, Julius T, et al. Approaching quality improvement at scale: a learning health system approach in Kenya. Arch Dis Child. 2018;103:1013-1019. 10.1136/archdischild-2017-314348.
    1. Yang C-W, Yen Z-S, McGowan JE, Chen HC, Chiang W-C, Mancini ME, et al. A systematic review of retention of adult advanced life support knowledge and skills in healthcare providers. Resuscitation. 2012;83:1055–1060. doi: 10.1016/j.resuscitation.2012.02.027.
    1. Li HK, Agweyu A, English M, Bejon P. An unsupported preference for intravenous antibiotics. PLoS Med. 2015;12:e1001825. doi: 10.1371/journal.pmed.1001825.
    1. Zurovac D, Sudoi RK, Akhwale WS, Ndiritu M, Hamer DH, Rowe AK, et al. The effect of mobile phone text-message reminders on Kenyan health workers’ adherence to malaria treatment guidelines: a cluster randomised trial. Lancet (London, England) Elsevier. 2011;378:795–803. doi: 10.1016/S0140-6736(11)60783-6.
    1. Landis Lewis Z, Mello-Thoms C, Gadabu OJ, Gillespie EM, Douglas GP, Crowley RS. The feasibility of automating audit and feedback for ART guideline adherence in Malawi. J Am Med Inform Assoc. American Medical Informatics Association. 2011;18:868–874. doi: 10.1136/amiajnl-2011-000097.
    1. Oluoch T, Kwaro D, Ssempijja V, Katana A, Langat P, Okeyo N, et al. Better adherence to pre-antiretroviral therapy guidelines after implementing an electronic medical record system in rural Kenyan HIV clinics: a multicenter pre-post study. Int J Infect Dis NIH Public Access. 2015;33:109–113. doi: 10.1016/j.ijid.2014.06.004.
    1. Boerma T, AbouZahr C, Evans D, Evans T. Monitoring intervention coverage in the context of universal health coverage. PLoS Med. 2014;11:e1001728. doi: 10.1371/journal.pmed.1001728.

Source: PubMed

Sponsorit ja yhteistyökumppanit

Sairaudet

Huumeiden interventiot

3
Tilaa