Effect of a Computer-Based Decision Support Intervention on Autism Spectrum Disorder Screening in Pediatric Primary Care Clinics: A Cluster Randomized Clinical Trial

Stephen M Downs, Nerissa S Bauer, Chandan Saha, Susan Ofner, Aaron E Carroll, Stephen M Downs, Nerissa S Bauer, Chandan Saha, Susan Ofner, Aaron E Carroll

Abstract

Importance: Universal early screening for autism spectrum disorder (ASD) is recommended but not routinely performed.

Objective: To determine whether computer-automated screening and clinical decision support can improve ASD screening rates in pediatric primary care practices.

Design, setting, and participants: This cluster randomized clinical trial, conducted between November 16, 2010, and November 21, 2012, compared ASD screening rates among a random sample of 274 children aged 18 to 24 months in urban pediatric clinics of an inner-city county hospital system with or without an ASD screening module built into an existing decision support software system. Statistical analyses were conducted from February 6, 2017, to June 1, 2018.

Interventions: Four clinics were matched in pairs based on patient volume and race/ethnicity, then randomized within pairs. Decision support with the Child Health Improvement Through Computer Automation system (CHICA) was integrated with workflow and with the electronic health record in intervention clinics.

Main outcomes and measures: The main outcome was screening rates among children aged 18 to 24 months. Because the intervention was discontinued among children aged 18 months at the request of the participating clinics, only results for those aged 24 months were collected and analyzed. Rates of positive screening results, clinicians' response rates to screening results in the computer system, and new cases of ASD identified were also measured. Main results were controlled for race/ethnicity and intracluster correlation.

Results: Two clinics were randomized to receive the intervention, and 2 served as controls. Records from 274 children (101 girls, 162 boys, and 11 missing information on sex; age range, 23-30 months) were reviewed (138 in the intervention clinics and 136 in the control clinics). Of 263 children, 242 (92.0%) were enrolled in Medicaid, 138 (52.5%) were African American, and 96 (36.5%) were Hispanic. Screening rates in the intervention clinics increased from 0% (95% CI, 0%-5.5%) at baseline to 68.4% (13 of 19) (95% CI, 43.4%-87.4%) in 6 months and to 100% (18 of 18) (95% CI, 81.5%-100%) in 24 months. Control clinics had no significant increase in screening rates (baseline, 7 of 64 children [10.9%]; 6-24 months after the intervention, 11 of 72 children [15.3%]; P = .46). Screening results were positive for 265 of 980 children (27.0%) screened by CHICA during the study period. Among the 265 patients with positive screening results, physicians indicated any response in CHICA in 151 (57.0%). Two children in the intervention group received a new diagnosis of ASD within the time frame of the study.

Conclusions and relevance: The findings suggest that computer automation, when integrated with clinical workflow and the electronic health record, increases screening of children for ASD, but follow-up by physicians is still flawed. Automation of the subsequent workup is still needed.

Trial registration: ClinicalTrials.gov identifier: NCT01612897.

Conflict of interest statement

Conflict of Interest Disclosures: Dr Downs reported being a cocreator of the Child Health Improvement Through Computer Automation (CHICA) system; being the founder and CEO of Digital Health Solutions, a company created to license the CHICA software (this study was completed prior to the formation of the company); and receiving grants from the Agency for Healthcare Research and Quality during the conduct of the study. Dr Saha reported receiving grants from the National Institutes of Health during the conduct of the study. Dr Carroll reported being a cocreator of the CHICA system; and receiving grants from the Agency for Healthcare Research and Quality during the conduct of the study. No other disclosures were reported.

Figures

Figure 1.. CONSORT Diagram for Cluster Randomized…
Figure 1.. CONSORT Diagram for Cluster Randomized Trial Showing Randomization Allocation, Follow-up, and Analysis
Figure 2.. Run Chart Showing the Rates…
Figure 2.. Run Chart Showing the Rates of Autism Spectrum Disorder Screening in Eligible Children During the Study Period
The screening rate at each time point for each group was estimated using the binomial distribution, and the 95% CIs (error bars) were from Clopper-Pearson (exact)–type intervals.
Figure 3.. Physician Responses to Alerts Indicating…
Figure 3.. Physician Responses to Alerts Indicating Child Had a Concerning Modified Checklist for Autism in Toddlers Result
Total percentages exceed 100% because physicians could check more than 1 response per child. ASD indicates autism spectrum disorder; and CHICA, Child Health Improvement Through Computer Automation system.

References

    1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5). . Accessed November 7, 2019.
    1. Baio J, Wiggins L, Christensen DL, et al. . Prevalence of autism spectrum disorder among children aged 8 years—Autism and Developmental Disabilities Monitoring Network, 11 sites, United States, 2014. MMWR Surveill Summ. 2018;67(6):-. doi:10.15585/mmwr.ss6706a1
    1. Dawson G, Rogers S, Munson J, et al. . Randomized, controlled trial of an intervention for toddlers with autism: the Early Start Denver Model. Pediatrics. 2010;125(1):e17-e23. doi:10.1542/peds.2009-0958
    1. Itzchak EB, Zachor DA. Who benefits from early intervention in autism spectrum disorders? Res Autism Spectr Disord. 2011;5(1):345-350. doi:10.1016/j.rasd.2010.04.018
    1. Peters-Scheffer N, Didden R, Korzilius H, Sturmey P. A meta-analytic study on the effectiveness of comprehensive ABA-based early intervention programs for children with autism spectrum disorders. Res Autism Spectr Disord. 2011;5(1):60-69. doi:10.1016/j.rasd.2010.03.011
    1. Reichow B, Barton EE, Boyd BA, Hume K. Early intensive behavioral intervention (EIBI) for young children with autism spectrum disorders (ASD). Cochrane Database Syst Rev. 2012;10:CD009260. doi:10.1002/14651858.CD009260.pub2
    1. Flanagan H, Perry A, Freeman N. Effectiveness of large-scale community-based intensive behavioral intervention: a waitlist comparison study exploring outcomes and predictors. Res Autism Spectr Disord. 2012;6(2):673-682. doi:10.1016/j.rasd.2011.09.011
    1. Sallows GO, Graupner TD. Intensive behavioral treatment for children with autism: four-year outcome and predictors. Am J Ment Retard. 2005;110(6):417-438. doi:10.1352/0895-8017(2005)110[417:IBTFCW];2
    1. Chasson G, Harris G, Neely W. Cost comparison of early intensive behavioral intervention and special education for children with autism. J Child Fam Stud. 2007;16(3):401-413. doi:10.1007/s10826-006-9094-1
    1. Perry A, Blacklock K, Dunn Geier J. The relative importance of age and IQ as predictors of outcomes in intensive behavioral intervention. Res Autism Spectr Disord. 2013;7(9):1142-1150. doi:10.1016/j.rasd.2013.06.004
    1. Charman T, Baird G, Simonoff E, et al. . Testing two screening instruments for autism spectrum disorder in UK community child health services. Dev Med Child Neurol. 2016;58(4):369-375. doi:10.1111/dmcn.12874
    1. Robins DL, Casagrande K, Barton M, Chen CM, Dumont-Mathieu T, Fein D. Validation of the modified checklist for Autism in toddlers, revised with follow-up (M-CHAT-R/F). Pediatrics. 2014;133(1):37-45. doi:10.1542/peds.2013-1813
    1. Christensen DL, Baio J, Van Naarden Braun K, et al. ; Centers for Disease Control and Prevention (CDC) . Prevalence and characteristics of autism spectrum disorder among children aged 8 years—Autism and Developmental Disabilities Monitoring Network, 11 sites, United States, 2012 [published correction appears in MMWR Morb Mortal Wkly Rep. 2016;65(15):404]. MMWR Surveill Summ. 2016;65(3):1-23. doi:10.15585/mmwr.ss6503a1
    1. Zwaigenbaum L, Bauman ML, Fein D, et al. . Early screening of autism spectrum disorder: recommendations for practice and research. Pediatrics. 2015;136(suppl 1):S41-S59. doi:10.1542/peds.2014-3667D
    1. Robins D, Fein D, Barton M Modified Checklist for Autism in Toddlers, Revised with Follow-Up (M-CHAT-R/F). . Published 2009. Accessed November 7, 2019.
    1. Bauer NS, Anand V, Carroll AE, Downs SM. Secondhand smoke exposure, parental depressive symptoms and preschool behavioral outcomes. J Pediatr Nurs. 2015;30(1):227-235. doi:10.1016/j.pedn.2014.06.004
    1. Carroll AE, Bauer NS, Dugan TM, Anand V, Saha C, Downs SM. Use of a computerized decision aid for ADHD diagnosis: a randomized controlled trial. Pediatrics. 2013;132(3):e623-e629. doi:10.1542/peds.2013-0933
    1. Bauer NS, Gilbert AL, Carroll AE, Downs SM. Associations of early exposure to intimate partner violence and parental depression with subsequent mental health outcomes. JAMA Pediatr. 2013;167(4):341-347. doi:10.1001/jamapediatrics.2013.780
    1. Carroll A, Anand V, Dugan T, Sheley M, Xu S, Downs S. Increased physician diagnosis of asthma with the Child Health Improvement through Computer Automation decision support system. Pediatr Allergy Immunol Pulmonol. 2012;25(3):168-171. doi:10.1089/ped.2012.0143
    1. Carroll AE, Biondich PG, Anand V, et al. . Targeted screening for pediatric conditions with the CHICA system. J Am Med Inform Assoc. 2011;18(4):485-490. doi:10.1136/amiajnl-2011-000088
    1. Carroll AE, Biondich P, Anand V, Dugan TM, Downs SM. A randomized controlled trial of screening for maternal depression with a clinical decision support system. J Am Med Inform Assoc. 2013;20(2):311-316. doi:10.1136/amiajnl-2011-000682
    1. Carroll AE, Bauer NS, Dugan TM, Anand V, Saha C, Downs SM. Use of a computerized decision aid for developmental surveillance and screening: a randomized clinical trial. JAMA Pediatr. 2014;168(9):815-821. doi:10.1001/jamapediatrics.2014.464
    1. Hannon TS, Dugan TM, Saha CK, McKee SJ, Downs SM, Carroll AE. Effectiveness of computer automation for the diagnosis and management of childhood type 2 diabetes: a randomized clinical trial. JAMA Pediatr. 2017;171(4):327-334. doi:10.1001/jamapediatrics.2016.4207
    1. CONSORT Cluster trials. . Accessed November 2, 2019.
    1. Johnson CP, Myers SM; American Academy of Pediatrics Council on Children With Disabilities . Identification and evaluation of children with autism spectrum disorders. Pediatrics. 2007;120(5):1183-1215. doi:10.1542/peds.2007-2361
    1. Anand V, Carroll AE, Biondich PG, Dugan TM, Downs SM. Pediatric decision support using adapted Arden Syntax. Artif Intell Med. 2018;92:15-23. doi:10.1016/j.artmed.2015.09.006
    1. Anand V, Carroll AE, Downs SM. Automated primary care screening in pediatric waiting rooms. Pediatrics. 2012;129(5):e1275-e1281. doi:10.1542/peds.2011-2875
    1. Anand V, McKee S, Dugan TM, Downs SM. Leveraging electronic tablets for general pediatric care: a pilot study. Appl Clin Inform. 2015;6(1):1-15. doi:10.4338/ACI-2014-09-RA-0071
    1. Aalsma MC, Zerr AM, Etter DJ, et al. . Physician intervention to positive depression screens among adolescents in primary care. J Adolesc Health. 2018;62(2):212-218. doi:10.1016/j.jadohealth.2017.08.023
    1. Bauer NS, Carroll AE, Saha C, Downs SM. Computer decision support changes physician practice but not knowledge regarding autism spectrum disorders. Appl Clin Inform. 2015;6(3):454-465. doi:10.4338/ACI-2014-09-RA-0084
    1. Bauer NS, Sturm LA, Carroll AE, Downs SM. Computer decision support to improve autism screening and care in community pediatric clinics. Infants Young Child. 2013;26(4):306-317. doi:10.1097/IYC.0b013e3182a4ec5e
    1. Marston L. Introductory Statistics for Health and Nursing Using SPSS. Thousand Oaks, CA: Sage Publications Ltd; 2010. doi:10.4135/9781446221570
    1. Garg AX, Adhikari NK, McDonald H, et al. . Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223-1238. doi:10.1001/jama.293.10.1223
    1. Grout RWCE, Cheng ER, Carroll AE, Bauer NS, Downs SM. A six-year repeated evaluation of computerized clinical decision support system user acceptability. Int J Med Inform. 2018;112:74-81. doi:10.1016/j.ijmedinf.2018.01.011
    1. Sturner R, Howard B, Bergmann P, et al. . Autism screening with online decision support by primary care pediatricians aided by M-CHAT/F. Pediatrics. 2016;138(3):e20153036. doi:10.1542/peds.2015-3036
    1. Daniels AM, Halladay AK, Shih A, Elder LM, Dawson G. Approaches to enhancing the early detection of autism spectrum disorders: a systematic review of the literature. J Am Acad Child Adolesc Psychiatry. 2014;53(2):141-152. doi:10.1016/j.jaac.2013.11.002
    1. Downs SM, Anand V, Dugan TM, Carroll AE. You can lead a horse to water: physicians’ responses to clinical reminders. AMIA Annu Symp Proc. 2010;2010:167-171.
    1. McDonald CJ. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med. 1976;295(24):1351-1355. doi:10.1056/NEJM197612092952405
    1. Isaac T, Weissman JS, Davis RB, et al. . Overrides of medication alerts in ambulatory care. Arch Intern Med. 2009;169(3):305-311. doi:10.1001/archinternmed.2008.551
    1. Schoeman JC, Swanepoel W, van der Linde J. Developmental screening: predictors of follow-up adherence in primary health care. Afr Health Sci. 2017;17(1):52-61. doi:10.4314/ahs.v17i1.8
    1. Mandell DS, Wiggins LD, Carpenter LA, et al. . Racial/ethnic disparities in the identification of children with autism spectrum disorders. Am J Public Health. 2009;99(3):493-498. doi:10.2105/AJPH.2007.131243
    1. Sheldrick RC, Garfinkel D. Is a positive developmental-behavioral screening score sufficient to justify referral? a review of evidence and theory. Acad Pediatr. 2017;17(5):464-470. doi:10.1016/j.acap.2017.01.016

Source: PubMed

3
購読する