Impact of AI Care Summaries on Caregiver Comprehension
Impact of AI Care Summaries on Caregiver Comprehension of Hospital Course
The primary objective is to assess if an AI-generated plain language summary of an inpatient progress note can improve caregiver understanding of their child's hospitalization by measuring differences in Hospital Course Comprehension scores, based on their responses to a survey regarding their child's hospital course.
Secondary objectives include exploring the caregiver's perspective on the use of AI in clinical care, as well as 7-day and 30-day readmission rates, 7-day and 30-day emergency department (ED) re-utilization rates, length of stay, and environmental impact measures.
Tutkimuksen yleiskatsaus
Tila
Interventio / Hoito
Yksityiskohtainen kuvaus
This randomized controlled trial evaluates whether AI-generated plain-language summaries of inpatient progress notes improve caregiver understanding of a child's hospitalization. The intervention uses a Children's National HIPAA-compliant large language model hosted within the institution's Azure environment to generate caregiver-facing summaries from attending-signed inpatient progress notes.
Eligible caregivers are randomized to receive either standard hospital communication alone or standard communication plus an attending-approved AI-generated care summary. Before distribution to caregivers, attending physicians review generated summaries for clinical appropriateness and accuracy.
Caregiver understanding of the hospitalization is assessed using a structured survey administered during the hospitalization. Responses are compared with information documented in the medical record to evaluate comprehension. Additional exploratory analyses evaluate implementation outcomes, caregiver perceptions of AI-assisted communication, physician acceptance of generated summaries, healthcare utilization outcomes following hospitalization, and operational measures related to AI summary generation.
Statistical analyses will compare outcomes between randomized groups while controlling for relevant covariates when appropriate.
Opintotyyppi
Ilmoittautuminen (Arvioitu)
Vaihe
- Ei sovellettavissa
Yhteystiedot ja paikat
Opiskeluyhteys
- Nimi: Kristen E Johnson, MD, MS
- Puhelinnumero: 571-235-6524
- Sähköposti: kejohnson@childrensnational.org
Opiskelupaikat
-
-
District of Columbia
-
Washington D.C., District of Columbia, Yhdysvallat, 20010
- Rekrytointi
- Children's National Hospital
-
Ottaa yhteyttä:
- Kristen Johnson, MD, MS
-
-
Osallistumiskriteerit
Kelpoisuusvaatimukset
Opintokelpoiset iät
Hyväksyy terveitä vapaaehtoisia
Sukupuolet, jotka voivat opiskella
Kuvaus
Inclusion Criteria: Caregiver of a patient 10 years and younger admitted to Children's National Hospital, whose preferred language is English
Exclusion Criteria:
- Caregivers of patients older than age 10 years
- Caregivers of patients not admitted to the Hospital Medicine service
- Caregivers of admitted patients whose preferred language is non-English
- Patients whose care summaries are deemed inaccurate by their attending physician and not eligible for sharing with their caregiver.
Opintosuunnitelma
Miten tutkimus on suunniteltu?
Suunnittelun yksityiskohdat
- Ensisijainen käyttötarkoitus: Terveyspalvelututkimus
- Jako: Satunnaistettu
- Inventiomalli: Rinnakkaistehtävä
- Naamiointi: Yksittäinen
Aseet ja interventiot
Osallistujaryhmä / Arm |
Interventio / Hoito |
|---|---|
|
Ei väliintuloa: Standard Hospital Communication
Standard hospital communication |
|
|
Kokeellinen: Standard Hospital Communication Plus AI Care Summary
Attending-approved written AI Care Summary provided to caregiver |
Written AI-generated plain-language summary of the patient's hospital course, reviewed and approved by the attending physician and provided to the caregiver during the hospitalization. |
Mitä tutkimuksessa mitataan?
Ensisijaiset tulostoimenpiteet
Tulosmittaus |
Toimenpiteen kuvaus |
Aikaikkuna |
|---|---|---|
|
Hospital Course Comprehension Score
Aikaikkuna: Within 24 hours after receipt of the AI care summary or completion of standard care communication, during the index hospitalization
|
Percentage of caregiver survey responses that align with information documented in the medical record (range 0%-100%; higher scores indicate greater caregiver understanding of the hospital course). |
Within 24 hours after receipt of the AI care summary or completion of standard care communication, during the index hospitalization
|
Toissijaiset tulostoimenpiteet
Tulosmittaus |
Toimenpiteen kuvaus |
Aikaikkuna |
|---|---|---|
|
LOS
Aikaikkuna: Throughout study duration, on average one year
|
Length of stay |
Throughout study duration, on average one year
|
|
Readmission
Aikaikkuna: During study duration, on average one year
|
7-day and 30-day readmission rates: readmissions within 7 or 30 days of the index hospitalization, when related to problems addressed during the initial hospitalization. |
During study duration, on average one year
|
|
ED reutilization
Aikaikkuna: 7 days after index hospital discharge and 30 days after index hospital discharge, respectively
|
7-day and 30-day ED re-utilization rates: return visits to the emergency department within 7 or 30 days for complaints related to the initial hospitalization. |
7 days after index hospital discharge and 30 days after index hospital discharge, respectively
|
|
Tokens
Aikaikkuna: WIthin 1 hour following generation of each AI care summary (during index hospitalization)
|
Token burden: the number of tokens used per AI-generated care summary. |
WIthin 1 hour following generation of each AI care summary (during index hospitalization)
|
|
Energy usage
Aikaikkuna: WIthin 1 hour of generation of the AI care summary (during index hospitalization)
|
Energy use: estimated average kilowatt-hour use per AI-generated summary. |
WIthin 1 hour of generation of the AI care summary (during index hospitalization)
|
|
Acceptability: Physician
Aikaikkuna: Within 1 hour of attending physician review of each AI-generated summary, prior to caregiver distribution, during index hospitalization
|
AI care summary rejection rate: the proportion of AI-generated summaries that attending physicians determine are not appropriate to share with caregivers. |
Within 1 hour of attending physician review of each AI-generated summary, prior to caregiver distribution, during index hospitalization
|
|
Reason for Rejection
Aikaikkuna: WIthin 1 hour of attending physician review of the AI care summary, during the index hospitalization
|
Reason for rejection: the primary reason an attending rejects a summary. One of five categorical options for rejection (contains sensitive information, contains factual errors, tone is not right, prefer not to provide written information, concerned may cause confusion); or category "other" with a free text response. |
WIthin 1 hour of attending physician review of the AI care summary, during the index hospitalization
|
|
Caregiver-Rated Usefulness of AI Care Summary (5-Point Likert Scale)
Aikaikkuna: Within 24 hours after receipt of the AI care summary, during the index hospitalization
|
Caregiver rating of how helpful the AI-generated care summary was for understanding the child's hospitalization, measured on a 5-point Likert scale ranging from 1 (Not Helpful at All) to 5 (Extremely Helpful). Higher scores indicate greater perceived usefulness. |
Within 24 hours after receipt of the AI care summary, during the index hospitalization
|
|
Engagement: Caregiver
Aikaikkuna: Within 24 hours after receipt of the AI care summary, during the index hospitalization
|
Caregiver interest in AI summaries as standard care: whether caregivers would want this type of summary incorporated into routine care. |
Within 24 hours after receipt of the AI care summary, during the index hospitalization
|
Yhteistyökumppanit ja tutkijat
Julkaisuja ja hyödyllisiä linkkejä
Yleiset julkaisut
- Greenberg JA, Basapur S, Quinn TV, Bulger JL, Schwartz NH, Oh SK, Ritz EM, Glover CM, Shah RC. Daily Written Care Summaries for Families of Critically Ill Patients: A Randomized Controlled Trial. Crit Care Med. 2022 Sep 1;50(9):1296-1305. doi: 10.1097/CCM.0000000000005583. Epub 2022 May 23.
- Bedi S, Liu Y, Orr-Ewing L, Dash D, Koyejo S, Callahan A, Fries JA, Wornow M, Swaminathan A, Lehmann LS, Hong HJ, Kashyap M, Chaurasia AR, Shah NR, Singh K, Tazbaz T, Milstein A, Pfeffer MA, Shah NH. Testing and Evaluation of Health Care Applications of Large Language Models: A Systematic Review. JAMA. 2025 Jan 28;333(4):319-328. doi: 10.1001/jama.2024.21700.
- Schoonbeek RC, Workum JD, Schuit SCE, Hoekman AH, Mehri T, Doornberg JN, van der Laan TP, Bootsma-Robroeks CMHHT; Applied Artificial Intelligence in Healthcare Consortium. Quality and efficiency of integrating customised large language model-generated summaries versus physician-written summaries: a validation study. BMJ Open. 2025 Sep 4;15(9):e099301. doi: 10.1136/bmjopen-2025-099301.
- Johnson AM, Brimhall AS, Johnson ET, Hodgson J, Didericksen K, Pye J, Harmon GJC, Sewell KB. A systematic review of the effectiveness of patient education through patient portals. JAMIA Open. 2023 Jan 18;6(1):ooac085. doi: 10.1093/jamiaopen/ooac085. eCollection 2023 Apr.
- Rea KE, Rao P, Hill E, Saylor KM, Cousino MK. Families' Experiences With Pediatric Family-Centered Rounds: A Systematic Review. Pediatrics. 2018 Mar;141(3):e20171883. doi: 10.1542/peds.2017-1883. Epub 2018 Feb 6.
Opintojen ennätyspäivät
Opi tärkeimmät päivämäärät
Opiskelun aloitus (Todellinen)
Ensisijainen valmistuminen (Arvioitu)
Opintojen valmistuminen (Arvioitu)
Opintoihin ilmoittautumispäivät
Ensimmäinen lähetetty
Ensimmäinen toimitettu, joka täytti QC-kriteerit
Ensimmäinen Lähetetty (Todellinen)
Tutkimustietojen päivitykset
Viimeisin päivitys julkaistu (Todellinen)
Viimeisin lähetetty päivitys, joka täytti QC-kriteerit
Viimeksi vahvistettu
Lisää tietoa
Tähän tutkimukseen liittyvät termit
Avainsanat
Muita asiaankuuluvia MeSH-ehtoja
Muut tutkimustunnusnumerot
- STUDY00001841
Yksittäisten osallistujien tietojen suunnitelma (IPD)
Aiotko jakaa yksittäisten osallistujien tietoja (IPD)?
IPD-suunnitelman kuvaus
Our IRB protocol does not permit IPD sharing for subject privacy
Lääke- ja laitetiedot, tutkimusasiakirjat
Tutkii yhdysvaltalaista FDA sääntelemää lääkevalmistetta
Tutkii yhdysvaltalaista FDA sääntelemää laitetuotetta
Nämä tiedot haettiin suoraan verkkosivustolta clinicaltrials.gov ilman muutoksia. Jos sinulla on pyyntöjä muuttaa, poistaa tai päivittää tutkimustietojasi, ota yhteyttä register@clinicaltrials.gov. Heti kun muutos on otettu käyttöön osoitteessa clinicaltrials.gov, se päivitetään automaattisesti myös verkkosivustollemme .