Enhancing Readability of Lay Abstracts and Summaries for Medical Knowledge Using Generative Artificial Intelligence (BRIDGE AI 3)
Enhancing Readability of Lay Abstracts and Summaries for Medical Knowledge Using Generative Artificial Intelligence: A Randomized Controlled Trial (BRIDGE AI 3)
Studieoversigt
Status
Intervention / Behandling
Detaljeret beskrivelse
This study evaluates whether a generative artificial intelligence (AI) tool can improve the readability and accessibility of lay summaries derived from scientific medical abstracts. Many patients encounter difficulty understanding medical literature due to technical language and complexity, which can limit informed decision-making and engagement with healthcare information.
The BRIDGE-AI (Provider Perspective) initiative aims to address this gap by enabling healthcare professionals and researchers to generate patient-friendly summaries of scientific content using AI-assisted tools. The intervention leverages a generative AI framework (pub2people) designed to translate complex medical terminology into language that is understandable to a general audience.
In this randomized controlled study, participants with experience in scientific publishing will be assigned to either an AI-assisted group or a control group using conventional methods. Participants will be asked to transform scientific abstracts into layperson-friendly summaries. The study compares AI-assisted and manually generated outputs in terms of readability, accuracy, and efficiency.
The primary objective is to determine whether AI-assisted generation improves the readability of lay summaries compared to standard approaches. Secondary objectives include evaluating the accuracy of AI-generated summaries relative to source material and assessing potential time savings associated with AI use.
This study contributes to ongoing efforts to improve health communication by evaluating scalable tools that may enhance the translation of complex medical information into patient-accessible formats.
Undersøgelsestype
Tilmelding (Faktiske)
Fase
- Fase 2
Kontakter og lokationer
Studiesteder
-
-
California
-
Los Angeles, California, Forenede Stater, 91100
- University of Southern California
-
-
Deltagelseskriterier
Berettigelseskriterier
Aldre berettiget til at studere
- Voksen
- Ældre voksen
Tager imod sunde frivillige
Beskrivelse
Provider Participants
Inclusion:
- Corresponding authors who have been published in the top 10 journals of urology and medicine
- All genders
- Any profession
- 18+ years of age
Exclusion:
- Anyone under the age of 18
- Participants that have not published in the top 10 journals of urology and medicine
Studieplan
Hvordan er undersøgelsen tilrettelagt?
Design detaljer
- Primært formål: Sundhedstjenesteforskning
- Tildeling: Randomiseret
- Interventionel model: Parallel tildeling
- Maskning: Enkelt
Våben og indgreb
Deltagergruppe / Arm |
Intervention / Behandling |
|---|---|
|
Ingen indgriben: Gold Standard
|
|
|
Eksperimentel: Pub2Post
|
Pub2Post, a generative artificial intelligence agent which helps in drafting the layperson abstracts and summaries
|
Hvad måler undersøgelsen?
Primære resultatmål
Resultatmål |
Foranstaltningsbeskrivelse |
Tidsramme |
|---|---|---|
|
Readability Change
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Flesch Reading Ease Score Description: Measures text readability based on sentence length and word syllables. Scale: 0 to 100 Interpretation: Higher scores indicate easier readability (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Flesch-Kincaid Grade Level Description: Estimates U.S. school grade level required to understand the text.
Scale: Typically ranges from ~0 to 18+ Interpretation: Lower scores indicate easier readability (better outcome).
|
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Gunning Fog Index Description: Estimates years of formal education needed to understand the text on first reading. Scale: Typically 0 to 20+ Interpretation: Lower scores indicate easier readability (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
SMOG Index (Simple Measure of Gobbledygook) Description: Estimates years of education required to comprehend the text.
Scale: Typically 0 to 20+ Interpretation: Lower scores indicate easier readability (better outcome).
|
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Coleman-Liau Index Description: Readability formula based on characters per word and sentence length. Scale: Typically 0 to 18+ (grade level equivalent) Interpretation: Lower scores indicate easier readability (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Automated Readability Index (ARI) Description: Estimates grade level required for comprehension using characters and word counts. Scale: Typically 0 to 14+ Interpretation: Lower scores indicate easier readability (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Sekundære resultatmål
Resultatmål |
Foranstaltningsbeskrivelse |
Tidsramme |
|---|---|---|
|
Time Saving
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
To evaluate the time savings achieved by using generative AI compared to traditional methods for generating layperson abstracts and summaries. Time will be recorded in hours, minutes, and seconds. We will collect and compare the total time spent drafting the complete layperson abstract and summaries, as well as the time spent on each individual section - background, methods, results, conclusion, and short summaries. The comparison will be made between summaries created by humans alone versus those created with GAI assistance. Time will be reported in minutes |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Accuracy Score of Layperson Abstract Sections Description: Degree to which each section (Background, Methods, Results, Conclusion, Short Summary) reflects key information from the original scientific abstract. Scale: 5-point Likert scale (1 = very inaccurate, 5 = highly accurate) Assessment Method: Two independent reviewers score each section Interpretation: Higher scores indicate better accuracy (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Completeness Score of Layperson Abstract Sections Description: Extent to which essential information from the original abstract is included in each section. Scale: 5-point Likert scale (1 = very incomplete, 5 = fully complete) Assessment Method: Two independent reviewers evaluate each section. Interpretation: Higher scores indicate greater completeness (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Clarity Score for Layperson Readability Description: Evaluates simplicity, avoidance of jargon, and coherence for lay audiences. Scale: 5-point Likert scale (1 = very unclear, 5 = very clear and understandable) Assessment Method: Two independent reviewers evaluate each section. Interpretation: Higher scores indicate better clarity (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Section-Level Correctness Rate Description: Proportion of sections rated as "correct," defined as receiving scores ≥4 from both reviewers on accuracy, completeness, and clarity simultaneously. Scale: 0 to 1 (proportion) or 0% to 100% Interpretation: Higher values indicate better overall section quality. |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Hallucination Rate Description: Frequency of false or misleading content in generated layperson abstracts, defined as information not supported by the original abstract. Scale: Proportion of sections or documents containing hallucinations (0 to 1 or %) Assessment Method: Evaluated separately by reviewers using predefined criteria. Interpretation: Lower values indicate better performance (fewer hallucinations). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Perceived Task Difficulty
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
Description: Participant-reported difficulty of completing the lay abstract summarization task. Scale: 5-point Likert scale (1 = very easy, 5 = very difficult) (adjust anchors if different in your instrument) Assessment Timing: Immediately after task completion Interpretation: Lower scores indicate less perceived difficulty (better outcome) |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
|
Perceived Task Duration
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
Description: Participant perception of time required to complete the task.
Scale: 5-point Likert scale (1 = very short, 5 = very long) Assessment Timing: Post-task Interpretation: Lower scores indicate shorter perceived duration (better outcome)
|
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
|
Perceived Helpfulness of the intervention
Tidsramme: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
Description: Participant-reported usefulness of the generative AI tool in assisting lay abstract creation. Scale: 5-point Likert scale (1 = not helpful at all, 5 = extremely helpful) Assessment Timing: Post-task Interpretation: Higher scores indicate greater perceived helpfulness (better outcome) |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
|
System Usability Scale (SUS) Score
Tidsramme: Immediately after completing the system/task (post-use assessment)
|
Description: Standardized assessment of system usability using the System Usability Scale. Scale: 0 to 100 Interpretation: Higher scores indicate better usability
|
Immediately after completing the system/task (post-use assessment)
|
|
Perceived Usefulness (Technology Acceptance Model)
Tidsramme: Immediately after completing the system/task (post-use assessment)
|
Description: Degree to which participants believe the GAI tool enhances task performance. Scale: Likert scale (typically 1-5 or 1-7; specify exact instrument version) Interpretation: Higher scores indicate greater perceived usefulness (better outcome) |
Immediately after completing the system/task (post-use assessment)
|
|
Perceived Ease of Use (Technology Acceptance Model)
Tidsramme: Immediately after completing the system/task (post-use assessment)
|
Description: Degree to which participants find the GAI tool easy to use.
Scale: Likert scale (typically 1-5 or 1-7; must match instrument used) Interpretation: Higher scores indicate greater ease of use (better outcome)
|
Immediately after completing the system/task (post-use assessment)
|
Samarbejdspartnere og efterforskere
Datoer for undersøgelser
Studer store datoer
Studiestart (Faktiske)
Primær færdiggørelse (Faktiske)
Studieafslutning (Faktiske)
Datoer for studieregistrering
Først indsendt
Først indsendt, der opfyldte QC-kriterier
Først opslået (Faktiske)
Opdateringer af undersøgelsesjournaler
Sidste opdatering sendt (Faktiske)
Sidste opdatering indsendt, der opfyldte kvalitetskontrolkriterier
Sidst verificeret
Mere information
Begreber relateret til denne undersøgelse
Nøgleord
Yderligere relevante MeSH-vilkår
- Urogenitale sygdomme
- Genitale sygdomme
- Sygdomme i det endokrine system
- Genitale neoplasmer, mandlige
- Urogenitale neoplasmer
- Neoplasmer efter sted
- Neoplasmer
- Kønssygdomme, mandlige
- Prostatasygdomme
- Mandlige urogenitale sygdomme
- Nyresygdomme
- Urologiske sygdomme
- Urogenitale sygdomme hos kvinder
- Kvinders urogenitale sygdomme og graviditetskomplikationer
- Neoplasmer efter histologisk type
- Neoplasmer i endokrine kirtler
- Neoplasmer, kirtel og epitel
- Gonadale lidelser
- Urologiske neoplasmer
- Karcinom
- Urinblæresygdomme
- Testikelsygdomme
- Prostatiske neoplasmer
- Adenocarcinom
- Urinblære neoplasmer
- Nyre-neoplasmer
- Testikulære neoplasmer
Andre undersøgelses-id-numre
- UP-24-01142
Plan for individuelle deltagerdata (IPD)
Planlægger du at dele individuelle deltagerdata (IPD)?
IPD-deling Understøttende informationstype
- STUDY_PROTOCOL
- SAP
Lægemiddel- og udstyrsoplysninger, undersøgelsesdokumenter
Studerer et amerikansk FDA-reguleret lægemiddelprodukt
Studerer et amerikansk FDA-reguleret enhedsprodukt
Disse oplysninger blev hentet direkte fra webstedet clinicaltrials.gov uden ændringer. Hvis du har nogen anmodninger om at ændre, fjerne eller opdatere dine undersøgelsesoplysninger, bedes du kontakte register@clinicaltrials.gov. Så snart en ændring er implementeret på clinicaltrials.gov, vil denne også blive opdateret automatisk på vores hjemmeside .