Enhancing Readability of Lay Abstracts and Summaries for Medical Knowledge Using Generative Artificial Intelligence (BRIDGE AI 3)
Enhancing Readability of Lay Abstracts and Summaries for Medical Knowledge Using Generative Artificial Intelligence: A Randomized Controlled Trial (BRIDGE AI 3)
Visão geral do estudo
Status
Intervenção / Tratamento
Descrição detalhada
This study evaluates whether a generative artificial intelligence (AI) tool can improve the readability and accessibility of lay summaries derived from scientific medical abstracts. Many patients encounter difficulty understanding medical literature due to technical language and complexity, which can limit informed decision-making and engagement with healthcare information.
The BRIDGE-AI (Provider Perspective) initiative aims to address this gap by enabling healthcare professionals and researchers to generate patient-friendly summaries of scientific content using AI-assisted tools. The intervention leverages a generative AI framework (pub2people) designed to translate complex medical terminology into language that is understandable to a general audience.
In this randomized controlled study, participants with experience in scientific publishing will be assigned to either an AI-assisted group or a control group using conventional methods. Participants will be asked to transform scientific abstracts into layperson-friendly summaries. The study compares AI-assisted and manually generated outputs in terms of readability, accuracy, and efficiency.
The primary objective is to determine whether AI-assisted generation improves the readability of lay summaries compared to standard approaches. Secondary objectives include evaluating the accuracy of AI-generated summaries relative to source material and assessing potential time savings associated with AI use.
This study contributes to ongoing efforts to improve health communication by evaluating scalable tools that may enhance the translation of complex medical information into patient-accessible formats.
Tipo de estudo
Inscrição (Real)
Estágio
- Fase 2
Contactos e Locais
Locais de estudo
-
-
California
-
Los Angeles, California, Estados Unidos, 91100
- University of Southern California
-
-
Critérios de participação
Critérios de elegibilidade
Idades elegíveis para estudo
- Adulto
- Adulto mais velho
Aceita Voluntários Saudáveis
Descrição
Provider Participants
Inclusion:
- Corresponding authors who have been published in the top 10 journals of urology and medicine
- All genders
- Any profession
- 18+ years of age
Exclusion:
- Anyone under the age of 18
- Participants that have not published in the top 10 journals of urology and medicine
Plano de estudo
Como o estudo é projetado?
Detalhes do projeto
- Finalidade Principal: Pesquisa de serviços de saúde
- Alocação: Randomizado
- Modelo Intervencional: Atribuição Paralela
- Mascaramento: Solteiro
Armas e Intervenções
Grupo de Participantes / Braço |
Intervenção / Tratamento |
|---|---|
|
Sem intervenção: Gold Standard
|
|
|
Experimental: Pub2Post
|
Pub2Post, a generative artificial intelligence agent which helps in drafting the layperson abstracts and summaries
|
O que o estudo está medindo?
Medidas de resultados primários
Medida de resultado |
Descrição da medida |
Prazo |
|---|---|---|
|
Readability Change
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Flesch Reading Ease Score Description: Measures text readability based on sentence length and word syllables. Scale: 0 to 100 Interpretation: Higher scores indicate easier readability (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Flesch-Kincaid Grade Level Description: Estimates U.S. school grade level required to understand the text.
Scale: Typically ranges from ~0 to 18+ Interpretation: Lower scores indicate easier readability (better outcome).
|
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Gunning Fog Index Description: Estimates years of formal education needed to understand the text on first reading. Scale: Typically 0 to 20+ Interpretation: Lower scores indicate easier readability (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
SMOG Index (Simple Measure of Gobbledygook) Description: Estimates years of education required to comprehend the text.
Scale: Typically 0 to 20+ Interpretation: Lower scores indicate easier readability (better outcome).
|
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Coleman-Liau Index Description: Readability formula based on characters per word and sentence length. Scale: Typically 0 to 18+ (grade level equivalent) Interpretation: Lower scores indicate easier readability (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Readability Change
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Automated Readability Index (ARI) Description: Estimates grade level required for comprehension using characters and word counts. Scale: Typically 0 to 14+ Interpretation: Lower scores indicate easier readability (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Medidas de resultados secundários
Medida de resultado |
Descrição da medida |
Prazo |
|---|---|---|
|
Time Saving
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
To evaluate the time savings achieved by using generative AI compared to traditional methods for generating layperson abstracts and summaries. Time will be recorded in hours, minutes, and seconds. We will collect and compare the total time spent drafting the complete layperson abstract and summaries, as well as the time spent on each individual section - background, methods, results, conclusion, and short summaries. The comparison will be made between summaries created by humans alone versus those created with GAI assistance. Time will be reported in minutes |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Accuracy Score of Layperson Abstract Sections Description: Degree to which each section (Background, Methods, Results, Conclusion, Short Summary) reflects key information from the original scientific abstract. Scale: 5-point Likert scale (1 = very inaccurate, 5 = highly accurate) Assessment Method: Two independent reviewers score each section Interpretation: Higher scores indicate better accuracy (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Completeness Score of Layperson Abstract Sections Description: Extent to which essential information from the original abstract is included in each section. Scale: 5-point Likert scale (1 = very incomplete, 5 = fully complete) Assessment Method: Two independent reviewers evaluate each section. Interpretation: Higher scores indicate greater completeness (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Clarity Score for Layperson Readability Description: Evaluates simplicity, avoidance of jargon, and coherence for lay audiences. Scale: 5-point Likert scale (1 = very unclear, 5 = very clear and understandable) Assessment Method: Two independent reviewers evaluate each section. Interpretation: Higher scores indicate better clarity (better outcome). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Section-Level Correctness Rate Description: Proportion of sections rated as "correct," defined as receiving scores ≥4 from both reviewers on accuracy, completeness, and clarity simultaneously. Scale: 0 to 1 (proportion) or 0% to 100% Interpretation: Higher values indicate better overall section quality. |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Correctness and meaning retention
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
Hallucination Rate Description: Frequency of false or misleading content in generated layperson abstracts, defined as information not supported by the original abstract. Scale: Proportion of sections or documents containing hallucinations (0 to 1 or %) Assessment Method: Evaluated separately by reviewers using predefined criteria. Interpretation: Lower values indicate better performance (fewer hallucinations). |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment.
|
|
Perceived Task Difficulty
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
Description: Participant-reported difficulty of completing the lay abstract summarization task. Scale: 5-point Likert scale (1 = very easy, 5 = very difficult) (adjust anchors if different in your instrument) Assessment Timing: Immediately after task completion Interpretation: Lower scores indicate less perceived difficulty (better outcome) |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
|
Perceived Task Duration
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
Description: Participant perception of time required to complete the task.
Scale: 5-point Likert scale (1 = very short, 5 = very long) Assessment Timing: Post-task Interpretation: Lower scores indicate shorter perceived duration (better outcome)
|
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
|
Perceived Helpfulness of the intervention
Prazo: The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
Description: Participant-reported usefulness of the generative AI tool in assisting lay abstract creation. Scale: 5-point Likert scale (1 = not helpful at all, 5 = extremely helpful) Assessment Timing: Post-task Interpretation: Higher scores indicate greater perceived helpfulness (better outcome) |
The assessment will be conducted immediately after the study closes, which will occur 4 weeks after enrollment
|
|
System Usability Scale (SUS) Score
Prazo: Immediately after completing the system/task (post-use assessment)
|
Description: Standardized assessment of system usability using the System Usability Scale. Scale: 0 to 100 Interpretation: Higher scores indicate better usability
|
Immediately after completing the system/task (post-use assessment)
|
|
Perceived Usefulness (Technology Acceptance Model)
Prazo: Immediately after completing the system/task (post-use assessment)
|
Description: Degree to which participants believe the GAI tool enhances task performance. Scale: Likert scale (typically 1-5 or 1-7; specify exact instrument version) Interpretation: Higher scores indicate greater perceived usefulness (better outcome) |
Immediately after completing the system/task (post-use assessment)
|
|
Perceived Ease of Use (Technology Acceptance Model)
Prazo: Immediately after completing the system/task (post-use assessment)
|
Description: Degree to which participants find the GAI tool easy to use.
Scale: Likert scale (typically 1-5 or 1-7; must match instrument used) Interpretation: Higher scores indicate greater ease of use (better outcome)
|
Immediately after completing the system/task (post-use assessment)
|
Colaboradores e Investigadores
Patrocinador
Datas de registro do estudo
Datas Principais do Estudo
Início do estudo (Real)
Conclusão Primária (Real)
Conclusão do estudo (Real)
Datas de inscrição no estudo
Enviado pela primeira vez
Enviado pela primeira vez que atendeu aos critérios de CQ
Primeira postagem (Real)
Atualizações de registro de estudo
Última Atualização Postada (Real)
Última atualização enviada que atendeu aos critérios de controle de qualidade
Última verificação
Mais Informações
Termos relacionados a este estudo
Palavras-chave
Termos MeSH relevantes adicionais
- Doenças urogenitais
- Doenças Genitais
- Doenças do Sistema Endócrino
- Neoplasias Genitais Masculinas
- Neoplasias urogenitais
- Neoplasias por local
- Neoplasias
- Doenças Genitais, Masculino
- Doenças prostáticas
- Doenças Urogenitais Masculinas
- Doenças renais
- Doenças Urológicas
- Doenças Urogenitais Femininas
- Doenças urogenitais femininas e complicações na gravidez
- Neoplasias por Tipo Histológico
- Neoplasias das Glândulas Endócrinas
- Neoplasias Glandulares e Epiteliais
- Distúrbios Gonadais
- Neoplasias Urológicas
- Carcinoma
- Doenças da Bexiga Urinária
- Doenças testiculares
- Neoplasias prostáticas
- Adenocarcinoma
- Neoplasias da Bexiga Urinária
- Neoplasias Renais
- Neoplasias testiculares
Outros números de identificação do estudo
- UP-24-01142
Plano para dados de participantes individuais (IPD)
Planeja compartilhar dados de participantes individuais (IPD)?
Tipo de informação de suporte de compartilhamento de IPD
- PROTOCOLO DE ESTUDO
- SEIVA
Informações sobre medicamentos e dispositivos, documentos de estudo
Estuda um medicamento regulamentado pela FDA dos EUA
Estuda um produto de dispositivo regulamentado pela FDA dos EUA
Essas informações foram obtidas diretamente do site clinicaltrials.gov sem nenhuma alteração. Se você tiver alguma solicitação para alterar, remover ou atualizar os detalhes do seu estudo, entre em contato com register@clinicaltrials.gov. Assim que uma alteração for implementada em clinicaltrials.gov, ela também será atualizada automaticamente em nosso site .