Improving the Reliability of LLMs as Medical Assistants for the General Public (LAMP-1)
11 giugno 2026 aggiornato da: Ji Xunming,MD,PhD, Capital Medical University
Improving the Reliability of LLMs as Medical Assistants for the General Public: a Proof of Concept Simulation Trial
This study will evaluate whether three-minute six-dimensions education(3M-6D education) can improve the reliability of large language models as medical assistants for the general public.
Participants will be randomly assigned to receive or not receive 3M-6D education and then use ChatGPT, Gemini, or non-AI information resources.
The study will assess relevant condition identification, disposition concordance, red-flag identification, and NASA-TLX score.
Panoramica dello studio
Stato
Non ancora reclutamento
Condizioni
Intervento / Trattamento
Descrizione dettagliata
This randomized, controlled, proof-of-concept simulation trial will evaluate whether three-minute six-dimensions education (3M-6D education) can improve the reliability of large language models as medical assistants for the general public.
Eligible participants will be randomly assigned in a 1:1:1:1:1 ratio to one of five study groups: the 3M-6D education GPT group, the GPT group, the 3M-6D education Gemini group, the Gemini group, or the control group. Participants in the 3M-6D education GPT and 3M-6D education Gemini groups will receive approximately three minutes of education before using ChatGPT or Gemini.Each participant will be randomly assigned one of 10 standardized clinical scenarios and complete a simulated counseling task in unrestricted natural language within approximately 10 minutes. The study will assess relevant condition identification, disposition concordance, red-flag identification, and NASA-TLX score.
Tipo di studio
Interventistico
Iscrizione (Stimato)
525
Fase
- Non applicabile
Contatti e Sedi
Questa sezione fornisce i recapiti di coloro che conducono lo studio e informazioni su dove viene condotto lo studio.
Contatto studio
- Nome: Xunming Ji
- Numero di telefono: 01083198962
- Email: jixm@ccmu.edu.cn
Backup dei contatti dello studio
- Nome: Chuanjie Wu
- Numero di telefono: 01083199439
- Email: wuchuanjie@ccmu.edu.cn
Luoghi di studio
-
-
Beijing Municipality
-
Beijing, Beijing Municipality, Cina, 100053
- Xuanwu Hospital, Capital Medical University
-
Contatto:
- Chuanjie Wu
- Numero di telefono: 010-83199439
- Email: wuchuanjie@ccmu.edu.cn
-
-
Criteri di partecipazione
I ricercatori cercano persone che corrispondano a una certa descrizione, chiamata criteri di ammissibilità. Alcuni esempi di questi criteri sono le condizioni generali di salute di una persona o trattamenti precedenti.
Criteri di ammissibilità
Età idonea allo studio
- Adulto
- Adulto più anziano
Accetta volontari sani
Sì
Descrizione
Inclusion Criteria:
- Age 18 years or greater, male or female;
- Completed primary school or higher education;
- Able to use a smartphone or computer to complete online interaction;
- No history of acute ischemic stroke, systemic lupus erythematosus, gastric ulcer, pneumonia, acute cardiac infarction, urinary tract infection, uterine fibroids, diabetes, osteoarthritis, or migraine.
- Able to understand and comply with study procedures and to provide written informed consent.
Exclusion Criteria:
- Currently or previously employed as a healthcare worker;
- Previously received systematic medical training;
- Currently involved in concurrent research that may interfere with the results of the present trial;
- The investigator considered that the participant had other conditions that might affect compliance or preclude participation.
Piano di studio
Questa sezione fornisce i dettagli del piano di studio, compreso il modo in cui lo studio è progettato e ciò che lo studio sta misurando.
Come è strutturato lo studio?
Dettagli di progettazione
- Scopo principale: Ricerca sui servizi sanitari
- Assegnazione: Randomizzato
- Modello interventistico: Assegnazione parallela
- Mascheramento: Separare
Armi e interventi
Gruppo di partecipanti / Arm |
Intervento / Trattamento |
|---|---|
|
Sperimentale: 3M-6D education GPT Group
Participants will first be trained in 3M-6D education, then use ChatGPT to complete a consultation task in unrestricted natural language in approximately 10 minutes.
|
3M-6D education is designed based on Cognitive Load Theory to reduce the cognitive burden on patients during medical interactions with AI and to improve the clarity and completeness of symptom reporting. Guided by cognitive load theory and the natural process physicians use to take medical histories, we identified candidate information dimensions and developed a structured expression framework with six dimensions for public health queries through a Delphi expert consensus process. Participants were instructed to use the framework to describe their symptoms across these six dimensions; this process can typically be completed within three minutes, so we call this approach three minutes six dimensions education (3M-6D education).
Participants use ChatGPT to complete a standardized simulated clinical scenarios in unrestricted natural language.
|
|
Sperimentale: 3M-6D education Gemini Group
Participants will first be trained in 3M-6D education, then use Gemini to complete a consultation task in unrestricted natural language in approximately 10 minutes.
|
3M-6D education is designed based on Cognitive Load Theory to reduce the cognitive burden on patients during medical interactions with AI and to improve the clarity and completeness of symptom reporting. Guided by cognitive load theory and the natural process physicians use to take medical histories, we identified candidate information dimensions and developed a structured expression framework with six dimensions for public health queries through a Delphi expert consensus process. Participants were instructed to use the framework to describe their symptoms across these six dimensions; this process can typically be completed within three minutes, so we call this approach three minutes six dimensions education (3M-6D education).
Participants use Gemini to complete a standardized simulated clinical scenarios in unrestricted natural language.
|
|
Comparatore attivo: GPT Group
Participants will use ChatGPT to complete a consultation task in unrestricted natural language in approximately 10 minutes.
|
Participants use ChatGPT to complete a standardized simulated clinical scenarios in unrestricted natural language.
|
|
Comparatore attivo: Gemini Group
Participants will use Gemini to complete a consultation task in unrestricted natural language in approximately 10 minutes.
|
Participants use Gemini to complete a standardized simulated clinical scenarios in unrestricted natural language.
|
|
Nessun intervento: Control group
Participants will use non-AI tools such as internet searches and medical websites to complete a consultation task in unrestricted natural language in approximately 10 minutes.
|
Cosa sta misurando lo studio?
Misure di risultato primarie
Misura del risultato |
Misura Descrizione |
Lasso di tempo |
|---|---|---|
|
Relevant conditions identification of the 3M-6D education GPT group compared with the GPT group
Lasso di tempo: Usually within 1 hour.
|
Relevant conditions identification is defined as the proportion of participants whose final response includes the expert-defined final diagnosis or a relevant differential diagnosis.
|
Usually within 1 hour.
|
|
Disposition concordance of the 3M-6D education GPT group compared with the GPT group
Lasso di tempo: Usually within 1 hour.
|
Disposition concordance is defined as the proportion of participants whose final care recommendation matches the expert-defined level.
The five levels are self-care, routine outpatient care, urgent outpatient care, emergency department visit, and emergency medical services.
|
Usually within 1 hour.
|
|
Relevant conditions identification of the 3M-6D education Gemini group compared with the Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Disposition concordance of the 3M-6D education Gemini group compared with the Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
Misure di risultato secondarie
Misura del risultato |
Misura Descrizione |
Lasso di tempo |
|---|---|---|
|
Relevant conditions identification of the 3M-6D education GPT group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Relevant conditions identification of the 3M-6D education Gemini group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Disposition concordance of the 3M-6D education GPT group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Disposition concordance of the 3M-6D education Gemini group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Red-flag identification in the 3M-6D education GPT group compared with the GPT group
Lasso di tempo: Usually within 1 hour.
|
Red-flag identification is defined as the proportion of participants whose final response includes the key warning signs that experts defined for the assigned scenario.
|
Usually within 1 hour.
|
|
Red-flag identification in the 3M-6D education GPT group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Red-flag identification in the 3M-6D education Gemini group compared with the Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Red-flag identification in the 3M-6D education Gemini group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
NASA Task Load Index score of the 3M-6D education GPT group compared with the GPT group
Lasso di tempo: Usually within 1 hour.
|
NASA-TLX score is a self-reported task-load score measured after the simulated consultation with a physician.
It includes six domains: mental demand, physical demand, temporal demand, effort, frustration, and performance.
Each domain is scored from 0 to 100.
The total score is the mean of the six domains.
Higher scores indicate greater perceived task load.
|
Usually within 1 hour.
|
|
NASA Task Load Index score of the 3M-6D education GPT group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
NASA Task Load Index score of the 3M-6D education Gemini group compared with the Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
NASA Task Load Index score of the 3M-6D education Gemini group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Relevant conditions identification of the 3M-6D education GPT group compared with the 3M-6D education Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Disposition concordance of the 3M-6D education GPT group compared with the 3M-6D education Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Red-flag identification in the 3M-6D education GPT group compared with the 3M-6D education Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
NASA Task Load Index score of the 3M-6D education GPT group compared with the 3M-6D education Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
Altre misure di risultato
Misura del risultato |
Misura Descrizione |
Lasso di tempo |
|---|---|---|
|
Failure to identify red flags in the 3M-6D education GPT group compared with the GPT group
Lasso di tempo: Usually within 1 hour.
|
Failure to identify red flags is defined as the proportion of participants whose final response does not include the expert-defined red-flag symptoms or warning signs for the assigned standardized simulated clinical scenario.
|
Usually within 1 hour.
|
|
Failure to identify red flags in the 3M-6D education GPT group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Failure to identify red flags in the 3M-6D education Gemini group compared with the Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Failure to identify red flags in the 3M-6D education Gemini group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Underestimation of disposition in the 3M-6D education GPT group compared with the GPT group
Lasso di tempo: Usually within 1 hour.
|
Underestimation of disposition is defined as the proportion of participants whose final care recommendation is lower than the expert-defined disposition level for the assigned standardized simulated clinical scenario.
|
Usually within 1 hour.
|
|
Underestimation of disposition in the 3M-6D education GPT group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Underestimation of disposition in the 3M-6D education Gemini group compared with the Gemini group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
|
|
Underestimation of disposition in the 3M-6D education Gemini group compared with the control group
Lasso di tempo: Usually within 1 hour.
|
Usually within 1 hour.
|
Collaboratori e investigatori
Qui è dove troverai le persone e le organizzazioni coinvolte in questo studio.
Sponsor
Collaboratori
Studiare le date dei record
Queste date tengono traccia dell'avanzamento della registrazione dello studio e dell'invio dei risultati di sintesi a ClinicalTrials.gov. I record degli studi e i risultati riportati vengono esaminati dalla National Library of Medicine (NLM) per assicurarsi che soddisfino specifici standard di controllo della qualità prima di essere pubblicati sul sito Web pubblico.
Studia le date principali
Inizio studio (Stimato)
20 giugno 2026
Completamento primario (Stimato)
20 luglio 2026
Completamento dello studio (Stimato)
20 luglio 2026
Date di iscrizione allo studio
Primo inviato
11 giugno 2026
Primo inviato che soddisfa i criteri di controllo qualità
11 giugno 2026
Primo Inserito (Effettivo)
16 giugno 2026
Aggiornamenti dei record di studio
Ultimo aggiornamento pubblicato (Effettivo)
16 giugno 2026
Ultimo aggiornamento inviato che soddisfa i criteri QC
11 giugno 2026
Ultimo verificato
1 giugno 2026
Maggiori informazioni
Termini relativi a questo studio
Parole chiave
Altri numeri di identificazione dello studio
- LAMP-1
Piano per i dati dei singoli partecipanti (IPD)
Hai intenzione di condividere i dati dei singoli partecipanti (IPD)?
INDECISO
Informazioni su farmaci e dispositivi, documenti di studio
Studia un prodotto farmaceutico regolamentato dalla FDA degli Stati Uniti
No
Studia un dispositivo regolamentato dalla FDA degli Stati Uniti
No
Queste informazioni sono state recuperate direttamente dal sito web clinicaltrials.gov senza alcuna modifica. In caso di richieste di modifica, rimozione o aggiornamento dei dettagli dello studio, contattare register@clinicaltrials.gov. Non appena verrà implementata una modifica su clinicaltrials.gov, questa verrà aggiornata automaticamente anche sul nostro sito web .