Medical Large Language Model-Assisted Diagnosis and Treatment in Primary Care Chronic Disease Management
Verification and Application Study of Medical Large Language Model-Assisted Diagnosis and Treatment in Primary Care Chronic Disease Management: A Randomized Controlled Study
Study Overview
Status
Status
Conditions
Conditions
Intervention / Treatment
Intervention / Treatment
Study Type
Study Type
Enrollment (Estimated)
Enrollment
Phase
Phase
- Not Applicable
Contacts and Locations
Study Contact
Study Contact
- Name: Guoyu Wang, MD
- Phone Number: +8615951154720
- Email: wangguoyutzheart@163.com
Study Locations
-
-
Jiangsu
-
Taizhou, Jiangsu, China, 225300
- The Affiliated Taizhou People's Hospital of Nanjing Medical University
-
Contact:
- Guoyu Wang, MD
- Phone Number: +8615951154720
- Email: wangguoyutzheart@163.com
-
-
Participation Criteria
Eligibility Criteria
Eligibility Criteria
Ages Eligible for Study
- Adult
- Older Adult
Accepts Healthy Volunteers
Description
Inclusion Criteria:
- Work experience of 3 years or more;
- Able to complete the case assessment tasks required by the study;
- Have a practicing doctor qualification;
- Work at a township health center or community health service center;
- Voluntarily participate in the study and sign the informed consent form.
Exclusion Criteria:
N/A
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Other
- Allocation: Randomized
- Interventional Model: Parallel Assignment
- Masking: Single
Number of Arms
Arms and Interventions
Participant Group / ArmParticipant Group / Arm |
Intervention / TreatmentIntervention / Treatment |
|---|---|
|
Active Comparator: LLM-Assisted Intervention Group
Primary care doctors creating management plans for chronic diseases (coronary heart disease, atrial fibrillation, heart failure, stroke) with the help of large medical language models
|
The primary care physicians in the intervention group completed the management decisions for chronic disease cases, including disease assessment, examination suggestions, treatment plans, selection of management methods, and health education, with the assistance of the medical LLM.
|
|
No Intervention: Usual Care Control Group
Primary care doctors creating management plans for chronic diseases (coronary heart disease, atrial fibrillation, heart failure, stroke) without the help of a large medical language model
|
What is the study measuring?
Primary Outcome Measures
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
expert overall scores
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
They rated them using a Likert scale on several aspects: accuracy of condition assessment, reasonableness of test recommendations, reasonableness of treatment plans, appropriateness of management choices, scientific nature of patient education content, feasibility at the primary care level, overall clinical quality.
Experts were instructed to rank the seven dimensions from lowest to highest quality.
These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
|
through study completion, an average of 3 months.
|
Secondary Outcome Measures
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
accuracy of condition assessment
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
They rated them using a Likert scale on accuracy of condition assessment from lowest to highest quality.
These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
|
through study completion, an average of 3 months.
|
|
reasonableness of test recommendations
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
They rated them using a Likert scale regarding the reasonableness of test recommendations.
Experts were instructed to rank the dimension from lowest to highest quality.
These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
|
through study completion, an average of 3 months.
|
|
reasonableness of treatment plans
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
They rated them using a Likert scale regarding the reasonableness of treatment plans.
Experts were instructed to rank the dimension from lowest to highest quality.
These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
|
through study completion, an average of 3 months.
|
|
appropriateness of management choices
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
They rated them using a Likert scale regarding the ppropriateness of management choices.
Experts were instructed to rank the dimension from lowest to highest quality.
These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
|
through study completion, an average of 3 months.
|
|
scientific nature of patient education content
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
They rated them using a Likert scale regarding the scientific nature of patient education content.
Experts were instructed to rank the dimension from lowest to highest quality.
These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
|
through study completion, an average of 3 months.
|
|
feasibility at the primary care level
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
They rated them using a Likert scale regarding the feasibility at the primary care level.
Experts were instructed to rank the dimension from lowest to highest quality.
These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
|
through study completion, an average of 3 months.
|
|
the overall clinical quality
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
They rated them using a Likert scale regarding the overall clinical quality.
Experts were instructed to rank the dimension from lowest to highest quality.
These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
|
through study completion, an average of 3 months.
|
|
risk advice
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
If there is no risk advice, the expert selects 'No'; otherwise, the expert selects 'Yes' and specifically lists the content of the risk advice.
|
through study completion, an average of 3 months.
|
|
Any diagnostic or treatment information missing
Time Frame: through study completion, an average of 3 months.
|
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts.
For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans.
If there is no omission of diagnostic and treatment information, the expert selects "No"; otherwise, the expert selects "Yes" and specifically lists the omitted diagnostic and treatment content.
|
through study completion, an average of 3 months.
|
|
feedback regarding the use of medical LLM by primary care physicians
Time Frame: through study completion, an average of 3 months.
|
After primary care physicians complete a case assessment assisted by medical LLM , they will fill out an evaluation of the medical LLM usage, including whether the medical LLM helped in disease assessment, assisted in formulating examination plans, aided in developing treatment plans, improved chronic disease management capabilities, supported chronic disease education, assisted in management approach selection, enhanced confidence, saved time, whether there were hallucinations or omissions, whether it provided risky suggestions, and any additional comments on the use of the medical LLM.
|
through study completion, an average of 3 months.
|
Collaborators and Investigators
Sponsor
Sponsor
Study record dates
Study Major Dates
Study Start (Estimated)
Study Start
Primary Completion (Estimated)
Primary Completion
Study Completion (Estimated)
Study Completion
Study Registration Dates
First Submitted
First Submitted
First Submitted That Met QC Criteria
First Submitted That Met QC Criteria
First Posted (Actual)
First Posted
Study Record Updates
Last Update Posted (Actual)
Last Update Posted
Last Update Submitted That Met QC Criteria
Last Update Submitted That Met QC Criteria
Last Verified
Last Verified
More Information
Terms related to this study
Additional Relevant MeSH Terms
- Cerebrovascular Disorders
- Brain Diseases
- Central Nervous System Diseases
- Nervous System Diseases
- Vascular Diseases
- Cardiovascular Diseases
- Pathologic Processes
- Heart Diseases
- Arrhythmias, Cardiac
- Arteriosclerosis
- Arterial Occlusive Diseases
- Coronary Disease
- Myocardial Ischemia
- Pathological Conditions, Signs and Symptoms
- Stroke
- Heart Failure
- Atrial Fibrillation
- Coronary Artery Disease
Other Study ID Numbers
Other Study ID Numbers
- LSKY 2026-114-01
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.