Medical Large Language Model-Assisted Diagnosis and Treatment in Primary Care Chronic Disease Management

July 27, 2026 updated by: Jiangsu Taizhou People's Hospital

Verification and Application Study of Medical Large Language Model-Assisted Diagnosis and Treatment in Primary Care Chronic Disease Management: A Randomized Controlled Study

This study aims to explore the feasibility of using medical large language models to assist in chronic disease management. By setting up experimental and control group interventions and having experts blindly evaluate anonymized cases, it compares different management approaches in chronic disease care, verifying the scientific basis, effectiveness, and potential for broader use of medical large language models in supporting chronic disease management.

Study Overview

Status

Not yet recruiting

Conditions

Intervention / Treatment

Study Type

Interventional

Enrollment (Estimated)

20

Phase

  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Contact

Study Locations

    • Jiangsu
      • Taizhou, Jiangsu, China, 225300
        • The Affiliated Taizhou People's Hospital of Nanjing Medical University
        • Contact:

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Adult
  • Older Adult

Accepts Healthy Volunteers

No

Description

Inclusion Criteria:

  1. Work experience of 3 years or more;
  2. Able to complete the case assessment tasks required by the study;
  3. Have a practicing doctor qualification;
  4. Work at a township health center or community health service center;
  5. Voluntarily participate in the study and sign the informed consent form.

Exclusion Criteria:

N/A

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: Other
  • Allocation: Randomized
  • Interventional Model: Parallel Assignment
  • Masking: Single

Arms and Interventions

Participant Group / Arm
Intervention / Treatment
Active Comparator: LLM-Assisted Intervention Group
Primary care doctors creating management plans for chronic diseases (coronary heart disease, atrial fibrillation, heart failure, stroke) with the help of large medical language models
The primary care physicians in the intervention group completed the management decisions for chronic disease cases, including disease assessment, examination suggestions, treatment plans, selection of management methods, and health education, with the assistance of the medical LLM.
No Intervention: Usual Care Control Group
Primary care doctors creating management plans for chronic diseases (coronary heart disease, atrial fibrillation, heart failure, stroke) without the help of a large medical language model

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
expert overall scores
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. They rated them using a Likert scale on several aspects: accuracy of condition assessment, reasonableness of test recommendations, reasonableness of treatment plans, appropriateness of management choices, scientific nature of patient education content, feasibility at the primary care level, overall clinical quality. Experts were instructed to rank the seven dimensions from lowest to highest quality. These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
through study completion, an average of 3 months.

Secondary Outcome Measures

Outcome Measure
Measure Description
Time Frame
accuracy of condition assessment
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. They rated them using a Likert scale on accuracy of condition assessment from lowest to highest quality. These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
through study completion, an average of 3 months.
reasonableness of test recommendations
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. They rated them using a Likert scale regarding the reasonableness of test recommendations. Experts were instructed to rank the dimension from lowest to highest quality. These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
through study completion, an average of 3 months.
reasonableness of treatment plans
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. They rated them using a Likert scale regarding the reasonableness of treatment plans. Experts were instructed to rank the dimension from lowest to highest quality. These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
through study completion, an average of 3 months.
appropriateness of management choices
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. They rated them using a Likert scale regarding the ppropriateness of management choices. Experts were instructed to rank the dimension from lowest to highest quality. These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
through study completion, an average of 3 months.
scientific nature of patient education content
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. They rated them using a Likert scale regarding the scientific nature of patient education content. Experts were instructed to rank the dimension from lowest to highest quality. These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
through study completion, an average of 3 months.
feasibility at the primary care level
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. They rated them using a Likert scale regarding the feasibility at the primary care level. Experts were instructed to rank the dimension from lowest to highest quality. These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
through study completion, an average of 3 months.
the overall clinical quality
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. They rated them using a Likert scale regarding the overall clinical quality. Experts were instructed to rank the dimension from lowest to highest quality. These ordinal rankings were then converted into standardized scores of 1 to 5. Higher scores mean better.
through study completion, an average of 3 months.
risk advice
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. If there is no risk advice, the expert selects 'No'; otherwise, the expert selects 'Yes' and specifically lists the content of the risk advice.
through study completion, an average of 3 months.
Any diagnostic or treatment information missing
Time Frame: through study completion, an average of 3 months.
A total of 200 cases (50 each of coronary heart disease, atrial fibrillation, heart failure, and stroke) were grouped by disease type and independently evaluated in a blinded manner by three subspecialty experts. For each case, the two management plans were anonymized in the same way and then randomly labeled by a computer as Plan A and Plan B. Experts could only view the anonymized case information and the two corresponding anonymized management plans. If there is no omission of diagnostic and treatment information, the expert selects "No"; otherwise, the expert selects "Yes" and specifically lists the omitted diagnostic and treatment content.
through study completion, an average of 3 months.
feedback regarding the use of medical LLM by primary care physicians
Time Frame: through study completion, an average of 3 months.
After primary care physicians complete a case assessment assisted by medical LLM , they will fill out an evaluation of the medical LLM usage, including whether the medical LLM helped in disease assessment, assisted in formulating examination plans, aided in developing treatment plans, improved chronic disease management capabilities, supported chronic disease education, assisted in management approach selection, enhanced confidence, saved time, whether there were hallucinations or omissions, whether it provided risky suggestions, and any additional comments on the use of the medical LLM.
through study completion, an average of 3 months.

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Estimated)

August 17, 2026

Primary Completion (Estimated)

September 30, 2026

Study Completion (Estimated)

November 30, 2026

Study Registration Dates

First Submitted

July 20, 2026

First Submitted That Met QC Criteria

July 27, 2026

First Posted (Actual)

July 31, 2026

Study Record Updates

Last Update Posted (Actual)

July 31, 2026

Last Update Submitted That Met QC Criteria

July 27, 2026

Last Verified

July 1, 2026

More Information

Terms related to this study

Other Study ID Numbers

  • LSKY 2026-114-01

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

NO

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.