Large Language Model Assistance for Clinical Decision-Making Among Rural Physicians
Effect of Large Language Model Assistance on Clinical Decision-Making Among Rural Physicians: A Randomized Controlled Trial
調査の概要
状態
条件
詳細な説明
Rural physicians play an essential role in the diagnosis and management of common and frequently occurring conditions, referral decision-making, chronic disease management, and patient education. In resource-constrained primary care settings, they often face limited access to medical information and specialist support, delays in updating clinical knowledge and guidelines, and substantial pressure in clinical decision-making. These challenges are particularly relevant in northwestern China, where primary care resources are relatively limited. Improving rural physicians' abilities in diagnostic assessment, recognition of clinical warning signs, and rational prescribing is therefore an important priority for strengthening primary healthcare services.
Large language models (LLMs) can support medical information retrieval, organization of diagnostic and management approaches, differential diagnosis, medication-related decision-making, patient education, and follow-up planning, and may therefore serve as accessible tools for supporting clinical decision-making in primary care. However, general-purpose LLMs were not specifically developed for use in resource-constrained primary care settings and have not been adequately evaluated among rural physicians. Their responses may contain factual errors or fabricated evidence, overlook warning signs, provide insufficient medication safety warnings, or recommend investigations and treatments that are not feasible in local primary care settings. Without adequate verification skills, physicians may fail to benefit from LLM assistance and may even introduce new safety risks. It is therefore important to evaluate how rural physicians use LLMs and whether structured training can improve the safe and effective use of these tools before their wider implementation.
This randomized controlled trial will evaluate the effects of LLM assistance and brief training on clinical decision-making among rural physicians. Participants will complete clinical cases involving common conditions encountered in primary care, with tasks assessing diagnostic judgment, recognition of warning signs, rational treatment, and patient education. Some participants will also use the LLM as a second-opinion tool to review and revise their initial decisions. All responses will be independently evaluated by reviewers blinded to group assignment using standardized scoring criteria to assess overall clinical decision-making performance and safety.
研究の種類
入学 (推定)
段階
- 適用できない
連絡先と場所
研究連絡先
- 名前：Liyuan Tao, MD
- 電話番号：+86 82265732
- メール：tendytly@163.com
研究場所
-
-
Xinjiang Uygur Autonomous Region
-
Karamay、Xinjiang Uygur Autonomous Region、中国
- Xinjiang Second Medical College
-
コンタクト：
- Zejiang Ma, Master of Medicine
- 電話番号：+86 18811331959
- メール：18811331959@163.com
-
-
参加基準
適格基準
就学可能な年齢
- 大人
- 高齢者
健康ボランティアの受け入れ
説明
Inclusion Criteria:
- Currently engaged in clinical practice at a rural primary healthcare institution in northwestern China.
- Has received formal medical education and holds a relevant diploma or degree.
- Able to read and understand clinical case materials in Chinese.
- Able to use a computer to complete the study tasks.
- Willing to participate and able to provide written informed consent.
Exclusion Criteria:
- Previously involved in the development of the clinical case tasks, reference answers, or scoring rubric for this study.
- Previously participated in pilot testing involving the same clinical case tasks or study procedures.
研究計画
研究はどのように設計されていますか？
デザインの詳細
- 主な目的：ヘルスサービス研究
- 割り当て：ランダム化
- 介入モデル：階乗代入
- マスキング：独身
武器と介入
参加者グループ / アーム |
介入・治療 |
|---|---|
|
アクティブコンパレータ：Conventional Resources Followed by LLM Second Opinion
Participants receive no LLM-use training.
During the initial 60-minute assessment, they complete the clinical cases using conventional non-LLM resources only.
After submitting their initial responses, they receive an additional 30 minutes to use the study-provided LLM as a second-opinion tool to review and revise their responses.
|
During the initial 60-minute assessment, participants complete primary care clinical cases using conventional non-LLM resources only, including clinical guidelines, textbooks, drug labels, training materials, medical websites, and standard search engines.
Participants are not permitted to use LLMs during this phase.
After completing and submitting their initial responses using conventional non-LLM resources, participants receive an additional 30 minutes to use the study-provided DeepSeek-V4 as a second-opinion tool.
They may review, verify, and revise their initial clinical decisions before submitting their final responses.
|
|
実験的：Direct LLM Assistance
Participants receive no LLM-use training and may use the study-provided LLM throughout the initial 60-minute assessment to complete the clinical cases.
They submit their final responses at 60 minutes and do not participate in the additional second-opinion phase.
|
During the initial 60-minute assessment, participants may use the study-provided DeepSeek-V4 to assist with medical information retrieval, diagnostic and management reasoning, identification of warning signs, referral decisions, rational prescribing, patient education, and follow-up planning.
Participants remain responsible for their final clinical decisions and responses.
|
|
実験的：LLM Training and Conventional Resources Followed by LLM Second Opinion
Participants receive brief structured training on the safe and effective use of LLMs.
During the initial 60-minute assessment, they complete the clinical cases using conventional non-LLM resources only.
After submitting their initial responses, they receive an additional 30 minutes to use the study-provided LLM as a second-opinion tool to review and revise their responses.
|
During the initial 60-minute assessment, participants complete primary care clinical cases using conventional non-LLM resources only, including clinical guidelines, textbooks, drug labels, training materials, medical websites, and standard search engines.
Participants are not permitted to use LLMs during this phase.
After completing and submitting their initial responses using conventional non-LLM resources, participants receive an additional 30 minutes to use the study-provided DeepSeek-V4 as a second-opinion tool.
They may review, verify, and revise their initial clinical decisions before submitting their final responses.
Before completing the clinical cases, participants receive brief structured training on the safe and effective use of LLMs.
The training covers the role and limitations of LLMs, structured prompting and follow-up questioning, identification of warning signs and referral indications, medication safety, verification of LLM-generated information, high-risk situations in which LLMs should not be relied upon, and protection of patient privacy.
|
|
実験的：LLM Training and Direct LLM Assistance
Participants receive brief structured training on the safe and effective use of LLMs and may use the study-provided LLM throughout the initial 60-minute assessment to complete the clinical cases.
They submit their final responses at 60 minutes and do not participate in the additional second-opinion phase.
|
During the initial 60-minute assessment, participants may use the study-provided DeepSeek-V4 to assist with medical information retrieval, diagnostic and management reasoning, identification of warning signs, referral decisions, rational prescribing, patient education, and follow-up planning.
Participants remain responsible for their final clinical decisions and responses.
Before completing the clinical cases, participants receive brief structured training on the safe and effective use of LLMs.
The training covers the role and limitations of LLMs, structured prompting and follow-up questioning, identification of warning signs and referral indications, medication safety, verification of LLM-generated information, high-risk situations in which LLMs should not be relied upon, and protection of patient privacy.
|
この研究は何を測定していますか？
主要な結果の測定
結果測定 |
メジャーの説明 |
時間枠 |
|---|---|---|
|
Overall Clinical Decision-Making Score
時間枠：At the end of the initial 60-minute assessment
|
Participants' responses to primary care clinical cases will be evaluated using a prespecified scoring rubric.
The overall score will reflect performance across key components of clinical decision-making.
Higher scores indicate better overall clinical decision-making performance.
|
At the end of the initial 60-minute assessment
|
二次結果の測定
結果測定 |
メジャーの説明 |
時間枠 |
|---|---|---|
|
Diagnostic Judgment Domain Score
時間枠：At the end of the initial 60-minute assessment
|
Participants' diagnostic judgment in response to primary care clinical cases will be evaluated using a predefined scoring rubric.
Higher scores indicate better diagnostic judgment.
|
At the end of the initial 60-minute assessment
|
|
Clinical Warning Sign Recognition Domain Score
時間枠：At the end of the initial 60-minute assessment
|
Participants' ability to identify clinically important warning signs in primary care clinical cases will be evaluated using a predefined scoring rubric.
Higher scores indicate better recognition of clinical warning signs.
|
At the end of the initial 60-minute assessment
|
|
Treatment Plan Domain Score
時間枠：At the end of the initial 60-minute assessment
|
Participants' proposed treatment plans for primary care clinical cases will be evaluated using a predefined scoring rubric.
Higher scores indicate better treatment planning performance.
|
At the end of the initial 60-minute assessment
|
|
Change in Overall Clinical Decision-Making Score After LLM Review
時間枠：Change from 60 to 90 minutes after the start of the assessment
|
Among participants assigned to the LLM second-opinion phase, the change in overall clinical decision-making score will be calculated as the score after LLM-assisted review minus the score before LLM-assisted review.
Positive values indicate improvement in overall clinical decision-making performance.
|
Change from 60 to 90 minutes after the start of the assessment
|
協力者と研究者
研究記録日
主要日程の研究
研究開始 (推定)
一次修了 (推定)
研究の完了 (推定)
試験登録日
最初に提出
QC基準を満たした最初の提出物
最初の投稿 (実際)
学習記録の更新
投稿された最後の更新 (実際)
QC基準を満たした最後の更新が送信されました
最終確認日
詳しくは
本研究に関する用語
その他の研究ID番号
- IRB00006761-M20260614
個々の参加者データ (IPD) の計画
個々の参加者データ (IPD) を共有する予定はありますか?
医薬品およびデバイス情報、研究文書
米国FDA規制医薬品の研究
米国FDA規制機器製品の研究
この情報は、Web サイト clinicaltrials.gov から変更なしで直接取得したものです。研究の詳細を変更、削除、または更新するリクエストがある場合は、register@clinicaltrials.gov。 までご連絡ください。 clinicaltrials.gov に変更が加えられるとすぐに、ウェブサイトでも自動的に更新されます。