Effects of Agent-assisted, LLM-assisted and Traditional Workflows on Diagnosis and Management Planning at Admission
Effects of Agent-assisted, LLM-assisted and Traditional Workflows on Diagnosis and Management Planning at Admission: A Randomized Controlled Study
The goal of this clinical trial is to evaluate whether AI-assisted workflows improve physicians' admission diagnosis and management planning performance on standardized simulated inpatient cases, among practicing internal medicine and surgery physicians across all seniority levels and across three tiers of the Chinese healthcare system.
The main questions it aims to answer are:
- Does the Agent-assisted workflow yield better structured admission diagnosis and management planning scores than standalone LLM assistance?
- Does the Agent-assisted workflow outperform the traditional workflow without AI tools? Researchers will compare three parallel groups (traditional workflow group, LLM-assisted group, Agent-assisted group) to determine whether the Agent tool can improve diagnostic accuracy and efficiency.
Participants will:
- Be recruited from 15 hospitals in China and participate remotely under video proctoring
- Be randomly assigned to one of the three fixed workflows, with randomization stratified by hospital tier, specialty and seniority
- Complete 6 anonymized simulated HIS admission cases within one hour
- Submit structured answers for each case covering principal diagnosis, secondary diagnoses, differential diagnoses, diagnostic justification, next diagnostic or therapeutic steps, consultation and referral decisions, and diagnostic confidence
- Have their operation logs and time consumption recorded automatically by the study platform
연구 개요
상태
상태
정황
정황
개입 / 치료
개입 / 치료
연구 유형
연구 유형
등록 (추정된)
등록
단계
단계
- 해당 없음
연락처 및 위치
연구 연락처
연구 연락처
- 이름: Yixin Zhang
- 전화번호: +86 19157950225
- 이메일: 12518552@zju.edu.cn
연구 장소
-
-
Zhejiang
-
Hangzhou, Zhejiang, 중국, 310009
- 2nd Affiliated Hospital, School of Medicine, Zhejiang University
-
연락하다:
- Human Subject Research Ethics Committee
- 전화번호: +86 0571 87783759
- 이메일: keyanlunli_zheer@163.com
-
-
참여기준
자격 기준
자격 기준
공부할 수 있는 나이
- 성인
- 고령자
건강한 자원 봉사자를 받아들입니다
설명
Inclusion Criteria
- Hold a Medical Practitioner Qualification Certificate and/or Medical License, or be a recognized standardized resident physician; able to independently read electronic medical records, laboratory and imaging reports on an HIS.
- Currently engaged in clinical work in internal medicine or surgery at one of the 15 participating hospitals.
- Able to complete the case assessment in one continuous hour without breaks.
- Able to participate remotely under video proctoring, with a stable internet connection and a working camera.
- Voluntarily agree to participate and sign the informed consent form, including the declaration not to use unauthorized AI tools during the assessment.
- Have not participated in case drafting, review, rubric development, or any activity that may leak the reference standard.
Exclusion Criteria
- Have previously accessed the official test cases or reference standard of this study.
- Unable to complete the training module, qualification test, or all experimental tasks.
- Have conflicts of interest, e.g. participation in developing core algorithms of the tested system.
- Unwilling to comply with remote proctoring, including keeping the camera on throughout.
- Judged unsuitable by the investigators.
공부 계획
연구는 어떻게 설계됩니까?
디자인 세부사항
- 주 목적: 건강 서비스 연구
- 할당: 무작위
- 중재 모델: 병렬 할당
- 마스킹: 하나의
팔의 수
무기와 개입
참가자 그룹 / 팔참가자 그룹 / 팔 |
개입 / 치료개입 / 치료 |
|---|---|
|
활성 비교기: 전통적인 그룹
|
Conventional resources only: the pre-admission clinical record, standard search engines.
No AI assistance.
|
|
실험적: Agent-assisted group
|
Conventional resources (pre-admission clinical record, search engines) plus an in-system Agent entry that automatically reads the full record and report images, produces a structured summary with source-text tracing, and supports multi-turn Q&A and one-click editable drafts.
|
|
실험적: LLM-assisted group
|
Conventional resources plus an in-system multi-turn AI dialogue entry.
The AI does not automatically read the record; participants paste text or send partial screenshots.
|
연구는 무엇을 측정합니까?
주요 결과 측정
주요 결과 측정
결과 측정 |
측정값 설명 |
기간 |
|---|---|---|
|
Mean Normalized Structured Score
기간: Within one-hour study
|
Mean of the rescaled case scores (each case rescaled to 100), divided by the number of cases completed; range 0 to 100.
|
Within one-hour study
|
2차 결과 측정
2차 결과 측정
결과 측정 |
측정값 설명 |
기간 |
|---|---|---|
|
Degree of Adherence to AI-Generated Recommendations
기간: Within one-hour study
|
Degree to which the submitted answer incorporates AI output.
Assessed in the Agent and LLM arms only.
|
Within one-hour study
|
|
Active Response Time per Case
기간: Within one-hour study
|
Active response time in seconds for each case, recorded automatically by the platform.Time is counted per case while that case's response page is active.
|
Within one-hour study
|
공동 작업자 및 조사자
스폰서
스폰서
협력자
협력자
수사관
수사관
- 연구 의자: Yuan Ding, Second Affiliated Hospital, Zhejiang University, School of Medicine
연구 기록 날짜
연구 주요 날짜
연구 시작 (추정된)
연구 시작
기본 완료 (추정된)
기본 완료
연구 완료 (추정된)
연구 완료
연구 등록 날짜
최초 제출
최초 제출
QC 기준을 충족하는 최초 제출
QC 기준을 충족하는 최초 제출
처음 게시됨 (실제)
처음 게시됨
연구 기록 업데이트
마지막 업데이트 게시됨 (실제)
마지막 업데이트 게시됨
QC 기준을 충족하는 마지막 업데이트 제출
QC 기준을 충족하는 마지막 업데이트 제출
마지막으로 확인됨
마지막으로 확인됨
추가 정보
이 연구와 관련된 용어
기타 연구 ID 번호
기타 연구 ID 번호
- 2026-0977
개별 참가자 데이터(IPD) 계획
개별 참가자 데이터(IPD)를 공유할 계획입니까?
약물 및 장치 정보, 연구 문서
미국 FDA 규제 의약품 연구
미국 FDA 규제 기기 제품 연구
이 정보는 변경 없이 clinicaltrials.gov 웹사이트에서 직접 가져온 것입니다. 귀하의 연구 세부 정보를 변경, 제거 또는 업데이트하도록 요청하는 경우 register@clinicaltrials.gov. 문의하십시오. 변경 사항이 clinicaltrials.gov에 구현되는 즉시 저희 웹사이트에도 자동으로 업데이트됩니다. .