Construction and Validation of a Coronary Artery Disease-Specific Large Language Model and Its Evaluation Framework (CorAI) (CorAI)
A Prospective, Multicenter, Observational Cohort Study for the Construction of a Multimodal Coronary Artery Disease Dataset and the Development, Evaluation, and External Validation of a Disease-Specific Large Language Model (CorAI)
Coronary artery disease (CAD) affects an estimated 11.39 million people in China, and mortality has continued to rise since 2012. Quality-of-care data indicate persistent gaps in diagnostic and therapeutic guideline adherence, incomplete implementation of secondary prevention, and suboptimal risk-factor control. Large language models (LLMs) can rapidly retrieve and integrate literature, medical records, and multimodal clinical data, and may support clinical decision-making. However, most existing medical LLMs are general-purpose, are trained predominantly on published literature and web text rather than authentic clinical records, and have not been validated with real patient data. No disease-specific LLM for CAD currently exists, and no evaluation framework tailored to CAD has been established; existing benchmarks are general-purpose, lack specialty-specific risk grading, are not rigorously anchored to current guidelines, and emphasize literal accuracy over clinically critical reasoning steps and prescription concordance.
This prospective, multicenter, observational study will enroll approximately 640 patients with confirmed or suspected CAD at Fuwai Hospital and collaborating centers. No study-specific intervention, examination, biospecimen collection, or additional follow-up visit is performed; all clinical decisions are made independently by the treating physician according to routine standards of care. For consenting participants, routinely generated clinical documentation from the index outpatient visit or hospitalization - including medical history, laboratory results, imaging and coronary angiography/coronary CT angiography reports, physician notes, online consultation records, and follow-up records - will be de-identified and used to construct a high-quality multimodal CAD dataset. This dataset will support the development of a CAD-specific large language model (CorAI), the construction of an evaluation framework spanning eight predefined clinical scenarios and multiple assessment dimensions, and external validation of the model at participating centers.
The primary objectives are to characterize the completeness and quality of the constructed prospective cohort dataset, and to quantify the guideline concordance of CorAI-generated clinical recommendations as adjudicated by a blinded panel of cardiologists.
연구 개요
연구 유형
등록 (추정된)
연락처 및 위치
연구 연락처
- 이름: Prof. Gao
- 전화번호: +861088322413
- 이메일: sophie_gao@sina.com
연구 장소
-
-
Anhui
-
Hefei, Anhui, 중국, 230001
- The First Affiliated Hospital of USTC
-
연락하다:
- Hongwu Chen, MD
- 전화번호: +86-551-62283114
- 이메일: 1025707914@qq.com
-
-
Beijing Municipality
-
Beijing, Beijing Municipality, 중국, 100037
- Fuwai Hospital, Chinese Academy of Medical Sciences/National Center for Cardiovascular Diseases
-
연락하다:
- Prof. Gao, MD, PhD
- 전화번호: +861088322413
- 이메일: sophie_gao@sina.com
-
연락하다:
- Prof. Gao, MD, PhD
- 이메일: sophie_gao@sina.com
-
-
Guangdong
-
Shenzhen, Guangdong, 중국, 518057
- Fuwai Hospital Chinese Academy of Medical Sciences, Shenzhen
-
연락하다:
- Fenghuan Hu, MD
- 전화번호: 0755-25509566
- 이메일: hufenghuanvip@163.com
-
-
참여기준
자격 기준
공부할 수 있는 나이
- 성인
- 고령자
건강한 자원 봉사자를 받아들입니다
샘플링 방법
연구 인구
설명
Inclusion Criteria:
- Age ≥ 18 years;
- Patients with confirmed or suspected coronary heart disease;
- Complete case information (including medical history, test results, imaging, follow-up records, etc.);
- Consent for the use of case data for model evaluation and research analysis.
Exclusion Criteria:
- Cases with severe data gaps that prevent the formation of a complete clinical scenario;
- Cases where the primary diagnosis is not coronary heart disease;
- Cases with serious data errors or where data cannot be anonymized.
공부 계획
연구는 어떻게 설계됩니까?
디자인 세부사항
코호트 및 개입
그룹/코호트 |
개입 / 치료 |
|---|---|
|
CorAI development and evaluation cohort
Adults aged 18 years or older with confirmed or suspected coronary artery disease presenting for routine outpatient or inpatient care at a participating center.
Routinely generated clinical documentation is de-identified and used for construction of a multimodal CAD dataset and for development and evaluation of a disease-specific large language model.
No study-specific intervention, testing, or follow-up is performed.
|
개입 없음: 관찰 코호트
|
연구는 무엇을 측정합니까?
주요 결과 측정
결과 측정 |
측정값 설명 |
기간 |
|---|---|---|
|
Completeness of the constructed multimodal CAD dataset
기간: From enrollment of the first participant through completion of dataset construction, up to 12 months
|
Proportion of enrolled participants whose de-identified record satisfies all pre-specified data-completeness criteria, defined as the presence of medical history, comorbidity and medication documentation, laboratory results, electrocardiography, coronary CT angiography and/or invasive coronary angiography findings, and at least one structured follow-up or discharge record sufficient to reconstruct a complete clinical scenario.
Reported as a percentage with 95% confidence interval.
|
From enrollment of the first participant through completion of dataset construction, up to 12 months
|
2차 결과 측정
결과 측정 |
측정값 설명 |
기간 |
|---|---|---|
|
Guideline concordance of CorAI-generated clinical recommendations across eight predefined coronary artery disease scenarios
기간: At completion of model development and evaluation, up to 18 months
|
Proportion of CorAI responses judged fully concordant with the coronary artery disease clinical practice guidelines in force at the time of adjudication, assessed on the held-out evaluation set across eight predefined clinical scenarios: (1) initial evaluation of chest pain; (2) coronary artery assessment; (3) antithrombotic therapy; (4) revascularization decision-making; (5) lipid-lowering therapy; (6) post-procedural management; (7) post-procedural complications; and (8) patient education and physician-patient communication.
Each item is scored as concordant, partially concordant, or discordant by cardiologists blinded to response source using a pre-specified rubric, with disagreements resolved by an independent third adjudicator.
The primary metric is the pooled percentage of items scored fully concordant across all eight scenarios, reported with a 95% confidence interval.
|
At completion of model development and evaluation, up to 18 months
|
공동 작업자 및 조사자
연구 기록 날짜
연구 주요 날짜
연구 시작 (추정된)
기본 완료 (추정된)
연구 완료 (추정된)
연구 등록 날짜
최초 제출
QC 기준을 충족하는 최초 제출
처음 게시됨 (실제)
연구 기록 업데이트
마지막 업데이트 게시됨 (실제)
QC 기준을 충족하는 마지막 업데이트 제출
마지막으로 확인됨
추가 정보
이 연구와 관련된 용어
기타 연구 ID 번호
- 2025-GSP-GG-18-3
- 2025-GSP-GG-18 (기타 보조금/기금 번호: the National High Level Hospital Clinical Research Funding (China))
개별 참가자 데이터(IPD) 계획
개별 참가자 데이터(IPD)를 공유할 계획입니까?
IPD 계획 설명
약물 및 장치 정보, 연구 문서
미국 FDA 규제 의약품 연구
미국 FDA 규제 기기 제품 연구
이 정보는 변경 없이 clinicaltrials.gov 웹사이트에서 직접 가져온 것입니다. 귀하의 연구 세부 정보를 변경, 제거 또는 업데이트하도록 요청하는 경우 register@clinicaltrials.gov. 문의하십시오. 변경 사항이 clinicaltrials.gov에 구현되는 즉시 저희 웹사이트에도 자동으로 업데이트됩니다. .