此页面是自动翻译的,不保证翻译的准确性。请参阅 英文版 对于源文本。

Multimodal LLM for Breast Cancer Radiotherapy Target Auto-Contouring and Planning

2026年11月11日 更新者:Xiaohui Zhao

Multimodal Data Fusion-Based Artificial Intelligence Large Language Model for Automated Target Volume Contouring and Intelligent Treatment Planning in Breast Cancer Radiotherapy: A Multicenter Ambidirectional Cohort Study

Breast cancer remains the most prevalent malignancy among women worldwide, with a continuously increasing incidence. As a crucial component of comprehensive cancer treatment, radiotherapy plays a key role in reducing local recurrence rates and improving overall survival outcomes. However, traditional radiotherapy target volume contouring and treatment planning design rely heavily on clinician expertise, presenting challenges such as prolonged processing time, significant inter-observer variability, and high subjectivity in dose optimization. Although artificial intelligence has made substantial progress in automated contouring and planning, conventional single-modal models still face major limitations. These models struggle to effectively integrate clinical text, tumor biological characteristics, and dose distribution factors, resulting in restricted generalizability. Therefore, developing an intelligent radiotherapy assistance system capable of multimodal data fusion is of high clinical significance to enhance precision and efficiency in breast cancer radiotherapy.

This study aims to develop an innovative breast cancer radiotherapy assistance system based on a multimodal large language model. By integrating multimodal imaging data (including CT, MRI, and ultrasound), pathology reports, and structured electronic health record text, the system realizes end-to-end intelligence from target volume contouring to treatment plan generation. Employing a multicenter, ambidirectional cohort design, the study collects comprehensive clinical data from breast cancer patients who have undergone breast-conserving surgery or mastectomy. Technologically, the system innovatively combines the natural language processing capabilities of large language models with the image analysis strengths of deep learning, utilizing attention mechanisms to achieve deep fusion and interactive comprehension of heterogeneous medical data. Notably, the system breaks through traditional radiotherapy planning workflows by jointly optimizing target contouring and dose planning as a unified pipeline, applying reinforcement learning algorithms to dynamically balance target volume coverage with organ-at-risk protection. The outcomes of this study will provide an important paradigm for the clinical application of AI in radiation oncology and advance the field of precision radiotherapy.

研究概览

研究类型

观察性的

注册 (估计的)

51000

联系人和位置

本节提供了进行研究的人员的详细联系信息,以及有关进行该研究的地点的信息。

学习联系方式

学习地点

    • Guangdong
      • Guangzhou、Guangdong、中国、510120
        • Sun Yat-sen Memorial Hospital, Sun Yat-sen University
        • 接触:
        • 首席研究员:
          • Xiaohui Zhao, MD

参与标准

研究人员寻找符合特定描述的人,称为资格标准。这些标准的一些例子是一个人的一般健康状况或先前的治疗。

资格标准

适合学习的年龄

  • 孩子
  • 成人
  • 年长者

接受健康志愿者

不

有资格学习的性别

全部

取样方法

非概率样本

研究人群

The study population includes patients with breast cancer from multiple medical centers. The retrospective cohort comprises patients treated at Sun Yat-sen Memorial Hospital (n=35,000) and external collaborating centers (Shenshan Medical Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Zhoukou Central Hospital, and Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, n=15,000) between January 1, 2002, and October 31, 2025. The prospective test cohort comprises patients prospectively enrolled at Sun Yat-sen Memorial Hospital starting from January 1, 2026 (n=1,000).

描述

Inclusion Criteria:

  • Patients with pathologically confirmed breast malignant tumors who require postoperative adjuvant radiotherapy following radical surgery.
  • Availability of complete pathology reports.
  • Availability of complete imaging examinations and reports (such as CT, MRI, ultrasound, X-ray).
  • Availability of standardized clinical medical records.

Exclusion Criteria:

  • Patients with missing data.
  • Patients with primary multiple cancers.
  • Patients receiving salvage or palliative radiotherapy.
  • Patients receiving accelerated partial breast irradiation (APBI).

学习计划

本节提供研究计划的详细信息,包括研究的设计方式和研究的衡量标准。

研究是如何设计的?

设计细节

  • 观测模型:COHORT
  • 时间观点:OTHER

队列和干预

团体/队列
干预/治疗
Retrospective Training and Internal Validation Cohort

Retrospective collection of clinical data, multimodal images (MRI, CT, ultrasound, X-ray), pathology reports, and radiotherapy plans from patients with breast cancer treated at Sun Yat-sen Memorial Hospital between January 1, 2002, and October 31, 2025. This cohort (n=35,000) is used for model training and internal validation of the multimodal LLM-assisted automated contouring and radiotherapy planning system.

The study evaluates an innovative multimodal large language model (LLM) system designed for automated target volume delineation and intelligent treatment planning in post-operative breast cancer radiotherapy. The system integrates clinical text, multimodal imaging (CT, MRI, ultrasound, X-ray), and pathology data to joint-optimize contouring and dose planning without direct patient intervention.

Retrospective External Validation Cohort

Retrospective collection of data from external collaborative centers (Sun Yat-sen Memorial Hospital Shenzhen Hospital, Zhoukou Central Hospital, and Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology) between January 1, 2002, and October 31, 2025 (total n=15,000). This cohort is used to evaluate the external generalizability and robustness of the multimodal AI model.

The study evaluates an innovative multimodal large language model (LLM) system designed for automated target volume delineation and intelligent treatment planning in post-operative breast cancer radiotherapy. The system integrates clinical text, multimodal imaging (CT, MRI, ultrasound, X-ray), and pathology data to joint-optimize contouring and dose planning without direct patient intervention.

Prospective Test Cohort

Prospective collection of data from patients with breast cancer treated at Sun Yat-sen Memorial Hospital starting from January 1, 2026 (n=1,000). This cohort undergoes double-blind evaluation to prospectively test the performance of the multimodal LLM-driven target volume auto-segmentation and intelligent radiotherapy planning system in clinical practice.

The study evaluates an innovative multimodal large language model (LLM) system designed for automated target volume delineation and intelligent treatment planning in post-operative breast cancer radiotherapy. The system integrates clinical text, multimodal imaging (CT, MRI, ultrasound, X-ray), and pathology data to joint-optimize contouring and dose planning without direct patient intervention.

研究衡量的是什么?

主要结果指标

结果测量
措施说明
大体时间
Dice Similarity Coefficient (DSC) of Target Volume Auto-Segmentation
大体时间:Baseline

Evaluation of the Dice Similarity Coefficient (DSC) between AI-generated automatic breast cancer target volume contours and expert manual contours.

Baseline

次要结果测量

结果测量
措施说明
大体时间
95% Hausdorff Distance (95HD) of Target Volume Auto-Segmentation
大体时间:Baseline

Evaluation of the 95% Hausdorff Distance (95HD) between AI-generated automatic breast cancer target volume contours and expert manual contours.

Baseline
Intersection over Union (IoU) of Target Volume Auto-Segmentation
大体时间:Baseline

Evaluation of the Intersection over Union (IoU) between AI-generated automatic breast cancer target volume contours and expert manual contours.

Baseline
Clinical Evaluation Score of Target Volume Auto-Segmentation
大体时间:Baseline

Blinded evaluation by radiation oncology experts using the Investigator-Developed Cancer Target Volume Contouring Performance Evaluation Scale, a structured 5-point clinical evaluation scale. The scale assesses five dimensions: laterality accuracy (0 to 1 point), radiotherapy type suitability (0 to 1 point), target volume definition (0 to 1.5 points), coverage (0 to 1 point), and structural integrity (0 to 0.5 points). The total score ranges from a minimum of 0 to a maximum of 5, where higher scores indicate better target volume contouring quality and clinical acceptability.

Baseline

合作者和调查者

在这里您可以找到参与这项研究的人员和组织。

赞助

调查人员

  • 首席研究员:Xiaohui Zhao, MD、Sun Yat-Sen Memorial Hospital of Sun Yat-Sen University

研究记录日期

这些日期跟踪向 ClinicalTrials.gov 提交研究记录和摘要结果的进度。研究记录和报告的结果由国家医学图书馆 (NLM) 审查,以确保它们在发布到公共网站之前符合特定的质量控制标准。

研究主要日期

学习开始 (估计的)

2026年11月9日

初级完成 (估计的)

2027年12月1日

研究完成 (估计的)

2027年12月31日

研究注册日期

首次提交

2026年11月2日

首先提交符合 QC 标准的

2026年11月11日

首次发布 (实际的)

2026年11月17日

研究记录更新

最后更新发布 (实际的)

2026年11月17日

上次提交的符合 QC 标准的更新

2026年11月11日

最后验证

2026年11月1日

更多信息

与本研究相关的术语

其他研究编号

  • SYSKY-2026-014-01

计划个人参与者数据 (IPD)

计划共享个人参与者数据 (IPD)?

不

药物和器械信息、研究文件

研究美国 FDA 监管的药品

不

研究美国 FDA 监管的设备产品

不

此信息直接从 clinicaltrials.gov 网站检索,没有任何更改。如果您有任何更改、删除或更新研究详细信息的请求,请联系 register@clinicaltrials.gov. clinicaltrials.gov 上实施更改,我们的网站上也会自动更新.

订阅