Chest X-Ray Image Diagnosis and Report Generation Dedicated Model Based on Deepseek

Large Language Models for Chest X-Ray Image Diagnosis and Report Generation: A Stepwise, Multicenter, Early-Stage Clinical Validation Study

The global shortage of radiologists is a pressing issue, particularly in regions with limited medical resources. Against this backdrop, making report generation the core objective of radiology AI systems not only aligns with the practical needs of radiologists but also better serves patient requirements. With the development of multimodal large models, it has become possible to develop automatic report generation systems for medical images. Although ChatGPT 4o has demonstrated certain capabilities in multiple medical sub - fields, as a closed - source system, it has limitations. Its model generation mechanism is opaque, and issues such as hallucination exist. Recently, Deepseek's open - source multimodal large model, Janus - Pro, an "any to any" model, has the advantages of high performance, low cost, and open - source. Nature published three consecutive articles introducing its stunning features. After training and fine - tuning, Janus - Pro shows great potential in medical image diagnosis and report generation. However, currently, the application of Janus - Pro in image diagnosis has not been evaluated. Most existing models are highly versatile but lack optimization for specific domains, and there is a lack of systematic and multi - dimensional evaluation methods to determine the pros and cons of multimodal large models in medical radiology. Based on these current situations, the purpose of our research is to develop and verify the application value of large models dedicated to medical images in image diagnosis and radiology report generation.

Study Overview

• Status: Completed
• Conditions: Radiology; Artificial Intellegence; Chest X-ray for Clinical Evaluation; Large Language Model
• Intervention / Treatment: Other: AI-generated report for reference

• Study Type: Observational
• Enrollment (Actual): 300

Contacts and Locations

Study Locations

• China
  • Henan
    • Luoyang, Henan, China, 471003
      • The first affiliated hospital of Henan University of science and technology
    • Zhengzhou, Henan, China, 450002
      • The first affiliated hospital of Zhengzhou university
  • Hubei
    • Wuhan, Hubei, China, 430023
      • Union Hospital Affiliated to Tongji Medical College, Huazhong University of Science and Technology

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: Child; Adult; Older Adult
• Accepts Healthy Volunteers: Yes

• Sampling Method: Probability Sample

Study Population

Patients requiring chest X-ray

Description

Inclusion Criteria:

1. Type of examination: standard digital orthopantomogram of the chest during the study period.
2. Completeness of information: Medical records containing basic information, medical history, etc.
3. Informed consent: written consent form signed by the patient or legal representative.

Exclusion Criteria:

1. Anatomical abnormalities: congenital abnormalities of chest development, history of chest surgery, or severe scoliosis that interfere with image interpretation.
2. Poor image quality: chest radiographs with severe artifacts, exposure abnormalities, or incomplete images.
3. Acutely ill: life-threatening and unable to cooperate with the study process.
4. Mental cognitive problems: suffering from severe mental illness or cognitive impairment, unable to understand the study and sign.
5. Pregnant: Fetus is radiosensitive and physiological changes during pregnancy affect the images.
6. Participation in other studies: concurrent participation in other programs that affect the results of this study.

Study Plan

How is the study designed?

Number of groups / cohorts

2

Cohorts and Interventions

Group / Cohort	Intervention / Treatment
Janus-Pro-CXR	Other: AI-generated report for reference; The Janus-Pro-CXR group has the AI-generated report for reference and can make changes to the AI-generated report. Another group completes the report independently.
SCP

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Report Quality Score and agreement score	The evaluation assessed the reports generated by the SCP group and the AI-assisted group, using a five-point Likert scale (5 being the best, 1 being the worst) to subjectively evaluate the capability of the large model in generating imaging reports. The RADPEER scoring system was used to assess the agreement between the original reports and the generated reports, including the clinical significance of any discrepancies.	No more than 1 week
Pairwise preference	For each evaluator, they must select the better report between the one generated by the large model and the published report. The proportion of cases where three or more evaluators agreed that the AI-assisted group's reports were superior to those of the SCP group was calculated.	No more than 1 week
Reading Time	To evaluate the impact of the large model on workflow efficiency, the reading time-defined as the duration from when a radiologist begins reviewing a chest X-ray to the completion of the final radiology report-was measured and automatically recorded by the system.	No more than 1 week

Collaborators and Investigators

• Sponsor: Wuhan Union Hospital, China

Publications and helpful links

General Publications

• Tanno R, Barrett DGT, Sellergren A, Ghaisas S, Dathathri S, See A, Welbl J, Lau C, Tu T, Azizi S, Singhal K, Schaekermann M, May R, Lee R, Man S, Mahdavi S, Ahmed Z, Matias Y, Barral J, Eslami SMA, Belgrave D, Liu Y, Kalidindi SR, Shetty S, Natarajan V, Kohli P, Huang PS, Karthikesalingam A, Ktena I. Collaboration between clinicians and vision-language models in radiology report generation. Nat Med. 2025 Feb;31(2):599-608. doi: 10.1038/s41591-024-03302-1. Epub 2024 Nov 7.

Study record dates

Study Major Dates

• Study Start (Actual): March 10, 2025
• Primary Completion (Actual): March 31, 2025
• Study Completion (Actual): March 31, 2025

Study Registration Dates

• First Submitted: March 9, 2025
• First Submitted That Met QC Criteria: March 9, 2025
• First Posted (Actual): March 13, 2025

Study Record Updates

• Last Update Posted (Actual): April 23, 2025
• Last Update Submitted That Met QC Criteria: April 17, 2025
• Last Verified: March 1, 2025

More Information

Terms related to this study

• Keywords: artificial intelligence; radiology; Large language model
• Other Study ID Numbers: Janus-Pro-CXR

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No
• product manufactured in and exported from the U.S.: No