Development of an AI-Agent for Urological Disease Diagnosis and Treatment
Development of an AI-Agent for Diagnosis and Treatment of Urological Diseases
Urological diseases such as urinary stones, prostate cancer, and bladder cancer are very common and often require highly specialized diagnosis and treatment. Today, the quality of care can vary between doctors, and there are not enough urology specialists to meet patient demand. Artificial intelligence (AI) may help doctors make faster and more consistent decisions.
This study aims to develop and test an AI-powered assistant called "UroAgent" that supports doctors in diagnosing and treating urological diseases. UroAgent is built on a large language model trained specifically for urology and is connected to tools that help it retrieve medical knowledge and analyze images. To build and test UroAgent, the research team will use 1,500 past patient records from 2010-2025 and collect 500 new patient cases for validation, for a total of 2,000 cases. This is an observational study: no patient's medical treatment will be changed because of it. The goal is to create a reliable AI tool that helps improve urological care for patients.
Panoramica dello studio
Stato
Stato
Condizioni
Condizioni
Descrizione dettagliata
Tipo di studio
Tipo di studio
Iscrizione (Stimato)
Iscrizione
Contatti e Sedi
Contatto studio
Contatto studio
- Nome: Mingzhou Dai
- Numero di telefono: +86 19924684262
- Email: daimzh3@mail2.sysu.edu.cn
Luoghi di studio
-
-
Guangdong
-
Guangzhou, Guangdong, Cina, 510000
- Reclutamento
- Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University
-
Contatto:
- Mingzhou Dai
- Numero di telefono: +86 19924684262
- Email: daimzh3@mail2.sysu.edu.cn
-
Shantou, Guangdong, Cina, 516600
- Reclutamento
- Shenshan Medical Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University
-
Contatto:
- Zhuang Tang
- Numero di telefono: +86 13666144867
- Email: tangzh23@mail.sysu.edu.cn
-
-
Jiangxi
-
Ganzhou, Jiangxi, Cina, 341000
- Reclutamento
- Ganzhou People's Hospital
-
Contatto:
- Cong Lai
- Numero di telefono: +86 19872753573
- Email: laic@mail2.sysu.edu.cn
-
-
Criteri di partecipazione
Criteri di ammissibilità
Criteri di ammissibilità
Età idonea allo studio
- Bambino
- Adulto
- Adulto più anziano
Accetta volontari sani
Metodo di campionamento
Popolazione di studio
Descrizione
Inclusion Criteria:
- Diagnosed with a urological disease (e.g., urinary stones, prostate cancer, bladder cancer, and other urological conditions).
- Availability of complete clinical information, imaging data, and surgical video required for model development and validation.
Exclusion Criteria:
1. Missing clinical information, imaging data, or surgical video.
Piano di studio
Come è strutturato lo studio?
Dettagli di progettazione
Numero di gruppi/coorti
Coorti e interventi
Gruppo / CoorteGruppo / Coorte |
|---|
|
Urological Disease Cohort
The cohort consists of patients diagnosed with urological diseases-including urinary stones, prostate cancer, and bladder cancer-at Sun Yat-sen Memorial Hospital.
A total of 2,000 cases are included: 1,500 retrospective cases recorded between 2010 and 2025 (used for model development) and 500 prospectively and consecutively enrolled cases (used for independent validation); all records are de-identified.
The intervention (technology) of interest is "UroAgent," an artificial-intelligence diagnostic-and-treatment agent built on a urology-specialized large language model with integrated tool modules (knowledge retrieval, image interpretation).
For each case, UroAgent's diagnostic and treatment recommendations are generated and compared with the analyses provided by human urology specialists, to evaluate the agent's performance-diagnostic accuracy, recommendation appropriateness, completeness, and safety-against expert judgment.
|
Cosa sta misurando lo studio?
Misure di risultato primarie
Misure di risultato primarie
Misura del risultato |
Misura Descrizione |
Lasso di tempo |
|---|---|---|
|
Diagnostic Accuracy of UroAgent
Lasso di tempo: Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
The primary outcome is UroAgent's diagnostic accuracy, measured as the F1 score of its leading diagnosis against the reference-standard final diagnosis.
The reference standard is established by senior urologists from pathology, imaging, and clinical course.
F1 = 2 × Precision × Recall / (Precision + Recall), computed per case and aggregated as macro-F1 across the 2,000-case cohort (1,500 retrospective + 500 prospective).
Unit of measure: F1 score (range 0-1).
|
Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
Misure di risultato secondarie
Misure di risultato secondarie
Misura del risultato |
Misura Descrizione |
Lasso di tempo |
|---|---|---|
|
Expert Subjective Accuracy Rating
Lasso di tempo: Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
Independent urologists rate the accuracy of UroAgent's diagnosis on a 5-point Likert scale (1 = completely inaccurate, 5 = completely accurate), blinded to model identity.
Reported as the mean rating and the percentage of cases rated ≥ 4; disagreements resolved by a third urologist.
Unit of measure: mean rating (1-5) and percentage of cases rated accurate (%).
|
Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
|
Treatment Recommendation Appropriateness of UroAgent
Lasso di tempo: Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
The proportion of cases in which UroAgent's management recommendation is rated appropriate.
Two independent urologists rate each recommendation on a 5-point Likert appropriateness scale (1 = completely inappropriate, 5 = completely appropriate), blinded; "appropriate" defined as Likert ≥ 4; disagreement resolved by a third urologist.
Unit of measure: percentage of cases (%) rated appropriate.
|
Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
|
Clinical Safety of UroAgent Recommendations
Lasso di tempo: Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
The rate of clinically unsafe recommendations.
Each case is reviewed by senior urologists using a safety rubric and flagged (binary per case) for any contraindicated, erroneous, or potentially harmful recommendation.
Unit of measure: percentage of cases (%) with ≥ 1 unsafe recommendation.
|
Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
|
Concordance and Non-Inferiority of UroAgent versus Clinician Diagnoses
Lasso di tempo: Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
On the same cases, UroAgent's diagnoses are compared with those of practicing urologists.
Reported as the agreement rate (%) between UroAgent and clinician diagnoses, plus the diagnostic-accuracy difference in percentage points (pp); Cohen's κ reported as a supplementary statistic.
Both are assessed against the reference-standard final diagnosis.
Unit of measure: agreement rate (%) and accuracy difference (pp).
|
Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
|
Collaboratori e investigatori
Sponsor
Sponsor
Collaboratori
Collaboratori
Studiare le date dei record
Studia le date principali
Inizio studio (Effettivo)
Inizio studio
Completamento primario (Stimato)
Completamento primario
Completamento dello studio (Stimato)
Completamento dello studio
Date di iscrizione allo studio
Primo inviato
Primo inviato
Primo inviato che soddisfa i criteri di controllo qualità
Primo inviato che soddisfa i criteri di controllo qualità
Primo Inserito (Effettivo)
Primo Inserito
Aggiornamenti dei record di studio
Ultimo aggiornamento pubblicato (Effettivo)
Ultimo aggiornamento pubblicato
Ultimo aggiornamento inviato che soddisfa i criteri QC
Ultimo aggiornamento inviato che soddisfa i criteri QC
Ultimo verificato
Ultimo verificato
Maggiori informazioni
Termini relativi a questo studio
Parole chiave
Termini MeSH pertinenti aggiuntivi
- Malattie urogenitali
- Malattie genitali
- Neoplasie genitali, maschio
- Neoplasie urogenitali
- Neoplasie per sede
- Neoplasie
- Malattie genitali, maschio
- Malattie della prostata
- Malattie urogenitali maschili
- Calcoli
- Condizioni patologiche, anatomiche
- Malattie urogenitali femminili
- Malattie urogenitali femminili e complicanze della gravidanza
- Urolitiasi
- Neoplasie urologiche
- Malattie della vescica urinaria
- Condizioni patologiche, segni e sintomi
- Neoplasie prostatiche
- Malattie urologiche
- Neoplasie della vescica urinaria
- Calcoli urinari
Altri numeri di identificazione dello studio
Altri numeri di identificazione dello studio
- SYSKY-2025-151-03
Piano per i dati dei singoli partecipanti (IPD)
Hai intenzione di condividere i dati dei singoli partecipanti (IPD)?
Descrizione del piano IPD
Informazioni su farmaci e dispositivi, documenti di studio
Studia un prodotto farmaceutico regolamentato dalla FDA degli Stati Uniti
Studia un dispositivo regolamentato dalla FDA degli Stati Uniti
Queste informazioni sono state recuperate direttamente dal sito web clinicaltrials.gov senza alcuna modifica. In caso di richieste di modifica, rimozione o aggiornamento dei dettagli dello studio, contattare register@clinicaltrials.gov. Non appena verrà implementata una modifica su clinicaltrials.gov, questa verrà aggiornata automaticamente anche sul nostro sito web .