AI-Augmented Diagnostic Assessment With ENLIGHT Versus Independent Pathologist Review (ENLIGHT)
This study will evaluate whether artificial intelligence (AI) can enhance clinicians' accuracy, efficiency, and confidence in distinguishing lung adenocarcinoma (LUAD) from lung squamous cell carcinoma (LUSC) and kidney renal papillary cell carcinoma (KIRP) from kidney renal clear cell carcinoma (KIRC) using digitized pathology slides. These subtype classifications are routinely performed by pathologists but can be challenging and time-consuming, particularly in difficult cases.
During the study, participating clinicians will review lung and kidney pathology slides under three different conditions:
- Unaided Review: Diagnosis without AI assistance.
- AI as Double-Check: The clinician first makes an independent diagnosis, after which the AI-generated diagnosis (prediction only or prediction with explanation) is revealed for review.
- AI as First-Look: The AI-generated diagnosis (prediction only or prediction with explanation) is presented before the clinician begins the review.
Clinicians will be randomly assigned to different review sequences to minimize potential order effects. This study design will enable us to assess the impact of AI assistance on diagnostic accuracy, interpretation time, and clinician confidence.
Přehled studie
Postavení
Postavení
Podmínky
Podmínky
Intervence / Léčba
Intervence / Léčba
- Behaviorální: Unaided Review First, Then AI as Double-Check, Then AI as First-Look.
- Behaviorální: Unaided Review First, Then AI as First-Look, Then AI as Double-Check.
- Behaviorální: AI as Double-Check First, Then AI as First-Look, Then Unaided Review.
- Behaviorální: AI as First-Look First, Then AI as Double-Check, Then Unaided Review.
Detailní popis
This study aims to evaluate the effect of artificial intelligence (AI) assistance on clinicians' diagnostic performance in distinguishing lung adenocarcinoma (LUAD) from lung squamous cell carcinoma (LUSC) and kidney renal papillary cell carcinoma (KIRP) from kidney renal clear cell carcinoma (KIRC) using digitized hematoxylin and eosin (H&E)-stained whole-slide images (WSIs). ENLIGHT (Explainable Neoplasm Learning In Grounded Histology Terms) will serve as the AI system under evaluation. This is a single-session, within-reader, between-case study in which each reader evaluates distinct sets of cases under all study conditions.
The study includes three diagnostic blocks: Block X, in which WSIs are reviewed without AI assistance; Block Y1, in which clinicians make an initial diagnosis before viewing the AI output as a double-check; and Block Y2, in which the AI output is displayed before clinicians begin their review as a first-look aid. Within each AI-assisted block, the prediction-only and prediction-with-explanation sub-blocks are presented in randomized order.
Each participating pathologist will review up to 400 de-identified WSIs (up to 200 lung cancer and up to 200 kidney cancer cases). Readers will be randomly assigned to one of four study arms that differ only in the order in which Blocks X, Y1, and Y2 are completed. For each reader, distinct WSIs will be randomly assigned to the diagnostic conditions so that no WSI is reviewed more than once by the same reader.
- Arm 1 (X -> Y1 -> Y2): Clinicians first complete Block X (Unaided Review), followed by Block Y1 (AI as Double-Check) and then Block Y2 (AI as First-Look).
- Arm 2 (X -> Y2 -> Y1): Clinicians first complete Block X (Unaided Review), followed by Block Y2 (AI as First-Look) and then Block Y1 (AI as Double-Check).
- Arm 3 (Y1 -> Y2 -> X): Clinicians first complete Block Y1 (AI as Double-Check), followed by Block Y2 (AI as First-Look), and then Block X (Unaided Review).
- Arm 4 (Y2 -> Y1 -> X): Clinicians first complete Block Y2 (AI as First-Look), followed by Block Y1 (AI as Double-Check), and then Block X (Unaided Review).
For each case, diagnostic accuracy, time to diagnosis, and diagnostic confidence will be recorded. No reader will review the same WSI under more than one condition, thereby eliminating within-reader recall bias. In parallel, the ENLIGHT model will independently generate diagnostic predictions for all WSIs to enable direct benchmarking of AI performance against pathologists and to evaluate the impact of different AI-assisted workflows on diagnostic performance.
Typ studie
Typ studie
Zápis (Odhadovaný)
Zápis
Fáze
Fáze
- Nelze použít
Kontakty a umístění
Studijní místa
-
-
Massachusetts
-
Boston, Massachusetts, Spojené státy, 02115
- Harvard Medical School,
-
-
Kritéria účasti
Kritéria způsobilosti
Kritéria způsobilosti
Věk způsobilý ke studiu
- Dítě
- Dospělý
- Starší dospělý
Přijímá zdravé dobrovolníky
Popis
Inclusion Criteria for Pathology Slides (i.e., Cases):
- Hematoxylin and eosin (H&E)-stained pathology slides
- Final diagnosis confirmed through molecular testing in conjunction with expert pathology evaluation
Exclusion Criteria for Pathology Slides (i.e., Cases):
- Poor-quality or unreadable slides
- Cases used in AI training
Inclusion Criteria for Readers (i.e., Participants):
- Board-certified or board-eligible pathologists
- Willingness to complete both unaided and AI-assisted review sessions
Studijní plán
Jak je studie koncipována?
Detaily designu
- Primární účel: Diagnostický
- Přidělení: Randomizované
- Intervenční model: Crossover Assignment
- Maskování: Čtyřnásobek
Počet zbraní
Zbraně a zásahy
Skupina účastníků / ArmSkupina účastníků / Arm |
Intervence / LéčbaIntervence / Léčba |
|---|---|
|
Aktivní komparátor: Unaided Review First, Then AI as Double-Check, Then AI as First-Look.
Readers first complete Block X (Unaided) on their assigned subset SX.
They then complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check).
Within Block Y1, the order of SY1a and SY1b is randomized.
They then complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look).
Within Block Y2, the order of SY2a and SY2b is randomized.
For each reader, each of the five subsets (SX, SY1a, SY1b, SY2a, and SY2b) comprises up to 80 slides: up to 40 slides from LUAD-LUSC and up to 40 slides from KIRP-KIRC.
|
Readers first complete Block X (Unaided) on their assigned subset SX.
They then complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check).
Within Block Y1, the order of SY1a and SY1b is randomized.
They then complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look).
Within Block Y2, the order of SY2a and SY2b is randomized.
For each reader, SX, SY1a, SY1b, SY2a, and SY2b are disjoint.
|
|
Aktivní komparátor: Unaided Review First, Then AI as First-Look, Then AI as Double-Check.
Readers first complete Block X (Unaided) on their assigned subset SX.
They then complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look).
Within Block Y2, the order of SY2a and SY2b is randomized.
They then complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check).
Within Block Y1, the order of SY1a and SY1b is randomized.
For each reader, each of the five subsets (SX, SY1a, SY1b, SY2a, and SY2b) comprises up to 80 slides: up to 40 slides from LUAD-LUSC and up to 40 slides from KIRP-KIRC.
|
Readers first complete Block X (Unaided) on their assigned subset SX.
They then complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look).
Within Block Y2, the order of SY2a and SY2b is randomized.
They then complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check).
Within Block Y1, the order of SY1a and SY1b is randomized.
For each reader, SX, SY1a, SY1b, SY2a, and SY2b are disjoint.
|
|
Aktivní komparátor: AI as Double-Check Review First, Then AI as First-Look, Then Unaided Review.
Readers first complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check).
Within Block Y1, the order of SY1a and SY1b is randomized.
They then complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look).
Within Block Y2, the order of SY2a and SY2b is randomized.
Then readers complete Block X (Unaided) on their assigned subset SX.
For each reader, each of the five subsets (SX, SY1a, SY1b, SY2a, and SY2b) comprises up to 80 slides: up to 40 slides from LUAD-LUSC and up to 40 slides from KIRP-KIRC.
|
Readers first complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check).
Within Block Y1, the order of SY1a and SY1b is randomized.
They then complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look).
Within Block Y2, the order of SY2a and SY2b is randomized.
Then readers complete Block X (Unaided) on their assigned subset SX.
For each reader, SX, SY1a, SY1b, SY2a, and SY2b are disjoint.
|
|
Aktivní komparátor: AI as First-Look Review First, Then AI as Double-Check, Then Unaided Review.
Readers first complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look).
Within Block Y2, the order of SY2a and SY2b is randomized.
They then complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check).
Within Block Y1, the order of SY1a and SY1b is randomized.
Then readers complete Block X (Unaided) on their assigned subset SX.
For each reader, each of the five subsets (SX, SY1a, SY1b, SY2a, and SY2b) comprises up to 80 slides: up to 40 slides from LUAD-LUSC and up to 40 slides from KIRP-KIRC.
|
Readers first complete Block Y2 (AI as First-Look) on two separate subsets: SY2a (AI prediction-only as First-Look) and SY2b (AI prediction-with-explanation as First-Look).
Within Block Y2, the order of SY2a and SY2b is randomized.
They then complete Block Y1 (AI as Double-Check) on two separate subsets: SY1a (AI prediction-only as Double-Check) and SY1b (AI prediction-with-explanation as Double-Check).
Within Block Y1, the order of SY1a and SY1b is randomized.
Then readers complete Block X (Unaided) on their assigned subset SX.
For each reader, SX, SY1a, SY1b, SY2a, and SY2b are disjoint.
|
Co je měření studie?
Primární výstupní opatření
Primární výstupní opatření
Měření výsledku |
Popis opatření |
Časové okno |
|---|---|---|
|
Diagnostic performance of cancers
Časové okno: Periprocedural (at the time of slide review)
|
Performance of clinicians (unaided and AI-assisted) for distinguishing LUAD- LUSC and distinguishing KIRP-KIRC, measured in accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and F1.
|
Periprocedural (at the time of slide review)
|
Sekundární výstupní opatření
Sekundární výstupní opatření
Měření výsledku |
Popis opatření |
Časové okno |
|---|---|---|
|
Čas na diagnostiku
Časové okno: Periprocedurální (v době kontroly snímku)
|
Průměrná doba (sekundy na případ) potřebná k dokončení diagnózy.
|
Periprocedurální (v době kontroly snímku)
|
|
Variabilita inter-obrveru
Časové okno: Periprocedurální (v době kontroly snímku)
|
Smlouva mezi klinickými lékaři napříč podmínkami, měřená pomocí metrik spolehlivosti mezi rater (např. Kappa statistiky).
|
Periprocedurální (v době kontroly snímku)
|
|
Čistá výhoda po expozici AI
Časové okno: Periprocedurální (v době kontroly snímku)
|
Celková změna v diagnostické přesnosti připisované pomoci AI.
|
Periprocedurální (v době kontroly snímku)
|
|
Clinician confidence level
Časové okno: Periprocedural (at the time of slide review)
|
Self-reported diagnostic confidence recorded for each case.
Scale: 5 - Absolutely Certain; 4 - Mostly Certain; 3 - Unsure; 2 - Very Doubtful; 1 - Random Guess; With 5 being the highest confidence score and 1 being the lowest.
|
Periprocedural (at the time of slide review)
|
Spolupracovníci a vyšetřovatelé
Sponzor
Sponzor
Termíny studijních záznamů
Hlavní termíny studia
Začátek studia (Odhadovaný)
Začátek studia
Primární dokončení (Odhadovaný)
Primární dokončení
Dokončení studie (Odhadovaný)
Dokončení studie
Termíny zápisu do studia
První předloženo
První předloženo
První předloženo, které splnilo kritéria kontroly kvality
První předloženo, které splnilo kritéria kontroly kvality
První zveřejněno (Aktuální)
První zveřejněno
Aktualizace studijních záznamů
Poslední zveřejněná aktualizace (Aktuální)
Poslední zveřejněná aktualizace
Odeslaná poslední aktualizace, která splnila kritéria kontroly kvality
Odeslaná poslední aktualizace, která splnila kritéria kontroly kvality
Naposledy ověřeno
Naposledy ověřeno
Více informací
Termíny související s touto studií
Klíčová slova
Další relevantní podmínky MeSH
Další identifikační čísla studie
Další identifikační čísla studie
- ENLIGHT Study
Plán pro data jednotlivých účastníků (IPD)
Plánujete sdílet data jednotlivých účastníků (IPD)?
Informace o lécích a zařízeních, studijní dokumenty
Studuje lékový produkt regulovaný americkým FDA
Studuje produkt zařízení regulovaný americkým úřadem FDA
Tyto informace byly beze změn načteny přímo z webu clinicaltrials.gov. Máte-li jakékoli požadavky na změnu, odstranění nebo aktualizaci podrobností studie, kontaktujte prosím register@clinicaltrials.gov. Jakmile bude změna implementována na clinicaltrials.gov, bude automaticky aktualizována i na našem webu .