Deze pagina is automatisch vertaald en de nauwkeurigheid van de vertaling kan niet worden gegarandeerd. Raadpleeg de Engelse versie voor een brontekst.

Agreement Between Large Language Model-Generated Treatment Recommendations With Guideline-Based and Tumor Board Decisions in Gastrointestinal Cancer (KITuKo)

14 mei 2026 bijgewerkt door: Rene Mantke, Medizinische Hochschule Brandenburg Theodor Fontane

Concordance of Large Language Model-Generated Treatment Recommendations With Multidisciplinary Tumor Board and Guideline-Based Decisions in Gastrointestinal Cancer: A Retrospective Cohort Study

The goal of this observational study is to learn whether a computer program can suggest cancer treatments that match expert recommendations for people with gastrointestinal cancer (cancer of the pancreas, stomach, or colon and rectum).

The main questions it aims to answer are:

  • Do the treatment suggestions from the computer program match current medical guidelines?
  • Do these suggestions match decisions made by a multidisciplinary tumor board (a team of cancer specialists)?

Researchers will review existing medical records from people who have already been treated for these cancers. They will enter key clinical information into a computer program that uses artificial intelligence (AI). The program will generate treatment suggestions for each case.

Researchers will then compare these suggestions with:

  • guideline-based treatment recommendations
  • decisions made by the tumor board

This study will help researchers understand whether AI tools could support doctors in making cancer treatment decisions in the future.

Studie Overzicht

Gedetailleerde beschrijving

Gastrointestinal cancers require complex treatment planning that often involves surgery, systemic therapy, and multidisciplinary coordination. Clinical decision-making is typically guided by evidence-based recommendations and discussed in multidisciplinary tumor boards. However, the increasing complexity of treatment strategies and guideline frameworks can make consistent and reproducible decision-making challenging in routine clinical practice.

Recent advances in artificial intelligence have enabled the development of large language models (LLMs) that can process structured clinical information and generate text-based recommendations. These systems may offer a scalable approach to support clinical workflows, but their ability to produce reliable and clinically appropriate treatment suggestions in oncology remains uncertain.

This study evaluates the performance of an LLM-based system in the context of gastrointestinal oncology using retrospectively collected clinical case data. Structured case summaries derived from routine clinical documentation are used as standardized input. The model generates treatment recommendations under controlled conditions, allowing systematic comparison with established clinical reference standards.

The analysis focuses on the level of agreement between model-generated recommendations and established decision-making frameworks. In addition, the study explores how model performance varies across different clinical scenarios, including varying levels of disease complexity. Particular attention is given to situations in which recommendations differ, in order to better understand potential limitations of the model and identify patterns that may be clinically relevant.

Furthermore, the study examines the consistency of model outputs when the same clinical information is processed multiple times. This provides insight into the stability and reproducibility of the system, which are important considerations for potential real-world use.

The findings of this study are intended to inform the potential role of LLM-based tools as supportive systems in clinical decision-making. The study does not evaluate clinical outcomes or patient benefit, but instead focuses on agreement with established standards and expert-driven decisions as an initial step in assessing feasibility and safety.

Studietype

Observationeel

Inschrijving (Werkelijk)

30

Contacten en locaties

In dit gedeelte vindt u de contactgegevens van degenen die het onderzoek uitvoeren en informatie over waar dit onderzoek wordt uitgevoerd.

Studie Locaties

    • Brandenburg
      • Brandenburg an der Havel, Brandenburg, Duitsland, 14770
        • University Hospital Brandenburg

Deelname Criteria

Onderzoekers zoeken naar mensen die aan een bepaalde beschrijving voldoen, de zogenaamde geschiktheidscriteria. Enkele voorbeelden van deze criteria zijn iemands algemene gezondheidstoestand of eerdere behandelingen.

Geschiktheidscriteria

Leeftijden die in aanmerking komen voor studie

  • Volwassen
  • Oudere volwassene

Accepteert gezonde vrijwilligers

Nee

Bemonsteringsmethode

Niet-waarschijnlijkheidssteekproef

Studie Bevolking

The study population consists of adult patients with gastrointestinal adenocarcinoma treated at a tertiary care academic center in the Federal State of Brandenburg, Germany. The population is derived from routine clinical practice and includes patients whose cases were evaluated in a multidisciplinary tumor board.

Beschrijving

Inclusion Criteria:

  • Histologically confirmed pancreatic, gastric, or colorectal adenocarcinoma
  • Treatment discussed in a multidisciplinary tumor board

Exclusion Criteria:

  • Non-adenocarcinoma histology

Studie plan

Dit gedeelte bevat details van het studieplan, inclusief hoe de studie is opgezet en wat de studie meet.

Hoe is de studie opgezet?

Ontwerpdetails

Cohorten en interventies

Groep / Cohort
Interventie / Behandeling
Colorectale kanker
Patiënten met darmkanker
Detailed treatment recommendation according to the official guideline of the Association of the Scientific Medical Societies in Germany (AWMF; Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften),
Structured clinical case summaries were analyzed by a GPT-4-class large language model to generate treatment recommendations.
Detailed treatment recommendation according to the case-specific postoperative tumor board review.
Pancreatic cancer
Patients with pancreatic cancer
Detailed treatment recommendation according to the official guideline of the Association of the Scientific Medical Societies in Germany (AWMF; Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften),
Structured clinical case summaries were analyzed by a GPT-4-class large language model to generate treatment recommendations.
Detailed treatment recommendation according to the case-specific postoperative tumor board review.
Gastric cancer
Patients with gastric cancer
Detailed treatment recommendation according to the official guideline of the Association of the Scientific Medical Societies in Germany (AWMF; Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften),
Structured clinical case summaries were analyzed by a GPT-4-class large language model to generate treatment recommendations.
Detailed treatment recommendation according to the case-specific postoperative tumor board review.

Wat meet het onderzoek?

Primaire uitkomstmaten

Uitkomstmaat
Maatregel Beschrijving
Tijdsspanne
Concordance with guideline-based management
Tijdsspanne: At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery
Agreement between LLM-generated recommendations and AWMF guideline-supported treatment strategies
At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery

Secundaire uitkomstmaten

Uitkomstmaat
Maatregel Beschrijving
Tijdsspanne
Concordance with multidisciplinary tumor board decisions
Tijdsspanne: At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery
Agreement between LLM-generated recommendations and tumor board treatment strategies
At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery
Reproducibility of LLM recommendations across repeated runs
Tijdsspanne: At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery
Structured clinical case vignettes were entered into ChatGPT using a standardized prompt template. To assess within-model reproducibility, each clinical vignette was analyzed in 3 independent model sessions performed on different days using identical clinical input.
At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery
Characterization of discordant recommendations (e.g., overtreatment, undertreatment)
Tijdsspanne: At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery

Overtreatment was defined as an LLM-generated recommendation exceeding the intensity of the reference recommendation.

Undertreatment was defined as omission of a recommended treatment or recommendation of a less intensive strategy.

At the time of multidisciplinary tumor board evaluation up to 4 weeks after surgery

Medewerkers en onderzoekers

Hier vindt u mensen en organisaties die betrokken zijn bij dit onderzoek.

Studie record data

Deze datums volgen de voortgang van het onderzoeksdossier en de samenvatting van de ingediende resultaten bij ClinicalTrials.gov. Studieverslagen en gerapporteerde resultaten worden beoordeeld door de National Library of Medicine (NLM) om er zeker van te zijn dat ze voldoen aan specifieke kwaliteitscontrolenormen voordat ze op de openbare website worden geplaatst.

Bestudeer belangrijke data

Studie start (Werkelijk)

1 januari 2025

Primaire voltooiing (Werkelijk)

1 januari 2026

Studie voltooiing (Werkelijk)

25 februari 2026

Studieregistratiedata

Eerst ingediend

4 mei 2026

Eerst ingediend dat voldeed aan de QC-criteria

14 mei 2026

Eerst geplaatst (Werkelijk)

18 mei 2026

Updates van studierecords

Laatste update geplaatst (Werkelijk)

18 mei 2026

Laatste update ingediend die voldeed aan QC-criteria

14 mei 2026

Laatst geverifieerd

1 mei 2026

Meer informatie

Termen gerelateerd aan deze studie

Plan Individuele Deelnemersgegevens (IPD)

Bent u van plan om gegevens van individuele deelnemers (IPD) te delen?

NEE

Beschrijving IPD-plan

Individual participant data will not be shared. The dataset consists of retrospective, pseudonymized clinical data from a single institution, and sharing is restricted due to data protection regulations and institutional policies.

Informatie over medicijnen en apparaten, studiedocumenten

Bestudeert een door de Amerikaanse FDA gereguleerd geneesmiddel

Nee

Bestudeert een door de Amerikaanse FDA gereguleerd apparaatproduct

Nee

Deze informatie is zonder wijzigingen rechtstreeks van de website clinicaltrials.gov gehaald. Als u verzoeken heeft om uw onderzoeksgegevens te wijzigen, te verwijderen of bij te werken, neem dan contact op met register@clinicaltrials.gov. Zodra er een wijziging wordt doorgevoerd op clinicaltrials.gov, wordt deze ook automatisch bijgewerkt op onze website .

Abonneren