- ICH GCP
- Rejestr badań klinicznych w USA
- Badanie kliniczne NCT07942701
Generating Medical Discharge Report Drafts Via Artificial Intelligence (Letter)
A key process in intensive care is the creation of transfer reports. These summarize the essential aspects of the treatment to date and ensure that information is passed on to the next treatment team in a structured manner. They contain, among other things, diagnoses, relevant examination results, and therapeutic measures that have been carried out. The aim of a transfer report is to document the patient's medical history and the course of treatment to date in a concise and complete manner. Incomplete transfer reports can lead to repeated examinations, which can potentially delay further therapy and endanger the patient, as well as incurring additional costs.
In this context, a complete transfer report ensures continuity of treatment and contributes significantly to patient safety.
Transfer reports are created from a synthesis of a large number of documents. In addition to medical facts from tables and free-text summaries, physicians also draw on their experience to pass on relevant information to future treatment teams in the synthesis of detailed documentation. This process naturally requires a great deal of time and concentration in patients receiving intensive care.
Artificial intelligence methods, such as large language models (LLMs), could be used to learn how to create transfer reports and formulate drafts.
LLMs can convert unstructured free text into a structured form, thereby facilitating the report creation process. This would make it possible to generate a pre-formulated draft that doctors could then review and supplement.
At present, transfer reports are created by physicians with considerable effort and time. The methods currently available for automating report generation are limited to text modules that largely bundle data sources deterministically. Some of these methods are already commercially available, but they are not capable of creating individual reports beyond form letters.
The automatic analysis of unstructured text data falls within a subfield of AI known as natural language processing (NLP), which also includes language models (LLMs) such as ChatGPT and Gemini, which have been popular since 2022. A major milestone was reached with the development of the Transformer architecture in 2017, which, in addition to the availability of enormous amounts of training data (e.g., Wikipedia, news articles, or books), forms the basis for many groundbreaking language models. The effectiveness of these LLMs is limited for specific domains such as medicine, as the training data often lacks relevant characteristics such as complex terminology or writing styles. Adapting these models for clinical use to improve patient care, research, and medical education is a highly topical field of research. The most relevant foreign-language models include BioBERT, Meditron, and Med-PaLM. As of July 2024, there is only limited research on the development of German-language models, e.g., medBERT, BioGottBERT, and a few models that are not publicly available.
The sole use of LLMs is problematic due to non-reproducible results, lack of transparency, and bias in the models. Knowledge graphs (KGs) are used in medicine to represent and analyze complex information structures. The creation of a "robust digital patient twin" would be improved by the use of LLMs and KGs. This would allow the state of health to be assessed based on all digitally available clinical information (both structured and, in this project, now also unstructured). Recent studies confirm that adapted LLMs in the English language domain can produce summaries that are equivalent to or better than those produced by human experts, and that these are often difficult to distinguish from reports written by humans.
The legal framework for this results from a complex interaction of legal provisions from data protection law (with regard to health data), artificial intelligence law (AI Act), medical law (in particular hospital law), (medical) product law, medical professional law, and other relevant professional groups (e.g., nursing and pharmacy), as well as relevant civil and criminal law standards of care. In addition, there are fundamental rights requirements based on the ECHR and the EU Charter of Fundamental Rights. Data protection issues relating to the use of health data, in particular for research with AI systems, and professional law issues in connection with automated aggregation and presentation have already been examined in detail (as part of the SMARAGD project, FFG 872575).
Przegląd badań
Status
Warunki
Typ studiów
Zapisy (Szacowany)
Kontakty i lokalizacje
Kontakt w sprawie studiów
- Nazwa: Thomas Tschoellitsch, MD
- Numer telefonu: 78132 +435768083
- E-mail: thomas.tschoellitsch@jku.at
Kopia zapasowa kontaktu do badania
- Nazwa: Jens Meier, MD
- Numer telefonu: 2158 +435768083
- E-mail: jens.meier@jku.at
Lokalizacje studiów
-
-
Upper Austria
-
Linz, Upper Austria, Austria, 4020
- Rekrutacyjny
- Johannes Kepler University, Kepler University Hospital
-
Kontakt:
- Thomas Tschoellitsch, MD
- Numer telefonu: 78132 +435768083
- E-mail: thomas.tschoellitsch@jku.at
-
Kontakt:
- Jens Meier, MD
- Numer telefonu: 2158 +435768083
- E-mail: jens.meier@jku.at
-
-
Kryteria uczestnictwa
Kryteria kwalifikacji
Wiek uprawniający do nauki
Akceptuje zdrowych ochotników
Płeć kwalifikująca się do nauki
Metoda próbkowania
Badana populacja
Patients treated in intensive care units.
Opis
Inclusion Criteria:
- Treated in intensive care units between 2008-11-01 to 2025-05-31 at the study center.
Exclusion Criteria:
- Refusal to participate in scientific studies.
Plan studiów
Jak projektuje się badanie?
Szczegóły projektu
- Modele obserwacyjne: OTHER
- Perspektywy czasowe: RETROSPECTIVE
Co mierzy badanie?
Podstawowe miary wyniku
Miara wyniku |
Opis środka |
Ramy czasowe |
|---|---|---|
|
Quality of Discharge Report Drafts
Ramy czasowe: 2008-11-01 to 2025-05-31
|
Quality of Discharge Report Drafts evaluated based on technical parameters and assessed by human experts. Factual correctness: Accurate reproduction of e.g. diagnoses, medication versus hallucinations using Entity Matching Score (Percentage of correctly reproduced entities compared with the source data) and Hallucination Rate (Proportion of unverifiable statements). Completeness: All relevant information is included using checklist compliance (proportion of required fields covered) and Recall against Reference Texts (comparison with physician-written letters, e.g. using ROUGE-L). Clinical Validity: Recommendations must be evidence-based and consistent with clinical guidelines using guideline-adherence (e.g. rule-based systems or LLM-based assessments). Structure is assessed with template compliance using NLP-based section recognition. Data Protection: Degree of Anonymization using NER models. Comprehensibility: Clear, precise language without ambiguities using Readability Assessment. |
2008-11-01 to 2025-05-31
|
Miary wyników drugorzędnych
Miara wyniku |
Opis środka |
Ramy czasowe |
|---|---|---|
|
Traceability
Ramy czasowe: 2008-11-01 to 2025-05-31
|
The data sources used to create text passages should be visualized so that the steps performed by the AI can be explained and traced. Traceability should also be evaluated by human experts. |
2008-11-01 to 2025-05-31
|
|
Degree of Necessary Adjustments
Ramy czasowe: 2008-11-01 to 2025-05-31
|
The degree of necessary adjustments to drafts should be evaluated proportionally as a percentage of the total text and based on the type of adjustments made by human experts (e.g., spelling errors, content corrections, additions). |
2008-11-01 to 2025-05-31
|
Współpracownicy i badacze
Sponsor
Śledczy
- Główny śledczy: Thomas Tschoellitsch, MD, Johannes Kepler University
Daty zapisu na studia
Główne daty studiów
Rozpoczęcie studiów (Rzeczywisty)
Zakończenie podstawowe (Rzeczywisty)
Ukończenie studiów (Szacowany)
Daty rejestracji na studia
Pierwszy przesłany
Pierwszy przesłany, który spełnia kryteria kontroli jakości
Pierwszy wysłany (Rzeczywisty)
Aktualizacje rekordów badań
Ostatnia wysłana aktualizacja (Rzeczywisty)
Ostatnia przesłana aktualizacja, która spełniała kryteria kontroli jakości
Ostatnia weryfikacja
Więcej informacji
Terminy związane z tym badaniem
Inne numery identyfikacyjne badania
- MEDI-DOK Letter
Plan dla danych uczestnika indywidualnego (IPD)
Planujesz udostępniać dane poszczególnych uczestników (IPD)?
Informacje o lekach i urządzeniach, dokumenty badawcze
Bada produkt leczniczy regulowany przez amerykańską FDA
Bada produkt urządzenia regulowany przez amerykańską FDA
Te informacje zostały pobrane bezpośrednio ze strony internetowej clinicaltrials.gov bez żadnych zmian. Jeśli chcesz zmienić, usunąć lub zaktualizować dane swojego badania, skontaktuj się z register@clinicaltrials.gov. Gdy tylko zmiana zostanie wprowadzona na stronie clinicaltrials.gov, zostanie ona automatycznie zaktualizowana również na naszej stronie internetowej .