- ICH GCP
- Registre américain des essais cliniques
- Essai clinique NCT07942701
Generating Medical Discharge Report Drafts Via Artificial Intelligence (Letter)
A key process in intensive care is the creation of transfer reports. These summarize the essential aspects of the treatment to date and ensure that information is passed on to the next treatment team in a structured manner. They contain, among other things, diagnoses, relevant examination results, and therapeutic measures that have been carried out. The aim of a transfer report is to document the patient's medical history and the course of treatment to date in a concise and complete manner. Incomplete transfer reports can lead to repeated examinations, which can potentially delay further therapy and endanger the patient, as well as incurring additional costs.
In this context, a complete transfer report ensures continuity of treatment and contributes significantly to patient safety.
Transfer reports are created from a synthesis of a large number of documents. In addition to medical facts from tables and free-text summaries, physicians also draw on their experience to pass on relevant information to future treatment teams in the synthesis of detailed documentation. This process naturally requires a great deal of time and concentration in patients receiving intensive care.
Artificial intelligence methods, such as large language models (LLMs), could be used to learn how to create transfer reports and formulate drafts.
LLMs can convert unstructured free text into a structured form, thereby facilitating the report creation process. This would make it possible to generate a pre-formulated draft that doctors could then review and supplement.
At present, transfer reports are created by physicians with considerable effort and time. The methods currently available for automating report generation are limited to text modules that largely bundle data sources deterministically. Some of these methods are already commercially available, but they are not capable of creating individual reports beyond form letters.
The automatic analysis of unstructured text data falls within a subfield of AI known as natural language processing (NLP), which also includes language models (LLMs) such as ChatGPT and Gemini, which have been popular since 2022. A major milestone was reached with the development of the Transformer architecture in 2017, which, in addition to the availability of enormous amounts of training data (e.g., Wikipedia, news articles, or books), forms the basis for many groundbreaking language models. The effectiveness of these LLMs is limited for specific domains such as medicine, as the training data often lacks relevant characteristics such as complex terminology or writing styles. Adapting these models for clinical use to improve patient care, research, and medical education is a highly topical field of research. The most relevant foreign-language models include BioBERT, Meditron, and Med-PaLM. As of July 2024, there is only limited research on the development of German-language models, e.g., medBERT, BioGottBERT, and a few models that are not publicly available.
The sole use of LLMs is problematic due to non-reproducible results, lack of transparency, and bias in the models. Knowledge graphs (KGs) are used in medicine to represent and analyze complex information structures. The creation of a "robust digital patient twin" would be improved by the use of LLMs and KGs. This would allow the state of health to be assessed based on all digitally available clinical information (both structured and, in this project, now also unstructured). Recent studies confirm that adapted LLMs in the English language domain can produce summaries that are equivalent to or better than those produced by human experts, and that these are often difficult to distinguish from reports written by humans.
The legal framework for this results from a complex interaction of legal provisions from data protection law (with regard to health data), artificial intelligence law (AI Act), medical law (in particular hospital law), (medical) product law, medical professional law, and other relevant professional groups (e.g., nursing and pharmacy), as well as relevant civil and criminal law standards of care. In addition, there are fundamental rights requirements based on the ECHR and the EU Charter of Fundamental Rights. Data protection issues relating to the use of health data, in particular for research with AI systems, and professional law issues in connection with automated aggregation and presentation have already been examined in detail (as part of the SMARAGD project, FFG 872575).
Aperçu de l'étude
Statut
Les conditions
Type d'étude
Inscription (Estimé)
Contacts et emplacements
Coordonnées de l'étude
- Nom: Thomas Tschoellitsch, MD
- Numéro de téléphone: 78132 +435768083
- E-mail: thomas.tschoellitsch@jku.at
Sauvegarde des contacts de l'étude
- Nom: Jens Meier, MD
- Numéro de téléphone: 2158 +435768083
- E-mail: jens.meier@jku.at
Lieux d'étude
-
-
Upper Austria
-
Linz, Upper Austria, L'Autriche, 4020
- Recrutement
- Johannes Kepler University, Kepler University Hospital
-
Contact:
- Thomas Tschoellitsch, MD
- Numéro de téléphone: 78132 +435768083
- E-mail: thomas.tschoellitsch@jku.at
-
Contact:
- Jens Meier, MD
- Numéro de téléphone: 2158 +435768083
- E-mail: jens.meier@jku.at
-
-
Critères de participation
Critère d'éligibilité
Âges éligibles pour étudier
Accepte les volontaires sains
Sexes éligibles pour l'étude
Méthode d'échantillonnage
Population étudiée
Patients treated in intensive care units.
La description
Inclusion Criteria:
- Treated in intensive care units between 2008-11-01 to 2025-05-31 at the study center.
Exclusion Criteria:
- Refusal to participate in scientific studies.
Plan d'étude
Comment l'étude est-elle conçue ?
Détails de conception
- Modèles d'observation: OTHER
- Perspectives temporelles: RETROSPECTIVE
Que mesure l'étude ?
Principaux critères de jugement
Mesure des résultats |
Description de la mesure |
Délai |
|---|---|---|
|
Quality of Discharge Report Drafts
Délai: 2008-11-01 to 2025-05-31
|
Quality of Discharge Report Drafts evaluated based on technical parameters and assessed by human experts. Factual correctness: Accurate reproduction of e.g. diagnoses, medication versus hallucinations using Entity Matching Score (Percentage of correctly reproduced entities compared with the source data) and Hallucination Rate (Proportion of unverifiable statements). Completeness: All relevant information is included using checklist compliance (proportion of required fields covered) and Recall against Reference Texts (comparison with physician-written letters, e.g. using ROUGE-L). Clinical Validity: Recommendations must be evidence-based and consistent with clinical guidelines using guideline-adherence (e.g. rule-based systems or LLM-based assessments). Structure is assessed with template compliance using NLP-based section recognition. Data Protection: Degree of Anonymization using NER models. Comprehensibility: Clear, precise language without ambiguities using Readability Assessment. |
2008-11-01 to 2025-05-31
|
Mesures de résultats secondaires
Mesure des résultats |
Description de la mesure |
Délai |
|---|---|---|
|
Traceability
Délai: 2008-11-01 to 2025-05-31
|
The data sources used to create text passages should be visualized so that the steps performed by the AI can be explained and traced. Traceability should also be evaluated by human experts. |
2008-11-01 to 2025-05-31
|
|
Degree of Necessary Adjustments
Délai: 2008-11-01 to 2025-05-31
|
The degree of necessary adjustments to drafts should be evaluated proportionally as a percentage of the total text and based on the type of adjustments made by human experts (e.g., spelling errors, content corrections, additions). |
2008-11-01 to 2025-05-31
|
Collaborateurs et enquêteurs
Parrainer
Les enquêteurs
- Chercheur principal: Thomas Tschoellitsch, MD, Johannes Kepler University
Dates d'enregistrement des études
Dates principales de l'étude
Début de l'étude (Réel)
Achèvement primaire (Réel)
Achèvement de l'étude (Estimé)
Dates d'inscription aux études
Première soumission
Première soumission répondant aux critères de contrôle qualité
Première publication (Réel)
Mises à jour des dossiers d'étude
Dernière mise à jour publiée (Réel)
Dernière mise à jour soumise répondant aux critères de contrôle qualité
Dernière vérification
Plus d'information
Termes liés à cette étude
Autres numéros d'identification d'étude
- MEDI-DOK Letter
Plan pour les données individuelles des participants (IPD)
Prévoyez-vous de partager les données individuelles des participants (DPI) ?
Informations sur les médicaments et les dispositifs, documents d'étude
Étudie un produit pharmaceutique réglementé par la FDA américaine
Étudie un produit d'appareil réglementé par la FDA américaine
Ces informations ont été extraites directement du site Web clinicaltrials.gov sans aucune modification. Si vous avez des demandes de modification, de suppression ou de mise à jour des détails de votre étude, veuillez contacter register@clinicaltrials.gov. Dès qu'un changement est mis en œuvre sur clinicaltrials.gov, il sera également mis à jour automatiquement sur notre site Web .