Assessing the Accuracy of ChatGPT-4 in Interpreting Arterial Blood Gas Results

January 18, 2025 updated by: Engin Ihsan Turan, Kanuni Sultan Suleyman Training and Research Hospital
Assessment of Acidosis and Alkalosis, Evaluation of Hypoxemia and Hyperoxemia, Evaluation of Hemoglobin Parameters, Assessment of Electrolytes, Evaluation of Metabolic Parameters (Glucose, Lactate, Bilirubin)

Study Overview

Status

Completed

Conditions

Intervention / Treatment

Detailed Description

Model Training:

The collected data will be used to train the artificial intelligence model. Utilizing the deep learning infrastructure provided by ChatGPT Plus, our model will be optimized to produce highly accurate results in interpreting blood gases.

During the training process, our model will be taught to interpret various blood gas samples, including assessments of acidosis-alkalosis, hypoxemia-hyperoxemia, hemoglobin, electrolytes, and metabolic parameters.

Model Testing and Validation:

The trained model will be tested on previously unseen test datasets to evaluate its performance. This step is crucial for understanding how the model will perform in real-world scenarios.

The accuracy of the model will be assessed by comparing its interpretations with feedback provided by expert anesthesiologists.

Furthermore, to comprehensively evaluate ChatGPT's effectiveness in this domain, the daily arterial blood gas results obtained in the intensive care unit will be submitted to ChatGPT for interpretation. The same questions will be posed, and the responses will be evaluated by an anesthesiology and reanimation specialist. These questions will be asked to the model:

Assessment of Acidosis and Alkalosis, Evaluation of Hypoxemia and Hyperoxemia, Evaluation of Hemoglobin Parameters, Assessment of Electrolytes, Evaluation of Metabolic Parameters (Glucose, Lactate, Bilirubin)

Study Type

Observational

Enrollment (Actual)

398

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

      • Istanbul, Turkey, 34303
        • Health Science University İstanbul Kanuni Sultan Süleyman Education and Training Hospital

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Adult
  • Older Adult

Accepts Healthy Volunteers

No

Sampling Method

Probability Sample

Study Population

A minimum of 398 arterial blood gas samples from patients in the intensive care unit will be included in the study

Description

Inclusion Criteria:

  • Patients aged 18 and above will be included in the study.
  • The study will evaluate arterial blood gas results.

Exclusion Criteria:

  • Venous blood gas results,
  • Blood gas results with calibration errors,
  • Blood gas results with incomplete data

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

Cohorts and Interventions

Group / Cohort
Intervention / Treatment
ChatGPT
interpretation of blood gases samples
Anesthesiology expert
interpretation of blood gases samples

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Time Frame
blood gases sample interpretation
Time Frame: 10 minutes
10 minutes

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

June 14, 2024

Primary Completion (Actual)

December 1, 2024

Study Completion (Actual)

December 2, 2024

Study Registration Dates

First Submitted

June 8, 2024

First Submitted That Met QC Criteria

June 8, 2024

First Posted (Actual)

June 13, 2024

Study Record Updates

Last Update Posted (Actual)

March 25, 2025

Last Update Submitted That Met QC Criteria

January 18, 2025

Last Verified

January 1, 2025

More Information

Terms related to this study

Other Study ID Numbers

  • Blood gases

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

NO

IPD Plan Description

there will be no IPD in this research. The investigators will only use blood gases samples and delete all the IPD.

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Blood Gases

Clinical Trials on interpretation

Subscribe