Expert-Validated ChatGPT Support for Arterial Blood Gas Interpretation (ABG-AI RCT)

September 24, 2026 updated by: Semih Musa Coşkun, Izmir Katip Celebi University

Expert-Validated Generative AI Support for Arterial Blood Gas Interpretation in Early-Career Non-Specialist Physicians: A Randomized Controlled Study

This randomized controlled study evaluated whether expert-validated ChatGPT support improved arterial blood gas (ABG) interpretation performance among early-career non-specialist physicians. Participants completed a baseline assessment consisting of 11 standardized clinical scenarios covering five domains of ABG interpretation. Eligible participants who entered the reassessment phase were randomly assigned to either an AI-supported group or a control group.

One week after baseline assessment, participants completed a posttest using the same clinical scenarios. The AI-supported group received expert-validated ChatGPT responses before answering each case, whereas the control group completed the assessment without AI support.

The primary outcome was posttest total ABG interpretation accuracy across 55 scored items, compared between groups after adjustment for baseline accuracy. Secondary outcomes included changes in total accuracy, domain-specific accuracy, case-level performance, and item-level accuracy.

Study Overview

Status

Status

Indicates the current recruitment status or the expanded access status.
Completed

Conditions

Conditions

The disease, disorder, syndrome, illness, or injury that is being studied. On ClinicalTrials.gov, conditions may also include other health-related issues, such as lifespan, quality of life, and health risks.

Intervention / Treatment

Intervention / Treatment

A process or action that is the focus of a clinical study. Interventions include drugs, medical devices, procedures, vaccines, and other products that are either investigational or already available. Interventions can also include noninvasive approaches, such as education or modifying diet and exercise.

Study Type

Study Type

Describes the nature of a clinical study. Study types include interventional studies (also called clinical trials), observational studies (including patient registries), and expanded access.
Interventional

Enrollment (Actual)

Enrollment

The number of participants in a clinical study. The "anticipated" enrollment is the target number of participants that the researchers need for the study.
161

Phase

Phase

The stage of a clinical trial studying a drug or biological product, based on definitions developed by the U.S. Food and Drug Administration (FDA). The phase is based on the study's objective, the number of participants, and other characteristics. There are five phases: Early Phase 1 (formerly listed as Phase 0), Phase 1, Phase 2, Phase 3, and Phase 4. Not Applicable is used to describe trials without FDA-defined phases, including trials of devices or behavioral interventions.
  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

  • Turkey (Türkiye)
    • Gaziantep
      • Gaziantep, Gaziantep, Turkey (Türkiye)
        • Gaziantep City Hospital

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Eligibility Criteria

The key requirements that people who want to participate in a clinical study must meet or the characteristics they must have. Eligibility criteria consist of both inclusion criteria (which are required for a person to participate in the study) and exclusion criteria (which prevent a person from participating). Types of eligibility criteria include whether a study accepts healthy volunteers, has age or age group requirements, or is limited by sex.

Ages Eligible for Study

  • Child
  • Adult
  • Older Adult

Accepts Healthy Volunteers

Yes

Genders Eligible for Study

All

Description

Inclusion Criteria:

  • Fewer than five years of postgraduate clinical experience
  • Actively involved in patient care
  • Had not completed specialty training

Exclusion Criteria:

  • Residents
  • Specialists
  • Physicians not actively assessing patients
  • Incomplete, duplicate, or unmatchable pretest-posttest records

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: Other
  • Allocation: Randomized
  • Interventional Model: Parallel Assignment
  • Masking: None (Open Label)

Arms and Interventions

Participant Group / Arm

Participant Group / Arm

A group or subgroup of participants in a clinical trial that receives a specific intervention/treatment, or no intervention, according to the trial's protocol.
Intervention / Treatment

Intervention / Treatment

A process or action that is the focus of a clinical study. Interventions include drugs, medical devices, procedures, vaccines, and other products that are either investigational or already available. Interventions can also include noninvasive approaches, such as education or modifying diet and exercise.
No Intervention: Control group

Participants completed the 11 ABG cases without receiving any AI response, explanation, or recommendation
Experimental: AI-Supported Group

Before each of the 11 ABG cases, participants viewed the expert-validated ChatGPT response before providing their own answers.
Other: Expert-Validated ChatGPT Support

Before each of the 11 arterial blood gas (ABG) cases, participants viewed a standardized ChatGPT response that had been independently validated against the expert reference key by three physician experts. The response addressed five scored domains and included a brief rationale. Participants then provided their own answers to each case.

What is the study measuring?

Primary Outcome Measures

Primary Outcome Measures

In a clinical study's protocol, the planned outcome measure that is the most important for evaluating the effect of an intervention/treatment. Most clinical studies have one primary outcome measure, but some have more than one.
Outcome Measure
Measure Description
Time Frame
Posttest Total ABG Interpretation Accuracy
Time Frame: One week after baseline assessment

Total accuracy across 55 scored items, comprising five scored domains for each of 11 ABG cases. Each item was scored as correct (1) or incorrect (0), and total accuracy was calculated as the number of correct responses divided by 55 × 100. The primary analysis compared posttest total accuracy between the AI-supported and control groups, adjusted for baseline total accuracy.
One week after baseline assessment

Secondary Outcome Measures

Secondary Outcome Measures

In a clinical study's protocol, a planned outcome measure that is not as important as the primary outcome measure for evaluating the effect of an intervention but is still of interest. Most clinical studies have more than one secondary outcome measure.
Outcome Measure
Measure Description
Time Frame
Change in Total ABG Interpretation Accuracy From Pretest to Posttest
Time Frame: From baseline to one week after baseline assessment

Change in total ABG interpretation accuracy from baseline (pretest) to the one-week posttest was assessed within each study group. Total accuracy was calculated across 55 scored items as the number of correct responses divided by 55 × 100.
From baseline to one week after baseline assessment
Between-Group Difference in Change in Total ABG Interpretation Accuracy
Time Frame: From baseline to one week after baseline assessment

The change in total ABG interpretation accuracy from baseline to posttest was compared between the AI-supported and control groups. Change scores were calculated as posttest accuracy minus baseline accuracy.
From baseline to one week after baseline assessment
Change From Baseline in Primary Acid-Base Disorder Identification Accuracy on an 11-Item Assessment
Time Frame: Baseline and one week after baseline assessment

Accuracy in identifying the primary acid-base disorder was calculated as the number of correct responses across 11 arterial blood gas cases divided by 11 and multiplied by 100. Each response was scored as correct (1) or incorrect (0). The outcome was the change in accuracy from baseline to posttest, calculated as posttest accuracy minus baseline accuracy and expressed in percentage points. Possible change scores ranged from -100 to +100 percentage points, with positive values indicating improved accuracy.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Acute Asthma Exacerbation Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the acute asthma exacerbation case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Item-Level ABG Interpretation Accuracy
Time Frame: One week after baseline assessment

Item-level performance was evaluated across the 55 scored items, comprising five scored domains for each of the 11 ABG cases. The probability of a correct response for individual items was compared between the AI-supported and control groups.
One week after baseline assessment
Change From Baseline in Acid-Base Compensation Assessment Accuracy on an 11-Item Assessment
Time Frame: Baseline and one week after baseline assessment

Accuracy in assessing acid-base compensation was calculated as the number of correct responses across 11 arterial blood gas cases divided by 11 and multiplied by 100. Each response was scored as correct (1) or incorrect (0). The outcome was the change in accuracy from baseline to posttest, calculated as posttest accuracy minus baseline accuracy and expressed in percentage points. Possible change scores ranged from -100 to +100 percentage points, with positive values indicating improved accuracy.
Baseline and one week after baseline assessment
Change From Baseline in Electrolyte and Anion Gap Assessment Accuracy on an 11-Item Assessment
Time Frame: Baseline and one week after baseline assessment

Accuracy in assessing electrolyte and anion gap findings was calculated as the number of correct responses across 11 arterial blood gas cases divided by 11 and multiplied by 100. Each response was scored as correct (1) or incorrect (0). The outcome was the change in accuracy from baseline to posttest, calculated as posttest accuracy minus baseline accuracy and expressed in percentage points. Possible change scores ranged from -100 to +100 percentage points, with positive values indicating improved accuracy.
Baseline and one week after baseline assessment
Change From Baseline in Clinical Diagnosis Identification Accuracy on an 11-Item Assessment
Time Frame: Baseline and one week after baseline assessment

Accuracy in identifying the most likely clinical diagnosis was calculated as the number of correct responses across 11 arterial blood gas cases divided by 11 and multiplied by 100. Each response was scored as correct (1) or incorrect (0). The outcome was the change in accuracy from baseline to posttest, calculated as posttest accuracy minus baseline accuracy and expressed in percentage points. Possible change scores ranged from -100 to +100 percentage points, with positive values indicating improved accuracy.
Baseline and one week after baseline assessment
Change From Baseline in Clinical Management Decision Accuracy on an 11-Item Assessment
Time Frame: Baseline and one week after baseline assessment

Accuracy in selecting appropriate clinical management was calculated as the number of correct responses across 11 arterial blood gas cases divided by 11 and multiplied by 100. Each response was scored as correct (1) or incorrect (0). The outcome was the change in accuracy from baseline to posttest, calculated as posttest accuracy minus baseline accuracy and expressed in percentage points. Possible change scores ranged from -100 to +100 percentage points, with positive values indicating improved accuracy.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Acute COPD Exacerbation Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the acute COPD exacerbation case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Methanol Intoxication Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the methanol intoxication case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Diabetic Ketoacidosis Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the diabetic ketoacidosis case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Carbon Monoxide Intoxication Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the carbon monoxide intoxication case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Acute Kidney Injury on Chronic Kidney Disease With Hyperkalemia Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the acute kidney injury on chronic kidney disease with hyperkalemia case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Pulmonary Embolism Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the pulmonary embolism case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Panic Attack With Hyperventilation Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the panic attack with hyperventilation case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Diuretic-Associated Metabolic Alkalosis Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the diuretic-associated metabolic alkalosis case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Hypoglycemia Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the hypoglycemia case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment
Number of Participants by Change Category in Upper Gastrointestinal Bleeding With Hypovolemic Shock Case Interpretation Score
Time Frame: Baseline and one week after baseline assessment

For the upper gastrointestinal bleeding with hypovolemic shock case, each participant received one point for each correct response across five predefined assessment domains, yielding a case-specific score ranging from 0 to 5. The posttest score was compared with the baseline score for the same case. Participants were classified into three mutually exclusive categories: improvement (posttest score greater than baseline score), no change (posttest score equal to baseline score), or deterioration (posttest score lower than baseline score). The number of participants in each category was recorded separately for the AI-supported and control groups.
Baseline and one week after baseline assessment

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Sponsor

The organization or person who initiates the study and who has authority and control over the study.
Izmir Katip Celebi University

Investigators

Investigators

A researcher involved in a clinical study. Related terms include site principal investigator, site sub-investigator, study chair, study director, and study principal investigator.
  • Principal Investigator: Coşkun, MD, Gaziantep City Hospital

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

Study Start

The actual date on which the first participant was enrolled in a clinical study. The "anticipated" study start date is the date that the researchers think will be the study start date.
May 20, 2026

Primary Completion (Actual)

Primary Completion

The date on which the last participant in a clinical study was examined or received an intervention to collect final data for the primary outcome measure. Whether the clinical study ended according to the protocol or was terminated does not affect this date. For clinical studies with more than one primary outcome measure with different completion dates, this term refers to the date on which data collection is completed for all the primary outcome measures. The "anticipated" primary completion date is the date that the researchers think will be the primary completion date for the study.
June 5, 2026

Study Completion (Actual)

Study Completion

The date on which the last participant in a clinical study was examined or received an intervention/treatment to collect final data for the primary outcome measures, secondary outcome measures, and adverse events (that is, the last participant's last visit). The "anticipated" study completion date is the date that the researchers think will be the study completion date.
June 5, 2026

Study Registration Dates

First Submitted

First Submitted

The date on which the study sponsor or investigator first submitted a study record to ClinicalTrials.gov. There is typically a delay of a few days between the first submitted date and the record's availability on ClinicalTrials.gov (the first posted date).
September 18, 2026

First Submitted That Met QC Criteria

First Submitted That Met QC Criteria

The date on which the study sponsor or investigator first submits a study record that is consistent with National Library of Medicine (NLM) quality control (QC) review criteria. The sponsor or investigator may need to revise and submit a study record one or more times before NLM's QC review criteria are met. It is the responsibility of the sponsor or investigator to ensure that the study record is consistent with the NLM QC review criteria.
September 24, 2026

First Posted (Actual)

First Posted

The date on which the study record was first available on ClinicalTrials.gov after National Library of Medicine (NLM) quality control (QC) review has concluded. There is typically a delay of a few days between the date the study sponsor or investigator submitted the study record and the first posted date.
September 30, 2026

Study Record Updates

Last Update Posted (Actual)

Last Update Posted

The most recent date on which changes to a study record were made available on ClinicalTrials.gov. There may be a delay between when the changes were submitted to ClinicalTrials.gov by the study's sponsor or investigator (the last update submitted date) and the last update posted date.
September 30, 2026

Last Update Submitted That Met QC Criteria

Last Update Submitted That Met QC Criteria

The most recent date on which the study sponsor or investigator submitted changes to a study record that are consistent with National Library of Medicine (NLM) quality control (QC) review criteria. It is the responsibility of the sponsor or investigator to ensure that the study record is consistent with the NLM QC review criteria.
September 24, 2026

Last Verified

Last Verified

The most recent date on which the study sponsor or investigator confirmed the information about a clinical study on ClinicalTrials.gov as accurate and current. If a study with a recruitment status of recruiting; not yet recruiting; or active, not recruiting has not been confirmed within the past 2 years, the study's recruitment status is shown as unknown.
September 1, 2026

More Information

Terms related to this study

Keywords

Other Study ID Numbers

Other Study ID Numbers

Identifiers or ID numbers other than the NCT number that are assigned to a clinical study by the study's sponsor, funders, or others. These numbers may include unique identifiers from other trial registries and National Institutes of Health grant numbers.
  • 0449

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Cookie Settings

We use cookies to ensure that we give you the best experience on our website. For more details carefully read our Privacy and Cookies Policy. ...>>>You can change your preferences or withdraw your consent at any time by deleting the cookies from your website or computer as described in the policy. Please accept it and choose your preferences by ticking the corresponding boxes in the "Manage Settings" section below. Please carefully read our Terms of Service before you proceed with using any part of this website.
«Manage Settings