Conversational AI Study
April 23, 2026 updated by: Thomas Caruso, Stanford University
Conversational Artificial Intelligence Simulations to Improve Non-Technical Skills Among Anesthesiology Trainees: A Prospective, Mixed-Methods Study
This is a prospective, collaborative, mixed-methods study which includes anesthesiology trainees receiving one active intervention - a conversational artificial intelligence (CAI) simulation.
The goal is to explore the capability of AI to provide high-fidelity simulations that can ultimately improve how healthcare professionals handle difficult conversations such as disclosing medical errors or mistakes.
Study Overview
Status
Withdrawn
Conditions
Intervention / Treatment
Study Type
Interventional
Phase
- Not Applicable
Contacts and Locations
This section provides the contact details for those conducting the study, and information on where this study is being conducted.
Participation Criteria
Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.
Eligibility Criteria
Ages Eligible for Study
- Adult
Accepts Healthy Volunteers
No
Description
Inclusion Criteria:
- Hospital providers, including nurses, physician assistants, physicians, physician trainees, and other healthcare workers at Lucile Packard Children's Hospital (LPCH) and affiliated facilities who communicate with patients daily will be included
Exclusion Criteria:
- Participants with reported severe motion sickness
- Nausea
- Seizure disorder
- Currently using chronotropic heart medications, such as β blockers
Study Plan
This section provides details of the study plan, including how the study is designed and what the study is measuring.
How is the study designed?
Design Details
- Primary Purpose: Supportive Care
- Allocation: N/A
- Interventional Model: Single Group Assignment
- Masking: None (Open Label)
Arms and Interventions
Participant Group / Arm |
Intervention / Treatment |
|---|---|
|
Experimental: AI Group
Participant will be using OpenAI's ChatGPT4o's application.
For the purposes of this medical error scenario, the CAI will have a standardized prompt to simulate an upset parent whose child recently had surgery in which there was a medical error involving a tooth injury from an intubation.
Following a scripted briefing, simulation will be initiated.
|
Use of Conversational Artificial Intelligence Simulations generate medical scenario.
|
What is the study measuring?
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Evaluate acceptance of Conversational Artificial Intelligence Simulations using Guided Discussion Interview Question Guide
Time Frame: Before simulation
|
Guided Discussion Interview Question Guide contains 6 questions focusing 3 areas including Attitudes and Opinions, Perceptions and Summation question.
All the questions are open-ended questions.
|
Before simulation
|
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Evaluation of Conversational Artificial Intelligence Simulations usability via the System Usability Scale (SUS)
Time Frame: Immediately after simulation
|
Measured with the System Usability Scale (SUS).
The scale has 10 items.
Scores ranges from 1-5 (1 = strongly disagree and 5 = strongly agree)
|
Immediately after simulation
|
|
Evaluation of Conversational Artificial Intelligence Simulations usability via the User Experience Questionnaire (UEQ-S).
Time Frame: Immediately after simulation
|
UEQ-S, includes eight items (four from the pragmatic scales Efficiency, Perspicuity, Dependability, and four from the hedonic scales Stimulation and Novelty).
Scores range from -3 (min) to 3 (max)
|
Immediately after simulation
|
|
Evaluation of the reliability of AI quantitative assessment of non-technical performance compared to expert human assessors
Time Frame: immediately after simulation
|
The Anaesthetist Non-Technical Skills (ANTS) tool previously published by Fletcher et al. translated in French.
The ANTS scoring system uses four categories assessing task management, teamworking, situation awareness and decision-making (1 to 4 points by categories).
The minimum score is 4 and the maximum 16
|
immediately after simulation
|
Collaborators and Investigators
This is where you will find people and organizations involved with this study.
Sponsor
Study record dates
These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.
Study Major Dates
Study Start (Estimated)
August 1, 2025
Primary Completion (Estimated)
July 31, 2026
Study Completion (Estimated)
July 31, 2026
Study Registration Dates
First Submitted
June 10, 2024
First Submitted That Met QC Criteria
June 10, 2024
First Posted (Actual)
June 14, 2024
Study Record Updates
Last Update Posted (Actual)
April 29, 2026
Last Update Submitted That Met QC Criteria
April 23, 2026
Last Verified
April 1, 2026
More Information
Terms related to this study
Keywords
Other Study ID Numbers
- 75964
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
NO
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
No
Studies a U.S. FDA-regulated device product
No
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.