Conversational AI Study
Conversational Artificial Intelligence Simulations to Improve Non-Technical Skills Among Anesthesiology Trainees: A Prospective, Mixed-Methods Study
Study Overview
Status
Status
Conditions
Conditions
Intervention / Treatment
Intervention / Treatment
Study Type
Study Type
Phase
Phase
- Not Applicable
Contacts and Locations
Study Contact
Study Contact
- Name: Thomas Caruso, MD, PhD
- Phone Number: 6282750341
- Email: tjcaruso@stanford.edu
Study Contact Backup
- Name: ManYee Suen, MMedSc
- Phone Number: 6282750341
- Email: smy822@stanford.edu
Participation Criteria
Eligibility Criteria
Eligibility Criteria
Ages Eligible for Study
- Adult
Accepts Healthy Volunteers
Description
Inclusion Criteria:
- Hospital providers, including nurses, physician assistants, physicians, physician trainees, and other healthcare workers at Lucile Packard Children's Hospital (LPCH) and affiliated facilities who communicate with patients daily will be included
Exclusion Criteria:
- Participants with reported severe motion sickness
- Nausea
- Seizure disorder
- Currently using chronotropic heart medications, such as β blockers
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Supportive Care
- Allocation: N/A
- Interventional Model: Single Group Assignment
- Masking: None (Open Label)
Number of Arms
Arms and Interventions
Participant Group / ArmParticipant Group / Arm |
Intervention / TreatmentIntervention / Treatment |
|---|---|
|
Experimental: AI Group
Participant will be using OpenAI's ChatGPT4o's application.
For the purposes of this medical error scenario, the CAI will have a standardized prompt to simulate an upset parent whose child recently had surgery in which there was a medical error involving a tooth injury from an intubation.
Following a scripted briefing, simulation will be initiated.
|
Use of Conversational Artificial Intelligence Simulations generate medical scenario.
|
What is the study measuring?
Primary Outcome Measures
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Evaluate acceptance of Conversational Artificial Intelligence Simulations using Guided Discussion Interview Question Guide
Time Frame: Before simulation
|
Guided Discussion Interview Question Guide contains 6 questions focusing 3 areas including Attitudes and Opinions, Perceptions and Summation question.
All the questions are open-ended questions.
|
Before simulation
|
Secondary Outcome Measures
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Evaluation of Conversational Artificial Intelligence Simulations usability via the System Usability Scale (SUS)
Time Frame: Immediately after simulation
|
Measured with the System Usability Scale (SUS).
The scale has 10 items.
Scores ranges from 1-5 (1 = strongly disagree and 5 = strongly agree)
|
Immediately after simulation
|
|
Evaluation of Conversational Artificial Intelligence Simulations usability via the User Experience Questionnaire (UEQ-S).
Time Frame: Immediately after simulation
|
UEQ-S, includes eight items (four from the pragmatic scales Efficiency, Perspicuity, Dependability, and four from the hedonic scales Stimulation and Novelty).
Scores range from -3 (min) to 3 (max)
|
Immediately after simulation
|
|
Evaluation of the reliability of AI quantitative assessment of non-technical performance compared to expert human assessors
Time Frame: immediately after simulation
|
The Anaesthetist Non-Technical Skills (ANTS) tool previously published by Fletcher et al. translated in French.
The ANTS scoring system uses four categories assessing task management, teamworking, situation awareness and decision-making (1 to 4 points by categories).
The minimum score is 4 and the maximum 16
|
immediately after simulation
|
Collaborators and Investigators
Sponsor
Sponsor
Study record dates
Study Major Dates
Study Start (Estimated)
Study Start
Primary Completion (Estimated)
Primary Completion
Study Completion (Estimated)
Study Completion
Study Registration Dates
First Submitted
First Submitted
First Submitted That Met QC Criteria
First Submitted That Met QC Criteria
First Posted (Actual)
First Posted
Study Record Updates
Last Update Posted (Actual)
Last Update Posted
Last Update Submitted That Met QC Criteria
Last Update Submitted That Met QC Criteria
Last Verified
Last Verified
More Information
Terms related to this study
Keywords
Other Study ID Numbers
Other Study ID Numbers
- 75964
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.