Utility of ChatGPT in Pre-vasectomy Counselling in an Office-based Setting

August 20, 2023 updated by: PremalPatel, University of Manitoba

Real World Utility of ChatGPT in Pre-vasectomy Counselling in an Office-based Setting

The investigators wish to perform a pilot study at the Manitoba Men's Health Clinic to assess if pre-vasectomy counseling with ChatGPT can safely streamline the consultation process by reducing visit times, while increasing patient satisfaction with the consultation process.

Study Overview

Status

Recruiting

Conditions

Intervention / Treatment

Detailed Description

The release of ChatGPT, a natural language AI chat bot, has recently captured the attention of the general public and medical professionals world-wide. ChatGPT is a conversational AI language model designed by OpenAI that utilizes deep learning techniques to generate human like responses to questions. There has been increasing interest among the medical community on developing new ways to harness this technology to aid medical professionals. New applications have included writing scientific manuscripts, drafting correspondents, as well as testing its ability on standardized medical licensing examinations. ChatGPT was able to perform at or near passing threshold on the United States Medical Licensing Exam (USMLE). Despite ChatGPT demonstrating good medical knowledge, it is still unclear if this translates to real world clinical practice.

Physician burnout is becoming an increasing problem. Per a recent Canadian Urologic Association (CUA) census, burnout was identified in 39% of urologists, with high number of patient visits/week to be cited as a predictor predictive of burnout. That begs the question, can ChatGPT be used for patient counseling and to improve patient flow in one's practice? ChatGPT has been shown to provide effective and safe responses to medical questions and even "curbside" consultations. However its ability to counsel patients in real time has not yet been studied.

As such, the investigators wish to perform a pilot study at the Manitoba Men's Health Clinic to assess if pre-vasectomy counseling with ChatGPT can safely streamline the consultation process by reducing visit times, while increasing patient satisfaction with the consultation process. If the hypothesis provides true, further implementation of ChatGPT in a healthcare practice may work to reduce the burden on health care providers.

There are no predicted adverse events of this study. There are no identified potential harms of this study.

Study Type

Interventional

Enrollment (Estimated)

40

Phase

  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Contact

Study Locations

  • Canada
    • Manitoba
      • Winnipeg, Manitoba, Canada, R3K 1M3
        • Recruiting
        • Men's Health Clinic Manitoba
        • Contact:

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Adult
  • Older Adult

Accepts Healthy Volunteers

Yes

Description

Inclusion Criteria:

  • Patients undergoing vasectomies interested in participating
  • Adult (>18 years old)
  • Consenting

Exclusion Criteria:

  • Do not consent, uninterested in participating

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: Health Services Research
  • Allocation: Non-Randomized
  • Interventional Model: Parallel Assignment
  • Masking: Single

Arms and Interventions

Participant Group / Arm
Intervention / Treatment
Experimental: Intervention arm - ChatGPT
Patient's interested in participating in the intervention group will be provided a secure ChatGPT account. They will have the opportunity to converse with ChatGPT to ask any potential questions they may have regarding their upcoming vasectomy. Patient's will then be seen for the standard pre-vasectomy consultation.
Other: ChatGPT Language Model
ChatGPT Language Model - ability to converse with the model and ask questions regarding vasectomies
No Intervention: Control arm - no ChatGPT
No intervention - standard of care

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Length of Consultation
Time Frame: Through study completion, estimated to be 2 months measured for each phone call
Length of pre-vasectomy consultation as measured from beginning to end of telephone call
Through study completion, estimated to be 2 months measured for each phone call
Number of questions asked
Time Frame: Through study completion, estimated to be 2 months measured for each phone call
Number of questions asked during pre-vasectomy consultation
Through study completion, estimated to be 2 months measured for each phone call
Satisfaction of patients assessed by Likert scale
Time Frame: Through study completion, estimated to be 2 months measured for each patient
Satisfaction of patients as measured by questionnaire with 10-point Likert Scale ([0-10] higher score correlates with higher satisfaction)
Through study completion, estimated to be 2 months measured for each patient

Secondary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Commonly asked questions
Time Frame: Through study completion period, estimated to be 2 months
Chat logs will be reviewed to examine common themes or questions and reported using descriptive statistics.
Through study completion period, estimated to be 2 months
Incidence of inaccurate ChatGPT responses
Time Frame: Through study completion period, estimated to be 2 months
ChatGPT responses will be reviewed by two licensed clinicians experienced in vasectomies to determine rates of inaccurate responses by the language models responses to patient questions. Incidence of inaccurate ChatGPT responses will be reported and through descriptive analysis this will be described and inaccurate responses will be conveyed.
Through study completion period, estimated to be 2 months

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

University of Manitoba

Investigators

  • Principal Investigator: Premal Patel, MD, Assistant Professor, Department of Surgery. Director, Undergraduate Urologic Medical Education

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Estimated)

August 30, 2023

Primary Completion (Estimated)

September 30, 2023

Study Completion (Estimated)

October 5, 2023

Study Registration Dates

First Submitted

June 19, 2023

First Submitted That Met QC Criteria

August 20, 2023

First Posted (Actual)

August 24, 2023

Study Record Updates

Last Update Posted (Actual)

August 24, 2023

Last Update Submitted That Met QC Criteria

August 20, 2023

Last Verified

August 1, 2023

More Information

Terms related to this study

Keywords

Other Study ID Numbers

  • HS25978 (H2023:136)

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

NO

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Contraception

Clinical Trials on ChatGPT Language Model

Search Similar Trials

Sponsors and Collaborators

Medical Conditions

Drug Interventions

CROs by country

CROs in Madagascar

Conditions

Rare Diseases

Drug Interventions

Dietary Supplements

Sponsor/Collaborators

Locations

Subscribe