ChatGPT v.s. Human in Writing a Preoperative Visit Sheet

July 11, 2023 updated by: Boston Intelligent Medical Research Center, Shenzhen United Scheme Technology Co., Ltd.

Using Natural Language Processing Models for Writing Preoperative Visit Sheets: a Preliminary Study Comparing ChatGPT and Clinicians

The goal of this study is to evaluate the performance of large language models i.e. ChatGPT, in making preoperative visit sheets using clinical records. The main questions it aims to answer are:

  • Can large language models read clinical records and make preoperative visit sheets same as physicians?
  • Can physicians distinguish preoperative visit sheets made by physicians and models?

Participants' records will be generated using ChatGPT-4, and read by both ChatGPT-4 and physicians to make 2 separate preoperative visit sheets, and form 2 groups, GPT group and physician group respectively.

A group of professionals will compare result of above mentioned 2 groups to see if ChatGPT can afford to write preoperative visit sheets.

Study Overview

Status

Not yet recruiting

Conditions

Intervention / Treatment

Study Type

Observational

Enrollment (Estimated)

120

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Child
  • Adult
  • Older Adult

Accepts Healthy Volunteers

No

Sampling Method

Probability Sample

Study Population

No restictions are applied to population.

Description

Inclusion Criteria:

  • Any as records are generated using ChatGPT-4.

Exclusion Criteria:

  • Any as records are generated using ChatGPT-4.

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

Cohorts and Interventions

Group / Cohort
Intervention / Treatment
Control
Other: Clinician
Subjects' clinical records will be read by clinicians to write preoperative visit sheets.
Experiment
Other: ChatGPT-4
Subjects' clinical records will be read by ChatGPT-4 to write preoperative visit sheets.

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Familiarity to human writing
Time Frame: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
Based on professionals' subjective evaluation, familiarity is a binary result indicating weather professionals think the preoperative visit sheet was written by physicians or ChatGPT, where 0 indicates "not written by human" and 1 indicates "written by human".
Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
Satisfaction for clinical use
Time Frame: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
A grading score of 1-10 indicating weather the professionals think the preoperative visit sheet is suitable in clinical use.
Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Boston Intelligent Medical Research Center, Shenzhen United Scheme Technology Co., Ltd.

Collaborators

Tsinghua University

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Estimated)

August 1, 2023

Primary Completion (Estimated)

August 15, 2023

Study Completion (Estimated)

September 1, 2023

Study Registration Dates

First Submitted

June 30, 2023

First Submitted That Met QC Criteria

July 11, 2023

First Posted (Actual)

July 14, 2023

Study Record Updates

Last Update Posted (Actual)

July 14, 2023

Last Update Submitted That Met QC Criteria

July 11, 2023

Last Verified

July 1, 2023

More Information

Terms related to this study

Other Study ID Numbers

  • US2023002

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Preoperative Care

Clinical Trials on ChatGPT-4

Search Similar Trials

Sponsors and Collaborators

Medical Conditions

Drug Interventions

CROs by country

CROs in Vietnam

Conditions

Rare Diseases

Drug Interventions

Dietary Supplements

Sponsor/Collaborators

Locations

Subscribe