ChatGPT v.s. Human in Writing a Preoperative Visit Sheet
July 11, 2023 updated by: Boston Intelligent Medical Research Center, Shenzhen United Scheme Technology Co., Ltd.
Using Natural Language Processing Models for Writing Preoperative Visit Sheets: a Preliminary Study Comparing ChatGPT and Clinicians
The goal of this study is to evaluate the performance of large language models i.e. ChatGPT, in making preoperative visit sheets using clinical records. The main questions it aims to answer are:
- Can large language models read clinical records and make preoperative visit sheets same as physicians?
- Can physicians distinguish preoperative visit sheets made by physicians and models?
Participants' records will be generated using ChatGPT-4, and read by both ChatGPT-4 and physicians to make 2 separate preoperative visit sheets, and form 2 groups, GPT group and physician group respectively.
A group of professionals will compare result of above mentioned 2 groups to see if ChatGPT can afford to write preoperative visit sheets.
Study Overview
Status
Not yet recruiting
Conditions
Intervention / Treatment
Study Type
Observational
Enrollment (Estimated)
120
Participation Criteria
Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.
Eligibility Criteria
Ages Eligible for Study
- Child
- Adult
- Older Adult
Accepts Healthy Volunteers
No
Sampling Method
Probability Sample
Study Population
No restictions are applied to population.
Description
Inclusion Criteria:
- Any as records are generated using ChatGPT-4.
Exclusion Criteria:
- Any as records are generated using ChatGPT-4.
Study Plan
This section provides details of the study plan, including how the study is designed and what the study is measuring.
How is the study designed?
Design Details
Cohorts and Interventions
Group / Cohort |
Intervention / Treatment |
|---|---|
|
Control
|
Subjects' clinical records will be read by clinicians to write preoperative visit sheets.
|
|
Experiment
|
Subjects' clinical records will be read by ChatGPT-4 to write preoperative visit sheets.
|
What is the study measuring?
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Familiarity to human writing
Time Frame: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
|
Based on professionals' subjective evaluation, familiarity is a binary result indicating weather professionals think the preoperative visit sheet was written by physicians or ChatGPT, where 0 indicates "not written by human" and 1 indicates "written by human".
|
Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
|
|
Satisfaction for clinical use
Time Frame: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
|
A grading score of 1-10 indicating weather the professionals think the preoperative visit sheet is suitable in clinical use.
|
Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
|
Collaborators and Investigators
This is where you will find people and organizations involved with this study.
Study record dates
These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.
Study Major Dates
Study Start (Estimated)
August 1, 2023
Primary Completion (Estimated)
August 15, 2023
Study Completion (Estimated)
September 1, 2023
Study Registration Dates
First Submitted
June 30, 2023
First Submitted That Met QC Criteria
July 11, 2023
First Posted (Actual)
July 14, 2023
Study Record Updates
Last Update Posted (Actual)
July 14, 2023
Last Update Submitted That Met QC Criteria
July 11, 2023
Last Verified
July 1, 2023
More Information
Terms related to this study
Other Study ID Numbers
- US2023002
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
No
Studies a U.S. FDA-regulated device product
No
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.