ChatGPT Versus Physical Medicine and Rehabilitation Residents

January 14, 2025 updated by: Selda Çiftci, Sisli Hamidiye Etfal Training and Research Hospital

Can Artificial Intelligence Take Place of Physical Medicine and Rehabilitation Physicians?: ChatGPT Versus Physical Medicine and Rehabilitation Residents

The aim of this study was to assess the performance of ChatGPT on examinations administered to physical medicine and rehabilitation (PMR) residents.

Study Overview

Status

Completed

Conditions

Intervention / Treatment

Detailed Description

These exams for resident physicians are annual exams administered throughout the training period, which constitute a fundamental component of the training process towards becoming a PMR physician. In this study, we evaluated the performance of ChatGPT in these exams, made separate assessments for each training year, and compared the results of ChatGPT with the results of residents who passed the same exam.

Study Type

Observational

Enrollment (Actual)

314

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

  • Turkey
    • Sarıyer
      • İstanbul, Sarıyer, Turkey
        • Sisli Hamidiye Etfal Training and Research Hospital

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Child
  • Adult
  • Older Adult

Accepts Healthy Volunteers

No

Sampling Method

Non-Probability Sample

Study Population

The study used exam questions taken by the majority of residents enrolled in the PMR specialization training program held throughout Turkey in May 2024. These exam questions were selected from a pool of questions developed by lecturers affiliated with the PMR departments of hospitals affiliated with the University of Health Sciences. The exam questions were structured to cover four different difficulty levels.

Description

Inclusion Criteria:

  • Physical medicine and rehabilitation residents exam results in May 2024

Exclusion Criteria:

-

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

Cohorts and Interventions

Group / Cohort
Intervention / Treatment
Physical medicine and rehabilitation residents
The residents enrolled in the PMR specialization training program held throughout Turkey in May 2024
Other: resident exam
Resident exam in May 2024.
ChatGPT
A new user was created for the free version of the ChatGPT-4o application, and a series of questions belonging to four distinct education levels were posed to it, one by one. For each question, ChatGPT was instructed to select only one option out of five.
Other: resident exam
Resident exam in May 2024.

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
The comparison of resident exam results and ChatGPT answers to the same questions
Time Frame: through study completion, an average of 10 days
In May 2024, the exam results of residents in training and research hospitals affiliated with the Health Sciences University across Türkiye will be compared with the answers and rankings given by ChatGPT to the same questions. ChatGPT accuracy rate and response time to questions will be determined. The minimum score to be obtained from this exam is 0 and the maximum score is 100.
through study completion, an average of 10 days

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Sisli Hamidiye Etfal Training and Research Hospital

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

January 1, 2025

Primary Completion (Actual)

January 10, 2025

Study Completion (Actual)

January 10, 2025

Study Registration Dates

First Submitted

January 2, 2025

First Submitted That Met QC Criteria

January 14, 2025

First Posted (Actual)

March 25, 2025

Study Record Updates

Last Update Posted (Actual)

March 25, 2025

Last Update Submitted That Met QC Criteria

January 14, 2025

Last Verified

January 1, 2025

More Information

Terms related to this study

Keywords

Other Study ID Numbers

  • 31.12.2024-2873

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

UNDECIDED

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

product manufactured in and exported from the U.S.

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Resident Education

Clinical Trials on resident exam

Search Similar Trials

Sponsors and Collaborators

Medical Conditions

Drug Interventions

CROs by country

CROs in Tunisia

Conditions

Rare Diseases

Drug Interventions

Dietary Supplements

Sponsor/Collaborators

Locations

Subscribe