Comparing Physician and Artificial Intelligence Chatbot Responses to Frequently Asked Questions From Osteoarthritis Patients (PARTICIPATE)

October 1, 2025 updated by: Canisius-Wilhelmina Hospital

Comparing Physician and Artificial Intelligence Chatbot Responses to Frequently Asked Questions From Osteoarthritis Patients: a Prospective Cross-sectional Study

This study aimed to compare the patient acceptability (preference, length, and difficulty) and accuracy of Chat-Generative Pre-Trained Transformer (ChatGPT) responses to questions from people with osteoarthritis (OA) with physician responses.

Study Overview

Status

Completed

Conditions

Detailed Description

This was a cross-sectional study where participants were invited by e-mail to participate in the questionnaire to compare Chatbot responses to physician responses.

Study Type

Observational

Enrollment (Actual)

286

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

  • Netherlands
      • Nijmegen, Netherlands
        • Canisius Wilhelmina Hospital

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Child
  • Adult
  • Older Adult

Accepts Healthy Volunteers

No

Sampling Method

Non-Probability Sample

Study Population

There were two groups of participants: 1) a panel of people with OA evaluating the preference, length, and difficulty, and 2) a panel of experts in the field of OA evaluating the accuracy of the responses

Description

Inclusion Criteria:

  • all individuals visiting the Department of Orthopedics in the Canisius Wilhelmina Hospital, a district general hospital in Nijmegen, The Netherlands, diagnosed with knee or hip OA between March 2023 and March 2024

Exclusion Criteria:

  • partly completion of the questionnaire

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Preferred response
Time Frame: From invitation until the end of the study at two weeks
Binary outcome, chatbot or physician response. This was an average based on the preferences on the 7 FAQs.
From invitation until the end of the study at two weeks

Secondary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Rating of length
Time Frame: From invitation until the end of the study at two weeks
Rating of both responses (chatbot and physician response) included 'too short', 'good', and 'too long'.
From invitation until the end of the study at two weeks
Rating of difficulty
Time Frame: From invitation until the end of the study at two weeks
Rating of difficulty included 'too easy', 'good', and 'too difficult' for both responses.
From invitation until the end of the study at two weeks
Accuracy
Time Frame: From invitation until the end of the study at two weeks
Accuracy of the responses included the options 'Completely incorrect,' 'partly incorrect, ' 'approximately equally correct and incorrect,' 'mostly correct,' 'completely correct'.
From invitation until the end of the study at two weeks

Other Outcome Measures

Outcome Measure
Time Frame
Number of words of the responses
Time Frame: This was determined before the study started
This was determined before the study started

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Canisius-Wilhelmina Hospital

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

May 22, 2024

Primary Completion (Actual)

June 5, 2024

Study Completion (Actual)

June 5, 2024

Study Registration Dates

First Submitted

September 30, 2025

First Submitted That Met QC Criteria

September 30, 2025

First Posted (Estimated)

October 1, 2025

Study Record Updates

Last Update Posted (Estimated)

October 6, 2025

Last Update Submitted That Met QC Criteria

October 1, 2025

Last Verified

October 1, 2025

More Information

Terms related to this study

Keywords

Additional Relevant MeSH Terms

Other Study ID Numbers

  • 075-2023

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

UNDECIDED

IPD Plan Description

The dataset supporting the conclusions of this study is available from the corresponding author upon reasonable request.

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Accuracy

Search Similar Trials

Sponsors and Collaborators

Medical Conditions

Drug Interventions

CROs by country

CROs in Greece

Conditions

Rare Diseases

Drug Interventions

Dietary Supplements

Sponsor/Collaborators

Locations

Subscribe