Interpretation Performance in Chinese and Japanese Medical Consultation Scenarios

February 2, 2026 updated by: Ke-Yun, Chao, Fu Jen Catholic University

A Comparative Study of Interpretation Performance of ChatGPT, Google Translate, and UD Talk in Chinese and Japanese Medical Consultation Scenarios: Contexts of Cardiopulmonary Disease Consultation

This study aims to compare the translation and interpretation performance of ChatGPT, Google Translate(GT),and UD Talk in cardiopulmonary consultations and analyze their effectiveness in addressing language barriers.The investigators hypothesize that ChatGPT and UD Talk will outperform GT in terms of accuracy and error rates.

Study Overview

Status

Completed

Conditions

Intervention / Treatment

Detailed Description

Background： Language barriers in healthcare have a significant impact on patient safety, health outcomes, and the quality of healthcare services. With the increase in global migration, more patients are facing language challenges in foreign healthcare systems. Literature shows that providing professional interpretation services significantly improves patient satisfaction and communication quality. However, due to the high usage of ad-hoc interpreters and the shortage of professional interpreters, clinical communication quality has declined.

Study Design： This is a one-year, single-center, prospective observational study. Methods： The study will be conducted in the cardiology and pulmonology outpatient clinics at Fu Jen University Hospital. A total of 20 cardiopulmonary disease patients will be enrolled, withtheir consultation sessions recorded and transcribed into Chinese. The study will compare the three tools' performance in terms of semantic accuracy, error types, and severity, and analyze their feasibility in clinical practice. Further analysis will involve satisfaction surveys from both professional interpreters and non-native speakers living in Taiwan. The translation results will be evaluated for accuracy and error rates by 8 professional medical interpreters, with a satisfaction survey completed by a total of 14 non-experts. The evaluation tool will be based on the assessment rubrics from the National Accreditation Authority for Translators and Interpreters.

Effect： It is expected that ChatGPT and UD Talk will show better translation accuracy and interpretation quality compared to GT. UD Talk is anticipated to perform better than the other two tools in real-time interpretation. The study results will provide valuable insights for future medical interpretation training and clinical applications.

Study Type

Observational

Enrollment (Actual)

42

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

  • Taiwan
      • New Taipei City, Taiwan, 24352
        • Fu Jen Catholic University Hospital, Fu Jen Catholic University

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Adult
  • Older Adult

Accepts Healthy Volunteers

Yes

Sampling Method

Probability Sample

Study Population

First part

  • Patients visiting the Cardiology or Pulmonology Department

Second part

  • Has completed Japanese-Chinese medical interpretation training and has clinical experience

Third part

  • Non-native Chinese-speaking Japanese residents

Description

First part

Inclusion Criteria:

  • Age over 18 years
  • Patients visiting the Cardiology or Pulmonology Department at Fu Jen Catholic University Hospital from December 2024 to November 2025

Exclusion Criteria:

  • Patients unable to communicate effectively as assessed by the physician
  • Refusal to participate in the study

Second part

Inclusion Criteria:

  • Age over 18 years
  • Completed the Japanese-Chinese medical interpretation training course and has at least two years of clinical experience

Exclusion Criteria:

  • Refusal to participate in the study

Third part

Inclusion Criteria:

  • Age over 18 years
  • Non-native Chinese-speaking Japanese residents who have lived in Taiwan for at least two years

Exclusion Criteria:

  • Refusal to participate in the study

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Translation Assessment Scale Score
Time Frame: 4 months
6-point Likert scale, with 5 representing the highest score and 0 representing the lowest.
4 months

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Fu Jen Catholic University

Investigators

  • Principal Investigator: Ke-Yun Chao, PhD, Fu Jen Catholic University

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

April 10, 2025

Primary Completion (Actual)

November 18, 2025

Study Completion (Actual)

November 18, 2025

Study Registration Dates

First Submitted

March 31, 2025

First Submitted That Met QC Criteria

April 16, 2025

First Posted (Actual)

April 18, 2025

Study Record Updates

Last Update Posted (Actual)

February 4, 2026

Last Update Submitted That Met QC Criteria

February 2, 2026

Last Verified

February 1, 2026

More Information

Terms related to this study

Keywords

Additional Relevant MeSH Terms

Other Study ID Numbers

  • FJUH113419

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

NO

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

product manufactured in and exported from the U.S.

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Outpatients

Clinical Trials on translation software

Search Similar Trials

Sponsors and Collaborators

Medical Conditions

Drug Interventions

CROs by country

CROs in Kazakhstan

Conditions

Rare Diseases

Drug Interventions

Dietary Supplements

Sponsor/Collaborators

Locations

Subscribe