Machine Vision Based MDS-UPDRS III Machine Rating

August 20, 2026 updated by: Ruijin Hospital

Machine Vision Based Machine Rating of MDS-UPDRS III

The Movement Disorders Society (MDS) Unified Parkinson's Disease Rating Scale (UPDRS) Part III (MDS-UPDRS III) is the primary assessment method for motor symptoms in Parkinson's disease patients. Currently, movement disorder specialists conduct semi-quantitative scoring, which entails limitations such as subjectivity, weak sensitivity, and a limited number of professional physicians. This study, based on machine vision, establishes gold standard labels according to expert scoring. By using machine learning, we develop a machine rating model and compare the model's performance with gold standard rating and general clinical rating to investigate the accuracy of machine vision-based MDS-UPDRS III machine rating.

Study Overview

Status

Status

Indicates the current recruitment status or the expanded access status.
Completed

Conditions

Conditions

The disease, disorder, syndrome, illness, or injury that is being studied. On ClinicalTrials.gov, conditions may also include other health-related issues, such as lifespan, quality of life, and health risks.

Intervention / Treatment

Intervention / Treatment

A process or action that is the focus of a clinical study. Interventions include drugs, medical devices, procedures, vaccines, and other products that are either investigational or already available. Interventions can also include noninvasive approaches, such as education or modifying diet and exercise.

Study Type

Study Type

Describes the nature of a clinical study. Study types include interventional studies (also called clinical trials), observational studies (including patient registries), and expanded access.
Observational

Enrollment (Actual)

Enrollment

The number of participants in a clinical study. The "anticipated" enrollment is the target number of participants that the researchers need for the study.
1679

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Contact

Study Contact

The name and contact information for the person who can answer enrollment questions for a clinical study. Each location where the study is being conducted may also have a specific contact, who may be better able to answer those questions.

Study Locations

  • China
    • Beijing Municipality
      • Beijing, Beijing Municipality, China, 100050
        • Center for Movement Disorders, Department of Neurology, Beijing Tiantan Hospital, Capital Medical University
      • Beijing, Beijing Municipality, China, 100730
        • Beijing Hospital, Neurology Department
    • Fujian
      • Fuzhou, Fujian, China, 350001
        • Department of Neurology, Fujian Medical University Union Hospital
    • Guangdong
      • Guangzhou, Guangdong, China, 510080
        • Department of Neurology, Guangdong Neuroscience Institute, Guangdong General Hospital, Guangdong Academy of Medical Sciences
    • Hubei
      • Wuhan, Hubei, China, 430022
        • Department of Neurology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology
    • Jiangsu
      • Suzhou, Jiangsu, China, 215004
        • Department of Neurology and Clinical Research Center of Neurological Disease, The Second Affiliated Hospital of Soochow University
    • Shanghai Municipality
      • Shanghai, Shanghai Municipality, China, 200025
        • Department of Neurology and Institute of Neurology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine
    • Sichuan
      • Chengdu, Sichuan, China, 610044
        • Department of Neurology, West China Hospital, Sichuan University

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Eligibility Criteria

The key requirements that people who want to participate in a clinical study must meet or the characteristics they must have. Eligibility criteria consist of both inclusion criteria (which are required for a person to participate in the study) and exclusion criteria (which prevent a person from participating). Types of eligibility criteria include whether a study accepts healthy volunteers, has age or age group requirements, or is limited by sex.

Ages Eligible for Study

  • Adult
  • Older Adult

Accepts Healthy Volunteers

No

Sampling Method

Probability Sample

Study Population

In this study, participants are mainly recruited from the Department of Neurology at Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, as well as from movement disorder clinics at 7 other centers. Participants are enrolled through outpatient assessment and screening. Two specialists in movement disorders independently diagnosed participants as having "Parkinsonism". In cases where there is a diagnostic disagreement, the Movement Disorder Specialist Group at the Department of Neurology, Ruijin Hospital collectively discusses and makes the decision.

Description

Inclusion Criteria:

  • Meeting the diagnostic criteria for Parkinsonism established by the International Movement Disorder Society: having bradykinesia, and meeting at least one of the two criteria for resting tremor or muscle rigidity
  • 20 to 80 years old
  • Good compliance, voluntarily joining the study, and able to sign an informed consent form or have it signed by a legal representative

Exclusion Criteria:

  • Significant cognitive impairment (MMSE ≤ 23)
  • Unable to sign written informed consent or unable to complete the trial due to other reasons
  • Other situations in which the researcher deems the participant unsuitable for this study
  • Participation in other clinical trials

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

What is the study measuring?

Primary Outcome Measures

Primary Outcome Measures

In a clinical study's protocol, the planned outcome measure that is the most important for evaluating the effect of an intervention/treatment. Most clinical studies have one primary outcome measure, but some have more than one.
Outcome Measure
Measure Description
Time Frame
Item-level: MAE
Time Frame: 1 day
At the item level, mean absolute error (MAE) between paired AI scores and consensus reference scores, calculated as the average absolute difference across items. Lower values indicate closer agreement.
1 day
Item-level: P(|Δ|≥2)
Time Frame: 1 day
At the item level, the proportion of paired AI and consensus reference scores with an absolute difference of 2 or more points. Lower values indicate fewer large item-level scoring disagreements.
1 day
Score-level: ICC
Time Frame: 1 day
Intraclass correlation coefficient (ICC) between AI-derived scores and consensus reference scores, calculated separately for each of the four subdomain scores and the total score. Higher ICC values indicate greater agreement.
1 day
Score-level: SEM
Time Frame: 1 day
Standard error of measurement (SEM) for AI-derived scores relative to consensus reference scores, calculated separately for each of the four subdomain scores and the total score. SEM quantifies measurement error in the units of the corresponding score, with lower values indicating greater measurement precision.
1 day
Score-level: SDC
Time Frame: 1 day
Smallest detectable change (SDC), derived from the measurement error and calculated separately for each of the four subdomain scores and the total score. SDC represents the minimum score change required to exceed expected measurement error. Lower values indicate greater measurement precision.
1 day

Secondary Outcome Measures

Secondary Outcome Measures

In a clinical study's protocol, a planned outcome measure that is not as important as the primary outcome measure for evaluating the effect of an intervention but is still of interest. Most clinical studies have more than one secondary outcome measure.
Outcome Measure
Measure Description
Time Frame
Item-level: Within-one agreement (ACC1; P(|Δ| ≤ 1))
Time Frame: 1 day
At the item level, ACC1 is defined as the proportion of paired AI and consensus reference scores with an absolute difference of no more than 1 point, i.e., P(|Δ| ≤ 1). Higher values indicate closer item-level agreement.
1 day
Item-level: Exact-error proportions [P(|Δ| = k)]
Time Frame: 1 day
At the item level, exact-error proportions, P(|Δ| = k), represent the proportions of paired AI and consensus reference scores with each exact absolute error magnitude k. In particular, P(|Δ| = 0) corresponds to exact-match accuracy (ACC), defined as the proportion of items for which the AI score exactly matches the consensus reference score. The remaining values of k characterize the distribution of item-level scoring errors.
1 day
Item-level: Per-class exact recall
Time Frame: 1 day
At the item level, for each consensus reference score class, the proportion of items for which the AI score exactly matches the consensus reference score among all items belonging to that reference class. Higher values indicate better class-specific exact agreement.
1 day
Item-level: Confusion matrix
Time Frame: 1 day
At the item level, a cross-tabulation of AI scores against consensus reference scores, showing the number of paired ratings for each combination of reference and AI score categories. Rows represent consensus reference scores and columns represent AI scores.
1 day
Item-level: Row-normalised confusion matrix
Time Frame: 1 day
At the item level, the confusion matrix normalised within each consensus reference score row so that each row sums to 1, showing the distribution of AI scores conditional on each reference score class.
1 day
Score-level: Limits of agreement
Time Frame: 1 day
Bland-Altman limits of agreement between AI-derived scores and consensus reference scores, calculated separately for each of the four subdomain scores and the total score. The limits characterize the range within which most paired differences between AI and reference scores are expected to fall.
1 day
Score-level: MAE
Time Frame: 1 day
Mean absolute error (MAE) between AI-derived scores and consensus reference scores, calculated separately for each of the four subdomain scores and the total score as the average absolute difference between paired scores. Lower values indicate smaller scoring errors.
1 day
Score-level: RMSE
Time Frame: 1 day
Root mean square error (RMSE) between AI-derived scores and consensus reference scores, calculated separately for each of the four subdomain scores and the total score. RMSE gives greater weight to larger scoring errors, with lower values indicating closer agreement.
1 day
Score-level: Spearman correlation
Time Frame: 1 day
Spearman rank correlation between AI-derived scores and consensus reference scores, calculated separately for each of the four subdomain scores and the total score. Higher values indicate a stronger monotonic association between AI-derived and reference scores.
1 day

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Sponsor

Sponsor

The organization or person who initiates the study and who has authority and control over the study.
Ruijin Hospital

Collaborators

Collaborators

An organization other than the sponsor that provides support for a clinical study. This support may include activities related to funding, design, implementation, data analysis, or reporting.
Beijing Tiantan Hospital
West China Hospital
Beijing Hospital
Guangdong Provincial People's Hospital
Fujian Medical University Union Hospital
Second Affiliated Hospital of Soochow University
Union Hospital, Tongji Medical College, Huazhong University of Science and Technology

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

Study Start

The actual date on which the first participant was enrolled in a clinical study. The "anticipated" study start date is the date that the researchers think will be the study start date.
March 1, 2023

Primary Completion (Actual)

Primary Completion

The date on which the last participant in a clinical study was examined or received an intervention to collect final data for the primary outcome measure. Whether the clinical study ended according to the protocol or was terminated does not affect this date. For clinical studies with more than one primary outcome measure with different completion dates, this term refers to the date on which data collection is completed for all the primary outcome measures. The "anticipated" primary completion date is the date that the researchers think will be the primary completion date for the study.
December 31, 2025

Study Completion (Actual)

Study Completion

The date on which the last participant in a clinical study was examined or received an intervention/treatment to collect final data for the primary outcome measures, secondary outcome measures, and adverse events (that is, the last participant's last visit). The "anticipated" study completion date is the date that the researchers think will be the study completion date.
December 31, 2025

Study Registration Dates

First Submitted

First Submitted

The date on which the study sponsor or investigator first submitted a study record to ClinicalTrials.gov. There is typically a delay of a few days between the first submitted date and the record's availability on ClinicalTrials.gov (the first posted date).
June 7, 2023

First Submitted That Met QC Criteria

First Submitted That Met QC Criteria

The date on which the study sponsor or investigator first submits a study record that is consistent with National Library of Medicine (NLM) quality control (QC) review criteria. The sponsor or investigator may need to revise and submit a study record one or more times before NLM's QC review criteria are met. It is the responsibility of the sponsor or investigator to ensure that the study record is consistent with the NLM QC review criteria.
June 7, 2023

First Posted (Actual)

First Posted

The date on which the study record was first available on ClinicalTrials.gov after National Library of Medicine (NLM) quality control (QC) review has concluded. There is typically a delay of a few days between the date the study sponsor or investigator submitted the study record and the first posted date.
June 18, 2023

Study Record Updates

Last Update Posted (Actual)

Last Update Posted

The most recent date on which changes to a study record were made available on ClinicalTrials.gov. There may be a delay between when the changes were submitted to ClinicalTrials.gov by the study's sponsor or investigator (the last update submitted date) and the last update posted date.
August 21, 2026

Last Update Submitted That Met QC Criteria

Last Update Submitted That Met QC Criteria

The most recent date on which the study sponsor or investigator submitted changes to a study record that are consistent with National Library of Medicine (NLM) quality control (QC) review criteria. It is the responsibility of the sponsor or investigator to ensure that the study record is consistent with the NLM QC review criteria.
August 20, 2026

Last Verified

Last Verified

The most recent date on which the study sponsor or investigator confirmed the information about a clinical study on ClinicalTrials.gov as accurate and current. If a study with a recruitment status of recruiting; not yet recruiting; or active, not recruiting has not been confirmed within the past 2 years, the study's recruitment status is shown as unknown.
August 1, 2026

More Information

Terms related to this study

Additional Relevant MeSH Terms

Other Study ID Numbers

Other Study ID Numbers

Identifiers or ID numbers other than the NCT number that are assigned to a clinical study by the study's sponsor, funders, or others. These numbers may include unique identifiers from other trial registries and National Institutes of Health grant numbers.
  • u3

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

NO

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Cookie Settings

We use cookies to ensure that we give you the best experience on our website. For more details carefully read our Privacy and Cookies Policy. ...>>>You can change your preferences or withdraw your consent at any time by deleting the cookies from your website or computer as described in the policy. Please accept it and choose your preferences by ticking the corresponding boxes in the "Manage Settings" section below. Please carefully read our Terms of Service before you proceed with using any part of this website.
«Manage Settings