Evaluation of Vision-Guided Shared Control for Assistive Robotics Manipulators (ARM Control)

Development of Vision-Guided Shared Control for Assistive Robotic Manipulators

The purpose of this study is to evaluate a new control (i.e., the vision-guided shared control) for a wheelchair-mounted assistive robotic manipulator among powered wheelchair users. This study will consist of a questionnaire about general demographics, health information, and previous experience with assistive technology. Several tests will also be administered to test upper extremity function and ability as well as to test spatial orientation and visualization ability. Participants till then undergo a training phase with the assistive robotic manipulator mounted on a table to assess if they will be eligible for participation in the study. Eligible participants will move on to a second training phase where they will be asked to learn and practice slightly more complex tasks while using the vision-guided shared controller. After this training the assistive robotic manipulator will be mounted to the participants wheelchair and they will be asked to complete a number of everyday tasks from a task list. At the conclusion of the study, researchers will conduct a brief semi-structured interview with each participant and obtain more insight on how participants perceive the ease-of-use and usefulness of the vision-guided shared control.

Study Overview

• Status: Recruiting
• Conditions: Spinal Cord Injury/Disorder
• Intervention / Treatment: Device: Compare two control methods for a wheelchair-mounted robotic manipulator

Detailed Description

Veterans who use powered mobility devices including those with high-level spinal cord injury (SCI), amyotrophic lateral sclerosis (ALS), and multiple sclerosis (MS) often experience serious upper extremity impairments. Management and care of upper extremity impairments often involve a range of assistive solutions. However, product availability and technological advancement for manipulation assistance fall far behind those for mobility. Many of these individuals, despite their independent mobility, cannot reach for a glass of water, make a simple meal, and pick up a tooth brush. They still require assistance from a personal caregiver for essential activities of daily living (ADLs) involving reaching and object handling/manipulation. With the rapid advancement of robotics technology, assistive robotic manipulators (ARMs) emerge as a viable solution for assisting Veterans with upper extremity impairments to complete daily tasks involving reaching, object handling, and manipulation. ARMs are often equipped with many degrees of freedom (DOF), but users cannot control all of the DOFs at the same time with a conventional joystick, and need to switch modes quite often to complete even simple manipulation tasks, especially when an ARM gets close to the target and need to be aligned appropriately for manipulation. Thus existing ARMs suffer from the lack of efficiency and effectiveness especially in an unstructured environment. The goal of this project is to combine vision-guided shared (VGS) control with two types of environment modifications to address the effectiveness and efficiency of ARMs for real-world use. The two types of environment modifications include using commercial or custom adaptive tools (e.g., a holder that can hold a bottle or jar so an ARM can open it), and adding fiducial markers (similar to QR codes) to objects or adaptive tools to make vision-based tracking robust and reliable for real-world applications. Built upon the environment modifications, the VGS control will allow a user to initiate any task by moving an ARM close to a tagged object, and the ARM to take over fine manipulation upon detecting the target. This project is to evaluate the new control among 16 powered wheelchair users who will use a wheelchair-mounted ARM to complete a set of everyday manipulation tasks. Participants will complete a set of 10 manipulation tasks using the default control method and the new VGS control method. Researchers will collect outcome measures in terms of efficiency (i.e., task completion time and mode switching frequency), effectiveness (i.e., task completion success rate), and usability (i.e., NASA Task Load Index, and System Usability Scale). Investigators expect to improve manipulation functions of Veterans with upper limb impairments through a more practical and usable implementation of vision-based robotic control and human-robot interaction technologies.

• Study Type: Interventional
• Enrollment (Anticipated): 16
• Phase: Not Applicable

Contacts and Locations

• Study Contact: Name: Dan Ding, PhD; Phone Number: (412) 688-6000; Email: dad5@pitt.edu
• Study Contact Backup: Name: Rory A Cooper, PhD; Phone Number: (412) 365-4850; Email: rcooper@pitt.edu

Study Locations

• United States
  • Pennsylvania
    • Pittsburgh, Pennsylvania, United States, 15240
      • Recruiting
      • VA Pittsburgh Healthcare System University Drive Division, Pittsburgh, PA
      • Contact: Andrea M Bagay; Phone Number: (412) 822-3661; Email: Andrea.Bagay@va.gov
      • Principal Investigator: Dan Ding, PhD
      • Contact: Dan Ding, PhD; Phone Number: 412-688-6000; Email: dad5@pitt.edu

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 18 years and older (Adult, Older Adult)
• Accepts Healthy Volunteers: No

Description

Inclusion Criteria:

• 18 years of age and older
• using a power wheelchair as primary means of mobility
• having self reported difficulties in performing everyday manipulation tasks such as reaching for a glass of water, opening a refrigerator, and picking up a toothbrush

Exclusion Criteria:

• people with impaired vision
• people with pressure ulcers that prevent them from sitting continuously for an extended period of time

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Other
• Allocation: Randomized
• Interventional Model: Crossover Assignment
• Masking: None (Open Label)

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Vision-guided control; New custom control method	Device: Compare two control methods for a wheelchair-mounted robotic manipulator; Participants will pay one visit to the lab where they will be asked to complete a set of manipulation tasks using a wheelchair-mounted robotic manipulator using the new custom vision-guided control and default joystick or switch control. The sequence of the two control methods will be counterbalanced.
Experimental: Default control; Default control method (joystick or switch)	Device: Compare two control methods for a wheelchair-mounted robotic manipulator; Participants will pay one visit to the lab where they will be asked to complete a set of manipulation tasks using a wheelchair-mounted robotic manipulator using the new custom vision-guided control and default joystick or switch control. The sequence of the two control methods will be counterbalanced.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Task completion time	The time it takes to complete each task successfully. Average time will be calculated over the total number of tasks selected by the participants.	After participants complete each task using each control method during the lab visit (which lasts about three hours for each control method)
Mode Switching Frequency	The number of times a participant has to switch modes for task completion based on logged control commands. The average number of times will be calculated over the total number of tasks selected by the participants.	After participants complete each task using each control method during the lab visit (which lasts about three hours for each control method)
Success rate	The number of tasks that can be completed successfully within the maximum assigned time over the total number of tasks selected by the participants.	After participants complete all tasks using each control method during the lab visit (which lasts about three hours for each control method)

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
NASA Task Load Index (TLX)	NASA TLX is to assess the subjective workload of participant after participants complete all the task using each control method. It consists of six dimensions: mental demands, physical demands, temporal demands, performance, effort and frustration. The score for each dimension ranges from 0 to 100 with a higher score indicating a higher workload. The overall task load index will be a weighted average of all six dimensions, where the weight for each dimension is obtained through pairwise comparisons of these dimensions.	After participants complete all tasks with each control method during the lab visit (which lasts about three hours for each control method)
System Usability Scale (SUS)	SUS is to collect perceived ease-of-use after each intervention. The SUS score ranges from 0 to 100 with a higher score indicating better usability and overall satisfaction.	After participants complete all tasks with each control method during the lab visit (which lasts about three hours for each control method)

Collaborators and Investigators

• Sponsor: VA Office of Research and Development
• Investigators: Principal Investigator: Dan Ding, PhD, VA Pittsburgh Healthcare System University Drive Division, Pittsburgh, PA

Study record dates

Study Major Dates

• Study Start (Actual): April 13, 2022
• Primary Completion (Anticipated): May 31, 2024
• Study Completion (Anticipated): June 30, 2024

Study Registration Dates

• First Submitted: March 18, 2020
• First Submitted That Met QC Criteria: March 24, 2020
• First Posted (Actual): March 26, 2020

Study Record Updates

• Last Update Posted (Actual): April 20, 2023
• Last Update Submitted That Met QC Criteria: April 19, 2023
• Last Verified: April 1, 2023

More Information

Terms related to this study

• Keywords: Activities of daily living; Assistive devices; Wheelchairs; Assistive robotic manipulators
• Additional Relevant MeSH Terms: Central Nervous System Diseases; Nervous System Diseases; Wounds and Injuries; Trauma, Nervous System; Spinal Cord Diseases; Spinal Cord Injuries
• Other Study ID Numbers: B3242-R

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: Yes
• product manufactured in and exported from the U.S.: No