Operant Conditioning for Neuromodulation

Operant Conditioning of Spinal Reflexes and Motor Evoked Potentials

Emerging evidence demonstrates that animals and people can exert control over the level of excitability in spinal and corticospinal neural circuits that contribute to movement. This discovery has important implications, as it represents a new strategy to improve motor control in people of all ability levels, including those with neurological conditions. Operant conditioning is a well-studied mechanism of learning, in which the modification of a behavior can be brought about by the consequence of the behavior, and reinforcement causes behaviors to become more frequent. In recent years, operant conditioning has been applied to spinally-mediated reflex responses in mice, rats, monkeys and people. By electrically stimulating a peripheral nerve, recording the muscle response, and rewarding responses that are within a desirable range, it is possible to increase or decrease the neural circuit's excitability. This may alter the level of resting muscle tone and spasticity, as well the muscle's contribution to planned movements and responses to unexpected events. Operant conditioning of spinal reflexes has been applied to a lower limb muscle in healthy people and those with spinal cord injuries. In this project, we will expand the use of operant conditioning to muscles of the upper limb, demonstrating feasibility and efficacy in healthy people and people post-stroke. We will determine whether operant conditioning can be used to decrease excitability of spinal reflexes that activate a wrist flexor muscle. Additionally, in a separate group of healthy people, we will determine whether operant conditioning can be used in a similar way to increase corticospinal excitability. We will stimulate the motor cortex with transcranial magnetic stimulation to elicit motor evoked potentials in the same wrist flexor muscle, and will reward responses that exceed a threshold value. We will examine the effects of these interventions on motor control at the wrist, using an innovative custom-designed cursor-tracking task to quantify movement performance. We will determine whether changes in spinal reflex excitability or corticospinal excitability alter motor control. The overall goal of this research is to develop a new, evidence-based strategy for rehabilitation that will improve recovery of upper limb function in people after stroke.

Study Overview

• Status: Recruiting
• Conditions: Stroke; Healthy
• Intervention / Treatment: Other: Operant conditioning of H-reflexes; Other: Operant conditioning of motor evoked potentials

Detailed Description

The purpose of this study is to investigate neuromodulation as new approach to enhance rehabilitation for people who have upper limb movement impairment after neurological injury such as stroke or spinal cord injury. Emerging evidence demonstrates that animals and people can exert control over the level of excitability in neural pathways that contribute to movement. This discovery has important implications, as it represents a new strategy to improve motor control in people of all ability levels, including those with neurological conditions. Operant conditioning is a well-studied mechanism of learning, in which the modification of a behavior can be brought about by the consequence of the behavior. Behaviors that are rewarded with positive reinforcement are displayed more frequently. In recent years, operant conditioning has been applied to spinal reflex responses in mice, rats, monkeys and people. Evidence suggests that it is possible to increase or decrease a neural circuit's excitability, by electrically stimulating a nerve or an area of the brain, then recording the muscle response and rewarding responses that are within a desirable range. This may alter the level of resting muscle tone, as well the muscle's contribution to intentional movements and its readiness to respond to unexpected perturbations. To date, only one research group has applied operant conditioning to improve motor performance in people. Their work has focused on modifying spinal reflexes for a lower limb muscle and the effects on walking. In the proposed project, we will expand the use of operant conditioning to muscles of the upper limb and to people with movement impairment following stroke and spinal cord injury, and to another neural pathway in addition to the spinal reflex.

This study will include procedures necessary to measure excitability of the nervous system at the level of the spinal cord and at the level of the brain. Spinal reflex excitability will be quantified by electrically stimulating a peripheral nerve and recording the muscle response (ie. the H-reflex) with electromyography. Excitability of the motor pathway from brain to muscle (the corticospinal tract) will be quantified by stimulating a specific area of the brain (the motor cortex) with transcranial magnetic stimulation, and recording the muscle response (ie. The motor evoked potential) with electromyography. In addition, upper limb movement impairment will be assessed by measuring muscle tone, sensation, ability to generate force, and performance on a computer-based wrist motor control task. In subjects who have neurological conditions, upper limb function will be assessed using standardized tests, including the Fugl-Meyer a assessment of the Upper Extremity, the Action Research Arm Test, and the Box and Blocks Test. This study will test the effectiveness of operant conditioning as an intervention to modify neural excitability. After baseline testing, subjects will participate in up to 12 sessions of sham intervention followed by up to 24 sessions of real operant conditioning intervention. Each session will include 225 trials (3 sets of 75), lasting about 30 minutes. For each trial during real intervention, a stimulus will be delivered while the subject maintains a low level muscle contraction, the muscle's response to stimulation will be recorded, and immediate feedback will be displayed on a computer screen, showing the subject whether their muscle response was within the desired range or not. For example, a green bar will appear if the muscle response was 'good', otherwise a red bar will appear. The subject's 'percent success' also will be displayed and updated after each trial. During sham intervention, all procedures will be identical except that no feedback will be provided to the subject, and there will be no instructions to either increase or decrease their muscle responses.

In healthy people, we will aim to shift spinal reflex excitability (H-reflexes) of an upper extremity muscle either upward or downward, expanding on previous findings showing those effects in a lower limb muscle, with no effect on normal movement ability (Thompson et al., 2009, Makihara et al., 2014). Also in healthy people, we will aim to shift excitability of the pathway from brain to muscle either upward or downward, using operant conditioning of motor evoked potentials. Only one prior study (Majid et al., 2015) has demonstrated a downward shift, and the first studies investigating the ability to increase motor evoked potentials currently are in progress. People with neurological conditions often have abnormally increased spinal reflex excitability affecting certain muscles, resulting in increased tone, stiffness, and difficulty moving. Therefore, we will aim to reduce spinal reflex excitability in over-active muscles, by eliciting H-reflexes and rewarding responses that are below a threshold. In addition, people with neurological conditions often have disrupted connections from brain to muscle, resulting in weakness (diminished ability to generate force). Therefore, we will aim to increase excitability of the pathway from brain to muscle, by eliciting motor evoked potentials and rewarding responses that are above a threshold.

• Study Type: Interventional
• Enrollment (Estimated): 60
• Phase: Not Applicable

Contacts and Locations

• Study Contact: Name: Stacey L DeJong, PhD, PT; Phone Number: 319-335-6842; Email: stacey-dejong@uiowa.edu
• Study Contact Backup: Name: Kim A Streeby; Phone Number: 319-384-4735; Email: kimberly-streeby@uiowa.edu

Study Locations

• United States
  • Iowa
    • Iowa City, Iowa, United States, 52242
      • Recruiting
      • University of Iowa
      • Contact: Stacey L DeJong, PhD, PT; Phone Number: 319-335-6842; Email: stacey-dejong@uiowa.edu
      • Contact: Kim A Streeby; Phone Number: 319-384-4735; Email: kimberly-streeby@uiowa.edu
      • Principal Investigator: Stacey L DeJong, PhD, PT

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 21 years to 90 years (Adult, Older Adult)
• Accepts Healthy Volunteers: Yes

Description

Inclusion Criteria for Healthy Group:

• Able and willing to provide informed consent
• Normal function of both upper extremities
• Generally in good health

Exclusion Criteria for Healthy Group:

• Any self-reported disease or disorder that might affect this study, including neurologic, psychiatric, muscular, orthopedic, cardiac, vascular, pulmonary, hematologic, infectious, immune, gastrointestinal, urogenital, integumentary, oncologic, or endocrine conditions
• Any self-reported or demonstrated loss of sensation, passive range of motion, or motor function affecting any part of the upper limb on either side

Inclusion Criteria for Stroke Group:

• Able and willing to provide informed consent
• Subcortical ischemic stroke OR incomplete spinal cord injury, diagnosed by a neurologist at least 3 months before enrollment
• Upper limb sensorimotor impairment on one or both sides, as indicated by a score of 10 to 56 out of 66 points on the Fugl-Meyer Assessment of the Upper Extremity
• Cognitive ability that is normal or only mildly impaired, as indicated by a score of 9 or less on the Short Blessed Test
• Normal receptive and expressive language abilities, as indicated by a score of 0 on the Best Language item of the National Institutes of Health Stroke Scale

Exclusion Criteria for Stroke Group:

• Any self-reported or medically documented disease or disorder that might affect this study, including other neurologic conditions besides stroke or spinal cord injury, psychiatric, muscular, orthopedic, cardiac, vascular, pulmonary, hematologic, infectious, immune, gastrointestinal, urogenital, integumentary, oncologic, or endocrine conditions
• Diagnosis of hemorrhagic stroke or hemorrhagic conversion
• Diagnosis of an infarct affecting the motor cortex

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Basic Science
• Allocation: Non-Randomized
• Interventional Model: Parallel Assignment
• Masking: None (Open Label)

Number of Arms

4

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: H-reflex conditioning - Healthy; Operant conditioning of H-reflexes in healthy volunteers	Other: Operant conditioning of H-reflexes; Spinal reflex responses will be elicited in a wrist flexor muscle using a peripheral nerve stimulator. During training trials, the size of the participant's response will be shown on a screen and the participant will be asked to decrease the size of the H-reflex response over successive trials. Responses that are below a threshold will be rewarded and those above will not.
Experimental: H-reflex conditioning - Stroke; Operant conditioning of H-reflexes in people post-stroke	Other: Operant conditioning of H-reflexes; Spinal reflex responses will be elicited in a wrist flexor muscle using a peripheral nerve stimulator. During training trials, the size of the participant's response will be shown on a screen and the participant will be asked to decrease the size of the H-reflex response over successive trials. Responses that are below a threshold will be rewarded and those above will not.
Experimental: MEP conditioning - Healthy; Operant conditioning of motor evoked potentials in healthy volunteers	Other: Operant conditioning of motor evoked potentials; Motor evoked potentials will be elicited in a wrist flexor muscle using transcranial magnetic stimulation. During training trials, the size of the participant's response will be shown on a screen and the participant will be asked to increase the size of the MEP response over successive trials. Responses that are above a threshold will be rewarded and those below will not.
Experimental: MEP conditioning - Stroke; Operant conditioning of motor evoked potentials in people post-stroke	Other: Operant conditioning of motor evoked potentials; Motor evoked potentials will be elicited in a wrist flexor muscle using transcranial magnetic stimulation. During training trials, the size of the participant's response will be shown on a screen and the participant will be asked to increase the size of the MEP response over successive trials. Responses that are above a threshold will be rewarded and those below will not.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Maximum H-reflex amplitude of target muscle (wrist flexor)	After operant conditioning of H-reflexes, the pre-training vs post-training change in the maximum H-reflex, identified using recruitment curves, will be the primary outcome measure.	baseline, before and after up to 8 weeks of operant conditioning and follow up 3 months later
Motor evoked potential amplitude of target muscle (wrist flexor)	After operant conditioning of motor evoked potentials, the pre-training vs post-training change in the MEP amplitude for the target muscle will be the primary outcome measure. Stimulus intensity will be kept constant during pre and post testing (e.g. 110% of the baseline resting motor threshold).	baseline, before and after up to 8 weeks of operant conditioning and follow up 3 months later

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Maximum H-reflex amplitude of an antagonist muscle (wrist extensor)	pre-training vs post-training change in the maximum H-reflex of the antagonist muscle, identified using recruitment curves	baseline, before and after up to 8 weeks of operant conditioning and follow up 3 months later
Motor evoked potential amplitude of an antagonist muscle (wrist extensor)	Pre-training vs post-training change in the motor evoked potential amplitude for the antagonist muscle.	baseline, before and after up to 8 weeks of operant conditioning and follow up 3 months later
Wrist motor control total error score	Wrist motor control will be assessed using a novel instrumented device and a computer-based force-tracking task that requires a high level of precise motor control at the wrist.	baseline, before and after up to 8 weeks of operant conditioning and follow up 3 months later
Maximum voluntary isometric contraction	Maximum wrist flexion force production	baseline, before and after up to 8 weeks of operant conditioning and follow up 3 months later
Action Research Arm Test	For participants with stroke only, this standardized test will be used to quantify upper limb function.	baseline, before and after up to 8 weeks of operant conditioning and follow up 3 months later
Fugl-Meyer Assessment of the Upper Extremity	For participants with stroke only, this standardized test will be used to quantify upper limb impairment.	baseline, before and after up to 8 weeks of operant conditioning and follow up 3 months later

Collaborators and Investigators

• Sponsor: Stacey Dejong
• Collaborators: National Center of Neuromodulation for Rehabilitation; Roy J. Carver Charitable Trust
• Investigators: Principal Investigator: Stacey L DeJong, PhD, PT, University of Iowa

Publications and helpful links

General Publications

• Carp JS, Tennissen AM, Chen XY, Wolpaw JR. H-reflex operant conditioning in mice. J Neurophysiol. 2006 Oct;96(4):1718-27. doi: 10.1152/jn.00470.2006. Epub 2006 Jul 12.
• Chen Y, Chen L, Wang Y, Wolpaw JR, Chen XY. Persistent beneficial impact of H-reflex conditioning in spinal cord-injured rats. J Neurophysiol. 2014 Nov 15;112(10):2374-81. doi: 10.1152/jn.00422.2014. Epub 2014 Aug 20.
• Majid DS, Lewis C, Aron AR. Training voluntary motor suppression with real-time feedback of motor evoked potentials. J Neurophysiol. 2015 May 1;113(9):3446-52. doi: 10.1152/jn.00992.2014. Epub 2015 Mar 4.
• Makihara Y, Segal RL, Wolpaw JR, Thompson AK. Operant conditioning of the soleus H-reflex does not induce long-term changes in the gastrocnemius H-reflexes and does not disturb normal locomotion in humans. J Neurophysiol. 2014 Sep 15;112(6):1439-46. doi: 10.1152/jn.00225.2014. Epub 2014 Jun 18.
• Thompson AK, Chen XY, Wolpaw JR. Acquisition of a simple motor skill: task-dependent adaptation plus long-term change in the human soleus H-reflex. J Neurosci. 2009 May 6;29(18):5784-92. doi: 10.1523/JNEUROSCI.4326-08.2009.
• Thompson AK, Pomerantz FR, Wolpaw JR. Operant conditioning of a spinal reflex can improve locomotion after spinal cord injury in humans. J Neurosci. 2013 Feb 6;33(6):2365-75. doi: 10.1523/JNEUROSCI.3968-12.2013.

Study record dates

Study Major Dates

• Study Start (Actual): June 8, 2018
• Primary Completion (Estimated): June 30, 2024
• Study Completion (Estimated): June 30, 2024

Study Registration Dates

• First Submitted: March 4, 2018
• First Submitted That Met QC Criteria: March 4, 2018
• First Posted (Actual): March 9, 2018

Study Record Updates

• Last Update Posted (Estimated): January 18, 2024
• Last Update Submitted That Met QC Criteria: January 17, 2024
• Last Verified: January 1, 2024

More Information

Terms related to this study

• Keywords: motor control; transcranial magnetic stimulation; H-reflex; motor evoked potential; operant conditioning
• Other Study ID Numbers: 201712733

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No