Distinct effects of apathy and dopamine on effort-based decision-making in Parkinson's disease

Campbell Le Heron, Olivia Plant, Sanjay Manohar, Yuen-Siang Ang, Matthew Jackson, Graham Lennox, Michele T Hu, Masud Husain, Campbell Le Heron, Olivia Plant, Sanjay Manohar, Yuen-Siang Ang, Matthew Jackson, Graham Lennox, Michele T Hu, Masud Husain

Abstract

Effort-based decision-making is a cognitive process crucial to normal motivated behaviour. Apathy is a common and disabling complication of Parkinson's disease, but its aetiology remains unclear. Intriguingly, the neural substrates associated with apathy also subserve effort-based decision-making in animal models and humans. Furthermore, the dopaminergic system plays a core role in motivating effortful behaviour for reward, and its dysfunction has been proposed to play a crucial role in the aetiology of apathy in Parkinson's disease. We hypothesized that disrupted effort-based decision-making underlies the syndrome of apathy in Parkinson's disease, and that this disruption may be modulated by the dopaminergic system. An effort-based decision-making task was administered to 39 patients with Parkinson's disease, with and without clinical apathy, ON and OFF their normal dopaminergic medications across two separate sessions, as well as 32 healthy age- and gender-matched controls. On a trial-by-trial basis, participants decided whether to accept or reject offers of monetary reward in return for exerting different levels of physical effort via handheld, individually calibrated dynamometers. Effort and reward were manipulated independently, such that offers spanned the full range of effort/reward combinations. Apathy was assessed using the Lille apathy rating scale. Motor effects of the dopamine manipulation were assessed using the Unified Parkinson's Disease Rating Scale part three motor score. The primary outcome variable was choice (accept/decline offer) analysed using a hierarchical generalized linear mixed effects model, and the vigour of squeeze (Newtons exerted above required force). Both apathy and dopamine depletion were associated with reduced acceptance of offers. However, these effects were driven by dissociable patterns of responding. While apathy was characterized by increased rejection of predominantly low reward offers, dopamine increased responding to high effort, high reward offers, irrespective of underlying motivational state. Dopamine also exerted a main effect on motor vigour, increasing force production independently of reward offered, while apathy did not affect this measure. The findings demonstrate that disrupted effort-based decision-making underlies Parkinson's disease apathy, but in a manner distinct to that caused by dopamine depletion. Apathy is associated with reduced incentivization by the rewarding outcomes of actions. In contrast, dopamine has a general effect in motivating behaviour for high effort, high reward options without altering the response pattern that characterizes the apathetic state. Thus, the motivational deficit observed in Parkinson's disease appears not to be simply secondary to dopaminergic depletion of mesocorticolimbic pathways, suggesting non-dopaminergic therapeutic strategies for apathy may be important future targets.

Figures

Figure 1
Figure 1
Effort-based decision-making task. On a trial-by-trial basis, participants were presented with offers of a certain amount of reward (apples on an apple tree, with each apple worth 1p) in return for a level of physical effort [ranging between 10% and 80% of a subjects’ previously determined maximal voluntary contraction (MVC), held for 1 s] (A and B). They were instructed to weigh up each offer, deciding ‘whether it was worth it’. If they accepted an offer (by squeezing the left-hand grip) the tree moved to the left or right of the screen, indicating which hand they had to perform the force squeeze with. They had a 5-s window within which to achieve the required force level. If they rejected the offer (by squeezing the right-hand grip) they waited the same 5-s period. After a feedback phase they then moved onto the next trial. After a practice session, participants worked through 180 trials, which evenly sampled the 6 × 6 ‘decision space’ over five blocks (C). Example force trace from a single trial (D, left). Participants parametrically modulated force output to task requirements. Superimposed force traces for all patients, ON and OFF their dopaminergic medications. Each required force level is a different colour, and the solid lines show the minimum required level (D, middle). Both patients and healthy controls modulated squeeze force appropriately (D, right). PD = Parkinson’s disease.
Figure 2
Figure 2
Raw acceptance results as apathy status, and dopamine state, varied. Mean acceptance rates for all patients, ON and OFF their normal medications. As reward on offer increased, and effort required decreased, the probability of a participant accepting an offer increased, raw data (A) and modelled data (B). Apathetic Parkinson’s disease patients accepted significantly fewer offers than healthy controls or non-apathetic Parkinson’s disease patients (C, ON state shown, error bars are ± SEM). Apathy level (action initiation subscale of LARS) strongly correlated with acceptance rate (D, r = 0.37, P = 0.019; ON state shown). Dopamine depletion (OFF state) was associated with significantly reduced acceptance rates, irrespective of apathy status (E, dotted line is mean effect ± SEM). PD = Parkinson’s disease.
Figure 3
Figure 3
Distinct effects of apathy and dopamine depletion on response pattern. Change in acceptance in apathetic compared to non-apathetic patients, as both reward and effort increase. The panels show difference in responding (% accepted in no apathy group − % accepted in apathy group) at each reward level, collapsed across effort (A, left) and effort level, collapsed across reward (A, right). The reduced acceptance rate seen in apathetic patients was driven by reduced responding to low reward offers, particularly when effort costs were lower (Apathy × Reward × Effort interaction P = 0.004). A different behavioural pattern characterized the effects of dopamine depletion (OFF state) on choice. Panels show the mean change in acceptance (ON minus OFF) across patients, as reward (B, left) and effort (B, right) increases. The difference between ON and OFF states was driven by increased responding to predominantly high effort, higher reward offers (Dopamine × Reward × Effort interaction P = 0.003). These differences in acceptance rates associated with apathy (C, left) and dopamine depletion (C, right) manifest within distinct regions of the 6 × 6 decision space grid. The grey shaded plane (z-axis = 0) represents no difference in acceptance. All error bars are ± SEM. PD = Parkinson’s disease.
Figure 4
Figure 4
Dopamine depletion, but not apathy, reduces motor vigour following decision to engage. Motor vigour was indexed by excess force generated above the required effort level, i.e. how much more than was required that a participant squeezed (A). Dopamine (ON state) significantly increased response vigour (indexed by OFF state), while the presence of apathy was not associated with a significant change in the vigour of response (B). Despite greater force production at each effort level in the ON state, there was no change in perceived physical exertion between ON and OFF state, nor between patients and controls (C). Maximal voluntary contraction did not differ between ON and OFF states (D). PD = Parkinson’s disease.

References

    1. Aarsland D, Marsh L, Schrag A. Neuropsychiatric symptoms in Parkinson’s disease. Mov Disord 2009; 24: 2175–86.
    1. Adam R, Leff A, Sinha N, Turner C, Bays P, Draganski B, et al.Dopamine reverses reward insensitivity in apathy following globus pallidus lesions. Cortex 2013; 49: 1292–303.
    1. Baggio HC, Segura B, Garrido-Millan JL, Marti MJ, Compta Y, Valldeoriola F, et al.Resting-state frontostriatal functional connectivity in Parkinson’s disease-related apathy. Mov Disord 2015; 30: 671–9.
    1. Bailey MR, Simpson EH, Balsam PD. Neural substrates underlying effort, time, and risk-based decision making in motivated behavior. Neurobiol Learn Mem 2016a; 133: 233–56.
    1. Bailey MR, Williamson C, Mezias C, Winiger V, Silver R, Balsam PD, et al.The effects of pharmacological modulation of the serotonin 2C receptor on goal-directed behavior in mice. Psychopharmacology 2016b; 233: 615–24.
    1. Balleine BW, O’Doherty JP. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010; 35: 48–69.
    1. Beck AT, Steer RA, Brown GK. Manual for the Beck depression inventory-II. San Antonio, TX: Psychological Corporation; 1996. p. 1–82.
    1. Bonnelle V, Manohar S, Behrens T, Husain M. Individual differences in premotor brain systems underlie behavioral apathy. Cereb Cortex 2016; 26: 807–19.
    1. Burnham KP, Anderson DR. Multimodel inference understanding AIC and BIC in model selection. Sociol Methods Res 2004; 33: 261–304.
    1. Callegari I, Mattei C, Benassi F, Krueger F, Grafman J, Yaldizli Ö, et al.Agomelatine improves apathy in frontotemporal dementia. Neurodegener Dis 2016; 16: 352–6.
    1. Cantril H. The patterns of human concerns. New Brunswick: Rutgers University Press; 1965.
    1. Carriere N, Besson P, Dujardin K, Duhamel A, Defebvre L, Delmaire C, et al.Apathy in Parkinson’s disease is associated with nucleus accumbens atrophy: a magnetic resonance imaging shape analysis. Mov Disord 2014; 29: 897–903.
    1. Chaudhuri KR, Healy DG, Schapira AH; National Institute for Clinical Excellence. Non-motor symptoms of Parkinson’s disease: diagnosis and management. Lancet Neurol 2006; 5: 235–45.
    1. Chong TT, Apps M, Giehl K, Sillence A, Grima LL, Husain M. Neurocomputational mechanisms underlying subjective valuation of effort costs. PLoS Biol 2017; 15: e1002598.
    1. Chong TT, Bonnelle V, Manohar S, Veromann KR, Muhammed K, Tofaris GK, et al.Dopamine enhances willingness to exert effort for reward in Parkinson’s disease. Cortex 2015; 69: 40–6.
    1. Chung SJ, Asgharnejad M, Bauer L, Ramirez F, Jeon B. Evaluation of rotigotine transdermal patch for the treatment of depressive symptoms in patients with Parkinson’s disease. Expert Opin Pharmacother 2016; 17: 1453–61.
    1. Croxson PL, Walton ME, O’Reilly JX, Behrens TE, Rushworth MF. Effort-based cost-benefit valuation and the human brain. J Neurosci 2009; 29: 4531–41.
    1. Devos D, Moreau C, Maltête D, Lefaucheur R, Kreisler A, Eusebio A, et al.Rivastigmine in apathetic but dementia and depression-free patients with Parkinson’s disease: a double-blind, placebo-controlled, randomised clinical trial. J Neurol Neurosurg Psychiatry 2014; 85: 668–74.
    1. Fobbs WC, Mizumori SJ. Cost-benefit decision circuitry: proposed modulatory role for acetylcholine. Prog Mol Biol Transl Sci 2014: 233–61.
    1. Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, et al.Movement Disorder Society-sponsored revision of the Unified Parkinson’s Disease Rating Scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov Disord 2008; 23: 2129–70.
    1. Groth-Marnat G. Neuropsychological assessment in clinical practice: a guide to test interpretation and integration. New York: Wiley; 2000.
    1. Hamid AA, Pettibone JR, Mabrouk OS, Hetrick VL, Schmidt R, Vander Weele CM, et al.Mesolimbic dopamine signals the value of work. Nat Neurosci 2016; 19: 117–26.
    1. Hauber W, Sommer S. Prefrontostriatal circuitry regulates effort-related decision making. Cereb Cortex 2009; 19: 2240–7.
    1. Hauser TU, Eldar E, Dolan RJ. Separate mesocortical and mesolimbic pathways encode effort and reward learning signals. Proc Natl Acad Sci USA 2017; 114: E7395–404.
    1. Holroyd CB, Umemoto A. The research domain criteria framework: the case for anterior cingulate cortex. Neurosci Biobehav Rev 2016; 71: 418–43.
    1. Holroyd CB, Yeung N. Motivation of extended behaviors by anterior cingulate cortex. Trends Cogn Sci 2012; 16: 122–8.
    1. Howe MW, Tierney PL, Sandberg SG, Phillips PEM, Graybiel AM. Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 2013; 500: 575–9.
    1. Hsieh S, Schubert S, Hoon C, Mioshi E, Hodges JR. Validation of the Addenbrooke’s Cognitive Examination III in frontotemporal dementia and Alzheimer’s disease. Dement Geriatr Cogn Disord 2013; 36: 242–50.
    1. Huang C, Ravdin LD, Nirenberg MJ, Piboolnurak P, Severt L, Maniscalco JS, et al.Neuroimaging markers of motor and nonmotor features of Parkinson’s disease: an 18f fluorodeoxyglucose positron emission computed tomography study. Dement Geriatr Cogn Disord 2013; 35: 183–96.
    1. Kalia LV, Lang AE. Parkinson’s disease. Lancet 2015; 386: 896–912.
    1. Kirsch-Darrow L, Marsiske M, Okun MS, Bauer R, Bowers D. Apathy and depression: separate factors in Parkinson’s disease. J Int Neuropsychol Soc 2011; 17: 1058–66.
    1. Klein-Flugge MC, Kennerley SW, Friston K, Bestmann S. Neural signatures of value comparison in human cingulate cortex during decisions requiring an effort-reward trade-off. J Neurosci 2016; 36: 10002–15.
    1. Kohno N, Abe S, Toyoda G, Oguro H, Bokura H, Yamaguchi S. Successful treatment of post-stroke apathy by the dopamine receptor agonist ropinirole. J Clin Neurosci 2010; 17: 804–6.
    1. Kolling N, Wittmann MK, Behrens TEJ, Boorman ED, Mars RB, Rushworth MFS. Value, search, persistence and model updating in anterior cingulate cortex. Nat Neurosci 2016; 19: 1280–85.
    1. Kurniawan IT, Guitart-Masip M, Dolan RJ. Dopamine and effort-based decision making. Front Neurosci 2011; 5: 81.
    1. Lawrence AD, Goerendt IK, Brooks DJ. Apathy blunts neural response to money in Parkinson’s disease. Soc Neurosci 2011; 6: 653–62.
    1. Le Bouc R, Rigoux L, Schmidt L, Degos B, Welter ML, Vidailhet M, et al.Computational dissection of dopamine motor and motivational functions in humans. J Neurosci 2016; 36: 6623–33.
    1. Le Heron C, Apps MAJ, Husain M. The anatomy of apathy: a neurocognitive framework for amotivated behaviour. Neuropsychologia 2017, in press. doi: 10.1016/j.neuropsychologia.2017.07.003.
    1. Levy R, Dubois B. Apathy and the functional anatomy of the prefrontal cortex-basal ganglia circuits. Cereb Cortex 2006; 16: 916–28.
    1. Maillet A, Krack P, Lhommée E, Météreau E, Klinger H, Favre E, et al.The prominent role of serotonergic degeneration in apathy, anxiety and depression in de novo Parkinson’s disease. Brain 2016; 139: 2486–502.
    1. Marin RS. Apathy: a neuropsychiatric syndrome. J Neuropsychiatry Clin Neurosci 1991; 3: 243–54.
    1. Martinez-Fernandez R, Pelissier P, Quesada JL, Klinger H, Lhommée E, Schmitt E, et al.Postoperative apathy can neutralise benefits in quality of life after subthalamic stimulation for Parkinson’s disease. J Neurol Neurosurg Psychiatry 2016; 87: 311–18.
    1. Martinez-Horta S, Riba J, de Bobadilla RF, Pagonabarraga J, Pascual-Sedano B, Antonijoan RM, et al.Apathy in Parkinson’s disease: neurophysiological evidence of impaired incentive processing. J Neurosci 2014; 34: 5918–26.
    1. Meyniel F, Goodwin GM, Deakin JW, Klinge C, MacFadyen C, Milligan H, et al.A specific role for serotonin in overcoming effort cost. Elife 2016; 5: e17282.
    1. Mogenson GJ, Jones DL, Yim CY. From motivation to action: functional interface between the limbic system and the motor system. Prog Neurobiol 1980; 14: 69–97.
    1. Muhammed K, Manohar S, Ben Yehuda M, Chong TT, Tofaris G, Lennox G, et al.Reward sensitivity deficits modulated by dopamine are associated with apathy in Parkinson’s disease. Brain 2016; 139: 2706–21.
    1. Nunes EJ, Randall PA, Podurgiel S, Correa M, Salamone JD. Nucleus accumbens neurotransmission and effort-related choice behavior in food motivation: effects of drugs acting on dopamine, adenosine, and muscarinic acetylcholine receptors. Neurosci Biobehav Rev 2013; 37: 2015–25.
    1. Pagonabarraga J, Kulisevsky J, Strafella AP, Krack P. Apathy in Parkinson’s disease: clinical features, neural substrates, diagnosis, and treatment. Lancet Neurol 2015; 14: 518–31.
    1. Pearson JM, Watson KK, Platt ML. Decision making: the neuroethological turn. Neuron 2014; 82: 950–65.
    1. Pluck GC, Brown RG. Apathy in Parkinson’s disease. J Neurol Neurosurg Psychiatry 2002; 73: 636–42.
    1. Prevost C, Pessiglione M, Metereau E, Clery-Melin ML, Dreher JC. Separate valuation subsystems for delay and effort decision costs. J Neurosci 2010; 30: 14080–90.
    1. Rea R, Carotenuto A, Traini E, Fasanaro AM, Manzo V, Amenta F. Apathy treatment in Alzheimer’s disease: interim results of the ASCOMALVA trial. J Alzheimers Dis 2015; 48: 377–83.
    1. Remy P, Doder M, Lees A, Turjanski N, Brooks D. Depression in Parkinson’s disease: loss of dopamine and noradrenaline innervation in the limbic system. Brain 2005; 128 (Pt 6): 1314–22.
    1. Robert GH, Le Jeune F, Lozachmeur C, Drapier S, Dondaine T, Péron J, et al.Preoperative factors of apathy in subthalamic stimulated Parkinson disease: a PET study. Neurology 2014; 83: 1620–6.
    1. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MFS. Separate neural pathways process different decision costs. Nat Neurosci 2006; 9: 1161–8.
    1. Rushworth MF, Kolling N, Sallet J, Mars RB. Valuation and decision-making in frontal cortex: one or many serial or parallel systems? Curr Opin Neurobiol 2012; 22: 946–55.
    1. Salamone JD, Correa M. The mysterious motivational functions of mesolimbic dopamine. Neuron 2012; 76: 470–85.
    1. Salamone JD, Correa M, Farrar A, Mingote SM. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 2007; 191: 461–82.
    1. Salamone JD, Yohn SE, López-Cruz L, San Miguel N, Correa M. Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology. Brain 2016; 139: 1325–47.
    1. Santangelo G, Vitale C, Picillo M, Cuoco S, Moccia M, Pezzella D, et al.Apathy and striatal dopamine transporter levels in de-novo, untreated Parkinson’s disease patients. Parkinsonism Relat Disord 2015; 21: 489–93.
    1. Schmidt L, D’Arc BF, Lafargue G, Galanaud D, Czernecki V, Grabli D, et al.Disconnecting force from money: effects of basal ganglia damage on incentive motivation. Brain 2008; 131: 1303–10.
    1. Scholl J, Kolling N, Nelissen N, Wittmann MK, Harmer CJ, Rushworth MFS. The good, the bad, and the irrelevant: neural mechanisms of learning real and hypothetical rewards and effort. J Neurosci 2015; 35: 11233–51.
    1. Sockeel P, Dujardin K, Devos D, Denève C, Destée A, Defebvre L. The Lille apathy rating scale (LARS), a new instrument for detecting and quantifying apathy: validation in Parkinson’s disease. J Neurol Neurosurg Psychiatry 2006; 77: 579–84.
    1. Starkstein SE, Leentjens FG. The nosological position of apathy in clinical practice. J Neurol Neurosurg Psychiatry 2008; 79: 1088–92.
    1. Syed ECJ, Grima LL, Magill PJ, Bogacz R, Brown P, Walton ME. Action initiation shapes mesolimbic dopamine encoding of future rewards. Nat Neurosci 2016; 19: 34–6.
    1. Thobois S, Ardouin C, Lhommee E, Klinger H, Lagrange C, Xie J, et al.Non-motor dopamine withdrawal syndrome after surgery for Parkinson’s disease: predictors and underlying mesolimbic denervation. Brain 2010; 133: 1111–27.
    1. Thobois S, Lhommée E, Klinger H, Ardouin C, Schmitt E, Bichon A, et al.Parkinsonian apathy responds to dopaminergic stimulation of D2/D3 receptors with piribedil. Brain 2013; 136: 1568–77.
    1. Treadway MT, Zald DH. Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci Biobehav Rev 2011; 35: 537–55.
    1. Varazzani C, San-Galli A, Gilardeau S, Bouret S. Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys. J Neurosci 2015; 35: 7866–77.
    1. Walton ME, Bannerman DM, Rushworth MFS. The role of rat medial frontal cortex in effort-based decision making. J Neurosci 2002; 22: 10996–1003.
    1. Weintraub D, Moberg PJ, Culbertson WC, Duda JE, Katz IR, Stern MB. Dimensions of executive function in Parkinson’s disease. Dement Geriatr Cogn Disord 2005; 20: 140–4.

Source: PubMed

3
Subscribe