A specific role for serotonin in overcoming effort cost
Florent Meyniel, Guy M Goodwin, Jf William Deakin, Corinna Klinge, Christine MacFadyen, Holly Milligan, Emma Mullings, Mathias Pessiglione, Raphaël Gaillard, Florent Meyniel, Guy M Goodwin, Jf William Deakin, Corinna Klinge, Christine MacFadyen, Holly Milligan, Emma Mullings, Mathias Pessiglione, Raphaël Gaillard
Abstract
Serotonin is implicated in many aspects of behavioral regulation. Theoretical attempts to unify the multiple roles assigned to serotonin proposed that it regulates the impact of costs, such as delay or punishment, on action selection. Here, we show that serotonin also regulates other types of action costs such as effort. We compared behavioral performance in 58 healthy humans treated during 8 weeks with either placebo or the selective serotonin reuptake inhibitor escitalopram. The task involved trading handgrip force production against monetary benefits. Participants in the escitalopram group produced more effort and thereby achieved a higher payoff. Crucially, our computational analysis showed that this effect was underpinned by a specific reduction of effort cost, and not by any change in the weight of monetary incentives. This specific computational effect sheds new light on the physiological role of serotonin in behavioral regulation and on the clinical effect of drugs for depression.
Clinical trial registration: ISRCTN75872983.
Keywords: computational biology; decision-making; effort; escitalopram; human; neuroscience; reward; serotonin; systems biology.
Conflict of interest statement
FM: Supported by The French Ministère de la Recherche and the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement no. 604102 (Human Brain Project).GMG: Holds shares in P1vital Ltd and has served as consultant, advisor or CME speaker in the last 12 months for AstraZeneca, Cephalon/Teva, Convergence, Eli Lilly, GSK, Lundbeck, Medscape, Otsuka, Servier, Sunovion, Takeda.JFWD: Currently advises or carries out research funded by Autifony, Sunovion, Lundbeck, AstraZeneca and Servier; all payment is to the University of Manchester; he has share options in P1vital Ltd.RG: Received compensation as a member of the scientific advisory board of Janssen, Lundbeck, Roche, Takeda; he has served as consultant and/or speaker for Astra Zeneca, Pierre Fabre, Lilly, Otsuka, SANOFI, Servier and received compensation, and he has received research support from Servier.The other authors declare that no competing interests exist.
Figures
References
- American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders (DSM-5) American Psychiatric Pub; 2013.
- Balasubramani PP, Chakravarthy VS, Ravindran B, Moustafa AA. A network model of basal ganglia for understanding the roles of dopamine and serotonin in reward-punishment-risk based decision making. Frontiers in Computational Neuroscience. 2015;9:e17282. doi: 10.3389/fncom.2015.00076.
- Bari A, Robbins TW. Inhibition and impulsivity: behavioral and neural basis of response control. Progress in Neurobiology. 2013;108:44–79. doi: 10.1016/j.pneurobio.2013.06.005.
- Bari A, Theobald DE, Caprioli D, Mar AC, Aidoo-Micah A, Dalley JW, Robbins TW. Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats. Neuropsychopharmacology. 2010;35:1290–1301. doi: 10.1038/npp.2009.233.
- Barnhart WJ, Makela EH, Latocha MJ. SSRI-induced apathy syndrome: a clinical review. Journal of Psychiatric Practice. 2004;10:196–199. doi: 10.1097/00131746-200405000-00010.
- Bauer M, Monz BU, Montejo AL, Quail D, Dantchev N, Demyttenaere K, Garcia-Cebrian A, Grassi L, Perahia DG, Reed C, Tylee A. Prescribing patterns of antidepressants in Europe: results from the Factors Influencing Depression Endpoints Research (FINDER) study. European Psychiatry. 2008;23:66–73. doi: 10.1016/j.eurpsy.2007.11.001.
- Boureau YL, Dayan P. Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology. 2011;36:74–97. doi: 10.1038/npp.2010.151.
- Chamberlain SR, Müller U, Blackwell AD, Clark L, Robbins TW, Sahakian BJ. Neurochemical modulation of response inhibition and probabilistic learning in humans. Science. 2006;311:861–863. doi: 10.1126/science.1121218.
- Cipriani A, Furukawa TA, Salanti G, Geddes JR, Higgins JPT, Churchill R, Watanabe N, Nakagawa A, Omori IM, McGuire H, Tansella M, Barbui C. Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis. The Lancet. 2009;373:746–758. doi: 10.1016/S0140-6736(09)60046-5.
- Clarke HF, Dalley JW, Crofts HS, Robbins TW, Roberts AC. Cognitive inflexibility after prefrontal serotonin depletion. Science. 2004;304:878–880. doi: 10.1126/science.1094987.
- Cléry-Melin ML, Schmidt L, Lafargue G, Baup N, Fossati P, Pessiglione M. Why don't you try harder? An investigation of effort production in major depression. PLoS One. 2011;6:e17282. doi: 10.1371/journal.pone.0023178.
- Cohen JY, Amoroso MW, Uchida N. Serotonergic neurons signal reward and punishment on multiple timescales. eLife. 2015;4:e17282. doi: 10.7554/eLife.06346.
- Cools R, Blackwell A, Clark L, Menzies L, Cox S, Robbins TW. Tryptophan depletion disrupts the motivational guidance of goal-directed behavior as a function of trait impulsivity. Neuropsychopharmacology. 2005;30:1362–1373. doi: 10.1038/sj.npp.1300704.
- Cools R, Nakamura K, Daw ND. Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology. 2011;36:98–113. doi: 10.1038/npp.2010.121.
- Cotel F, Exley R, Cragg SJ, Perrier JF. Serotonin spillover onto the axon initial segment of motoneurons induces central fatigue by inhibiting action potential initiation. PNAS. 2013;110:4774–4779. doi: 10.1073/pnas.1216150110.
- Cousins MS, Atherton A, Turner L, Salamone JD. Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task. Behavioural Brain Research. 1996;74:189–197. doi: 10.1016/0166-4328(95)00151-4.
- Crockett MJ, Clark L, Robbins TW. Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans. Journal of Neuroscience. 2009;29:11993–11999. doi: 10.1523/JNEUROSCI.2513-09.2009.
- Crockett MJ, Clark L, Smillie LD, Robbins TW. The effects of acute tryptophan depletion on costly information sampling: impulsivity or aversive processing? Psychopharmacology. 2012;219:587–597. doi: 10.1007/s00213-011-2577-9.
- Crockett MJ, Clark L, Tabibnia G, Lieberman MD, Robbins TW. Serotonin modulates behavioral reactions to unfairness. Science. 2008;320:e17282. doi: 10.1126/science.1155577.
- Daunizeau J, Adam V, Rigoux L. VBA: a probabilistic treatment of nonlinear models for neurobiological and behavioural data. PLoS Computational Biology. 2014;10:e17282. doi: 10.1371/journal.pcbi.1003441.
- Daw ND, Kakade S, Dayan P. Opponent interactions between serotonin and dopamine. Neural Networks. 2002;15:603–616. doi: 10.1016/S0893-6080(02)00052-7.
- Dayan P. Twenty-five lessons from computational neuromodulation. Neuron. 2012;76:240–256. doi: 10.1016/j.neuron.2012.09.027.
- Denk F, Walton ME, Jennings KA, Sharp T, Rushworth MF, Bannerman DM. Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology. 2005;179:587–596. doi: 10.1007/s00213-004-2059-4.
- Doya K. Metalearning and neuromodulation. Neural Networks. 2002;15:495–506. doi: 10.1016/S0893-6080(02)00044-8.
- Dremencov E, El Mansari M, Blier P. Effects of sustained serotonin reuptake inhibition on the firing of dopamine neurons in the rat ventral tegmental area. Journal of Psychiatry & Neuroscience. 2009;34:223–229.
- Eldar E, Niv Y. Interaction between emotional state and learning underlies mood instability. Nature Communications. 2015;6:e17282. doi: 10.1038/ncomms7149.
- Faulkner P, Deakin JF. The role of serotonin in reward, punishment and behavioural inhibition in humans: insights from studies with acute tryptophan depletion. Neuroscience & Biobehavioral Reviews. 2014;46:365–378. doi: 10.1016/j.neubiorev.2014.07.024.
- Fava M, Ball S, Nelson JC, Sparks J, Konechnik T, Classi P, Dube S, Thase ME. Clinical relevance of fatigue as a residual symptom in major depressive disorder. Depression and Anxiety. 2014;31:250–257. doi: 10.1002/da.22199.
- Fischer AG, Jocham G, Ullsperger M. Dual serotonergic signals: a key to understanding paradoxical effects? Trends in Cognitive Sciences. 2015;19:21–26. doi: 10.1016/j.tics.2014.11.004.
- Fonseca MS, Murakami M, Mainen ZF. Activation of dorsal raphe serotonergic neurons promotes waiting but is not reinforcing. Current Biology. 2015;25:306–315. doi: 10.1016/j.cub.2014.12.002.
- Frank MJ, Seeberger LC, O'reilly RC. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science. 2004;306:1940–1943. doi: 10.1126/science.1102941.
- Gandevia SC. Spinal and supraspinal factors in human muscle fatigue. Physiological Reviews. 2001;81:1725–1789.
- Guitart-Masip M, Economides M, Huys QJ, Frank MJ, Chowdhury R, Duzel E, Dayan P, Dolan RJ. Differential, but not opponent, effects of L -DOPA and citalopram on action learning with reward and punishment. Psychopharmacology. 2014;231:955–966. doi: 10.1007/s00213-013-3313-4.
- Hale MW, Raison CL, Lowry CA. Integrative physiology of depression and antidepressant drug action: implications for serotonergic mechanisms of action and novel therapeutic strategies for treatment of depression. Pharmacology & Therapeutics. 2013;137:108–118. doi: 10.1016/j.pharmthera.2012.09.005.
- Harmer CJ, Bhagwagar Z, Perrett DI, Völlm BA, Cowen PJ, Goodwin GM. Acute SSRI administration affects the processing of social cues in healthy volunteers. Neuropsychopharmacology. 2003;28:148–152. doi: 10.1038/sj.npp.1300004.
- Harmer CJ, Goodwin GM, Cowen PJ. Why do antidepressants take so long to work? A cognitive neuropsychological model of antidepressant drug action. The British Journal of Psychiatry. 2009;195:102–108. doi: 10.1192/bjp.bp.108.051193.
- Harmer CJ, Shelley NC, Cowen PJ, Goodwin GM. Increased positive versus negative affective perception and memory in healthy volunteers following selective serotonin and norepinephrine reuptake inhibition. American Journal of Psychiatry. 2004;161:1256–1263. doi: 10.1176/appi.ajp.161.7.1256.
- Jacobs BL, Azmitia EC. Structure and function of the brain serotonin system. Physiological Reviews. 1992;72:165–229.
- Kobayashi T, Hayashi E, Shimamura M, Kinoshita M, Murphy NP. Neurochemical responses to antidepressants in the prefrontal cortex of mice and their efficacy in preclinical models of anxiety-like and depression-like behavior: a comparative and correlational study. Psychopharmacology. 2008;197:567–580. doi: 10.1007/s00213-008-1070-6.
- Le Bouc R, Rigoux L, Schmidt L, Degos B, Welter ML, Vidailhet M, Daunizeau J, Pessiglione M. Computational dissection of dopamine motor and motivational functions in humans. Journal of Neuroscience. 2016;36 doi: 10.1523/JNEUROSCI.3078-15.2016. in press.
- Meyniel F, Safra L, Pessiglione M. How the brain decides when to work and when to rest: dissociation of implicit-reactive from explicit-predictive computational processes. PLoS Computational Biology. 2014;10:e17282. doi: 10.1371/journal.pcbi.1003584.
- Meyniel F, Sergent C, Rigoux L, Daunizeau J, Pessiglione M. Neurocomputational account of how the human brain decides when to have a break. PNAS. 2013;110:2641–2646. doi: 10.1073/pnas.1211925110.
- Miyazaki KW, Miyazaki K, Tanaka KF, Yamanaka A, Takahashi A, Tabuchi S, Doya K. Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards. Current Biology. 2014;24:2033–2040. doi: 10.1016/j.cub.2014.07.041.
- Niv Y, Daw ND, Joel D, Dayan P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology. 2007;191:507–520. doi: 10.1007/s00213-006-0502-4.
- Nutt DJ, Forshall S, Bell C, Rich A, Sandford J, Nash J, Argyropoulos S. Mechanisms of action of selective serotonin reuptake inhibitors in the treatment of psychiatric disorders. European Neuropsychopharmacology. 1999;9:S81–S86. doi: 10.1016/S0924-977X(99)00030-9.
- Padala PR, Padala KP, Monga V, Ramirez DA, Sullivan DH. Reversal of SSRI-associated apathy syndrome by discontinuation of therapy. Annals of Pharmacotherapy. 2012;46:e17282. doi: 10.1345/aph.1Q656.
- Palminteri S, Lebreton M, Worbe Y, Grabli D, Hartmann A, Pessiglione M. Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes. PNAS. 2009;106:19179–19184. doi: 10.1073/pnas.0904035106.
- Papakostas GI, Nutt DJ, Hallett LA, Tucker VL, Krishen A, Fava M. Resolution of sleepiness and fatigue in major depressive disorder: A comparison of bupropion and the selective serotonin reuptake inhibitors. Biological Psychiatry. 2006;60:1350–1355. doi: 10.1016/j.biopsych.2006.06.015.
- Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature. 2006;442:1042–1045. doi: 10.1038/nature05051.
- Salamone JD, Correa M, Farrar A, Mingote SM. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology. 2007;191:461–482. doi: 10.1007/s00213-006-0668-9.
- Sansone RA, Sansone LA. SSRI-Induced Indifference. Psychiatry (Edgmont) 2010;7:14–18.
- Schilström B, Konradsson-Geuken A, Ivanov V, Gertow J, Feltmann K, Marcus MM, Jardemark K, Svensson TH. Effects of S-citalopram, citalopram, and R-citalopram on the firing patterns of dopamine neurons in the ventral tegmental area, N-methyl-D-aspartate receptor-mediated transmission in the medial prefrontal cortex and cognitive function in the rat. Synapse. 2011;65:357–367. doi: 10.1002/syn.20853.
- Schweighofer N, Bertin M, Shishida K, Okamoto Y, Tanaka SC, Yamawaki S, Doya K. Low-serotonin levels increase delayed reward discounting in humans. Journal of Neuroscience. 2008;28:4528–4532. doi: 10.1523/JNEUROSCI.4982-07.2008.
- Serretti A, Calati R, Goracci A, Di Simplicio M, Castrogiovanni P, De Ronchi D. Antidepressants in healthy subjects: what are the psychotropic/psychological effects? European Neuropsychopharmacology. 2010;20:433–453. doi: 10.1016/j.euroneuro.2009.11.009.
- Smith HS. Potential analgesic mechanisms of acetaminophen. Pain Physician. 2009;12:269–280.
- Stahl SM. Stahl’s Essential Psychopharmacology. Neuroscientific Basis and Practical Applications. (2nd ed) Cambridge University Press; 2008. Chapter 12 - Antidepressants.
- Stephan KE, Penny WD, Daunizeau J, Moran RJ, Friston KJ. Bayesian model selection for group studies. NeuroImage. 2009;46:1004–1017. doi: 10.1016/j.neuroimage.2009.03.025.
- Stoy M, Schlagenhauf F, Sterzer P, Bermpohl F, Hägele C, Suchotzki K, Schmack K, Wrase J, Ricken R, Knutson B, Adli M, Bauer M, Heinz A, Ströhle A. Hyporeactivity of ventral striatum towards incentive stimuli in unmedicated depressed patients normalizes after treatment with escitalopram. Journal of Psychopharmacology. 2012;26:677–688. doi: 10.1177/0269881111416686.
- Tang TZ, DeRubeis RJ, Hollon SD, Amsterdam J, Shelton R, Schalet B. A placebo-controlled test of the effects of paroxetine and cognitive therapy on personality risk factors in depression. Arch Gen Psychiatry. 2009;66:1322–1330. doi: 10.1001/archgenpsychiatry.2009.166.
- Treadway MT, Bossaller NA, Shelton RC, Zald DH. Effort-based decision-making in major depressive disorder: a translational model of motivational anhedonia. Journal of Abnormal Psychology. 2012;121:553–558. doi: 10.1037/a0028813.
- Trivedi MH, Rush AJ, Wisniewski SR, Nierenberg AA, Warden D, Ritz L, Norquist G, Howland RH, Lebowitz B, McGrath PJ, Shores-Wilson K, Biggs MM, Balasubramani GK, Fava M, STAR*D Study Team Evaluation of outcomes with citalopram for depression using measurement-based care in STAR*D: implications for clinical practice. American Journal of Psychiatry. 2006;163:28–40. doi: 10.1176/appi.ajp.163.1.28.
- Warden MR, Selimbeyoglu A, Mirzabekov JJ, Lo M, Thompson KR, Kim SY, Adhikari A, Tye KM, Frank LM, Deisseroth K. A prefrontal cortex-brainstem neuronal projection that controls response to behavioural challenge. Nature. 2012;492:428–432. doi: 10.1038/nature11617.
- Wardle MC, Treadway MT, Mayo LM, Zald DH, de Wit H. Amping up effort: effects of d-amphetamine on human effort-based decision-making. Journal of Neuroscience. 2011;31:16597–16602. doi: 10.1523/JNEUROSCI.4387-11.2011.
- Weber M, Talmon S, Schulze I, Boeddinghaus C, Gross G, Schoemaker H, Wicke KM. Running wheel activity is sensitive to acute treatment with selective inhibitors for either serotonin or norepinephrine reuptake. Psychopharmacology. 2009;203:753–762. doi: 10.1007/s00213-008-1420-4.
- Worbe Y, Savulich G, Voon V, Fernandez-Egea E, Robbins TW. Serotonin depletion induces 'waiting impulsivity' on the human four-choice serial reaction time task: cross-species translational significance. Neuropsychopharmacology. 2014;39:1519–1526. doi: 10.1038/npp.2013.351.
- Yohn SE, Collins SL, Contreras-Mora HM, Errante EL, Rowland MA, Correa M, Salamone JD. Not all antidepressants are created equal: differential effects of monoamine uptake inhibitors on effort-related choice behavior. Neuropsychopharmacology. 2016;41:686–694. doi: 10.1038/npp.2015.188.
- Yuen GS, Gunning FM, Woods E, Klimstra SA, Hoptman MJ, Alexopoulos GS. Neuroanatomical correlates of apathy in late-life depression and antidepressant treatment response. Journal of Affective Disorders. 2014;166:179–186. doi: 10.1016/j.jad.2014.05.008.
- Zahodne LB, Bernal-Pacheco O, Bowers D, Ward H, Oyama G, Limotai N, Velez-Lago F, Rodriguez RL, Malaty I, McFarland NR, Okun MS. Are selective serotonin reuptake inhibitors associated with greater apathy in Parkinson’s disease? Journal of Neuropsychiatry and Clinical Neurosciences. 2012;24:326–330. doi: 10.1176/appi.neuropsych.11090210.
Source: PubMed