Single dose of a dopamine agonist impairs reinforcement learning in humans: behavioral evidence from a laboratory-based measure of reward responsiveness

Diego A Pizzagalli, A Eden Evins, Erika Cowman Schetter, Michael J Frank, Petra E Pajtas, Diane L Santesso, Melissa Culhane, Diego A Pizzagalli, A Eden Evins, Erika Cowman Schetter, Michael J Frank, Petra E Pajtas, Diane L Santesso, Melissa Culhane

Abstract

Rationale: The dopaminergic system, particularly D2-like dopamine receptors, has been strongly implicated in reward processing. Animal studies have emphasized the role of phasic dopamine (DA) signaling in reward-related learning, but these processes remain largely unexplored in humans.

Objectives: To evaluate the effect of a single, low dose of a D2/D3 agonist--pramipexole--on reinforcement learning in healthy adults. Based on prior evidence indicating that low doses of DA agonists decrease phasic DA release through autoreceptor stimulation, we hypothesized that 0.5 mg of pramipexole would impair reward learning due to presynaptic mechanisms.

Materials and methods: Using a double-blind design, a single 0.5-mg dose of pramipexole or placebo was administered to 32 healthy volunteers, who performed a probabilistic reward task involving a differential reinforcement schedule as well as various control tasks.

Results: As hypothesized, response bias toward the more frequently rewarded stimulus was impaired in the pramipexole group, even after adjusting for transient adverse effects. In addition, the pramipexole group showed reaction time and motor speed slowing and increased negative affect; however, when adverse physical side effects were considered, group differences in motor speed and negative affect disappeared.

Conclusions: These findings show that a single low dose of pramipexole impaired the acquisition of reward-related behavior in healthy participants, and they are consistent with prior evidence suggesting that phasic DA signaling is required to reinforce actions leading to reward. The potential implications of the present findings to psychiatric conditions, including depression and impulse control disorders related to addiction, are discussed.

Conflict of interest statement

Disclosure/Conflict of Interest Dr. Pizzagalli has received research support from GlaxoSmithKline and Merck & Co., Inc., manufactures of antidepressants. Dr. Evins has received research grant support from Janssen Pharmaceutica, Sanofi-Aventis, Astra Zeneca; research materials from GSK and Pfizer, and honoraria from Primedia, Inc. Moreover, Dr. Evins is an investigator in a NIDA-funded collaborative study with GSK. Dr. Frank, Ms. Schetter, Ms. Culhane, and Ms. Pajtas report no competing interests.

Figures

Figure 1. Schematic summary of the experimental…
Figure 1. Schematic summary of the experimental session timeline
VAMS: Visual Analog Mood Scale (Bond and Lader, 1974). EEG: electroencephalogram.
Figure 2. Probabilistic reward task
Figure 2. Probabilistic reward task
(a) Response bias, (b) Accuracy for the more frequently rewarded stimulus (“rich stimulus”), and (c) Accuracy for the less frequently rewarded stimulus (“lean stimulus”) as a function of Blocks for the pramipexole (n = 11) and placebo group (n = 13). Error bars correspond to S.E. Solid arrows and dashes arrows denote significant between-group and within-group differences, respectively.
Figure 3. Probabilistic reward task
Figure 3. Probabilistic reward task
Probability of choosing the more frequently rewarded stimulus (“rich stimulus”) as a function of whether the immediately preceding rich stimulus had been rewarded (left side) or not (right side) for the pramipexole (n = 11) and placebo group (n = 13). See Figure 2 for more detail.
Figure 4. Simple RT task
Figure 4. Simple RT task
Reaction time before and after administration of study medication for the pramipexole (n = 11) and placebo group (n = 15). See Figure 2 for more detail.
Figure 5. BRAIN task
Figure 5. BRAIN task
Square-root transformed kinesia score before and after administration of study medication for the pramipexole (n = 12) and placebo group (n = 15). See Figure 2 for more detail.
Figure 6. VAMS
Figure 6. VAMS
Baseline-corrected VAMS scores at several time points during the experimental session for the pramipexole (n = 16) and placebo group (n = 14). See Figure 2 for more detail.

References

    1. Baudry M, Martres MP, Schwartz JC. In vivo binding of 3H-pimozide in mouse striatum: effects of dopamine agonists and antagonists. Life Sci. 1977;21:1163–1170.
    1. Bayer HM, Glimcher PW. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron. 2005;47:129–141.
    1. Beck AT, Steer RA, Brown GK. Beck Depression Inventory Manual. 2nd. San Antonio, TX: The Psychological Corporation; 1996.
    1. Bogdan R, Pizzagalli DA. Acute stress reduces reward responsiveness: implications for depression. Biol Psychiatry. 2006;60:1147–1154.
    1. Bond A, Lader M. The use of analogue scales in rating subjective feelings. Br J Med Psychol. 1974;47:211–218.
    1. Cassano P, Lattanzi L, Soldani F, Navari S, Mattistini G, Gemignani A, Cassano G. Pramipexole in treatment-resistant depression: an extended follow-up. Depress Anxiety. 2004;20:131–138.
    1. Chapman LJ, Chapman JP. The measurement of handedness. Brain Cognition. 1987;6:175–183.
    1. Chen YC, Choi JK, Andersen SL, Rosen BR, Jenkins BG. Mapping dopamine D2/D3 receptor function using pharmacological magnetic resonance imaging. Psychopharmacology (Berl) 2005;180:705–715.
    1. Cheng J, Feenstra MG. Individual differences in dopamine efflux in nucleus accumbens shell and core during instrumental learning. Learn Mem. 2006;13:168–177.
    1. Civelli O. Molecular biology of dopamine receptor subtypes. In: Bloom FE, Kupfer DJ, editors. Psychopharmacology: The Fourth Generation of Progress. New York: Raven Press; 2000.
    1. Cools R, Altamirano L, D’Esposito M. Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia. 2006;44:1663–1673.
    1. Cools R, Lewis SJ, Clark L, Barker RA, Robbins TW. L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology. 2007;32:180–189.
    1. Cooper JR, Bloom FE, Roth RH. The biochemical basis of neuropharmacology. 8th. Oxford: Oxford University Press; 2003.
    1. Corrigan MH, Denahan AQ, Wright CE, Ragual RJ, Evans DL. Comparison of pramipexole, fluoxetine, and placebo in patients with major depression. Depress Anxiety. 2000;11:58–65.
    1. de Wit H, Enggasser JL, Richards JB. Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharmacology. 2002;27:813–825.
    1. Dunlop BW, Nemeroff CB. The role of dopamine in the pathophysiology of depression. Arch Gen Psychiatry. 2007;64:327–337.
    1. Ferreira JJ, Galitzky M, Thalamas C, Tiberge M, Montastruc JL, Sampaio C, Rascol O. Effect of ropinirole on sleep onset: a randomized, placebo-controlled study in healthy volunteers. Neurology. 2002;58:460–462.
    1. Fiorillo CD, Tobler PN, Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science. 2003;299:1898–1902.
    1. First MB, Spitzer RL, Gibbon M, Williams JBM. Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition(SCID-I/P) New York: Biometrics Research, New York State Psychiatric Institute; 2002.
    1. Frank MJ. Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J Cogn Neurosci. 2005;17:51–72.
    1. Frank MJ, O’Reilly RC. A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behav Neurosci. 2006;120:497–517.
    1. Frank MJ, Seeberger LC, O'Reilly RC. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science. 2004;306:1940–1943.
    1. Fuller RW, Clemens JA, Hynes MD., 3rd Degree of selectivity of pergolide as an agonist at presynaptic versus postsynaptic dopamine receptors: implications for prevention or treatment of tardive dyskinesia. J Clin Psychopharmacol. 1982;2:371–375.
    1. Garris PA, Kilpatrick M, Bunin MA, Michael D, Walker QD, Wightman RM. Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation. Nature. 1999;398:67–69.
    1. Giovannoni G, van Schalkwyk J, Fritz VU, Lees AJ. Bradykinesia akinesia inco-ordination test (BRAIN TEST): an objective computerised assessment of upper limb motor function. J Neurol Neurosurg Psychiatry. 1999;67:624–629.
    1. Grace AA. Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience. 1991;41:1–24.
    1. Grace AA. Dopamine. In: Davis KL, Charney D, Coyle JT, Nemeroff C, editors. Neuropsychopharmacology: The Fifth Generation of Progress. Philadelphia: Lippincott Williams & Wilkins; 2002. pp. 119–132.
    1. Harrison BJ, Olver JS, Norman TR, Nathan PJ. Effects of serotonin and catecholamine depletion on interleukin-6 activation and mood in human volunteers. Hum Psychopharmacol. 2002;17:293–297.
    1. Hollerman JR, Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci. 1998;1:304–309.
    1. Holroyd CB, Coles MGH. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychol Rev. 2002;109:679–709.
    1. Hornykiewicz O, Kish SJ. Biochemical pathophysiology of Parkinson's disease. Adv Neurol. 1987;45:19–34.
    1. Ikemoto S, Panksepp J. Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions. Behav Neurosci. 1996;110:331–345.
    1. Keating GL, Rye DB. Where you least expect it ' dopamine in the pons and modulation of sleep and REM-sleep. Sleep. 2003;26:788–789.
    1. Lefoll B, Diaz J, Sokoloff P. Neuroadaptations to hyperdopaminergia in dopamine D3-receptor deficient mice. Life Sci. 2005;76:1281–1296.
    1. Lehr E. Potential antidepressant properties of pramipexole detected in locomotor and operant behavioral investigations in mice. Psychopharmacology. 2002;163:495–500.
    1. Leyton M, aan het Rot M, Booij L, Baker GB, Young SN, Benkelfat C. Mood-elevating effects of d-amphetamine and incentive salience: the effect of acute dopamine precursor depletion. J Psychiatry Neurosci. 2007;32:129–136.
    1. Lemke MR, Brecht HM, Koester J, Reichmann H. Effects of the dopamine agonist pramipexole on depression, anhedonia and motor functioning in Parkinson's disease. J Neurol Sci. 2006;248:266–270.
    1. Maj J, Rogoz Z. Synsergic effect of pramipexole and sertraline in the forced swimming test. Pol J Pharmacol. 1999;51:471–475.
    1. Montague PR, Dayan P, Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci. 1996;16:1936–1347.
    1. Montague PR, Hyman SE, Cohen JD. Computational roles for dopamine in behavioural control. Nature. 2004;431:760–767.
    1. Monti JM, Hawkins M, Jantos H, D'Angelo L, Fernandez M. Biphasic effects of dopamine D-2 receptor agonists on sleep and wakefulness in the rat. Psychopharmacology. 1988;95:395–400.
    1. Myers RE, Anderson LI, Dluzen DE. Estrogen, but not testosterone, attenuates methamphetamine-evoked dopamine output from superfused striatal tissue of female and male mice. Neuropharmacology. 2003;44:624–632.
    1. Nagy H, Keri S, Myers CE, Benedek G, Shohamy D, Gluck MA. Cognitive sequence learning in Parkinson's disease and amnestic mild cognitive impairment: Dissociation between sequential and non-sequential learning of associations. Neuropsychologia. 2007;45:1386–1392.
    1. Parkinson JA, Dalley JW, Cardinal RN, Bamford A, Fehnert B, Lachenal G, Rudarakanchana N, Halkerston KM, Robbins TW, Everitt BJ. Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behav Brain Res. 2002;137:149–163.
    1. Parkinson Study Group. Pramipexole vs levodopa as initial treatment for Parkinson disease: A randomized controlled trial. Parkinson Study Group. JAMA. 2000;284:1931–1938.
    1. Perbal S, Couillet J, Azouvi P, Pouthas V. Relationships between time estimation, memory, attention, and processing speed in patients with severe traumatic brain injury. Neuropsychologia. 2003;41:1599–1610.
    1. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature. 2006;442:1042–1045.
    1. Piercey MF, Hoffmann WE, Smith MW, Hyslop DK. Inhibition of dopamine neuron firing by pramipexole, a dopamine D3 receptor-preferring agonist: comparison to other dopamine receptor agonists. Eur J Pharmacol. 1996;312:35–44.
    1. Pizzagalli DA, Jahn AL, O'Shea JP. Toward an objective characterization of an anhedonic phenotype: a signal-detection approach. Biol Psychiatry. 2005;57:319–327.
    1. Reynolds JN, Hyland BI, Wickens JR. A cellular mechanism of reward-related learning. Nature. 2001;413:67–70.
    1. Robinson S, Rainwater AJ, Hnasko TS, Palmiter RD. Viral restoration of dopamine signaling to the dorsal striatum restores instrumental conditioning to dopamine-deficient mice. Psychopharmacology (Berl) 2007;191:567–578.
    1. Rye DB. The two faces of Eve: dopamine's modulation of wakefulness and sleep. Neurology. 2004;63 8 suppl 3:S2–S7.
    1. Rye DB, Jankovic J. Emerging views of dopamine in modulating sleep/wake state from an unlikely source: PD. Neurology. 2002;58:341–346.
    1. Samuels ER, Hou RH, Langley RW, Szabadi E, Bradshaw CW. Comparison of pramipexole and amisulpride on alertness, autonomic and endocrine functions in healthy volunteers. Psychopharmacology (Berl) 2006;187:498–510.
    1. Samuels ER, Hou RH, Langley RW, Szabadi E, Bradshaw CM. Comparison of pramipexole and modafinil on arousal, autonomic, and endocrine functions in healthy volunteers. J Psychopharmacol. 2006;20:756–770.
    1. Schmitz Y, Benoit-Marand M, Gonon F, Sulzer D. Presynaptic regulation of dopaminergic neurotransmission. J Neurochem. 2003;87:273–289.
    1. Schuck S, Bentue-Ferrer D, Kleinermans D, Reymann JM, Polard E, Gandon JM, Allain H. Psychomotor and cognitive effects of piribedil, a dopamine agonist, in young healthy volunteers. Fundam Clin Pharmacol. 2002;16:57–65.
    1. Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science. 1997;275:1593–1599.
    1. Schultz W. Getting formal with dopamine and reward. Neuron. 2002;36:241–263.
    1. Schultz W. Behavioral dopamine signals. Trends Neurosci. 2007;30:203–210.
    1. Servan-Schreiber D, Carter CS, Bruno RM, Cohen JD. Dopamine and the mechanisms of cognition: Part II. D-amphetamine effects in human subjects performing a selective attention task. Biol Psychiatry. 1998;43:723–729.
    1. Sevy S, Hassoun Y, Bechara A, Yechiam E, Napolitano B, Burdick K, Delman H, Malhotra A. Emotion-based decision-making in healthy subjects: short-term effects of reducing dopamine levels. Psychopharmacology (Berl) 2006;188:228–235.
    1. Shohamy D, Myers CE, Grossman S, Sage J, Gluck MA. The role of dopamine in cognitive sequence learning: evidence from Parkinson's disease. Behav Brain Res. 2005;156:191–199.
    1. Sokoloff P, Diaz J, Le Foll B, Guillin O, Leriche L, Bezard E, Gross C. The dopamine D3 receptor: a therapeutic target for the treatment of neuropsychiatric disorders. CNS Neurol Disord Drug Targets. 2006;5:25–43.
    1. Sokolowski JD, Conlan AN, Salamone JD. A microdialysis study of nucleus accumbens core and shell dopamine during operant responding in the rat. Neuroscience. 1998;86:1001–1009.
    1. Spielberger CD, Gorsuch RL, Lushere RE. Manual of the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press; 1970.
    1. Schwabe K, Koch M. Effects of aripiprazole on operant responding for a natural reward after psychostimulant withdrawal in rats. Psychopharmacology (Berl) 2007;191:759–765.
    1. Sumners C, de Vries JB, Horn AS. Behavioural and neurochemical studies on apomorphine-induced hypomotility in mice. Neuropharmacology. 1981;20:1203–1208.
    1. Tissari AH, Rossetti ZL, Meloni M, Frau MI, Gessa GL. Autoreceptors mediate the inhibition of dopamine synthesis by bromocriptine and lisuride in rats. Eur J Pharmacol. 1983;91:463–468.
    1. Tripp G, Alsop B. Sensitivity to reward frequency in boys with attention deficit hyperactivity disorder. J Clin Child Psychol. 1999;28:366–375.
    1. Waelti P, Dickinson A, Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature. 2001;412:43–48.
    1. Weintraub D, Siderowf AD, Potenza MN, Goveas J, Morales KH, Duda JE, Moberg PJ, Stern MB. Association of dopamine agonist use with impulse control disorders in Parkinson disease. Arch Neurol. 2006;63:969–973.
    1. Willner P. Dopaminergic mechanisms in depression and mania. In: Bloom FE, Kupfer DJ, editors. Psychopharmacology: The Fourth Generation of Progress. New York: Raven Press; 1995. pp. 921–931.
    1. Willner P, Lappas S, Cheeta S, Muscat R. Reversal of stress-induced anhedonia by the dopamine receptor agonist, pramipexole. Psychopharmacology. 1994;115:454–462.
    1. Wright CE, Sisson TL, Ichhpurani AK, Peters GR. Steady-state pharmacokinetic properties of pramipexole in healthy volunteers. J Clin Pharmacol. 1997;37:520–525.

Source: PubMed

3
订阅