The neural correlates of subjective value during intertemporal choice
Joseph W Kable, Paul W Glimcher, Joseph W Kable, Paul W Glimcher
Abstract
Neuroimaging studies of decision-making have generally related neural activity to objective measures (such as reward magnitude, probability or delay), despite choice preferences being subjective. However, economic theories posit that decision-makers behave as though different options have different subjective values. Here we use functional magnetic resonance imaging to show that neural activity in several brain regions--particularly the ventral striatum, medial prefrontal cortex and posterior cingulate cortex--tracks the revealed subjective value of delayed monetary rewards. This similarity provides unambiguous evidence that the subjective value of potential rewards is explicitly represented in the human brain.
Figures
References
- Weber EH. De Pulsu, Resorptione, Audita et Tactu. Annotationes Anatomicae et Physiologicae. CF Koehler; Lipsiae: 1834.
- Fechner GT. Elemente der Psychophysik. Breitkopf & Hartel; Leipzig: 1860.
- Stevens S. Neural events and the psychophysical law. Science. 1970;170:1043–1050.
- Bernoulli D. The Works. Birkhauser; Boston: 1982.
- Platt ML, Glimcher PW. Neural correlates of decision variables in parietal cortex. Nature. 1999;400:233–238.
- Abler B, Walter H, Erk S, Kammerer H, Spitzer M. Prediction error as a linear function of reward probability is coded in human nucleus accumbens. Neuroimage. 2006;31:790–795.
- Cromwell HC, Schultz W. Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol. 2003;89:2823–2838.
- Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol. 2000;84:3072–3077.
- McCoy AN, Crowley JC, Haghighian G, Dean HL, Platt ML. Saccade reward signals in posterior cingulate cortex. Neuron. 2003;40:1031–1040.
- O’Doherty J, Critchley H, Deichmann R, Dolan RJ. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci. 2003;23:7931–7939.
- Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron. 2001;30:619–639.
- Nieuwenhuis S, et al. Activity in human reward-sensitive brain areas is strongly context dependent. Neuroimage. 2005;25:1302–1309.
- Rogers RD, et al. Distinct portions of anterior cingulate cortex and medial prefrontal cortex are activated by reward processing in separable phases of decision-making cognition. Biol Psychiatry. 2004;55:594–602.
- Kuhnen CM, Knutson B. The neural basis of financial risk taking. Neuron. 2005;47:763–770.
- Knutson B, Taylor J, Kaufman M, Peterson R, Glover G. Distributed neural representation of expected value. J Neurosci. 2005;25:4806–4812.
- Bowman EM, Aigner TG, Richmond BJ. Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J Neurophysiol. 1996;75:1061–1073.
- Cromwell HC, Hassani OK, Schultz W. Relative reward processing in primate striatum. Exp Brain Res. 2005;162:520–525.
- McCoy AN, Platt ML. Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci. 2005;8:1220–1227.
- Dorris MC, Glimcher PW. Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron. 2004;44:365–378.
- McClure SM, et al. Neural correlates of behavioral preference for culturally familiar drinks. Neuron. 2004;44:379–387.
- Gottfried JA, O’Doherty J, Dolan RJ. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science. 2003;301:1104–1107.
- Tanaka SC, et al. Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci. 2004;7:887–893.
- Padoa-Schioppa C, Assad JA. Neurons in the orbitofrontal cortex encode economic value. Nature. 2006;441:223–226.
- Daw ND, O’Doherty JP, Dayan P, Seymour B, Dolan RJ. Cortical substrates for exploratory decisions in humans. Nature. 2006;441:876–879.
- O’Doherty JP, Buchanan TW, Seymour B, Dolan RJ. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron. 2006;49:157–166.
- Johnson KO, Hsiao SS, Yoshioka T. Neural coding and the basic law of psychophysics. Neuroscientist. 2002;8:111–121.
- Parker AJ, Newsome WT. Sense and the single neuron: probing the physiology of perception. Annu Rev Neurosci. 1998;21:227–277.
- Werner G, Mountcastle VB. Quantitative relations between mechanical stimuli to the skin and neural responses evoked by them. In: Kenshalo DR, editor. The Skin Senses. Charles C Thomas Publisher; Springfield, Illinois: 1968. pp. 112–138.
- Newsome WT, Britten KH, Movshon JA. Neuronal correlates of a perceptual decision. Nature. 1989;341:52–54.
- Frederick S, Loewenstein G, O’Donoghue T. Time discounting and time preference: a critical review. J Econ Lit. 2002;40:351–401.
- Mazur JE. An adjusting procedure for studying delayed reinforcement. In: Commons ML, Mazur JE, Nevin JA, Rachlin H, editors. Quantitative Analysis of Behavior: The Effects of Delay and Intervening Events on Reinforcement Value. Lawrence Erlbaum Associates, Publishers; Hillsdale, New Jersey: 1987. pp. 55–73.
- Laibson D. Golden eggs and hyperbolic discounting. Q J Econ. 1997;12:443–477.
- Green L, Myerson J. A discounting framework for choice with delayed and probabilistic rewards. Psychol Bull. 2004;130:769–792.
- Benhabib J, Bisin A, Schotter A. Working Paper. New York University Department of Economics; New York: 2006. Present-bias, quasi-hyperbolic discounting and fixed costs. < >.
- McClure SM, Laibson DI, Loewenstein G, Cohen JD. Separate neural systems value immediate and delayed monetary rewards. Science. 2004;306:503–507.
- Teller DY, Pugh EN. Linking propositions in color vision. In: Mollon JD, Sharpe LT, editors. Colour Vision: Physiology and Psychophysics. Academic Press; New York: 1983. pp. 577–589.
- von Neumann J, Morgenstern O. The Theory of Games and Economic Behavior. Princeton University Press; Princeton, New Jersey: 1944.
- Samuelson PA. Foundations of Economic Analysis. Harvard University Press; Cambridge, Massachusetts: 1947.
- Gul F, Pesendorfer W. Working Paper. Princeton University Department of Economics; Princeton, New Jersey: 2005. The case for mindless economics. < >.
- Gusnard DA, Raichle ME. Searching for a baseline: functional imaging and the resting human brain. Nat Rev Neurosci. 2001;2:685–694.
- Zysset S, Huber O, Ferstl E, von Cramon DY. The anterior frontomedian cortex and evaluative judgment: an fMRI study. Neuroimage. 2002;15:983–991.
- Hsu M, Bhatt M, Adolphs R, Tranel D, Camerer CF. Neural systems responding to degrees of uncertainty in human decision-making. Science. 2005;310:1680–1683.
- Paulus MP, Frank LR. Anterior cingulate activity modulates nonlinear decision weight function of uncertain prospects. Neuroimage. 2006;30:668–677.
- Tom SM, Fox CR, Trepel C, Poldrack RA. The neural basis of loss aversion in decision-making under risk. Science. 2007;315:515–518.
- Sugrue LP, Corrado GS, Newsome WT. Matching behavior and the representation of value in the parietal cortex. Science. 2004;304:1782–1787.
- Shadlen MN, Newsome WT. Motion perception: seeing and deciding. Proc Natl Acad Sci USA. 1996;93:628–633.
- Collier M, Williams MB. Eliciting individual discount rates. Exp Econ. 1999;2:107–127.
- Camerer CF, Hogarth RM. The effects of financial incentives in experiments: a review and capital-labor-production framework. J Risk Uncertain. 1999;19:7–42.
- Smith VL, Walker JM. Monetary rewards and decision cost in experimental economics. Econ Inq. 1993;31:245–261.
Source: PubMed