The nucleus accumbens: a switchboard for goal-directed behaviors

Aaron J Gruber, Rifat J Hussain, Patricio O'Donnell, Aaron J Gruber, Rifat J Hussain, Patricio O'Donnell

Abstract

Reward intake optimization requires a balance between exploiting known sources of rewards and exploring for new sources. The prefrontal cortex (PFC) and associated basal ganglia circuits are likely candidates as neural structures responsible for such balance, while the hippocampus may be responsible for spatial/contextual information. Although studies have assessed interactions between hippocampus and PFC, and between hippocampus and the nucleus accumbens (NA), it is not known whether 3-way interactions among these structures vary under different behavioral conditions. Here, we investigated these interactions with multichannel recordings while rats explored an operant chamber and while they performed a learned lever-pressing task for reward in the same chamber shortly afterward. Neural firing and local field potentials in the NA core synchronized with hippocampal activity during spatial exploration, but during lever pressing they instead synchronized more strongly with the PFC. The latter is likely due to transient drive of NA neurons by bursting prefrontal activation, as in vivo intracellular recordings in anesthetized rats revealed that NA up states can transiently synchronize with spontaneous PFC activity and PFC stimulation with a bursting pattern reliably evoked up states in NA neurons. Thus, the ability to switch synchronization in a task-dependent manner indicates that the NA core can dynamically select its inputs to suit environmental demands, thereby contributing to decision-making, a function that was thought to primarily depend on the PFC.

Conflict of interest statement

Competing Interests: The authors have declared that no competing interests exist.

Figures

Figure 1. PFC-NA unit correlation is strengthened…
Figure 1. PFC-NA unit correlation is strengthened during bar press for a natural reward.
(A) Representative cross-correlograms of a NA-PFC neuron pair (referenced to PFC firing at time 0) when the animal was exploring (gray) and during bar pressing for sucrose (black). Right: bar graphs showing the ratio between the crosscorrelogram peak and a similar analysis of shuffled recordings from the same pairs for both behavioral conditions. Mean±SD; * p

Figure 2. Dominant frequencies in the VH,…

Figure 2. Dominant frequencies in the VH, NA and PFC field potentials differ between exploration…

Figure 2. Dominant frequencies in the VH, NA and PFC field potentials differ between exploration and goal-directed behavior.
(A) Normalized spectral densities in the NA shell, NA core, PFC and VH obtained from simultaneously recorded epochs (4 seconds) in which the animals were exploring the cage (red line). The epochs were selected to match the location and body orientation of the operant task. The blue line represents the normalized spectral densities for the same four locations but during 4 second epochs in which the rats were lever-pressing for sucrose (2 seconds prior and after the lever press). The graphs were constructed with data from 6 sessions in 5 rats for the NA core, and 2 sessions in 2 rats for the NA shell (all of them with simultaneous recordings in the PFC and VH). Strong theta peaks are evident in all regions during exploration (green arrows), but they are lost in the NA core and PFC during the instrumental behavior. An increase in delta activity can be observed instead. (B) Pseudocolor plots of relative spectral power in the NA shell, NA core, PFC and VH during a 5-second epoch in which rats were exploring (top) and during a 5-second epoch centered on the lever press when the animals were engaged in instrumental behavior (bottom). The LFP traces of one of the epochs included in the analyses are shown above each box. Event-triggered and exploration spectrograms were constructed from one session from each animal and the display is the averaged data of all animals, revealing a strong theta oscillation during exploration, which weakens in the NA core and PFC (but not in the NA shell and VH) during lever-pressing. The NA core and PFC show instead strong activity in the delta range (arrows), which are driven by slow deflections that can be observed in the traces above. (D) Cross-spectral densities were calculated to determine coherence between similar frequency peaks in LFP obtained simultaneously from different brain regions during exploration and instrumental behavior. The two leftward panels illustrate representative pairings of PFC and NA core, and VH and NA core while the rat was exploring (red line), revealing a high coherence in the theta range between VH and NA core (arrow in second panel from left). The blue line in both panels are cross-spectral densities in the same pairs when the rat was bar pressing for sucrose in the same session, showing a peak in the delta range between NA core and PFC (arrow in left panel). The two rightward panels illustrate cross-spectral densities between the NA shell and PFC and VH in the same rat and session. A strong theta peak is present in the shell-VH cross-spectrum independently of the behavioral condition.

Figure 3. Weight of spectral bands during…

Figure 3. Weight of spectral bands during spatial exploration and goal-directed behavior.

Bar graphs depicting…

Figure 3. Weight of spectral bands during spatial exploration and goal-directed behavior.
Bar graphs depicting summed power for the 1–4 Hz (delta), 4–8 Hz (theta), 8–14 Hz (alpha), 14–30 (beta), and 30–50 (gamma) bands. Gray bars show the weight of each band during spatial exploration and black bars represent band weight during goal-directed behavior. Top to bottom graphs illustrate spectral bands from all accumbens core, hippocampal, and PFC recordings.

Figure 4. PFC stimulation with trains of…

Figure 4. PFC stimulation with trains of pulses evokes persistent depolarizations in NA neurons.

Overlay…

Figure 4. PFC stimulation with trains of pulses evokes persistent depolarizations in NA neurons.
Overlay of six traces obtained from a NA neuron during in vivo intracellular recording from an anesthetized rat, showing the membrane potential responses to stimulating the PFC with a train of 5 pulses at 50 Hz (arrows indicate the stimulation times; stimulus artifacts were removed for clarity). The traces were selected to display stimuli delivered during both up and down states, and in either case a sustained depolarization was observed.

Figure 5. Cross-covariance analysis of intracellular NA…

Figure 5. Cross-covariance analysis of intracellular NA neuron membrane potential and PFC LFP in anesthetized…

Figure 5. Cross-covariance analysis of intracellular NA neuron membrane potential and PFC LFP in anesthetized rats.
(A) Simultaneous recording of intracellular membrane potential of a NA medium spiny neuron (MSN; top) and PFC field potential (LFP; bottom) showing spontaneous oscillations typical of an anesthetized rat. Transitions of MSN membrane potential between a hyperpolarized down state and depolarized up states are detected with a threshold (dotted line). (B) Pseudocolor plot of the cross covariance of these traces with a ±200 ms time lag window (ordinate). MSN membrane potential transitions from down to up states are indicated by dark triangles, and up-to-down transitions with white triangles. Oblique arrows point to two consecutive up state onsets showing high covariance (left) and no covariance (right) with PFC LFP. (C) Overlay of the cross covariance plot in B and the MSN membrane potential trace in A showing the high covariance epochs to correspond to state transitions. (D) Cross covariance at successive down-to-up state transitions from data in A, showing that both the magnitude and lag of the peak cross-covariance (indicated by ‘+’) vary in time. Transitions that co-vary with PFC LFP are interspersed with those that do not co-vary. (E) Cross covariance in B plotted in time and superimposed with mean±standard deviation of cross covariance computed from randomized versions of the traces in A (gray region). Cross-covariance near lag = 0 shows the data clustered in two populations: a significantly covariant set of events and others with almost no covariance.
Figure 2. Dominant frequencies in the VH,…
Figure 2. Dominant frequencies in the VH, NA and PFC field potentials differ between exploration and goal-directed behavior.
(A) Normalized spectral densities in the NA shell, NA core, PFC and VH obtained from simultaneously recorded epochs (4 seconds) in which the animals were exploring the cage (red line). The epochs were selected to match the location and body orientation of the operant task. The blue line represents the normalized spectral densities for the same four locations but during 4 second epochs in which the rats were lever-pressing for sucrose (2 seconds prior and after the lever press). The graphs were constructed with data from 6 sessions in 5 rats for the NA core, and 2 sessions in 2 rats for the NA shell (all of them with simultaneous recordings in the PFC and VH). Strong theta peaks are evident in all regions during exploration (green arrows), but they are lost in the NA core and PFC during the instrumental behavior. An increase in delta activity can be observed instead. (B) Pseudocolor plots of relative spectral power in the NA shell, NA core, PFC and VH during a 5-second epoch in which rats were exploring (top) and during a 5-second epoch centered on the lever press when the animals were engaged in instrumental behavior (bottom). The LFP traces of one of the epochs included in the analyses are shown above each box. Event-triggered and exploration spectrograms were constructed from one session from each animal and the display is the averaged data of all animals, revealing a strong theta oscillation during exploration, which weakens in the NA core and PFC (but not in the NA shell and VH) during lever-pressing. The NA core and PFC show instead strong activity in the delta range (arrows), which are driven by slow deflections that can be observed in the traces above. (D) Cross-spectral densities were calculated to determine coherence between similar frequency peaks in LFP obtained simultaneously from different brain regions during exploration and instrumental behavior. The two leftward panels illustrate representative pairings of PFC and NA core, and VH and NA core while the rat was exploring (red line), revealing a high coherence in the theta range between VH and NA core (arrow in second panel from left). The blue line in both panels are cross-spectral densities in the same pairs when the rat was bar pressing for sucrose in the same session, showing a peak in the delta range between NA core and PFC (arrow in left panel). The two rightward panels illustrate cross-spectral densities between the NA shell and PFC and VH in the same rat and session. A strong theta peak is present in the shell-VH cross-spectrum independently of the behavioral condition.
Figure 3. Weight of spectral bands during…
Figure 3. Weight of spectral bands during spatial exploration and goal-directed behavior.
Bar graphs depicting summed power for the 1–4 Hz (delta), 4–8 Hz (theta), 8–14 Hz (alpha), 14–30 (beta), and 30–50 (gamma) bands. Gray bars show the weight of each band during spatial exploration and black bars represent band weight during goal-directed behavior. Top to bottom graphs illustrate spectral bands from all accumbens core, hippocampal, and PFC recordings.
Figure 4. PFC stimulation with trains of…
Figure 4. PFC stimulation with trains of pulses evokes persistent depolarizations in NA neurons.
Overlay of six traces obtained from a NA neuron during in vivo intracellular recording from an anesthetized rat, showing the membrane potential responses to stimulating the PFC with a train of 5 pulses at 50 Hz (arrows indicate the stimulation times; stimulus artifacts were removed for clarity). The traces were selected to display stimuli delivered during both up and down states, and in either case a sustained depolarization was observed.
Figure 5. Cross-covariance analysis of intracellular NA…
Figure 5. Cross-covariance analysis of intracellular NA neuron membrane potential and PFC LFP in anesthetized rats.
(A) Simultaneous recording of intracellular membrane potential of a NA medium spiny neuron (MSN; top) and PFC field potential (LFP; bottom) showing spontaneous oscillations typical of an anesthetized rat. Transitions of MSN membrane potential between a hyperpolarized down state and depolarized up states are detected with a threshold (dotted line). (B) Pseudocolor plot of the cross covariance of these traces with a ±200 ms time lag window (ordinate). MSN membrane potential transitions from down to up states are indicated by dark triangles, and up-to-down transitions with white triangles. Oblique arrows point to two consecutive up state onsets showing high covariance (left) and no covariance (right) with PFC LFP. (C) Overlay of the cross covariance plot in B and the MSN membrane potential trace in A showing the high covariance epochs to correspond to state transitions. (D) Cross covariance at successive down-to-up state transitions from data in A, showing that both the magnitude and lag of the peak cross-covariance (indicated by ‘+’) vary in time. Transitions that co-vary with PFC LFP are interspersed with those that do not co-vary. (E) Cross covariance in B plotted in time and superimposed with mean±standard deviation of cross covariance computed from randomized versions of the traces in A (gray region). Cross-covariance near lag = 0 shows the data clustered in two populations: a significantly covariant set of events and others with almost no covariance.

References

    1. Fuster JM. The Prefrontal Cortex. Anatomy, Physiology, and Neuropsychology of the frontal lobe. New York: Lippincott-Raven; 1997. p. 333.
    1. Christakou A, Robbins TW, Everitt BJ. Prefrontal cortical-ventral striatal interactions involved in affective modulation of attentional performance: implications for corticostriatal circuit function. J Neurosci. 2004;24:773–780.
    1. Haddon JE, Killcross S. Prefrontal cortex lesions disrupt the contextual control of response conflict. J Neurosci. 2006;26:2933–2940.
    1. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ. Cortical substrates for exploratory decisions in humans. Nature. 2006;441:876–879.
    1. Grace AA, Floresco SB, Goto Y, Lodge DJ. Regulation of firing of dopaminergic neurons and control of goal-directed behaviors. Trends Neurosci. 2007;30:220–227.
    1. Kelley AE. Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning. Neurosci Biobehav Rev. 2004;27:765–776.
    1. Mogenson GJ, Jones DL, Yim CY. From motivation to action: functional interface between limbic system and the motor system. Progr Neurobiol. 1980;14:69–97.
    1. Groenewegen HJ, Wright CI, Beijer AVJ. The nucleus accumbens: gateway for limbic structures to reach the motor system? Progr Brain Res. 1996;107:485–511.
    1. O'Donnell P. Dopamine gating of forebrain neural ensembles. Eur J Neurosci. 2003;17:429–435.
    1. Berendse HW, Galis-de Graaf Y, Groenewegen HJ. Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat. J Comp Neurol. 1992;316:314–347.
    1. Kelley AE, Domesick VB. The distribution of the projection from the hippocampal formation to the nucleus accumbens in the rat: an anterograde- and retrograde-horseradish peroxidase study. Neuroscience. 1982;7:2321–2335.
    1. O'Donnell P, Grace AA. Synaptic interactions among excitatory afferents to nucleus accumbens neurons: hippocampal gating of prefrontal cortical input. J Neurosci. 1995;15:3622–3639.
    1. Berke JD, Okatan M, Skurski J, Eichenbaum HB. Oscillatory entrainment of striatal neurons in freely moving rats. Neuron. 2004;43:883–896.
    1. Tabuchi ET, Mulder AB, Wiener SI. Position and behavioral modulation of synchronization of hippocampal and accumbens neuronal discharges in freely moving rats. Hippocampus. 2000;10:717–728.
    1. DeCoteau WE, Thorn C, Gibson DJ, Courtemanche R, Mitra P, et al. Learning-related coordination of striatal and hippocampal theta rhythms during acquisition of a procedural maze task. Proc Natl Acad Sci U S A. 2007;104:5644–5649.
    1. Jones MW, Wilson MA. Theta rhythms coordinate hippocampal-prefrontal interactions in a spatial memory task. PLoS Biol. 2005;3:e402. doi:10.1371/journal.pbio.0030402.
    1. Block AE, Dhanji H, Thompson-Tardif SF, Floresco SB. Thalamic-prefrontal cortical-ventral striatal circuitry mediates dissociable components of strategy set shifting. Cereb Cortex. 2007;17:1625–1636.
    1. Narayanan NS, Laubach M. Neuronal correlates of post-error slowing in the rat dorsomedial prefrontal cortex. J Neurophysiol. 2008;100:520–525.
    1. Ostlund SB, Balleine BW. Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. J Neurosci. 2005;25:7763–7770.
    1. Peters YM, O'Donnell P, Carelli RM. Prefrontal cortical cell firing during maintenance, extinction, and reinstatement of goal-directed behavior for natural reward. Synapse. 2005;56:74–83.
    1. Narayanan NS, Laubach M. Top-down control of motor cortex ensembles by dorsomedial prefrontal cortex. Neuron. 2006;52:921–931.
    1. French SJ, Totterdell S. Hippocampal and prefrontal cortical inputs monosynaptically converge with individual projection neurons of the nucleus accumbens. J Comp Neurol. 2002;446:151–165.
    1. Paxinos G, Watson C. The rat brain in stereotaxic coordinates. San Diego: Academic Press; 1998.
    1. DeCoteau WE, Thorn C, Gibson DJ, Courtemanche R, Mitra P, et al. Oscillations of local field potentials in the rat dorsal striatum during spontaneous and instructed behaviors. J Neurophysiol. 2007;97:3800–3805.
    1. Goto Y, O'Donnell P. Synchronous activity in the hippocampus and nucleus accumbens in vivo. J Neurosci. 2001;21:RC131.
    1. Goto Y, O'Donnell P. Network synchrony in the nucleus accumbens in vivo. J Neurosci. 2001;21:4498–4504.
    1. Carelli RM. Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. ‘natural’ reinforcement. Physiol Behav. 2002;76:379–387.
    1. Buzsaki G. Theta oscillations in the hippocampus. Neuron. 2002;33:325–340.
    1. Buzsaki G. Theta rhythm of navigation: link between path integration and landmark navigation, episodic and semantic memory. Hippocampus. 2005;15:827–840.
    1. Vertes RP. Hippocampal theta rhythm: a tag for short-term memory. Hippocampus. 2005;15:923–935.
    1. Goto Y, O'Donnell P. Delayed mesolimbic system alteration in a developmental animal model of schizophrenia. J Neurosci. 2002;22:9070–9077.
    1. Balleine BW, Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology. 1998;37:407–419.
    1. Steriade M, Nuñez A, Amzica F. A novel slow (<1 Hz) oscillation of neocortical neurons in vivo: depolarizing and hyperpolarizing components. J Neurosci. 1993;13:3252–3265.
    1. Steriade M, Amzica F. Coalescence of sleep rhythms and their chronology in corticothalamic networks. Sleep Res Online. 1998;1:1–10.
    1. Rickert J, Oliveira SC, Vaadia E, Aertsen A, Rotter S, et al. Encoding of movement direction in different frequency ranges of motor cortical local field potentials. J Neurosci. 2005;25:8815–8824.
    1. Gonzalez-Hernandez JA, Pita-Alcorta C, Cedeno I, Bosch-Bayard J, Galan-Garcia L, et al. Wisconsin Card Sorting Test synchronizes the prefrontal, temporal and posterior association cortex in different frequency ranges and extensions. Hum Brain Mapp. 2002;17:37–47.
    1. Leung LS, Yim CY. Rhythmic delta-frequency activities in the nucleus accumbens of anesthetized and freely moving rats. Can J Physiol Pharmacol. 1993;71:311–320.
    1. Floresco SB, Ghods-Sharifi S, Vexelman C, Magyar O. Dissociable roles for the nucleus accumbens core and shell in regulating set shifting. J Neurosci. 2006;26:2449–2457.
    1. Gruber A, O'Donnell P. Bursting activation of prefrontal cortex drives sustained up states in nucleus accumbens spiny neurons in vivo. Synapse. 2008 in press.
    1. Collins P, Roberts AC, Dias R, Everitt BJ, Robbins TW. Perseveration and strategy in a novel spatial self-ordered sequencing task for nonhuman primates: effects of excitotoxic lesions and dopamine depletions of the prefrontal cortex. J Cogn Neurosci. 1998;10:332–354.
    1. Perlstein WM, Dixit NK, Carter CS, Noll DC, Cohen JD. Prefrontal cortex dysfunction mediates deficits in working memory and prepotent responding in schizophrenia. Biol Psychiatry. 2003;53:25–38.

Source: PubMed

3
S'abonner