The role of the striatum in aversive learning and aversive prediction errors

Abstract

Neuroeconomic studies of decision making have emphasized reward learning as critical in the representation of value-driven choice behaviour. However, it is readily apparent that punishment and aversive learning are also significant factors in motivating decisions and actions. In this paper, we review the role of the striatum and amygdala in affective learning and the coding of aversive prediction errors (PEs). We present neuroimaging results showing aversive PE-related signals in the striatum in fear conditioning paradigms with both primary (shock) and secondary (monetary loss) reinforcers. These results and others point to the general role for the striatum in coding PEs across a broad range of learning paradigms and reinforcer types.

Figures

Figure 1

(a,b) Striatal responses during reward conditioning with secondary reinforcers. In this paradigm, the participants are presented with two conditioned stimuli that predict a potential reward (CS+, blue bar) or not (CS−, yellow bar). Adapted with permission from Delgado et al. (2008). ROI, region of interest.

Figure 2

Experimental paradigm. The experimental task consisted of two parts: (a) a gambling session to allow participants to earn a monetary endowment (adapted from Delgado et al. 2000) and (b) an aversive conditioning paradigm where presentation of the unconditioned stimulus (−$2.00) led to monetary detractions from the total sum earned during the gambling session (adapted from Delgado et al. 2006).

Figure 3

SCRs during the aversive conditioning: SCR data suggest successful aversive conditioning with a secondary reinforcer such as monetary losses. Blue bar, CS+; yellow bar, CS−.

Figure 4

Activation of striatum ROI defined by a contrast of PE regressor and fixation. The ROI is located in the right hemisphere, in the anterior portion of the head of the caudate nucleus (x, y, z=13, 20, 4).