The attribution of incentive salience to reward-paired cues is dependent on dopamine release in the nucleus accumbens core (NAcC). These dopamine signals conform to traditional reward-prediction error signals and have been shown to diminish with time. Here we examined whether the diminishing dopamine signal in the NAcC has functional implications for the expression of sign-tracking, a Pavlovian conditioned response indicative of the attribution of incentive salience to reward-paired cues. Food-restricted male Sprague Dawley rats were trained in a Pavlovian paradigm in which an insertable lever predicted delivery of food reward in a nearby food cup. After 7 or 14 training sessions, rats received infusions of saline, the dopamine antagonist flupenthixol, or the GABA agonists baclofen and muscimol into the NAcC or the dorsal lateral striatum (DLS). Dopamine antagonism within the NAcC attenuated sign-tracking, whereas reversible inactivation did not affect sign-tracking but increased non-specific food cup checking behaviors. Neither drug in the DLS affected sign-tracking behavior. Critically, extended training did not alter these effects. Although extended experience with an incentive stimulus may reduce cue-evoked dopamine in the NAcC, this does not remove the dependence on dopamine in this region to promote Pavlovian cue approach nor result in the recruitment of dorsal lateral striatal systems for this behavior. These data support the notion that dopamine within the mesoaccumbal system, but not the nigrostriatal system, contributes critically to incentive motivational processes independent of the length of training.

The context in which reward-paired cues are encountered can resolve ambiguity and set the occasion for appropriate reward-seeking. The psychological processes by which contexts regulate reward-seeking remain unclear as contexts are diffuse and difficult to isolate from other stimuli. To overcome this, we modeled a context as a phasic and discrete event-an occasion setter (OS)-which allowed for control over its presentation and influence on cue-driven reward-seeking. This allowed us to directly assess how OSs regulate the predictive and motivational significance of Pavlovian cues. Male rats (n = 50) were trained in a Pavlovian procedure where the presentation of an ambiguous conditioned stimulus (CS) was reinforced only if preceded by an occasion setting cue. We assessed the motivational value of the OS and CS alone or in combination using tests of conditioned reinforcement. Rats enhanced conditioned approach to the reward port during the CS when it was preceded by the OS. When allowed the opportunity, rats responded more to obtain presentations of the CS in combination with the OS than the CS alone. Critically, rats also worked to obtain presentations of the OS alone more than the CS alone, and this was resistant to manipulations of the value of the OS. We conclude that occasion setting can act via incentive motivational mechanisms and that, apart from resolving predictive information about ambiguous reward-paired cues, OSs themselves generate states of appetitive motivation that can facilitate reward-seeking.

Occasion setting refers to the ability of 1 stimulus, an occasion setter, to modulate the efficacy of the association between another, conditioned stimulus (CS) and an unconditioned stimulus (US) or reinforcer. Occasion setters and simple CSs are readily distinguished. For example, occasion setters are relatively immune to extinction and counterconditioning, and their combination and transfer functions differ substantially from those of simple CSs. Similarly, the acquisition of occasion setting is favored when stimuli are separated by longer intervals, by empty trace intervals, and are of different modalities, whereas the opposite conditions typically favor the acquisition of simple associations. Furthermore, the simple conditioning and occasion setting properties of a single stimulus can be independent, for example, that stimulus may simultaneously predict the occurrence of a reinforcer and indicate that another stimulus will not be reinforced. Many behavioral phenomena that are intractable to simple associative analysis are better understood within an occasion setting framework. Besides capturing the distinction between direct and modulatory control common to many arenas in neuroscience, occasion setting provides a model for the hierarchical organization of memory for events and event relations, and for contextual control more broadly. Although early lesion studies further differentiated between occasion setting and simple conditioning functions, little is known about the neurobiology of occasion setting. Modern techniques for precise manipulation and monitoring of neuronal activity in multiple brain regions are ideally suited for disentangling contributions of simple conditioning and occasion setting in associative learning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Ventral tegmental area (VTA) dopamine (DA) neurons are often thought to uniformly encode reward prediction errors. Conversely, DA release in the nucleus accumbens (NAc), the prominent projection target of these neurons, has been implicated in reinforcement learning, motivation, aversion, and incentive salience. This contrast between heterogeneous functions of DA release versus a homogeneous role for DA neuron activity raises numerous questions regarding how VTA DA activity translates into NAc DA release. Further complicating this issue is increasing evidence that distinct VTA DA projections into defined NAc subregions mediate diverse behavioral functions. Here, we evaluate evidence for heterogeneity within the mesoaccumbal DA system and argue that frameworks of DA function must incorporate the precise topographic organization of VTA DA neurons to clarify their contribution to health and disease.

The paraventricular nucleus of the thalamus (PVT) has been implicated in behavioral responses to reward-associated cues. However, the precise role of the PVT in these behaviors has been difficult to ascertain since Pavlovian-conditioned cues can act as both predictive and incentive stimuli. The "sign-tracker/goal-tracker" rat model has allowed us to further elucidate the role of the PVT in cue-motivated behaviors, identifying this structure as a critical component of the neural circuitry underlying individual variation in the propensity to attribute incentive salience to reward cues. The current study assessed differences in the engagement of specific PVT afferents and efferents in response to presentation of a food-cue that had been attributed with only predictive value or with both predictive and incentive value. The retrograde tracer fluorogold (FG) was injected into the PVT or the nucleus accumbens (NAc) of rats, and cue-induced c-Fos in FG-labeled cells was quantified. Presentation of a predictive stimulus that had been attributed with incentive value elicited c-Fos in PVT afferents from the lateral hypothalamus, medial amygdala (MeA), and the prelimbic cortex (PrL), as well as posterior PVT efferents to the NAc. PVT afferents from the PrL also showed elevated c-Fos levels following presentation of a predictive stimulus alone. Thus, presentation of an incentive stimulus results in engagement of subcortical brain regions; supporting a role for the hypothalamic-thalamic-striatal axis, as well as the MeA, in mediating responses to incentive stimuli; whereas activity in the PrL to PVT pathway appears to play a role in processing the predictive qualities of reward-paired stimuli.

Reward-seeking requires the coordination of motor programs to achieve goals. Midbrain dopamine neurons are critical for reinforcement and their activation is sufficient for learning about cues, actions, and outcomes. Here we examine in detail the mechanisms underlying the ability of ventral tegmental area (VTA) and substantia nigra (SNc) dopamine neurons to support instrumental learning. By exploiting numerous behavioral tasks in combination with time-limited optogenetic manipulations, we reveal that VTA and SNc dopamine neurons generate reinforcement through separable psychological processes. VTA dopamine neurons imbue actions and their associated cues with motivational value that allows flexible and persistent pursuit whereas SNc dopamine neurons support time-limited, precise, action-specific learning that is non-scalable and inflexible. This architecture is reminiscent of actor-critic reinforcement learning models with VTA and SNc instructing the critic and actor, respectively. Our findings indicate that heterogeneous dopamine systems support unique forms of instrumental learning that ultimately result in disparate reward-seeking strategies.

Elucidating the neurobiological mechanisms underlying individual differences in the extent to which reward cues acquire the ability to act as incentive stimuli may contribute to the development of successful treatments for addiction and related disorders. We used the sign-tracker/goal-tracker animal model to examine the role of dopamine D2 and D3 receptors in the propensity to attribute incentive salience to reward cues. Following Pavlovian training, wherein a discrete lever-cue was paired with food reward, rats were classified as sign- or goal-trackers based on the resultant conditioned response. We examined the effects of D2/D3 agonists, 7-OH-DPAT (0.01-0.32mg/kg) or pramipexole (0.032-0.32mg/kg), the D2/D3 antagonist raclopride (0.1mg/kg), and the selective D3 antagonist, SB-277011A (6 or 24mg/kg), on the expression of sign- and goal-tracking conditioned responses. The lever-cue acquired predictive value and elicited a conditioned response for sign- and goal-trackers, but only for sign-trackers did it also acquire incentive value. Following administration of either 7-OH-DPAT, pramipexole, or raclopride, the performance of the previously acquired conditioned response was attenuated for both sign- and goal-trackers. For sign-trackers, the D2/D3 agonist, 7-OH-DPAT, also attenuated the conditioned reinforcing properties of the lever-cue. The selective D3 antagonist did not affect either conditioned response. Alterations in D2/D3 receptor signaling, but not D3 signaling alone, transiently attenuate a previously acquired Pavlovian conditioned response, regardless of whether the response is a result of incentive motivational processes. These findings suggest activity at the dopamine D2 receptor is critical for a reward cue to maintain either its incentive or predictive qualities.

A key function of the nervous system is producing adaptive behavior across changing conditions, like physiological state. Although states like thirst and hunger are known to impact decision-making, the neurobiology of this phenomenon has been studied minimally. Here, we tracked evolving preference for sucrose and water as rats proceeded from a thirsty to sated state. As rats shifted from water choices to sucrose choices across the session, the activity of a majority of neurons in the ventral pallidum, a region crucial for reward-related behaviors, closely matched the evolving behavioral preference. The timing of this signal followed the pattern of a reward prediction error, occurring at the cue or the reward depending on when reward identity was revealed. Additionally, optogenetic stimulation of ventral pallidum neurons at the time of reward was able to reverse behavioral preference. Our results suggest that ventral pallidum neurons guide reward-related decisions across changing physiological states.

The nervous system is hypothesized to compute reward prediction errors (RPEs) to promote adaptive behavior. Correlates of RPEs have been observed in the midbrain dopamine system, but the extent to which RPE signals exist in other reward-processing regions is less well understood. In the present study, we quantified outcome history-based RPE signals in the ventral pallidum (VP), a basal ganglia region functionally linked to reward-seeking behavior. We trained rats to respond to reward-predicting cues, and we fit computational models to predict the firing rates of individual neurons at the time of reward delivery. We found that a subset of VP neurons encoded RPEs and did so more robustly than the nucleus accumbens, an input to the VP. VP RPEs predicted changes in task engagement, and optogenetic manipulation of the VP during reward delivery bidirectionally altered rats' subsequent reward-seeking behavior. Our data suggest a pivotal role for the VP in computing teaching signals that influence adaptive reward seeking.