In reward-based learning, synaptic modifications depend on a brief stimulus and a temporally delayed reward, which poses the question of how synaptic activity patterns associate with a delayed reward. A theoretical solution to this so-called distal reward problem has been the notion of activity-generated "synaptic eligibility traces," silent and transient synaptic tags that can be converted into long-term changes in synaptic strength by reward-linked neuromodulators. Here we report the first experimental demonstration of eligibility traces in cortical synapses. We demonstrate the Hebbian induction of distinct traces for LTP and LTD and their subsequent timing-dependent transformation into lasting changes by specific monoaminergic receptors anchored to postsynaptic proteins. Notably, the temporal properties of these transient traces allow stable learning in a recurrent neural network that accurately predicts the timing of the reward, further validating the induction and transformation of eligibility traces for LTP and LTD as a plausible synaptic substrate for reward-based learning.

Reinforcement allows organisms to learn which stimuli predict subsequent biological relevance. Hebbian mechanisms of synaptic plasticity are insufficient to account for reinforced learning because neuromodulators signaling biological relevance are delayed with respect to the neural activity associated with the stimulus. A theoretical solution is the concept of eligibility traces (eTraces), silent synaptic processes elicited by activity which upon arrival of a neuromodulator are converted into a lasting change in synaptic strength. Previously we demonstrated in visual cortical slices the Hebbian induction of eTraces and their conversion into LTP and LTD by the retroactive action of norepinephrine and serotonin Here we show in vivo in mouse V1 that the induction of eTraces and their conversion to LTP/D by norepinephrine and serotonin respectively potentiates and depresses visual responses. We also show that the integrity of this process is crucial for ocular dominance plasticity, a canonical model of experience-dependent plasticity.

The tetra(ethylene glycol) derivative of benzothiazole aniline, BTA-EG4, is a novel amyloid-binding small molecule that can penetrate the blood-brain barrier and protect cells from Aβ-induced toxicity. However, the effects of Aβ-targeting molecules on other cellular processes, including those that modulate synaptic plasticity, remain unknown. We report here that BTA-EG4 decreases Aβ levels, alters cell surface expression of amyloid precursor protein (APP), and improves memory in wild-type mice. Interestingly, the BTA-EG4-mediated behavioral improvement is not correlated with LTP, but with increased spinogenesis. The higher dendritic spine density reflects an increase in the number of functional synapses as determined by increased miniature EPSC (mEPSC) frequency without changes in presynaptic parameters or postsynaptic mEPSC amplitude. Additionally, BTA-EG4 requires APP to regulate dendritic spine density through a Ras signaling-dependent mechanism. Thus, BTA-EG4 may provide broad therapeutic benefits for improving neuronal and cognitive function, and may have implications in neurodegenerative disease therapy.