Recently, numerous studies have investigated the neurocognitive mechanism of learning words in isolation or in semantic contexts. However, emotion as an important influencing factor on novel word learning has not been fully considered in the previous studies. In addition, the effects of emotion on word learning and the underlying neural mechanism have not been systematically investigated. Sixteen participants were trained to learn novel concrete or abstract words under negative, neutral, and positive contextual emotions over 3 days; then, fMRI scanning was done during the testing sessions on day 1 and day 3. We compared the brain activations in day 1 and day 3 to investigate the role of contextual emotions in learning different types of words and the corresponding neural plasticity changes. Behaviorally, the performance of the words learned in the negative context was lower than those in the neutral and positive contexts, which indicated that contextual emotions had a significant impact on novel word learning. Correspondingly, the functional plasticity changes of the right angular gyrus (AG), bilateral insula, and anterior cingulate cortex (ACC) induced by word learning were modulated by the contextual emotions. The insula also was sensitive to the concreteness of the learned words. More importantly, the functional plasticity changes of the left inferior frontal gyrus (left IFG) and left fusiform gyrus (left FG) were interactively influenced by the contextual emotions and concreteness, suggesting that the contextual emotional information had a discriminable effect on different types of words in the neural mechanism level. These results demonstrate that emotional information in contexts is inevitably involved in word learning. The role of contextual emotions in brain plasticity for learning is discussed.