The proposed mechanisms of sleep-dependent memory consolidation involve the overnight regulation of neural activity at both synaptic and whole-network levels. Now, there is a lack of in vivo data in humans elucidating if, and how, sleep and its varied stages balance neural activity, and if such recalibration benefits memory. We combined electrophysiology with in vivo two-photon calcium imaging in rodents as well as intracranial and scalp electroencephalography (EEG) in humans to reveal a key role for non-oscillatory brain activity during rapid eye movement (REM) sleep to mediate sleep-dependent recalibration of neural population dynamics. The extent of this REM sleep recalibration predicted the success of overnight memory consolidation, expressly the modulation of hippocampal-neocortical activity, favoring remembering rather than forgetting. The findings describe a non-oscillatory mechanism how human REM sleep modulates neural population activity to enhance long-term memory.