Repeated exposure to stressors is known to produce large-scale remodeling of neurons within the prefrontal cortex (PFC). Recent work suggests stress-related forms of structural plasticity can interact with aging to drive distinct patterns of pyramidal cell morphological changes. However, little is known about how other cellular components within PFC might be affected by these challenges. Here, we examined the effects of stress exposure and aging on medial prefrontal cortical glial subpopulations. Interestingly, we found no changes in glial morphology with stress exposure but a profound morphological change with aging. Furthermore, we found an upregulation of non-nuclear glucocorticoid receptors (GR) with aging, while nuclear levels remained largely unaffected. Both changes are selective for microglia, with no stress or aging effect found in astrocytes. Lastly, we show that the changes found within microglia inversely correlated with the density of dendritic spines on layer III pyramidal cells. These findings suggest microglia play a selective role in synaptic health within the aging brain.