Negative fateful life events (FLEs) such as interpersonal conflict, death in the family, financial hardship, and serious medical emergencies can act as allostatic stressors that accelerate biological aging. However, the relationship between FLEs and neuroanatomical aging is not well understood. We examined 359 men (mean age 62 years) participating in the Vietnam Era twin study of aging (VETSA) to determine whether negative midlife FLEs are associated with advanced brain aging after controlling for physical, psychological, and lifestyle factors. At two different time points, participants were assessed for negative FLEs, health and well-being, general cognitive ability, socioeconomic status, depression, and ethnicity. Participants underwent a magnetic resonance imaging examination, and T1-weighted images were processed with FreeSurfer. Subsequent neuroanatomical measurements were entered into the Brain-Age Regression Analysis and Computation Utility software (BARACUS) to predict brain age. Having more midlife FLEs, particularly relating to interpersonal relationships, was associated with advanced predicted brain aging (i.e., higher predicted brain age relative to chronological age). This association remained after controlling for the significant covariates of alcohol consumption, cardiovascular risk, adult socioeconomic status, and ethnicity.