Brain aging process is influenced by various lifestyle, environmental and genetic factors, as well as by age-related and often coexisting pathologies. Magnetic resonance imaging and artificial intelligence methods have been instrumental in understanding neuroanatomical changes that occur during aging. Large, diverse population studies enable identifying comprehensive and representative brain change patterns resulting from distinct but overlapping pathological and biological factors, revealing intersections and heterogeneity in affected brain regions and clinical phenotypes. Herein, we leverage a state-of-the-art deep-representation learning method, Surreal-GAN, and present methodological advances and extensive experimental results elucidating brain aging heterogeneity in a cohort of 49,482 individuals from 11 studies. Five dominant patterns of brain atrophy were identified and quantified for each individual by respective measures, R-indices. Their associations with biomedical, lifestyle and genetic factors provide insights into the etiology of observed variances, suggesting their potential as brain endophenotypes for genetic and lifestyle risks. Furthermore, baseline R-indices predict disease progression and mortality, capturing early changes as supplementary prognostic markers. These R-indices establish a dimensional approach to measuring aging trajectories and related brain changes. They hold promise for precise diagnostics, especially at preclinical stages, facilitating personalized patient management and targeted clinical trial recruitment based on specific brain endophenotypic expression and prognosis.