The objective of the study was to examine variability across multiple prospective cohort studies in level and rate of cognitive decline by race/ethnicity and years of education. We compare data across studies, we harmonized estimates of common latent factors representing overall or general cognitive performance, memory, and executive function derived from the: (a) Washington Heights, Hamilton Heights, Inwood Columbia Aging Project (N = 4,115), (b) Spanish and English Neuropsychological Assessment Scales (N = 525), (c) Duke Memory, Health, and Aging study (N = 578), and (d) Neurocognitive Outcomes of Depression in the Elderly (N = 585). We modeled cognitive change over age for cognitive outcomes by race, education, and study. We adjusted models for sex, dementia status, and study-specific characteristics. The results found that for baseline levels of overall cognitive performance, memory, and executive function, differences in race and education tended to be larger than between-study differences and consistent across studies. This pattern did not hold for rate of cognitive decline: effects of education and race/ethnicity on cognitive change were not consistently observed across studies, and when present were small, with racial/ethnic minorities and those with lower education declining at faster rates. In this diverse set of datasets, non-Hispanic Whites and those with higher education had substantially higher baseline cognitive test scores. However, differences in the rate of cognitive decline by race/ethnicity and education did not follow this pattern. This study suggests that baseline test scores and longitudinal change have different determinants, and future studies to examine similarities and differences of causes of cognitive decline in racially/ethnically and educationally diverse older groups is needed.