The purpose of this study was to determine whether white matter microstructure measured by diffusion magnetic resonance imaging (dMRI) provides independent information about baseline level or change in executive function (EF) or memory (MEM) in older adults with and without cognitive impairment. Longitudinal data was acquired from the Alzheimer's Disease Neuroimaging Initiative (ADNI) study from phases GO and 2 (2009-2015). ADNI participants included were diagnosed as cognitively normal (n = 46), early mild cognitive impairment (MCI) (n = 48), late MCI (n = 29), and dementia (n = 39) at baseline. We modeled the association between dMRI-based global white matter mean diffusivity (MD) and baseline level and change in EF and MEM composite scores, in models controlling for baseline bilateral hippocampal volume, regional cerebral FDG PET metabolism and global cerebral AV45 PET uptake. EF and MEM composite scores were measured at baseline, 6, 12, 24 and 36 months. In the baseline late MCI and dementia groups, greater global MD was associated with lesser baseline EF, but not EF change nor MEM baseline or change. As expected, lesser hippocampal volume and lesser FDG PET metabolism was associated with greater rates of EF and MEM decline. In ADNI-GO/2 participants, white matter integrity provided independent information about current executive function, but was not sensitive to future cognitive change. Since individuals experiencing executive function declines progress to dementia more rapidly than those with only memory impairment, better biomarkers of future executive function decline are needed.