The purpose of this explorative study was to investigate whether diffusion tensor imaging (DTI) and diffusion kurtosis imaging (DKI) parameter changes are reliable measures of white matter integrity changes in Alzheimer's disease (AD) patients using a whole brain voxel-based analysis (VBA). Therefore, age- and gender-matched patients with mild cognitive impairment (MCI) due to AD (n = 18), dementia due to AD (n = 19), and age-matched cognitively healthy controls (n = 14) were prospectively included. The magnetic resonance imaging protocol included routine structural brain imaging and DKI. Datasets were transformed to a population-specific atlas space. Groups were compared using VBA. Differences in diffusion and mean kurtosis measures between MCI and AD patients and controls were shown, and were mainly found in the splenium of the corpus callosum and the corona radiata. Hence, DTI and DKI parameter changes are suggestive of white matter changes in AD.