We present RIPMMARC (Rotation Invariant Patch-based Multi-Modality Analysis aRChitecture), a flexible and widely applicable method for extracting information unique to a given modality from a multi-modal data set. We use RIPMMARC to improve the interpretation of arterial spin labeling (ASL) perfusion images by removing the component of perfusion that is predicted by the underlying anatomy. Using patch-based, rotation invariant descriptors derived from the anatomical image, we learn a predictive relationship between local neuroanatomical structure and the corresponding perfusion image. This relation allows us to produce an image of perfusion that would be predicted given only the underlying anatomy and a residual image that represents perfusion information that cannot be predicted by anatomical features. Our learned structural features are significantly better at predicting brain perfusion than tissue probability maps, which are the input to standard partial volume correction techniques. Studies in test-retest data show that both the anatomically predicted and residual perfusion signals are highly replicable for a given subject. In a pediatric population, both the raw perfusion and structurally predicted images are tightly linked to age throughout adolescence throughout the brain. Interestingly, the residual perfusion also shows a strong correlation with age in selected regions including the hippocampi (corr = 0.38, p-value <10(-6)), precuneus (corr = -0.44, p < 10(-5)), and combined default mode network regions (corr = -0.45, p < 10(-8)) that is independent of global anatomy-perfusion trends. This finding suggests that there is a regionally heterogeneous pattern of functional specialization that is distinct from that of cortical structural development.

Rigorous statistical analysis of multimodal imaging datasets is challenging. Mass-univariate methods for extracting correlations between image voxels and outcome measurements are not ideal for multimodal datasets, as they do not account for interactions between the different modalities. The extremely high dimensionality of medical images necessitates dimensionality reduction, such as principal component analysis (PCA) or independent component analysis (ICA). These dimensionality reduction techniques, however, consist of contributions from every region in the brain and are therefore difficult to interpret. Recent advances in sparse dimensionality reduction have enabled construction of a set of image regions that explain the variance of the images while still maintaining anatomical interpretability. The projections of the original data on the sparse eigenvectors, however, are highly collinear and therefore difficult to incorporate into multi-modal image analysis pipelines. We propose here a method for clustering sparse eigenvectors and selecting a subset of the eigenvectors to make interpretable predictions from a multi-modal dataset. Evaluation on a publicly available dataset shows that the proposed method outperforms PCA and ICA-based regressions while still maintaining anatomical meaning. To facilitate reproducibility, the complete dataset used and all source code is publicly available.

To understand multifactorial conditions such as Alzheimer's disease (AD) we need brain signatures that predict the impact of multiple pathologies and their interactions. To help uncover the relationships between pathology affected brain circuits and cognitive markers we have used mouse models that represent, at least in part, the complex interactions altered in AD, while being raised in uniform environments and with known genotype alterations. In particular, we aimed to understand the relationship between vulnerable brain circuits and memory deficits measured in the Morris water maze, and we tested several predictive modeling approaches. We used in vivo manganese enhanced MRI traditional voxel based analyses to reveal regional differences in volume (morphometry), signal intensity (activity), and magnetic susceptibility (iron deposition, demyelination). These regions included hippocampus, olfactory areas, entorhinal cortex and cerebellum, as well as the frontal association area. The properties of these regions, extracted from each of the imaging markers, were used to predict spatial memory. We next used eigenanatomy, which reduces dimensionality to produce sets of regions that explain the variance in the data. For each imaging marker, eigenanatomy revealed networks underpinning a range of cognitive functions including memory, motor function, and associative learning, allowing the detection of associations between context, location, and responses. Finally, the integration of multivariate markers in a supervised sparse canonical correlation approach outperformed single predictor models and had significant correlates to spatial memory. Among a priori selected regions, expected to play a role in memory dysfunction, the fornix also provided good predictors, raising the possibility of investigating how disease propagation within brain networks leads to cognitive deterioration. Our cross-sectional results support that modeling approaches integrating multivariate imaging markers provide sensitive predictors of AD-like behaviors. Such strategies for mapping brain circuits responsible for behaviors may help in the future predict disease progression, or response to interventions.

Magnetic resonance imaging (MRI) captures the dynamics of brain development with multiple modalities that quantify both structure and function. These measurements may yield valuable insights into the neural patterns that mark healthy maturation or that identify early risk for psychiatric disorder. The Pediatric Template of Brain Perfusion (PTBP) is a free and public neuroimaging resource that will help accelerate the understanding of childhood brain development as seen through the lens of multiple modality neuroimaging and in relation to cognitive and environmental factors. The PTBP uses cross-sectional and longitudinal MRI to quantify cortex, white matter, resting state functional connectivity and brain perfusion, as measured by Arterial Spin Labeling (ASL), in 120 children 7-18 years of age. We describe the PTBP and show, as a demonstration of validity, that global summary measurements capture the trajectories that demarcate critical turning points in brain maturation. This novel resource will allow a more detailed understanding of the network-level, structural and functional landmarks that are obtained during normal adolescent brain development.

Longitudinal studies of development and disease in the human brain have motivated the acquisition of large neuroimaging data sets and the concomitant development of robust methodological and statistical tools for quantifying neurostructural changes. Longitudinal-specific strategies for acquisition and processing have potentially significant benefits including more consistent estimates of intra-subject measurements while retaining predictive power. Using the first phase of the Alzheimer's Disease Neuroimaging Initiative (ADNI-1) data, comprising over 600 subjects with multiple time points from baseline to 36 months, we evaluate the utility of longitudinal FreeSurfer and Advanced Normalization Tools (ANTs) surrogate thickness values in the context of a linear mixed-effects (LME) modeling strategy. Specifically, we estimate the residual variability and between-subject variability associated with each processing stream as it is known from the statistical literature that minimizing the former while simultaneously maximizing the latter leads to greater scientific interpretability in terms of tighter confidence intervals in calculated mean trends, smaller prediction intervals, and narrower confidence intervals for determining cross-sectional effects. This strategy is evaluated over the entire cortex, as defined by the Desikan-Killiany-Tourville labeling protocol, where comparisons are made with the cross-sectional and longitudinal FreeSurfer processing streams. Subsequent linear mixed effects modeling for identifying diagnostic groupings within the ADNI cohort is provided as supporting evidence for the utility of the proposed ANTs longitudinal framework which provides unbiased structural neuroimage processing and competitive to superior power for longitudinal structural change detection.