Objective

Multimodal measurements of the same phenomena provide complementary information and highlight different perspectives, albeit each with their own limitations. A focus on a single modality may lead to incorrect inferences, which is especially important when a studied phenomenon is a disease. In this paper, we introduce a method that takes advantage of multimodal data in addressing the hypotheses of disconnectivity and dysfunction within schizophrenia (SZ).

Methods

We start with estimating and visualizing links within and among extracted multimodal data features using a Gaussian graphical model (GGM). We then propose a modularity-based method that can be applied to the GGM to identify links that are associated with mental illness across a multimodal data set. Through simulation and real data, we show our approach reveals important information about disease-related network disruptions that are missed with a focus on a single modality. We use functional MRI (fMRI), diffusion MRI (dMRI), and structural MRI (sMRI) to compute the fractional amplitude of low frequency fluctuations (fALFF), fractional anisotropy (FA), and gray matter (GM) concentration maps. These three modalities are analyzed using our modularity method.

Results

Our results show missing links that are only captured by the cross-modal information that may play an important role in disconnectivity between the components.

Conclusion

We identified multimodal (fALFF, FA and GM) disconnectivity in the default mode network area in patients with SZ, which would not have been detectable in a single modality.

Significance

The proposed approach provides an important new tool for capturing information that is distributed among multiple imaging modalities.

OBJECTIVE: Multimodal measurements of the same phenomena provide complementary information and highlight different perspectives, albeit each with their own limitations. A focus on a single modality may lead to incorrect inferences, which is especially important when a studied phenomenon is a disease. In this paper, we introduce a method that takes advantage of multimodal data in addressing the hypotheses of disconnectivity and dysfunction within schizophrenia (SZ). METHODS: We start with estimating and visualizing links within and among extracted multimodal data features using a Gaussian graphical model (GGM). We then propose a modularity-based method that can be applied to the GGM to identify links that are associated with mental illness across a multimodal data set. Through simulation and real data, we show our approach reveals important information about disease-related network disruptions that are missed with a focus on a single modality. We use functional MRI (fMRI), diffusion MRI (dMRI), and structural MRI (sMRI) to compute the fractional amplitude of low frequency fluctuations (fALFF), fractional anisotropy (FA), and gray matter (GM) concentration maps. These three modalities are analyzed using our modularity method. RESULTS: Our results show missing links that are only captured by the cross-modal information that may play an important role in disconnectivity between the components. CONCLUSION: We identified multimodal (fALFF, FA and GM) disconnectivity in the default mode network area in patients with SZ, which would not have been detectable in a single modality. SIGNIFICANCE: The proposed approach provides an important new tool for capturing information that is distributed among multiple imaging modalities.

Graph-theoretical methods have been widely used to study human brain networks in psychiatric disorders. However, the focus has primarily been on global graphic metrics with little attention to the information contained in paths connecting brain regions. Details of disruption of these paths may be highly informative for understanding disease mechanisms. To detect the absence or addition of multistep paths in the patient group, we provide an algorithm estimating edges that contribute to these paths with reference to the control group. We next examine where pairs of nodes were connected through paths in both groups by using a covariance decomposition method. We apply our method to study resting-state fMRI data in schizophrenia versus controls. Results show several disconnectors in schizophrenia within and between functional domains, particularly within the default mode and cognitive control networks. Additionally, we identify new edges generating additional paths. Moreover, although paths exist in both groups, these paths take unique trajectories and have a significant contribution to the decomposition. The proposed path analysis provides a way to characterize individuals by evaluating changes in paths, rather than just focusing on the pairwise relationships. Our results show promise for identifying path-based metrics in neuroimaging data.