Regional Brain Fusion: Graph Convolutional Network for Alzheimer's Disease Prediction and Analysis

Wenchao Li1, Jiaqi Zhao2, Chenyu Shen1, Jingwen Zhang3, Ji Hu1, Mang Xiao4, Jiyong Zhang1, Minghan Chen3
1Intelligent Information Processing Laboratory, Hangzhou Dianzi University, Hangzhou, China
2Research Center for Healthcare Data Science, Zhejiang Lab, Hangzhou, China
3Department of Computer Science, Wake Forest University, Winston-Salem, NC, United States
4Sir Run Run Shaw Hospital, College of Medicine, Zhejiang University, Hangzhou, China

Tóm tắt

Alzheimer's disease (AD) has raised extensive concern in healthcare and academia as one of the most prevalent health threats to the elderly. Due to the irreversible nature of AD, early and accurate diagnoses are significant for effective prevention and treatment. However, diverse clinical symptoms and limited neuroimaging accuracy make diagnoses challenging. In this article, we built a brain network for each subject, which assembles several commonly used neuroimaging data simply and reasonably, including structural magnetic resonance imaging (MRI), diffusion-weighted imaging (DWI), and amyloid positron emission tomography (PET). Based on some existing research results, we applied statistical methods to analyze (i) the distinct affinity of AD burden on each brain region, (ii) the topological lateralization between left and right hemispheric sub-networks, and (iii) the asymmetry of the AD attacks on the left and right hemispheres. In the light of advances in graph convolutional networks for graph classifications and summarized characteristics of brain networks and AD pathologies, we proposed a regional brain fusion-graph convolutional network (RBF-GCN), which is constructed with an RBF framework mainly, including three sub-modules, namely, hemispheric network generation module, multichannel GCN module, and feature fusion module. In the multichannel GCN module, the improved GCN by our proposed adaptive native node attribute (ANNA) unit embeds within each channel independently. We not only fully verified the effectiveness of the RBF framework and ANNA unit but also achieved competitive results in multiple sets of AD stages' classification tasks using hundreds of experiments over the ADNI clinical dataset.

Từ khóa


Tài liệu tham khảo

2019, 2019 Alzheimer's disease facts and figures, Alzheimers Dementia, 15, 321, 10.1016/j.jalz.2019.01.010

Amlien, 2014, Diffusion tensor imaging of white matter degeneration in Alzheimer's disease and mild cognitive impairment, Neuroscience, 276, 206, 10.1016/j.neuroscience.2014.02.017

Araque Caballero, 2018, White matter diffusion alterations precede symptom onset in autosomal dominant Alzheimer's disease, Brain, 141, 3065, 10.1093/brain/awy229

Baratloo, 2015, Part 1: simple definition and calculation of accuracy, sensitivity and specificity

Bischof, 2016, Impact of tau and amyloid burden on glucose metabolism in Alzheimer's disease, Ann. Clin. Transl. Neurol., 3, 934, 10.1002/acn3.339

Braak, 2015, The preclinical phase of the pathological process underlying sporadic Alzheimer's disease, Brain, 138, 2814, 10.1093/brain/awv236

Brendel, 2015, Improved longitudinal [18F]-AV45 amyloid PET by white matter reference and VOI-based partial volume effect correction, Neuroimage, 108, 450, 10.1016/j.neuroimage.2014.11.055

BrunaJ. ZarembaW. SzlamA. LeCunY. Spectral networks and locally connected networks on graphs. 2013

Caeyenberghs, 2014, Hemispheric lateralization of topological organization in structural brain networks, Hum. Brain Mapp., 35, 4944, 10.1002/hbm.22524

CogDL: Toolkit for deep learning on graphs CenY. HouZ. WangY. ChenQ. LuoY. YaoX. arXiv [Preprint]2021

Cope, 2018, Tau burden and the functional connectome in Alzheimer's disease and progressive supranuclear palsy, Brain, 141, 550, 10.1093/brain/awx347

Crossley, 2014, The hubs of the human connectome are generally implicated in the anatomy of brain disorders, Brain, 137, 2382, 10.1093/brain/awu132

Cuingnet, 2011, Automatic classification of patients with Alzheimer's disease from structural MRI: a comparison of ten methods using the ADNI database, Neuroimage, 56, 766, 10.1016/j.neuroimage.2010.06.013

Destrieux, 2010, Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature, Neuroimage, 53, 1, 10.1016/j.neuroimage.2010.06.010

Du, 2020, Selective feature connection mechanism: concatenating multi-layer CNN features with a feature selector, Patt. Recogn. Lett., 129, 108, 10.1016/j.patrec.2019.11.015

Dyrba, 2013, Robust automated detection of microstructural white matter degeneration in Alzheimer's disease using machine learning classification of multicenter DTI data, PLoS ONE, 8, e64925, 10.1371/journal.pone.0064925

Fornito, 2016, Fundamentals of Brain Network Analysis.

Gao, 2019, Graph u-nets, International Conference on Machine Learning, 2083

Giannakopoulos, 1994, Alzheimer's disease with asymmetric atrophy of the cerebral hemispheres: morphometric analysis of four cases, Acta Neuropathol., 88, 440, 10.1007/BF00389496

Glorot, 2010, Understanding the difficulty of training deep feedforward neural networks, Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics: JMLR Workshop and Conference Proceedings, 249

Gonzalez-Escamilla, 2021, Metabolic and amyloid PET network reorganization in Alzheimer's disease: differential patterns and partial volume effects, Brain Imaging Behav., 15, 190, 10.1007/s11682-019-00247-9

Deep convolutional networks on graph-structured data HenaffM. BrunaJ. LeCunY. arXiv [Preprint]2015

Huang, 2019, Attpool: Towards hierarchical feature representation in graph convolutional networks via attention mechanism, Proceedings of the IEEE/CVF International Conference on Computer Vision, 6480

Iturria-Medina, 2011, Brain hemispheric structural efficiency and interconnectivity rightward asymmetry in human and nonhuman primates, Cerebr. Cortex, 21, 56, 10.1093/cercor/bhq058

Iturria-Medina, 2014, Epidemic spreading model to characterize misfolded proteins propagation in aging and associated neurodegenerative disorders, PLoS Comput. Biol., 10, e1003956, 10.1371/journal.pcbi.1003956

Kaiser, 2011, A tutorial in connectome analysis: topological and spatial features of brain networks, Neuroimage, 57, 892, 10.1016/j.neuroimage.2011.05.025

Kim, 2019, Comparison of amyloid β and tau spread models in Alzheimer's Disease, Cerebr Cortex, 29, 4291, 10.1093/cercor/bhy311

Kingma, 2014, Adam: a method for stochastic optimization, arXiv [Preprint]

Kipf, 2017, Semi-supervised classification with graph convolutional networks, The 5th International Conference on Learning Representations

Klöppel, 2008, Automatic classification of MR scans in Alzheimer's disease, Brain, 131, 681, 10.1093/brain/awm319

Kondor, 2016, The multiscale laplacian graph kernel, Proceedings of the 30th International Conference on Neural Information Processing Systems, 2990

Lee, 2019, Self-attention graph pooling, International Conference on Machine Learning, 3734

Liu, 2016, Classification of Alzheimer's disease using whole brain hierarchical network, IEEE/ACM Transact. Comp. Biol. Bioinformat., 15, 624, 10.1109/TCBB.2016.2635144

Lu, 2020, Global-local fusion network for face super-resolution, Neurocomputing, 387, 309, 10.1016/j.neucom.2020.01.015

Ma, 2019, Multi-layers feature fusion of convolutional neural network for scene classification of remote sensing, IEEE Access, 7, 121685, 10.1109/ACCESS.2019.2936215

Messaritaki, 2019, Optimization of graph construction can significantly increase the power of structural brain network studies, Neuroimage, 199, 495, 10.1016/j.neuroimage.2019.05.052

NarayananA. ChandramohanM. VenkatesanR. ChenL. LiuY. JaiswalS. graph2vec: Learning distributed representations of graphs. 2017

Niepert, 2016, Learning convolutional neural networks for graphs, International Conference on Machine Learning, 2014

Nir, 2015, Diffusion weighted imaging-based maximum density path analysis and classification of Alzheimer's disease, Neurobiol. Aging, 36, S132, 10.1016/j.neurobiolaging.2014.05.037

Nusbaum, 2017, Hemispheric differences in white matter microstructure between two profiles of children with high intelligence quotient vs. controls: a tract-based spatial statistics study, Front. Neurosci., 11, 173, 10.3389/fnins.2017.00173

O'Dwyer, 2012, Using support vector machines with multiple indices of diffusion for automated classification of mild cognitive impairment, PLoS ONE, 7, e32441, 10.1371/journal.pone.0032441

Ossenkoppele, 2016, Tau PET patterns mirror clinical and neuroanatomical variability in Alzheimer's disease, Brain, 139, 1551, 10.1093/brain/aww027

Pereira, 2019, Amyloid and tau accumulate across distinct spatial networks and are differentially associated with brain connectivity, Elife, 8, e50830, 10.7554/eLife.50830.sa2

Prasad, 2015, Brain connectivity and novel network measures for Alzheimer's disease classification, Neurobiol. Aging, 36, S121, 10.1016/j.neurobiolaging.2014.04.037

Raj, 2021, Graph models of pathology spread in Alzheimer's disease: an alternative to conventional graph theoretic analysis, Brain Connect, 11, 799, 10.1089/brain.2020.0905

Rajapakse, 1997, Statistical approach to segmentation of single-channel cerebral MR images, IEEE Trans. Med. Imag., 16, 176, 10.1109/42.563663

Ranjan, 2020, Asap: adaptive structure aware pooling for learning hierarchical graph representations, Proceedings of the AAAI Conference on Artificial Intelligence, 5470

Saad, 2022, COVID-19 classification using deep feature concatenation technique, J. Ambient Intell. Human. Comp., 13, 2025, 10.1007/s12652-021-02967-7

Schouten, 2016, Combining anatomical, diffusion, and resting state functional magnetic resonance imaging for individual classification of mild and moderate Alzheimer's disease, NeuroImage Clin., 11, 46, 10.1016/j.nicl.2016.01.002

Siglidis, 2020, GraKeL: a graph kernel library in python, J. Mach. Learn. Res., 21, 1

Son, 2020, The clinical feasibility of deep learning-based classification of amyloid PET images in visually equivocal cases, Eur. J. Nucl. Med. Mol. Imaging, 47, 332, 10.1007/s00259-019-04595-y

Song, 2019, Graph convolutional neural networks for Alzheimer's disease classification, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), 414, 10.1109/ISBI.2019.8759531

Sperling, 2011, Toward defining the preclinical stages of Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease, Alzheimers Dementia, 7, 280, 10.1016/j.jalz.2011.03.003

Infograph: unsupervised and semi-supervised graph-level representation learning via mutual information maximization SunF.-Y. HoffmannJ. VermaV. TangJ. arXiv [Preprint]2019

Tang, 2016, Shape and diffusion tensor imaging based integrative analysis of the hippocampus and the amygdala in Alzheimer's disease, Magn. Reson. Imaging, 34, 1087, 10.1016/j.mri.2016.05.001

Tanveer, 2020, Machine learning techniques for the diagnosis of Alzheimer's disease: a review, ACM Transact. Multimedia Comp. Commun. Appl., 16, 1, 10.1145/3344998

Tohka, 2004, Fast and robust parameter estimation for statistical partial volume models in brain MRI, Neuroimage, 23, 84, 10.1016/j.neuroimage.2004.05.007

Vandenberghe, 2013, Binary classification of 18F-flutemetamol PET using machine learning: comparison with visual reads and structural MRI, Neuroimage, 64, 517, 10.1016/j.neuroimage.2012.09.015

Veale, 2021, Loss and dispersion of superficial white matter in Alzheimer's disease: a diffusion MRI study, Brain Commun, 3, fcab272, 10.1093/braincomms/fcab272

Vemuri, 2008, Alzheimer's disease diagnosis in individual subjects using structural MR images: validation studies, Neuroimage, 39, 1186, 10.1016/j.neuroimage.2007.09.073

Vogel, 2020, Spread of pathological tau proteins through communicating neurons in human Alzheimer's disease, Nat. Commun., 11, 1, 10.1038/s41467-020-15701-2

Wee, 2011, Enriched white matter connectivity networks for accurate identification of MCI patients, Neuroimage, 54, 1812, 10.1016/j.neuroimage.2010.10.026

Yan, 2019, Classification of amyloid PET images using novel features for early diagnosis of Alzheimer's disease and mild cognitive impairment conversion, Nucl. Med. Commun., 40, 242, 10.1097/MNM.0000000000000953

Yang, 2017, The abnormality of topological asymmetry between hemispheric brain white matter networks in Alzheimer's disease and mild cognitive impairment, Front. Aging Neurosci., 9, 261, 10.3389/fnagi.2017.00261

A review of artificial intelligence technologies for early prediction of Alzheimer's Disease YangK. MohammedE. A. arXiv [Preprint]2020

Ying, 2018, Hierarchical graph representation learning with differentiable pooling, Proceedings of the 32nd International Conference on Neural Information Processing Systems, 4805

Yu, 2016, Graph-guided joint prediction of class label and clinical scores for the Alzheimer's disease, Brain Struct. Funct., 221, 3787, 10.1007/s00429-015-1132-6

Zhang, 2018, Individual identification using multi-metric of DTI in Alzheimer's disease and mild cognitive impairment, Chinese Phys. B, 27, 088702, 10.1088/1674-1056/27/8/088702

Zheng, 2017, Improving MRI-based diagnosis of Alzheimer's disease via an ensemble privileged information learning algorithm, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), 456, 10.1109/ISBI.2017.7950559