BrainSim: AI-Driven Brain MRI Simulation for Alzheimer’s Disease Diagnosis
DOI:
https://doi.org/10.54097/8bevk423Keywords:
Alzheimer’s Disease, Generative Adversarial Network, Magnetic Resonance Imaging, Brain Aging and Rejuvenation.Abstract
Alzheimer's Disease, a progressive neurodegenerative disorder with no cure, presents a formidable challenge to global healthcare. The simulation of brain states, encompassing both rejuvenation and aging, aids clinicians in understanding disease progression and early detection. Recent advances in deep adversarial neural networks, effective in generating age-varied facial images, are now applied to brain MRI simulations across different time states. However, existing methods for brain MRI synthesis predominantly focus on aging simulation, lacking rejuvenation capabilities, and relying heavily on longitudinal data. Access to rejuvenated brain scans is essential as it can help researchers track the structural changes and biomarkers in the early stage of AD, facilitating AD research and personalized treatments. Additionally, previous methods are often 2D-based, failing to capture complex 3D spatial information obtained by 3D scans. To overcome these limitations, I propose BrainSim, a novel longitudinal brain MRI synthesis framework. Specifically, BrainSim leverages a bidirectional cycle-consistent generative neural network to generate rejuvenated and aged MRI scans simultaneously using cross-sectional scans only. BrainSim incorporates a 3D conditional U-Net as its fundamental model, facilitating the direct generation of 3D MRI scans conditioned on the subject's health state and sex. BrainSim was evaluated against benchmark models using longitudinal data and a pre-trained age predictor to assess the quality of generated images. Experiments using the ADNI dataset show BrainSim's state-of-the-art performance in brain aging and rejuvenation tasks, marking significant advancements in MRI synthesis for Alzheimer's research and drug development.
Downloads
References
[1] F. Alshehri, “Integrated virtual screening, molecular modeling and machine learning approaches revealed potential natural inhibitors for epilepsy,” Saudi Pharm. J., vol. 31, no. 12, p. 101835, Dec. 2023, doi: 10.1016/j.jsps.2023.101835.
[2] J. Lam, J. Lee, C. Y. Liu, A. M. Lozano, and D. J. Lee, “Deep Brain Stimulation for Alzheimer’s Disease: Tackling Circuit Dysfunction,” Neuromodulation Technol. Neural Interface, vol. 24, no. 2, pp. 171 – 186, Feb. 2021, doi: 10.1111/ner.13305.
[3] J. Rasmussen and H. Langerman, “Alzheimer’s Disease – Why We Need Early Diagnosis,” Degener. Neurol. Neuromuscul. Dis., vol. Volume 9, pp. 123–130, Dec. 2019, doi: 10.2147/DNND.S228939.
[4] J. H. Cole, R. E. Marioni, S. E. Harris, and I. J. Deary, “Brain age and other bodily ‘ages’: implications for neuropsychiatry,” Mol. Psychiatry, vol. 24, no. 2, pp. 266 – 281, Feb. 2019, doi: 10.1038/s41380 – 018 - 0098 - 1.
[5] L. Chouliaras and J. T. O’Brien, “The use of neuroimaging techniques in the early and differential diagnosis of dementia,” Mol. Psychiatry, Aug. 2023, doi: 10.1038/s41380 - 023 - 02215 - 8.
[6] S. Aramadaka et al., “Neuroimaging in Alzheimer’s Disease for Early Diagnosis: A Comprehensive Review,” Cureus, May 2023, doi: 10.7759/cureus.38544.
[7] X. Song et al., “Strengths and challenges of longitudinal non-human primate neuroimaging,” NeuroImage, vol. 236, p. 118009, Aug. 2021, doi: 10.1016/j.neuroimage.2021.118009.
[8] Y. Wu, Q. Liu, Y. Qiu, and L. Xie, “Deep learning prediction of chemical-induced dose-dependent and context-specific multiplex phenotype responses and its application to personalized alzheimer’s disease drug repurposing,” PLOS Comput. Biol., vol. 18, no. 8, p. e1010367, Aug. 2022, doi: 10.1371/journal.pcbi.1010367.
[9] P. ‐L. Kuo et al., “A roadmap to build a phenotypic metric of ageing: insights from the Baltimore Longitudinal Study of Aging,” J. Intern. Med., vol. 287, no. 4, pp. 373 – 394, Apr. 2020, doi: 10.1111/joim.13024.
[10] R. C. Petersen et al., “Alzheimer’s Disease Neuroimaging Initiative (ADNI): Clinical characterization,” Neurology, vol. 74, no. 3, pp. 201 – 209, Jan. 2010, doi: 10.1212/WNL.0b013e3181cb3e25.
[11] M. Hajij, G. Zamzmi, R. Paul, and L. Thukar, “Normalizing Flow for Synthetic Medical Images Generation,” in 2022 IEEE Healthcare Innovations and Point of Care Technologies (HI-POCT), Houston, TX, USA: IEEE, Mar. 2022, pp. 46 – 49. doi: 10.1109/HI-POCT54491.2022.9744072.
[12] S. Pal, S. Dutta, and R. Maitra, “Fast matrix-free methods for model-based personalized synthetic MR imaging.” arXiv, Aug. 24, 2023. Accessed: Jun. 15, 2024. [Online]. Available: http://arxiv.org/abs/2103.01532
[13] T. Xia, A. Chartsias, C. Wang, and S. A. Tsaftaris, “Learning to synthesise the ageing brain without longitudinal data,” Med. Image Anal., vol. 73, p. 102169, Oct. 2021, doi: 10.1016/j.media.2021.102169.
[14] D. Ravi, D. C. Alexander, and N. P. Oxtoby, “Degenerative Adversarial NeuroImage Nets: Generating Images that Mimic Disease Progression.” arXiv, Aug. 30, 2019. Accessed: Mar. 14, 2024. [Online]. Available: http://arxiv.org/abs/1907.02787.
[15] T. Wang et al., “A review on medical imaging synthesis using deep learning and its clinical applications,” J. Appl. Clin. Med. Phys., vol. 22, no. 1, pp. 11 – 36, Jan. 2021, doi: 10.1002/acm2.13121.
[16] Y. Zhang, M. Brady, and S. Smith, “Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm,” IEEE Trans. Med. Imaging, vol. 20, no. 1, pp. 45 – 57, Jan. 2001, doi: 10.1109/42.906424.
[17] J. Pegueroles et al., “Longitudinal brain structural changes in preclinical Alzheimer’s disease,” Alzheimers Dement., vol. 13, no. 5, pp. 499 – 509, May 2017, doi: 10.1016/j.jalz.2016.08.010.
[18] A. Machado et al., “The cholinergic system in subtypes of Alzheimer’s disease: an in vivo longitudinal MRI study,” Alzheimers Res. Ther., vol. 12, no. 1, p. 51, Dec. 2020, doi: 10.1186/s13195 - 020 - 00620 - 7.
[19] J. Zhang, M. Liu, Le An, Y. Gao, and D. Shen, “Alzheimer’s Disease Diagnosis Using Landmark-Based Features from Longitudinal Structural MR Images,” IEEE J. Biomed. Health Inform., vol. 21, no. 6, pp. 1607 – 1616, Nov. 2017, doi: 10.1109/JBHI.2017.2704614.
[20] C. Platero, M. C. Tobar, and for the Alzheimer’s Disease Neuroimaging Initiative, “Predicting Alzheimer’s conversion in mild cognitive impairment patients using longitudinal neuroimaging and clinical markers,” Brain Imaging Behav., vol. 15, no. 4, pp. 1728–1738, Aug. 2021, doi: 10.1007/s11682 -020 - 00366 - 8.
[21] D. Milana, “Deep generative models for predicting Alzheimer’s disease progression from MRI data.,” Politec. MILANO Sch. Ind. Inf. Eng., 2017.
[22] N. Pawlowski, D. C. Castro, and B. Glocker, “Deep Structural Causal Models for Tractable Counterfactual Inference.” arXiv, Oct. 22, 2020. Accessed: Mar. 17, 2024. [Online]. Available: http://arxiv.org/abs/2006.06485.
[23] M. F. Rachmadi, M. Del C. Valdés-Hernández, S. Makin, J. M. Wardlaw, and T. Komura, “Predicting the Evolution of White Matter Hyperintensities in Brain MRI Using Generative Adversarial Networks and Irregularity Map,” in Medical Image Computing and Computer Assisted Intervention – MICCAI 2019, vol. 11766, D. Shen, T. Liu, T. M. Peters, L. H. Staib, C. Essert, S. Zhou, P.-T. Yap, and A. Khan, Eds., in Lecture Notes in Computer Science, vol. 11766., Cham: Springer International Publishing, 2019, pp. 146–154. doi: 10.1007/978 – 3 - 030 - 32248 - 9_17.
[24] V. Wegmayr, M. Hörold, and J. M. Buhmann, “Generative Aging of Brain MR-Images and Prediction of Alzheimer Progression,” in Pattern Recognition, vol. 11824, G. A. Fink, S. Frintrop, and X. Jiang, Eds., in Lecture Notes in Computer Science, vol. 11824. , Cham: Springer International Publishing, 2019, pp. 247–260. doi: 10.1007/978-3-030-33676-9_17.
[25] Q. Zhao, E. Adeli, N. Honnorat, T. Leng, and K. M. Pohl, “Variational AutoEncoder for Regression: Application to Brain Aging Analysis.” arXiv, Jul. 11, 2019. Accessed: Mar. 14, 2024. [Online]. Available: http://arxiv.org/abs/1904.05948.
[26] O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional Networks for Biomedical Image Segmentation,” 2015, doi: 10.48550/ARXIV.1505.04597.
[27] B. Xu, N. Wang, T. Chen, and M. Li, “Empirical Evaluation of Rectified Activations in Convolutional Network.” arXiv, Nov. 27, 2015. Accessed: Mar. 16, 2024. [Online]. Available: http://arxiv.org/abs/1505.00853.
[28] S. M. Smith, “Fast robust automated brain extraction.,” Hum. Brain Mapp., vol. 17(3):143-155, Nov. 2002.
[29] M. W. Woolrich et al., “Bayesian analysis of neuroimaging data in FSL,” NeuroImage, vol. 45, no. 1, pp. S173–S186, Mar. 2009, doi: 10.1016/j.neuroimage.2008.10.055.
[30] A. Paszke et al., “PyTorch: An Imperative Style, High-Performance Deep Learning Library,” 2019, doi: 10.48550/ARXIV.1912.01703.
[31] Z. Wang, E. P. Simoncelli, and A. C. Bovik, “Multiscale structural similarity for image quality assessment,” in The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003, Pacific Grove, CA, USA: IEEE, 2003, pp. 1398 – 1402. doi: 10.1109/ACSSC.2003.1292216.
[32] D. Sethi, S. Bharti, and C. Prakash, “A comprehensive survey on gait analysis: History, parameters, approaches, pose estimation, and future work,” Artif. Intell. Med., vol. 129, p. 102314, Jul. 2022, doi: 10.1016/j.artmed.2022.102314.
[33] Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image Quality Assessment: From Error Visibility to Structural Similarity,” IEEE Trans. Image Process., vol. 13, no. 4, pp. 600–612, Apr. 2004, doi: 10.1109/TIP.2003.819861.
[34] J. Guerreiro, P. Tomás, N. Garcia, and H. Aidos, “Super-resolution of magnetic resonance images using Generative Adversarial Networks,” Comput. Med. Imaging Graph., vol. 108, p. 102280, Sep. 2023, doi: 10.1016/j.compmedimag.2023.102280.
[35] S. He, P. E. Grant, and Y. Ou, “Global-Local Transformer for Brain Age Estimation,” IEEE Trans. Med. Imaging, vol. 41, no. 1, pp. 213 – 224, Jan. 2022, doi: 10.1109/TMI. 2021. 3108910.
[36] L. T. Westlye et al., “Increased sensitivity to effects of normal aging and Alzheimer’s disease on cortical thickness by adjustment for local variability in gray/white contrast: A multi-sample MRI study,” NeuroImage, vol. 47, no. 4, pp. 1545 – 1557, Oct. 2009, doi: 10.1016/j.neuroimage.2009.05.084.
[37] L. Ferrarini, W. M. Palm, H. Olofsen, M. A. Van Buchem, J. H. C. Reiber, and F. Admiraal-Behloul, “Shape differences of the brain ventricles in Alzheimer’s disease,” NeuroImage, vol. 32, no. 3, pp. 1060 – 1069, Sep. 2006, doi: 10.1016/j.neuroimage.2006.05.048.
[38] N. T. Aggarwal and M. M. Mielke, “Sex Differences in Alzheimer’s Disease,” Neurol. Clin., vol. 41, no. 2, pp. 343 – 358, May 2023, doi: 10.1016/j.ncl.2023.01.001.
[39] X. Huang and S. Belongie, “Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization,” 2017, doi: 10.48550/ARXIV.1703.06868.
[40] E. Perez, F. Strub, H. De Vries, V. Dumoulin, and A. Courville, “FiLM: Visual Reasoning with a General Conditioning Layer,” Proc. AAAI Conf. Artif. Intell., vol. 32, no. 1, Apr. 2018, doi: 10.1609/aaai. v32i1. 11671.
[41] Z. Li, Q. Zheng, B. Shi, G. Pan, and X. Jiang, “DANI-Net: Uncalibrated Photometric Stereo by Differentiable Shadow Handling, Anisotropic Reflectance Modeling, and Neural Inverse Rendering,” Mar. 28, 2023, arXiv: arXiv:2303.15101. Accessed: Jul. 26, 2024. [Online]. Available: http: //arxiv.org/abs/2303. 15101.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Highlights in Science, Engineering and Technology
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
