Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3613905.3651108acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

Exploring the Multimodal Integration of VR and MRI Biomarkers for Enhanced Early Detection of Mild Cognitive Impairment

Published: 11 May 2024 Publication History

Abstract

Early detection of mild cognitive impairment (MCI) is crucial to impede dementia progression. Virtual reality (VR) biomarkers are adept at detecting impairments in instrumental activities of daily living (IADL), whereas magnetic resonance imaging (MRI) biomarkers excel in measuring observable structural changes in the brain. However, the efficacy of integrating VR and MRI biomarkers to improve early MCI detection remains unclear. This study aims to evaluate and compare the effectiveness of VR and MRI biomarkers and investigates the potential of their combined use for more accurate early MCI detection. Through support vector machine analysis, distinct characteristics were observed. For identifying MCI, VR biomarkers demonstrated high specificity (90.0%), whereas MRI showed high sensitivity (90.9%). The combination of both biomarkers yielded superior results in accuracy (94.4%), sensitivity (100.0%), and specificity (90.9%). Drawing from these results, we suggest a sequential diagnostic approach, employing VR for initial screening and MRI for subsequent confirmation of MCI.

Supplemental Material

MP4 File - Video Preview
Video Preview
Transcript for: Video Preview
SRT File - Video Preview Captions
Video Preview Captions
DOCX File - Appendices
A Details on Biomarkers Derived from VR and MRI B Detailed Statistical Analysis Results

References

[1]
Julius Opwonya, Dieu Ni Doan, Seul Gee Kim, 2021. Saccadic eye movement in mild cognitive impairment and alzheimer's disease: A systematic review and meta-analysis. Neuropsychology Review 32, 2: 193–227. http://doi.org/10.1007/s11065-021-09495-3
[2]
Hokyoung Ryu and Kyoungwon Seo. 2021. The illusion of having a large virtual body biases action-specific perception in patients with mild cognitive impairment. Scientific Reports 11, 1. http://doi.org/10.1038/s41598-021-03571-7
[3]
Philip Scheltens, Bart De Strooper, Miia Kivipelto, 2021. Alzheimer's disease. The Lancet 397, 10284: 1577–1590. http://doi.org/10.1016/s0140-6736(20)32205-4
[4]
Iris Rawtaer, Rathi Mahendran, Ee Heok Kua, 2020. Early detection of mild cognitive impairment with in-home sensors to monitor behavior patterns in community-dwelling senior citizens in Singapore: Cross-sectional Feasibility Study. Journal of Medical Internet Research 22, 5. http://doi.org/10.2196/16854
[5]
Junbo Ma, Jilian Zhang, and Zeyu Wang. 2022. Multimodality Alzheimer's disease analysis in deep Riemannian manifold. Information Processing & Management 59, 4: 102965. http://doi.org/10.1016/j.ipm.2022.102965
[6]
Santos Bringas, Sergio Salomón, Rafael Duque, Carmen Lage, and José Luis Montaña. 2020. Alzheimer's disease stage identification using deep learning models. Journal of Biomedical Informatics 109: 103514. http://doi.org/10.1016/j.jbi.2020.103514 A.P. Porsteinsson, R.S. Isaacson, S. Knox, M.N. Sabbagh, and I. Rubino. 2021. Diagnosis of Early Alzheimer's Disease: Clinical Practice in 2021. The Journal Of Prevention of Alzheimer (2021), 1-16. https://doi.org/10.14283/jpad.2021.23
[7]
M.N. Sabbagh, M. Boada, S. Borson, 2020. Early detection of mild cognitive impairment (MCI) in primary care. The Journal of Prevention of Alzheimer's Disease: 1–6. http://doi.org/10.14283/jpad.2020.21 Philip D. Harvey. 2012. Clinical applications of neuropsychological assessment. Dialogues in Clinical Neuroscience 14, 1 (2012), 91-99. https://doi.org/10.31887/dcns.2012.14.1/pharvey
[8]
M.N. Sabbagh, M. Boada, S. Borson, 2020. Early detection of mild cognitive impairment (MCI) in primary care. The Journal of Prevention of Alzheimer's Disease: 1–6. http://doi.org/10.14283/jpad.2020.21
[9]
Huaidong Huang, Shiqiang Zheng, Zhongxian Yang, 2022. Voxel-based morphometry and a deep learning model for the diagnosis of early alzheimer's disease based on cerebral gray matter changes. Cerebral Cortex 33, 3: 754–763. http://doi.org/10.1093/cercor/bhac099
[10]
Pan He, Hang Qu, Ming Cai, Weijie Liu, Xinyi Gu, and Qiang Ma. 2022. Structural alteration of medial temporal lobe subfield in the amnestic mild cognitive impairment stage of alzheimer's disease. Neural Plasticity 2022: 1–11. http://doi.org/10.1155/2022/8461235
[11]
Elena Carapelle, Ciro Mundi, Tommaso Cassano, and Carlo Avolio. 2020. Interaction between cognitive reserve and biomarkers in alzheimer disease. International Journal of Molecular Sciences 21, 17: 6279. http://doi.org/10.3390/ijms21176279
[12]
James A. Mortimer, Amy R. Borenstein, Karen M. Gosche, and David A. Snowdon. 2005. Very early detection of alzheimer neuropathology and the role of Brain Reserve in modifying its clinical expression. Journal of Geriatric Psychiatry and Neurology 18, 4: 218–223. http://doi.org/10.1177/0891988705281869
[13]
Kyoungwon Seo, Jae-kwan Kim, Dong Hoon Oh, Hokyoung Ryu, and Hojin Choi. 2017. Virtual daily living test to screen for mild cognitive impairment using kinematic movement analysis. PLOS ONE 12, 7. http://doi.org/10.1371/journal.pone.0181883
[14]
Se Young Kim, Jinseok Park, Hojin Choi, Martin Loeser, Hokyoung Ryu, and Kyoungwon Seo. 2023. Digital Marker for early screening of mild cognitive impairment through hand and eye movement analysis in Virtual Reality Using Machine Learning: First Validation Study. Journal of Medical Internet Research 25. http://doi.org/10.2196/48093
[15]
Silvia Cavedoni, Alice Chirico, Elisa Pedroli, Pietro Cipresso, and Giuseppe Riva. 2020. Digital biomarkers for the early detection of mild cognitive impairment: Artificial Intelligence Meets Virtual reality. Frontiers in Human Neuroscience 14. http://doi.org/10.3389/fnhum.2020.00245
[16]
Kyoungwon Seo, Ahreum Lee, Jieun Kim, Hokyoung Ryu, and Hojin Choi. 2018. Measuring the kinematics of daily living movements with motion capture systems in virtual reality. Journal of Visualized Experiments, 134. http://doi.org/10.3791/57284
[17]
Andrea Castegnaro, David Howett, Adrienne Li, 2022. Assessing mild cognitive impairment using object‐location memory in immersive virtual environments. Hippocampus 32, 9: 660–678. http://doi.org/10.1002/hipo.23458
[18]
David Howett, Andrea Castegnaro, Katarzyna Krzywicka, 2019. Differentiation of mild cognitive impairment using an entorhinal cortex-based test of Virtual Reality Navigation. Brain 142, 6: 1751–1766. http://doi.org/10.1093/brain/awz116
[19]
Marilyn S. Albert, Steven T. DeKosky, Dennis Dickson, 2011. The diagnosis of mild cognitive impairment due to alzheimer's disease: Recommendations from the National Institute on aging‐alzheimer's association workgroups on diagnostic guidelines for alzheimer's disease. Alzheimer's & Dementia 7, 3: 270–279. http://doi.org/10.1016/j.jalz.2011.03.008
[20]
Seungmin Jahng, Duk L. Na, and Yeonwook Kang. 2015. Constructing a composite score for the Seoul Neuropsychological Screening Battery-core. Dementia and Neurocognitive Disorders 14, 4: 137. http://doi.org/10.12779/dnd.2015.14.4.137
[21]
Ae Young Lee, Juyoun Lee, Eungseok Oh, Soo Jin Yoon, Bora Yoon, and Seong Dong Yu. 2019. Clinical utility of Seoul neuropsychological screening battery-core for Dementia Management Project in the community. Journal of the Korean Neurological Association 37, 3: 277–283. http://doi.org/10.17340/jkna.2019.3.5
[22]
Se Young Kim, Hahyeon Park, Hongbum Kim, Joon Kim, and Kyoungwon Seo. 2022. Technostress causes cognitive overload in high-stress people: Eye Tracking Analysis in a virtual kiosk test. Information Processing & Management 59, 6: 103093. http://doi.org/10.1016/j.ipm.2022.103093
[23]
Jinseok Park, Kyoungwon Seo, Seong-Eun Kim, Hokyoung Ryu, and Hojin Choi. 2022. Early screening of mild cognitive impairment through hand movement analysis in virtual reality based on machine learning: Screening of MCI through hand movement in VR. Journal of Cognitive Intervention and Digital Health 1, 1: 1. http://doi.org/10.58558/jcd.2022.1.1.1
[24]
Shin-ichi Tokushige, Hideyuki Matsumoto, Shun-ichi Matsuda, 2023. Early detection of cognitive decline in alzheimer's disease using eye tracking. Frontiers in Aging Neuroscience 15. http://doi.org/10.3389/fnagi.2023.1123456
[25]
Thomas Kosch, Mariam Hassib, Paweł W. Woźniak, Daniel Buschek, and Florian Alt. 2018. Your eyes tell. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. http://doi.org/10.1145/3173574.3174010
[26]
Sean Ing Chua, Ngiap Chuan Tan, Wei Teen Wong, 2019. Virtual reality for screening of cognitive function in older persons: Comparative study. Journal of Medical Internet Research 21, 8. http://doi.org/10.2196/14821
[27]
Minho Lee, JeeYoung Kim, Regina EY Kim, 2020. Split-attention U-Net: A fully convolutional network for robust multi-label segmentation from Brain Mri. Brain Sciences 10, 12: 974. http://doi.org/10.3390/brainsci10120974
[28]
Robin de Flores, Sandhitsu R. Das, Long Xie, 2022. Medial temporal lobe networks in alzheimer's disease: Structural and molecular vulnerabilities. The Journal of Neuroscience 42, 10: 2131–2141. http://doi.org/10.1523/jneurosci.0949-21.2021
[29]
C. J. Galton, K. Patterson, K. Graham, 2001. Differing patterns of temporal atrophy in alzheimer's disease and semantic dementia. Neurology 57, 2: 216–225. http://doi.org/10.1212/wnl.57.2.216
[30]
Seong-Jin Son, Jonghoon Kim, and Hyunjin Park. 2017. Structural and functional connectional fingerprints in mild cognitive impairment and alzheimer's disease patients. PLOS ONE 12, 3. http://doi.org/10.1371/journal.pone.0173426
[31]
Boon Lead Tee, Christa Watson Pereira, Sladjana Lukic, 2022. Neuroanatomical correlations of visuospatial processing in primary progressive aphasia. Brain Communications 4, 2. http://doi.org/10.1093/braincomms/fcac060
[32]
Kevin S. Weiner and Karl Zilles. 2016. The anatomical and functional specialization of the fusiform gyrus. Neuropsychologia 83: 48–62. http://doi.org/10.1016/j.neuropsychologia.2015.06.033
[33]
V. Singh, H. Chertkow, J. P. Lerch, A. C. Evans, A. E. Dorr, and N. J. Kabani. 2006. Spatial patterns of cortical thinning in mild cognitive impairment and alzheimer's disease. Brain 129, 11: 2885–2893. http://doi.org/10.1093/brain/awl256
[34]
Michael P. Sanfilipo, Ralph H.B. Benedict, Jitendra Sharma, Bianca Weinstock-Guttman, and Rohit Bakshi. 2005. The relationship between Whole Brain Volume and disability in multiple sclerosis: A comparison of normalized Gray vs. White matter with misclassification correction. NeuroImage 26, 4: 1068–1077. http://doi.org/10.1016/j.neuroimage.2005.03.008
[35]
Shipra Swati, Mukesh Kumar, and Suyel Namasudra. 2022. Early prediction of cognitive impairments using physiological signal for enhanced socioeconomic status. Information Processing & Management 59, 2: 102845. http://doi.org/10.1016/j.ipm.2021.102845
[36]
Shlomo Berkovsky, Ronnie Taib, Irena Koprinska, 2019. Detecting personality traits using eye-tracking data. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. http://doi.org/10.1145/3290605.3300451
[37]
Qiuhong Wei, Huiling Cao, Yuan Shi, Ximing Xu, and Tingyu Li. 2023. Machine learning based on eye-tracking data to identify autism spectrum disorder: A systematic review and meta-analysis. Journal of Biomedical Informatics 137: 104254. http://doi.org/10.1016/j.jbi.2022.104254
[38]
Hui Jin Ryu and Dong Won Yang. 2023. The Seoul Neuropsychological Screening Battery (SNSB) for Comprehensive Neuropsychological Assessment. Dementia and Neurocognitive Disorders 22, 1: 1. http://doi.org/10.12779/dnd.2023.22.1.1
[39]
Chen Xue, Aoyu Li, Ruixuan Wu, 2023. VRNPT: A neuropsychological test tool for diagnosing mild cognitive impairment using virtual reality and EEG signals. International Journal of Human–Computer Interaction: 1–19. http://doi.org/10.1080/10447318.2023.2250605
[40]
Stelios Zygouris, Dimitrios Giakoumis, Konstantinos Votis, 2015. Can a virtual reality cognitive training application fulfill a dual role? using the virtual supermarket cognitive training application as a screening tool for mild cognitive impairment. Journal of Alzheimer's Disease 44, 4: 1333–1347. http://doi.org/10.3233/jad-141260
[41]
Hatice Eraslan Boz, Hatice Limoncu, Stelios Zygouris, 2019. A new tool to assess amnestic mild cognitive impairment in Turkish older adults: Virtual supermarket (VSM). Aging, Neuropsychology, and Cognition 27, 5: 639–653. http://doi.org/10.1080/13825585.2019.1663146
[42]
Jafar Zamani, Ali Sadr, and Amir-Homayoun Javadi. 2022. Diagnosis of early mild cognitive impairment using a multiobjective optimization algorithm based on T1-MRI data. Scientific Reports 12, 1. http://doi.org/10.1038/s41598-022-04943-3
[43]
Hang Qu, Haitao Ge, Liping Wang, Wei Wang, and Chunhong Hu. 2023. Volume changes of hippocampal and amygdala subfields in patients with mild cognitive impairment and alzheimer's disease. Acta Neurologica Belgica 123, 4: 1381–1393. http://doi.org/10.1007/s13760-023-02235-9
[44]
Besma Mabrouk, Ahmed BenHamida, Nidhal Drissi, Nouha Bouzidi, and Chokri Mhiri. 2023. Contribution of brain regions asymmetry scores combined with random forest classifier in the diagnosis of alzheimer's disease in his earlier stage. Journal of Medical and Biological Engineering 43, 1: 74–82. http://doi.org/10.1007/s40846-023-00775-2
[45]
Ho Young Park, Chong Hyun Suh, Hwon Heo, Woo Hyun Shim, and Sang Joon Kim. 2022. Diagnostic performance of hippocampal volumetry in alzheimer's disease or mild cognitive impairment: A meta-analysis. European Radiology 32, 10: 6979–6991. http://doi.org/10.1007/s00330-022-08838-9
[46]
Yafei Wu, Xing Wang, and Ya Fang. 2023. Predicting mild cognitive impairment in older adults: A machine learning analysis of the alzheimer's disease neuroimaging initiative. Geriatrics & Gerontology International. http://doi.org/10.1111/ggi.14670
[47]
Orasa Chawalparit, Natcha Wontaneeporn, Weerasak Muangpaisan, Tanyaluck Thientunyakit, Panida Charnchaowanish, and Chanon Ngamsombat. 2019. MRI hippocampal subfield volume analysis: Comparison between alzheimer's disease, mild cognitive impairment, and normal aging subjects in an amyloid pet project. Journal of Alzheimer's Disease & Parkinsonism 9, 01. http://doi.org/10.4172/2161-0460.1000459
[48]
Andras Attila Horvath, Dalida Borbala Berente, Balazs Vertes, 2022. Differentiation of patients with mild cognitive impairment and healthy controls based on Computer Assisted Hand Movement Analysis: A proof-of-concept study. Scientific Reports 12, 1. http://doi.org/10.1038/s41598-022-21445-4
[49]
Jonathan R. Whitlock, Robert J. Sutherland, Menno P. Witter, May-Britt Moser, and Edvard I. Moser. 2008. Navigating from hippocampus to parietal cortex. Proceedings of the National Academy of Sciences 105, 39: 14755–14762. http://doi.org/10.1073/pnas.0804216105
[50]
Julius Opwonya, Boncho Ku, Kun Ho Lee, Joong Il Kim, and Jaeuk U. Kim. 2023. Eye movement changes as an indicator of mild cognitive impairment. Frontiers in Neuroscience 17. http://doi.org/10.3389/fnins.2023.1171417
[51]
Alexandra Wolf, Kornkanok Tripanpitak, Satoshi Umeda, and Mihoko Otake-Matsuura. 2023. Eye-tracking paradigms for the assessment of mild cognitive impairment: A systematic review. Frontiers in Psychology 14. http://doi.org/10.3389/fpsyg.2023.1197567
[52]
Charles-André Cuénod. 1993. Amygdala atrophy in alzheimer's disease. Archives of Neurology 50, 9: 941. http://doi.org/10.1001/archneur.1993.00540090046009
[53]
Stéphane P. Poulin, Rebecca Dautoff, John C. Morris, Lisa Feldman Barrett, and Bradford C. Dickerson. 2011. Amygdala atrophy is prominent in early alzheimer's disease and relates to symptom severity. Psychiatry Research: Neuroimaging 194, 1: 7–13. http://doi.org/10.1016/j.pscychresns.2011.06.014
[54]
Alla Vovk, Ameera Patel, and Dennis Chan. 2019. Augmented reality for early alzheimer's disease diagnosis. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. http://doi.org/10.1145/3290607.3313007
[55]
Giorgio Colombo and Jascha Grübel. 2023. The Spatial Performance Assessment for Cognitive Evaluation (Space): A novel game for the early detection of cognitive impairment. Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. http://doi.org/10.1145/3544549.3583828
[56]
Liana G. Apostolova and Jeffrey L. Cummings. 2007. Neuropsychiatric manifestations in mild cognitive impairment: A systematic review of the literature. Dementia and Geriatric Cognitive Disorders 25, 2: 115–126. http://doi.org/10.1159/000112509
[57]
Kei M. Igarashi. 2023. Entorhinal cortex dysfunction in alzheimer's disease. Trends in Neurosciences 46, 2: 124–136. http://doi.org/10.1016/j.tins.2022.11.006
[58]
James E. Galvin, Paul Aisen, Jessica B. Langbaum, 2021. Early stages of alzheimer's disease: Evolving the care team for Optimal Patient Management. Frontiers in Neurology 11. http://doi.org/10.3389/fneur.2020.592302
[59]
Clinton B. Wright, Janet T. DeRosa, Michelle P. Moon, 2021. Race/ethnic disparities in mild cognitive impairment and dementia: The Northern Manhattan Study. Journal of Alzheimer's Disease 80, 3: 1129–1138. http://doi.org/10.3233/jad-201370
[60]
Jing Gao, Feng Tian, Junjun Fan, 2018. Implicit detection of motor impairment in parkinson's disease from everyday smartphone interactions. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. http://doi.org/10.1145/3170427.3188502
[61]
Joanna Ciafone, Bethany Little, Alan J. Thomas, and Peter Gallagher. 2019. The neuropsychological profile of mild cognitive impairment in Lewy Body dementias. Journal of the International Neuropsychological Society 26, 2: 210–225. http://doi.org/10.1017/s1355617719001103
[62]
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, and others. 2021. Learning transferable visual models from natural language supervision. In Proceedings of the International Conference on Machine Learning (ICML '21), 8748–8763. PMLR.

Cited By

View all
  • (2024)Multimodal Machine Learning Model For MCI Detection Using EEG, MRI and VR Data2024 International Technical Conference on Circuits/Systems, Computers, and Communications (ITC-CSCC)10.1109/ITC-CSCC62988.2024.10628204(1-6)Online publication date: 2-Jul-2024
  • (2024)Advancing Mild Cognitive Impairment Detection: Integrating VR, MRI, and Neuropsychological Insights for Comprehensive Diagnosis2024 International Technical Conference on Circuits/Systems, Computers, and Communications (ITC-CSCC)10.1109/ITC-CSCC62988.2024.10628151(1-6)Online publication date: 2-Jul-2024

Index Terms

  1. Exploring the Multimodal Integration of VR and MRI Biomarkers for Enhanced Early Detection of Mild Cognitive Impairment
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Information & Contributors

            Information

            Published In

            cover image ACM Conferences
            CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
            May 2024
            4761 pages
            ISBN:9798400703317
            DOI:10.1145/3613905
            Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

            Sponsors

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            Published: 11 May 2024

            Check for updates

            Author Tags

            1. Biomarker
            2. Magnetic resonance imaging
            3. Mild cognitive impairment
            4. Virtual reality

            Qualifiers

            • Work in progress
            • Research
            • Refereed limited

            Funding Sources

            • This work was supported by Institute of Information & communications Technology Planning & Evaluation(IITP) grant funded by the Korea government(MSIT) (RS-2023-00262158).

            Conference

            CHI '24

            Acceptance Rates

            Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

            Upcoming Conference

            CHI 2025
            ACM CHI Conference on Human Factors in Computing Systems
            April 26 - May 1, 2025
            Yokohama , Japan

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • Downloads (Last 12 months)271
            • Downloads (Last 6 weeks)51
            Reflects downloads up to 13 Jan 2025

            Other Metrics

            Citations

            Cited By

            View all
            • (2024)Multimodal Machine Learning Model For MCI Detection Using EEG, MRI and VR Data2024 International Technical Conference on Circuits/Systems, Computers, and Communications (ITC-CSCC)10.1109/ITC-CSCC62988.2024.10628204(1-6)Online publication date: 2-Jul-2024
            • (2024)Advancing Mild Cognitive Impairment Detection: Integrating VR, MRI, and Neuropsychological Insights for Comprehensive Diagnosis2024 International Technical Conference on Circuits/Systems, Computers, and Communications (ITC-CSCC)10.1109/ITC-CSCC62988.2024.10628151(1-6)Online publication date: 2-Jul-2024

            View Options

            Login options

            View options

            PDF

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader

            Full Text

            View this article in Full Text.

            Full Text

            HTML Format

            View this article in HTML Format.

            HTML Format

            Media

            Figures

            Other

            Tables

            Share

            Share

            Share this Publication link

            Share on social media