research-article

Progress on Hybrid EEG-fNIRs system and its application

Authors:

Yuan LianAuthors Info & Claims

ISAIMS '21: Proceedings of the 2nd International Symposium on Artificial Intelligence for Medicine Sciences

Pages 1 - 6

https://doi.org/10.1145/3500931.3500932

Published: 22 December 2021 Publication History

Abstract

Monitoring brain activity is of great significance in biomedical, neuroscience, and even computer science. Though many technologies can detect brain activity, such as EEG, MEG, fMRI and fNIRS, they all have limitations on spatial resolution or time resolution. Combining EEG and fNIRS systems can detect brain activity at both high time and spatial resolution. In this review article, basic principles and current application of EEG-fNIRS technology would be introduced, advantages and disadvantages of the technology will also be included. Moreover, we will emphasize its wide applicability in cognitive neuroscience with its great potential in further understanding human brain cognitive function and future directions to improve the hybrid system.

References

[1]

Cohen, M. X. (2017) Where Does EEG Come From and What Does It Mean? Trends in Neurosciences, 40(4): 208--218.

[2]

Li, G. L., et al. (2020). Review of semi-dry electrodes for EEG recording. Journal of Neural Engineering, 17(5): 26.

[3]

Chen, W. L., et al. (2020) Functional Near-Infrared Spectroscopy and Its Clinical Application in the Field of Neuroscience: Advances and Future Directions. Frontiers in Neuroscience, 14: 15.

[4]

Lee, S. H., et al. (2020) Wearable hip-assist robot modulates cortical activation during gait in stroke patients: a functional near-infrared spectroscopy study. Journal of Neuroengineering and Rehabilitation, 17(1): 8.

[5]

Fazli, S., Mehnert, J., Steinbrink, J., Curio, G., Villringer, A., Müller, K.-R., et al. (2012) Enhanced performance by a hybrid NIRS-EEG brain computer interface. Neuroimage, 59: 519--529.

[6]

Güven, A., Altinkaynak, M., Dolu, N. et al. (2020) Combining functional near-infrared spectroscopy and EEG measurements for the diagnosis of attention-deficit hyperactivity disorder. Neural Comput & Applic, 32: 8367--8380.

Digital Library

[7]

Chiarelli, A. M. et al. (2020) Fiberless, Multi-Channel fNIRS-EEG System Based on Silicon Photomultipliers: Towards Sensitive and Ecological Mapping of Brain Activity and Neurovascular Coupling. Sensors, 20(10): 23.

[8]

Zhou, Y. et al. (2020) 'A Hybrid Asynchronous Brain-Computer Interface Combining SSVEP and EOG Signals', IEEE Transactions on Biomedical Engineering, Biomedical Engineering, IEEE Transactions on, IEEE Trans. Biomed. Eng, 67(10), pp. 2881--2892.

[9]

Davidson, R.J.; Jackson, D.C.; Larson, C.L. Human electroencephalography. (2000) In Handbook of Psychophysiology; Cambridge University Press: Cambridge, UK; pp. 27--52

[10]

Rezazadeh Sereshkeh A, Yousefi R, Wong AT, Rudzicz F, Chau T. (2019) Development of a ternary hybrid fNIRS-EEG brain-computer interface based on imagined speech. Brain-Computer Interfaces. 6(4):128--140.

[11]

Baddeley, A. (2003). Working memory: looking back and looking forward. Nat. Rev. Neurosci. 4, 829--839.

[12]

Natalia E. Krzesniak, Anna Sarnowska, Anna Figiel-Dabrowska, Katarzyna Osiak, Krystyna Domanska-Janik, & Bart?omiej H. Noszczyk. (2021). Secondary release of the peripheral nerve with autologous fat derivates benefits for functional and sensory recovery. Neural Regeneration Research, 16(5), 856--864.

[13]

Liu Z, Shore J, Wang M, Yuan F, Buss A, Zhao X. (2021) A systematic review on hybrid EEG/fNIRS in brain-computer interface. Biomedical Signal Processing and Control. 20 68.

[14]

Kapadia A, Mirrahimi A, Dmytriw AA.(2020) Intersection between sleep and neurovascular coupling as the driving pathophysiology of Alzheimer's disease. Medical hypotheses. 144:110283.

[15]

Buccino AP, Keles HO, Omurtag A. (2016)Hybrid EEG-fNIRS Asynchronous Brain-Computer Interface for Multiple Motor Tasks. PLoS ONE. 11(1):1--16.

[16]

Cicalese PA, Li R, Ahmadi MB, et al. (2020)An EEG-fNIRS hybridization technique in the four-class classification of alzheimer's disease. J Neurosci Methods. 336:108618.

[17]

David, P.; Antonio, M.C.; Chiara, F.; Daniela, C; Pierpaolo, C.; Ludovica, zzz. (2020) Working Memory Decline in Alzheimer's Disease Is Detected by Complexity Analysis of Multimodal EEG-fNIRS. Entropy, 12

[18]

Perpetuini, D.; Chiarelli, A.; Cardone, D.; Filippini, C.; Bucco, R.; Zito, M.; Merla, A. (2019) Complexity of Frontal Cortex fNIRS Can Support Alzheimer Disease Diagnosis in Memory and Visuo-Spatial Tests. Entropy, 21, 26.

[19]

Xu Z, Skorheim S, Tu M, et al. (2017) Improving efficiency in sparse learning with the feedforward inhibitory motif. Neurocomputing, 267:141--151.

Digital Library

[20]

National Safety Council (2018) Drivers are Falling Asleep Behind the Wheel https://www.nsc.org/road-safety/safety-topics/fatigued-driving#:~:text=According%20to%20the%20National%20Highway, 1%2C550%20fatalities%20and%2071%2C000%20injuries.&text=A%20study%20by%20the%20AAA, drowsy%20driving%20crashes%20occur%20annually.

[21]

Ahn S, Nguyen T, Jang H, Kim JG and Jun SC (2016) Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data. Front. Hum. Neurosci. 10:219.

[22]

Frédéric D, Alban D, Gianluca Di F, Kevin J. Verdière, Gianluca B, et al. (2018) Monitoring pilot's cognitive fatigue with engagement features in simulated and actual flight conditions using an hybrid fNIRS-EEG passive BCI. 2018 IEEE International Conference on Systems, Man, and Cybernetics: 544--549.

[23]

Bin X, Gavriel S (2000) Review and reappraisal of modelling and predicting mental workload in single- and multi-task environments, Work & Stress, 14:1, 74--99

[24]

Young, M. S., and Stanton, N. A. (2002) Malleable attentional resources theory: a new explanation for the effects of mental underload on performance. Hum. Factors 44, 365--375.

[25]

Thomas, L. C., and Wickens, C. D. (2001). Visual displays and cognitive tunneling: frames of reference effects on spatial judgments and change detection. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 45, 336--340.

[26]

Dixon, B. J., Daly, M. J., Chan, H., Vescan, A. D., Witterick, I. J., and Irish, J. C. (2013). Surgeons blinded by enhanced navigation: the effect of augmented reality on attention. Surg Endosc. 27, 454--61. Dehais, F., Causse, M., Vachon, F., Régis, N., Menant, E., and Tremblay, S. (2014). Failure to detect critical auditory alerts in the cockpit: evidence for inattentional deafness. Hum. Factors 56, 631--44.

[27]

Dehais F., Causse M., Vachon F., Régis N., Menant E., and Tremblay, S. (2014). Failure to detect critical auditory alerts in the cockpit: evidence for inattentional deafness. Hum. Factors 56, 631--44.

[28]

Aghajani H, Garbey M, Omurtag A (2017) Measuring Mental Workload with EEG+fNIRS. Frontiers in Human Neuroscience, 11: 359.

[29]

Saadati M, Jill N, Hasan A (2019) Mental Workload Classification from Spatial Representation of FNIRS Recordings Using Convolutional Neural Networks, 2019 IEEE 29th International Workshop on Machine Learning for Signal Processing: 1--6.

[30]

Li R, Nguyen T, Potter T, et al. (2019) Dynamic cortical connectivity alterations associated with Alzheimer's disease: An EEG and fNIRS integration study. NeuroImage: Clinical, 21:101622.

[31]

Perpetuini, D., et al. (2020). Working Memory Decline in Alzheimer's Disease Is Detected by Complexity Analysis of Multimodal EEG-fNIRS. Entropy, 22(12): 16.

[32]

Sirpal P, Kassab A, Pouliot P, et al. (2019) fNIRS improves seizure detection in multimodal EEG-fNIRS recordings. Journal of Biomedical Optics, 24(5):1.

[33]

Abtahi, M., et al. (2020). Merging fNIRS-EEG Brain Monitoring and Body Motion Capture to Distinguish Parkinsons Disease. Ieee Transactions on Neural Systems and Rehabilitation Engineering, 28(6): 1246--1253.

Cited By

Tang JChen JXu XLiu AChen X(2024)Imagined Speech Reconstruction From Neural Signals—An Overview of Sources and MethodsIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.347283073(1-21)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3472830
Rahimi NKumar CMcLinden JIsmail Hosni SBahram Borgheai SShahriari YShao M(2024)Topology-Aware Multimodal Fusion for Neural Dynamics Representation Learning and ClassificationIEEE Sensors Journal10.1109/JSEN.2024.340000624:13(21062-21073)Online publication date: 1-Jul-2024
https://doi.org/10.1109/JSEN.2024.3400006
Hirshfield LWickens CDoherty ESpencer CWilliams THayne L(2023)Toward Workload-Based Adaptive Automation: The Utility of fNIRS for Measuring Load in Multiple Resources in the BrainInternational Journal of Human–Computer Interaction10.1080/10447318.2023.226624240:22(7404-7430)Online publication date: 23-Oct-2023
https://doi.org/10.1080/10447318.2023.2266242

Index Terms

Progress on Hybrid EEG-fNIRs system and its application
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

Brain Processes and Neurofeedback for Performance Enhancement of Precision Motor Behavior
FAC '09: Proceedings of the 5th International Conference on Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience: Held as Part of HCI International 2009

Based on a number of empirical investigations of cerebral cortical dynamics during precision aiming tasks (i.e. marksmanship) employing electroencephalography (EEG) refinement of cortical activity and attenuation of nonessential cortico-cortical ...
Brain Activation in Virtual Reality for Attention Guidance
Learning and Collaboration Technologies. Human and Technology Ecosystems
Abstract
Virtual Reality (VR) not only offers great opportunities in terms of entertainment, it is also widely applicable in the field of attention guidance, medicine and psychology. The distinction between VR and ordinary media is the 360 - also known as ...
Research Commentary---NeuroIS: The Potential of Cognitive Neuroscience for Information Systems Research

This paper introduces the idea of drawing upon the cognitive neuroscience literature to inform IS research (herein termed “NeuroIS”). Recent advances in cognitive neuroscience are uncovering the neural bases of cognitive, emotional, and social processes,...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ISAIMS '21: Proceedings of the 2nd International Symposium on Artificial Intelligence for Medicine Sciences

October 2021

593 pages

ISBN:9781450395588

DOI:10.1145/3500931

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 December 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ISAIMS 2021

ISAIMS 2021: 2nd International Symposium on Artificial Intelligence for Medicine Sciences

October 29 - 31, 2021

Beijing, China

Acceptance Rates

Overall Acceptance Rate 53 of 112 submissions, 47%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
267
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)9

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tang JChen JXu XLiu AChen X(2024)Imagined Speech Reconstruction From Neural Signals—An Overview of Sources and MethodsIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.347283073(1-21)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3472830
Rahimi NKumar CMcLinden JIsmail Hosni SBahram Borgheai SShahriari YShao M(2024)Topology-Aware Multimodal Fusion for Neural Dynamics Representation Learning and ClassificationIEEE Sensors Journal10.1109/JSEN.2024.340000624:13(21062-21073)Online publication date: 1-Jul-2024
https://doi.org/10.1109/JSEN.2024.3400006
Hirshfield LWickens CDoherty ESpencer CWilliams THayne L(2023)Toward Workload-Based Adaptive Automation: The Utility of fNIRS for Measuring Load in Multiple Resources in the BrainInternational Journal of Human–Computer Interaction10.1080/10447318.2023.226624240:22(7404-7430)Online publication date: 23-Oct-2023
https://doi.org/10.1080/10447318.2023.2266242

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents