Application of Deep Learning Method in Emotional Brain computer Interface
Author: 
Shangpu WuAuthors Info & Claims
Shangpu WuAuthors Info & ClaimsPages 7 - 10
Abstract
Brain computer Interface (BCI) is attracting increasing attention in neural engineering, which can encode brain signals into control command. In recent years, with computer science growing, deep learning has been gradually applied to BCI system, which greatly increases the precision of target recognition in BCI. This paper first introduces several models commonly used in deep learning, such as convolutional neural networks (CNN), recurrent neural networks (RNN), and Deep Belief Networks (DBN). Then, some research on BCI systems based on deep learning in various application scenarios is listed. In particular, emotional BCI has been widely studied among all kinds of BCI systems based on Electroencephalogram (EEG) signals. This paper also reviews research on the emotion BCI system based on deep learning. Finally, the current research status of deep learning in BCI systems and the factors affecting BCI recognition accuracy are summarized and the future research directions and the trend of emotional BCI system are discussed.
References
[1]
Lotte, F., Bougrain, L., Cichocki, A., Clerc, M. (2018) A review of classification algorithms for EEG-based brain-computer interfaces: a 10 year update. Journal of neural engineering., 15: 1--28.
[2]
Leuthardt, E. C., Schalk, G., Roland, J., Rouse, A., Moran, D. W. (2009). Evolution of brain-computer interfaces: going beyond classic motor physiology. Neurosurgical Focus., 27: E4.
[3]
Jr, D. B., Bell, W. L., Jr, J., Mathews, V. P., Glazier, S. S. (2002) Assessment and cost comparison of sleep-deprived eeg, mri and pet in the prediction of surgical treatment for epilepsy. Seizure., 11: 303--309.
[4]
Deng, L. (2014) A tutorial survey of architectures, algorithms, and applications for deep learning. Apsipa Transactions on Signal & Information Processing., 3: -.
[5]
Acharya, U. R., Oh, S. L., Hagiwara, Y., Tan, J. H., Adeli, H. (2017) Deep convolutional neural network for the automated detection and diagnosis of seizure using eeg signals. Computers in Biology and Medicine., 100: 270--278.
[6]
Schirrmeister, R. T., Gemein, L., Eggensperger, K., Hutter, F., Ball, T. (2017) Deep learning with convolutional neural networks for decoding and visualization of eeg pathology. In: 2017 IEEE Signal Processing in Medicine and Biology Symposium (SPMB). Philadelphia, PA, USA. pp. 1--7.
[7]
Morabito, F. C., Campolo, M., Ieracitano, C., Ebadi, J. M., & Bramanti, P. (2016) Deep convolutional neural networks for classification of mild cognitive impaired and Alzheimer's disease patients from scalp EEG recordings. In: 2016 IEEE 2nd International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI). Bologna, Italy. pp. 1--6.
[8]
Suk, H. I., Shen, D. (2015) Deep Learning in Diagnosis of Brain Disorders. In: Lee, S., Heinrich, H. (Eds.), Recent Progress in Brain and Cognitive Engineering. Springer., Germany. pp. 203--213.
[9]
Tan, D., Rui, Z., Sun, J., Wei, Q. (2015) Sleep spindle detection using deep learning: A validation study based on crowdsourcing. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Milan, Italy. pp. 2828--2831.
[10]
Sors, A., Bonnet, S., Mirek, S., Vercueil, L., Payen, J. F. (2018) A convolutional neural network for sleep stage scoring from raw singlechannel eeg. Biomedical Signal Processing and Control., 42: 107--114.
[11]
Maddula, R. K., Stivers, J., Mousavi, M., Ravindran, S., Sa, V. (2017) Deep recurrent convolutional neural networks for classifying P300 BCI signals. In Proceedings of the 7th Graz Brain-Computer Interface Conference, Graz, Austria. pp. 18--22.
[12]
X Zhang, Yao, L., Kanhere, S. S., Liu, Y., Chen, K. (2017) Mindid: person identification from brain waves through attention-based recurrent neural network. Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies., 2: 149.
[13]
Hajinoroozi, M., Mao, Z., Huang, Y. (2016) Prediction of driver's drowsy and alert states from EEG signals with deep learning. In: 2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP). Cancun, Mexico. pp. 493--496.
[14]
Prasad, M., Huang, Y. C., Wang, Y. K., Lin, C. T. (2017). Brain Dynamic States Analysis based 3D Convolutional Neural Network. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Banff, AB, Canada. pp. 493--496.
[15]
Almogbel, M. A., Dang, A. H., Kameyama, W. (2018) EEG-signals based cognitive workload detection of vehicle driver using deep learning. In: 2018 20th International Conference on Advanced Communication Technology (ICACT). Chuncheon, Korea (South). pp. 256--259.
[16]
Yanagimoto M, Sugimoto C. (2016) Recognition of persisting emotional valence from EEG using convolutional neural networks In: 2016 IEEE 9th International Workshop on Computational Intelligence and Applications (IWCIA). Hiroshima, Japan. pp. 27--32.
[17]
Jiang, H., Liu, W. Yao, L. (2017) Analyze EEG Signals with Convolutional Neural Network Based on Power Spectrum Feature Selection. In: CENet 2017-the 7th International Conference on Computer Engineering and Networks. Shanghai, China. pp. 18--24.
[18]
Qiao, R., Qing, C., Zhang, T. (2017) A novel deep-learning based framework for multi-subject emotion recognition. In: 2017 4th International Conference on Information Cybernetics and Computational Social Systems (ICCSS). Dalian, China. pp. 181--185.
[19]
Hiroyasu, T., Hanawa, K., Yamamoto, U. (2014) Gender classiffcation of subjects from cerebral blood flow changes using Deep Learning. In: 2014 IEEE Symposium on Computational Intelligence and Data Mining (CIDM). Orlando, FL, USA. pp. 229--233.
[20]
Alhagry, S., Aly, A., Reda, A. (2017) Emotion Recognition based on EEG using LSTM Recurrent Neural Network. International Journal of Advanced Computer Science and Applications., 8: 355--358.
[21]
Zhang, T., Zheng, W., Cui, Z., Zong, Y., Li, Y. (2018) Spatial-temporal recurrent neural network for emotion recognition. IEEE transactions on cybernetics., 49: 1--9.
[22]
Xiang Li, Peng Zhang, Dawei Song, Guangliang Yu, Yuexian Hou, and Bin Hu. (2015) EEG based emotion identification using unsupervised deep feature learning. (2015). In: SIGIR 2015 Workshop on Neuro-Physiological Methods in IR Research. Santiago, Chile.
[23]
Zheng, W. L., Guo, H. T., Lu, B. L. (2015) Revealing critical channels and frequency bands for emotion recognition from EEG with deep belief network. In: 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER). Montpellier, France. pp. 154--157.
[24]
Xu, H., Plataniotis, K. N. (2016) EEG-based affect states classification using deep belief networks. In: Digital Media Industry & Academic Forum (DMIAF). Santorini, Greece. pp. 148--153.
[25]
Jia, X., Li, K., Li, X., Zhang, A. (2014) A novel semi-supervised deep learning framework for affective state recognition on eeg signals. In: 2014 IEEE International Conference on Bioinformatics and Bioengineering. Boca Raton, FL, USA. pp. 30--37.
[26]
Xu, H., Plataniotis, K. N. (2016) Affective states classification using EEG and semi-supervised deep learning approaches. In:2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP). Montreal, QC, Canada. pp. 1--6.
[27]
Kawde, P., Verma, G. K. (2017) Deep belief network based affect recognition from physiological signals. In: 2017 4th IEEE Uttar Pradesh Section International conference on Electrical, Computer and Electronics (UPCON). Mathura, India. pp. 587--592.
[28]
Miranda-Correa, J. A., Patras, I. (2018) A Multi-Task Cascaded Network for Prediction of Affect, Personality, Mood and Social Context Using EEG Signals. In: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018). Xi'an, China. pp. 373--380.
[29]
Yang, Y., Wu, Q., Ming, Q., Wang, Y., Chen, X. (2018) Emotion recognition from multi- channel EEG through parallel convolutional recurrent neural network. In: 2018 International Joint Conference on Neural Networks (IJCNN). Rio de Janeiro, Brazil. pp. 1--7.
[30]
Gao, Y., Lee, H. J., Mehmood, R. M. (2015). Deep learninig of EEG signals for emotion recognition. In: 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). Turin, Italy. pp. 1--5.
[31]
Gu, J., Wang, Z., Kuen, J., Ma, L., & Gang, W. (2015) Recent advances in convolutional neural networks. Pattern Recognition., 77: 354--377.
[32]
Schmidhuber, Jürgen. (2015) Deep learning in neural networks: an overview. Neural Netw., 61: 85--117.
Index Terms
- Application of Deep Learning Method in Emotional Brain computer Interface
Recommendations
Brain Computer Interface for Neuro-rehabilitation With Deep Learning Classification and Virtual Reality Feedback
AH2019: Proceedings of the 10th Augmented Human International Conference 2019Though Motor Imagery (MI) stroke rehabilitation effectively promotes neural reorganization, current therapeutic methods are immeasurable and their repetitiveness can be demotivating. In this work, a real-time electroencephalogram (EEG) based MI-BCI (...
Design of Wearable Brain Computer Interface Based on Motor Imagery
IIH-MSP '14: Proceedings of the 2014 Tenth International Conference on Intelligent Information Hiding and Multimedia Signal ProcessingBrain computer interface (BCI) is a communication system to establish a communication interface between the brain and the device. Motor imagery-based brain computer interface is one of asynchronous BCIs, and have been widely developed in recent years. ...
Development of a Wearable Motor-Imagery-Based Brain---Computer Interface
A motor-imagery-based brain---computer interface (BCI) is a translator that converts the motor intention of the brain into a control command to control external machines without muscles. Numerous motor-imagery-based BCIs have been successfully proposed ...
Comments
Information & Contributors
Information
Published In
October 2021
593 pages
ISBN:9781450395588
DOI:10.1145/3500931
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 December 2021
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ISAIMS 2021
ISAIMS 2021: 2nd International Symposium on Artificial Intelligence for Medicine Sciences
October 29 - 31, 2021
Beijing, China
Acceptance Rates
Overall Acceptance Rate 53 of 112 submissions, 47%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 78Total Downloads
- Downloads (Last 12 months)12
- Downloads (Last 6 weeks)1
Reflects downloads up to 01 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in