Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3594806.3594862acmotherconferencesArticle/Chapter ViewAbstractPublication PagespetraConference Proceedingsconference-collections
research-article

A Systematic Review of Interaction Approaches based on Visually Evoked Potentials

Published: 10 August 2023 Publication History

Abstract

BCIs are already present in the mass market. Visual evoked potentials (VEP) are based on the recognition of recurrent visual stimuli by specific BCI. A variety of approaches use this technology to implement a whole range of different application scenarios. This paper provides an overview of approaches that use VEP either as a stand-alone technology or in combination with other technologies. First, terms for different VEP technologies and their possible procedures are introduced. The papers are classified according to the technology used, the quality of the classification, the number of simultaneous stimuli, and different application areas. One focus of the paper is value input through VEP, especially for approaches that do not work in combination with other devices. It is shown that the value input has been addressed only very little so far.

References

[1]
Brendan Allison, Clemens Brunner, Christof Altstätter, Isabella Wagner, Sebastian Grissmann, and Christa Neuper. 2012. A hybrid ERD/SSVEP BCI for continuous simultaneous two dimensional cursor control. Journal of neuroscience methods 209 (07 2012), 299–307. https://doi.org/10.1016/j.jneumeth.2012.06.022
[2]
Sinantya Feranti Anindya, Hendi Handian Rachmat, and Ediana Sutjiredjeki. 2016. A prototype of SSVEP-based BCI for home appliances control. In 2016 1st International Conference on Biomedical Engineering (IBIOMED). 1–6. https://doi.org/10.1109/IBIOMED.2016.7869810
[3]
Alexandre Armengol-Urpi and Sanjay E. Sarma. 2018. Sublime: A Hands-Free Virtual Reality Menu Navigation System Using a High-Frequency SSVEP-Based Brain-Computer Interface. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (Tokyo, Japan) (VRST ’18). Association for Computing Machinery, New York, NY, USA, Article 1, 8 pages. https://doi.org/10.1145/3281505.3281514
[4]
Jonas Auda, Uwe Gruenefeld, Thomas Kosch, and Stefan Schneegaß. 2022. The Butterfly Effect: Novel Opportunities for Steady-State Visually-Evoked Potential Stimuli in Virtual Reality. https://doi.org/10.1145/3519391.3519397
[5]
Annushree Bablani, Damodar Reddy Edla, Diwakar Tripathi, and Ramalingaswamy Cheruku. 2019. Survey on Brain-Computer Interface: An Emerging Computational Intelligence Paradigm. ACM Comput. Surv. 52, 1, Article 20 (feb 2019), 32 pages. https://doi.org/10.1145/3297713
[6]
Luzheng Bi, Xin-an Fan, Ke Jie, Teng Teng, Hongsheng Ding, and Yili Liu. 2014. Using a Head-up Display-Based Steady-State Visually Evoked Potential Brain–Computer Interface to Control a Simulated Vehicle. IEEE Transactions on Intelligent Transportation Systems 15, 3 (2014), 959–966. https://doi.org/10.1109/TITS.2013.2291402
[7]
Luzheng Bi, Xin-an Fan, Ke Jie, Teng Teng, Hongsheng Ding, and Yili Liu. 2014. Using a Head-up Display-Based Steady-State Visually Evoked Potential Brain–Computer Interface to Control a Simulated Vehicle. IEEE Transactions on Intelligent Transportation Systems 15, 3 (2014), 959–966. https://doi.org/10.1109/TITS.2013.2291402
[8]
Jordi Bieger, Gary Garcia-Molina, and Danhua Zhu. 2010. Effects of Stimulation Properties in Steady-State Visual Evoked Potential Based Brain-Computer Interfaces.
[9]
Jordi Bieger, Gary Garcia-Molina, and Danhua Zhu. 2010. Effects of Stimulation Properties in Steady-State Visual Evoked Potential Based Brain-Computer Interfaces.
[10]
Guangyu Bin, Xiaorong Gao, Yijun Wang, Bo Hong, and Shangkai Gao. 2009. VEP-based brain-computer interfaces: time, frequency, and code modulations [Research Frontier]. IEEE Computational Intelligence Magazine 4, 4 (2009), 22–26. https://doi.org/10.1109/MCI.2009.934562
[11]
Hubert Cecotti. 2010. A Self-Paced and Calibration-Less SSVEP-Based Brain–Computer Interface Speller. IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society 18 (04 2010), 127–33. https://doi.org/10.1109/TNSRE.2009.2039594
[12]
G G Celesia. 1982. Steady-state and transient visual evoked potentials in clinical practice. Ann N Y Acad Sci 388 (1982), 290–307.
[13]
Xiaogang Chen, Xiaoshan Huang, Yijun Wang, and Xiaorong Gao. 2020. Combination of Augmented Reality Based Brain- Computer Interface and Computer Vision for High-Level Control of a Robotic Arm. IEEE Transactions on Neural Systems and Rehabilitation Engineering 28 (2020), 3140–3147.
[14]
Ming Cheng, Lian Gao, Xiaorong Gao, Senior Member, and Dingfeng Xu. 2002. Design and Implementation of a Brain-Computer Interface With High Transfer Rates. October 49 (10 2002), 1181–1186. https://doi.org/10.1109/TBME.2002.803536
[15]
Kang-min Choi, Seonghun Park, and Chang-Hwan Im. 2019. Comparison of Visual Stimuli for Steady-State Visual Evoked Potential-Based Brain-Computer Interfaces in Virtual Reality Environment in terms of Classification Accuracy and Visual Comfort. Computational Intelligence and Neuroscience 2019 (01 Jul 2019), 9680697. https://doi.org/10.1155/2019/9680697
[16]
Nikolay Chumerin, Nikolay V. Manyakov, Marijn van Vliet, Arne Robben, Adrien Combaz, and Marc M. Van Hulle. 2013. Steady-State Visual Evoked Potential-Based Computer Gaming on a Consumer-Grade EEG Device. IEEE Transactions on Computational Intelligence and AI in Games 5, 2 (2013), 100–110. https://doi.org/10.1109/TCIAIG.2012.2225623
[17]
Frederic Dehais, Simon Ladouce, Ludovic Darmet, Tran-Vu Nong, Giuseppe Ferraro, Juan Torre Tresols, Sébastien Velut, and Patrice Labedan. 2022. Dual Passive Reactive Brain-Computer Interface: A Novel Approach to Human-Machine Symbiosis. Frontiers in Neuroergonomics 3 (2022). https://doi.org/10.3389/fnrgo.2022.824780
[18]
Pablo F Diez, Vicente A Mut, Enrique M Avila Perona, and Eric Laciar Leber. 2011. Asynchronous BCI control using high-frequency SSVEP. Journal of NeuroEngineering and Rehabilitation 8, 39 (2011). https://doi.org/10.1186/1743-0003-8-39
[19]
Azhar Dilshad, Vali Uddin, Muhammad Rizwan Tanweer, and Tariq Javid. 2021. A low cost SSVEP-EEG based human-computer- interaction system for completely locked-in patients. Bulletin of Electrical Engineering and Informatics 10, 4 (Aug. 2021), pp. 2245 2253. https://doi.org/10.11591/eei.v10i4.2923
[20]
Günter Edlinger, Clemens Holzner, and Christoph Guger. 2011. A Hybrid Brain-Computer Interface for Smart Home Control. In Human-Computer Interaction. Interaction Techniques and Environments, Julie A. Jacko (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 417–426.
[21]
Andéol Evain, Ferran Argelaguet, Nicolas Roussel, Géry Casiez, and Anatole Lécuyer. 2017. Can I Think of Something Else When Using a BCI? Cognitive Demand of an SSVEP-Based BCI. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5120–5125. https://doi.org/10.1145/3025453.3026037
[22]
Xiaorong Gao, Dingfeng Xu, Ming Cheng, and Shangkai Gao. 2003. A BCI-based environmental controller for the motion-disabled. IEEE Transactions on Neural Systems and Rehabilitation Engineering 11, 2 (2003), 137–140. https://doi.org/10.1109/TNSRE.2003.814449
[23]
Jisoo Ha, Seonghun Park, and Chang-Hwan Im. 2022. Novel Hybrid Brain-Computer Interface for Virtual Reality Applications Using Steady-State Visual-Evoked Potential-Based Brain–Computer Interface and Electrooculogram-Based Eye Tracking for Increased Information Transfer Rate. Frontiers in Neuroinformatics 16 (2022). https://doi.org/10.3389/fninf.2022.758537
[24]
James Henshaw. 2017. Improved Brain-Computer Interface Methods with Application to Gaming. (November 2017). https://etheses.whiterose.ac.uk/20761/
[25]
B. J. Hou, J. P. Hansen, C. Uyanik, P. Bækgaard, S. Puthusserypady, J. M. Araujo, and I. S. MacKenzie. 2022. Feasibility of a Device for Gaze Interaction by Visually-Evoked Brain Signals. ETRA 202262, 1–7. https://doi.org/10.1145/3517031.3529232
[26]
Christoph Kapeller, Christoph Hintermüller, and Christoph Guger. 2012. Augmented Control of an Avatar Using an SSVEP Based BCI. In Proceedings of the 3rd Augmented Human International Conference (Megève, France) (AH ’12). Association for Computing Machinery, New York, NY, USA, Article 27, 2 pages. https://doi.org/10.1145/2160125.2160152
[27]
Manjot Kaur and Birinder Singh. 2018. Implementation of SSVEP Technology to Develop Assistive Devices. In Progress in Advanced Computing and Intelligent Engineering, Khalid Saeed, Nabendu Chaki, Bibudhendu Pati, Sambit Bakshi, and Durga Prasad Mohapatra (Eds.). Springer Singapore, Singapore, 687–699.
[28]
Ji-Wan Kim, Maeng-Nam Kim, Dong-Hyeon Kang, Min-Hee Ahn, Hyun-Seok Kim, and Byoung-Kyong Min. 2019. An online top-down SSVEP-BMI for augmented reality. In 2019 7th International Winter Conference on Brain-Computer Interface (BCI). 1–3. https://doi.org/10.1109/IWW-BCI.2019.8737348
[29]
Yongwon Kim, Netiwit Kaongoen, and Sungho Jo. 2015. Hybrid-BCI smart glasses for controlling electrical devices. 1162–1166. https://doi.org/10.1109/SICE.2015.7285345
[30]
Bonkon Koo, Hwan-Gon Lee, Yunjun Nam, and Seungjin Choi. 2015. Immersive BCI with SSVEP in VR head-mounted display. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 1103–1106. https://doi.org/10.1109/EMBC.2015.7318558
[31]
Simon Ladouce, Juan Torre Tresols, Ludovic Darmet, G. Ferraro, and Frédéric Dehais. 2021. Improving user experience of SSVEP-BCI through reduction of stimuli amplitude depth. 2936–2941. https://doi.org/10.1109/SMC52423.2021.9659135
[32]
Po-Lei Lee, Jyun-Jie Sie, Yu-Ju Liu, Chi-Hsun Wu, Ming-Huan Lee, Chih-Hung Shu, Po-Hung Li, Chia-Wei Sun, and Kuo-Kai Shyu. 2010. An SSVEP-Actuated Brain Computer Interface Using Phase-Tagged Flickering Sequences: A Cursor System. Annals of Biomedical Engineering 38, 7 (01 Jul 2010), 2383–2397. https://doi.org/10.1007/s10439-010-9964-y
[33]
Jozef Legeny, Raquel Viciana Abad, and Anatole Lécuyer. 2011. Navigating in Virtual Worlds Using a Self-Paced SSVEP-Based Brain–Computer Interface with Integrated Stimulation and Real-Time Feedback. Presence 20, 6 (2011), 529–544. https://doi.org/10.1162/PRES_a_00075
[34]
Zhao Li, Zhao Aidong, and Bian Yan. 2019. Based on Double-layer Stimulation SSVEP Character Input System. In 2019 Chinese Control Conference (CCC). 3643–3647. https://doi.org/10.23919/ChiCC.2019.8866691
[35]
Ke Lin, Xiaogang Chen, Xiaoshan Huang, Qiang Ding, and Xiaorong Gao. 2015. A Hybrid BCI speller based on the combination of EMG envelopes and SSVEP. Applied Informatics 2, 1 (10 Jan 2015), 1. https://doi.org/10.1186/s40535-014-0004-0
[36]
Fabien Lotte and Raphaëlle N. Roy. 2019. Chapter 7 - Brain–Computer Interface Contributions to Neuroergonomics. In Neuroergonomics, Hasan Ayaz and Frederic Dehais (Eds.). Academic Press, 43–48. https://doi.org/10.1016/B978-0-12-811926-6.00007-5
[37]
Xinyao Ma, Zhaolin Yao, Yijun Wang, Weihua Pei, and Hongda Chen. 2018. Combining Brain-Computer Interface and Eye Tracking for High-Speed Text Entry in Virtual Reality. In 23rd International Conference on Intelligent User Interfaces (Tokyo, Japan) (IUI ’18). Association for Computing Machinery, New York, NY, USA, 263–267. https://doi.org/10.1145/3172944.3172988
[38]
Pablo Martínez, Hovagim Bakardjian, and Andrzej Cichocki. 2007. Fully Online Multicommand Brain-Computer Interface with Visual Neurofeedback Using SSVEP Paradigm. Computational intelligence and neuroscience 2007 (02 2007), 94561. https://doi.org/10.1155/2007/94561
[39]
Cheng Ming and Gao Shangkai. 1999. An EEG-based cursor control system. In Proceedings of the First Joint BMES/EMBS Conference. 1999 IEEE Engineering in Medicine and Biology 21st Annual Conference and the 1999 Annual Fall Meeting of the Biomedical Engineering Society (Cat. N, Vol. 1. 669 vol.1–. https://doi.org/10.1109/IEMBS.1999.802747
[40]
Krupal Sureshbai Mistry, Pablo Pelayo, Divya Geethakumari Anil, and Kiran George. 2018. An SSVEP based brain computer interface system to control electric wheelchairs. In 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC). 1–6. https://doi.org/10.1109/I2MTC.2018.8409632
[41]
Surej Mouli and Ramaswamy Palaniappan. 2020. DIY hybrid SSVEP-P300 LED stimuli for BCI platform using EMOTIV EEG headset. HardwareX 8 (2020), e00113. https://doi.org/10.1016/j.ohx.2020.e00113
[42]
Masaki Nakanishi, Yijun Wang, Xiaogang Chen, Yu-Te Wang, Xiaorong Gao, and Tzyy-Ping Jung. 2018. Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis. IEEE Transactions on Biomedical Engineering 65, 1 (2018), 104–112. https://doi.org/10.1109/TBME.2017.2694818
[43]
Hooman Nezamfar, Seyed Sadegh Mohseni Salehi, Mohammad Moghadamfalahi, and Deniz Erdogmus. 2016. FlashType: A Context-Aware c-VEP-Based BCI Typing Interface Using EEG Signals. IEEE Journal of Selected Topics in Signal Processing 10, 5 (2016), 932–941. https://doi.org/10.1109/JSTSP.2016.2552140
[44]
Rajesh C. Panicker, Sadasivan Puthusserypady, and Ying Sun. 2011. An Asynchronous P300 BCI With SSVEP-Based Control State Detection. IEEE Transactions on Biomedical Engineering 58, 6 (2011), 1781–1788. https://doi.org/10.1109/TBME.2011.2116018
[45]
Zahra Rezazadeh and Ali Sheikhani. 2017. An SSVEP-Based Brain-Computer Interface to Navigate in a Virtual Home. In Proceedings of the 7th International Conference on Bioscience, Biochemistry and Bioinformatics (Bangkok, Thailand) (ICBBB ’17). Association for Computing Machinery, New York, NY, USA, 22–27. https://doi.org/10.1145/3051166.3051171
[46]
Abdul Saboor, Aya Rezeika, Piotr Stawicki, Felix Gembler, Mihaly Benda, Thomas Grunenberg, and Ivan Volosyak. 2017. SSVEP-Based BCI in a Smart Home Scenario. In Advances in Computational Intelligence, Ignacio Rojas, Gonzalo Joya, and Andreu Catala (Eds.). Springer International Publishing, Cham, 474–485.
[47]
Dieter Schmalstieg, Alexander Bornik, Gernot Müller-Putz, and Gert Pfurtscheller. 2010. Gaze-Directed Ubiquitous Interaction Using a Brain-Computer Interface. In Proceedings of the 1st Augmented Human International Conference (Megève, France) (AH ’10). Association for Computing Machinery, New York, NY, USA, Article 4, 5 pages. https://doi.org/10.1145/1785455.1785459
[48]
Piotr Stawicki, Felix Gembler, Cheuk Yin Chan, Mihaly Benda, Aya Rezeika, Abdul Saboor, Roland Grichnik, and Ivan Volosyak. 2018. SSVEP-Based BCI in Virtual Reality - Control of a Vacuum Cleaner Robot. In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC). 534–537. https://doi.org/10.1109/SMC.2018.00749
[49]
Piotr Stawicki, Felix Gembler, and Ivan Volosyak. 2016. Driving a Semiautonomous Mobile Robotic Car Controlled by an SSVEP-Based BCI. Computational Intelligence and Neuroscience 2016 (26 Jul 2016), 4909685. https://doi.org/10.1155/2016/4909685
[50]
Ivan Volosyak, Hubert Cecotti, and Axel Graser. 2009. Optimal visual stimuli on LCD screens for SSVEP based brain-computer interfaces. In 2009 4th International IEEE/EMBS Conference on Neural Engineering. 447–450. https://doi.org/10.1109/NER.2009.5109329
[51]
Lisa-Marie Vortmann and Felix Putze. 2020. Attention-Aware Brain Computer Interface to Avoid Distractions in Augmented Reality. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3382889
[52]
Meng Wang, Renjie Li, Ruofan Zhang, Guangye Li, and Dingguo Zhang. 2018. A Wearable SSVEP-Based BCI System for Quadcopter Control Using Head-Mounted Device. IEEE Access 6 (2018), 26789–26798. https://doi.org/10.1109/ACCESS.2018.2825378
[53]
Yao Wang, Kun Li, Xiang Zhang, Jinhai Wang, and Ran Wei. 2020. Research on the Application of Augmented Reality in SSVEP-BCI. In Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence (Tianjin, China) (ICCAI ’20). Association for Computing Machinery, New York, NY, USA, 505–509. https://doi.org/10.1145/3404555.3404587
[54]
Yijun Wang, Ruiping Wang, Xiaorong Gao, Bo Hong, and Shangkai Gao. 2006. A practical VEP-based brain-computer interface. IEEE Trans Neural Syst Rehabil Eng 14, 2 (06 2006), 234–239.
[55]
Yao Wang, Xiang Zhang, Kun Li, Jinhai Wang, and Xiaogang Chen. 2020. Humanoid Robot Control System Based on AR-SSVEP. In Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence (Tianjin, China) (ICCAI ’20). Association for Computing Machinery, New York, NY, USA, 529–533. https://doi.org/10.1145/3404555.3404625
[56]
Chi Man Wong, Qi Tang, Janir Nuno da Cruz, and Feng Wan. 2015. A multi-channel SSVEP-based BCI for computer games with analogue control. In 2015 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA). 1–6. https://doi.org/10.1109/CIVEMSA.2015.7158612
[57]
Chi-Hsu Wu and Heba Lakany. 2013. The Effect of the Viewing Distance of Stimulus on SSVEP Response for Use in Brain-Computer Interfaces. In Proceedings of the 2013 IEEE International Conference on Systems, Man, and Cybernetics(SMC ’13). IEEE Computer Society, USA, 1840–1845. https://doi.org/10.1109/SMC.2013.317
[58]
Xiao Xing, Yijun Wang, Weihua Pei, Xuhong Guo, Zhiduo Liu, Fei Wang, Gege Ming, Hongze Zhao, Qiang Gui, and Hongda Chen. 2018. A High-Speed SSVEP-Based BCI Using Dry EEG Electrodes. Scientific Reports 8, 1 (Oct. 2018), 14708. https://doi.org/10.1038/s41598-018-32283-8 Number: 1 Publisher: Nature Publishing Group.
[59]
Chenguang Yang, Yuhang Ye, Xinyang Li, and Ruowei Wang. 2018. Development of a neuro-feedback game based on motor imagery EEG. Multimedia Tools and Applications 77 (06 2018). https://doi.org/10.1007/s11042-017-5168-x
[60]
Thorsten O Zander and Christian Kothe. 2011. Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general. Journal of Neural Engineering 8, 2 (mar 2011), 025005. https://doi.org/10.1088/1741-2560/8/2/025005

Cited By

View all
  • (2024)Evaluation of Different Visual Feedback Methods for Brain—Computer Interfaces (BCI) Based on Code-Modulated Visual Evoked Potentials (cVEP)Brain Sciences10.3390/brainsci1408084614:8(846)Online publication date: 22-Aug-2024
  • (2023)VEPdgets: Towards Richer Interaction Elements Based on Visually Evoked PotentialsSensors10.3390/s2322912723:22(9127)Online publication date: 12-Nov-2023

Index Terms

  1. A Systematic Review of Interaction Approaches based on Visually Evoked Potentials

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      PETRA '23: Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments
      July 2023
      797 pages
      ISBN:9798400700699
      DOI:10.1145/3594806
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 10 August 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. BCI
      2. Brain-computer interface
      3. HCI
      4. Interaction
      5. Potentials
      6. VEP
      7. Visually Evoked

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      PETRA '23

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)46
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 22 Sep 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Evaluation of Different Visual Feedback Methods for Brain—Computer Interfaces (BCI) Based on Code-Modulated Visual Evoked Potentials (cVEP)Brain Sciences10.3390/brainsci1408084614:8(846)Online publication date: 22-Aug-2024
      • (2023)VEPdgets: Towards Richer Interaction Elements Based on Visually Evoked PotentialsSensors10.3390/s2322912723:22(9127)Online publication date: 12-Nov-2023

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media