research-article

User expectations and experiences of a speech and thought controlled computer game

Authors:

Hayrettin Gürkök,

Anton NijholtAuthors Info & Claims

ACE '11: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology

Article No.: 53, Pages 1 - 6

https://doi.org/10.1145/2071423.2071490

Published: 08 November 2011 Publication History

Abstract

Brain-computer interfaces (BCIs) are often evaluated in terms of performance and seldom for usability. However in some application domains, such as entertainment computing, user experience evaluation is vital. User experience evaluation in BCI systems, especially in entertainment applications such as games, can be biased due to the novelty of the interface. However, as the novelty will eventually vanish, what matters is the user experience related to the unique features offered by BCI. Therefore it is a viable approach to compare BCI to other novel modalities, such as a speech or motion recogniser, rather than the traditional mouse and keyboard. In the study which we present in this paper, our participants played a computer game with a BCI and an automatic speech recogniser (ASR) and they rated their expectations and experiences for both modalities. Our analysis on subjective ratings revealed that both ASR and BCI were successful in satisfying participants' expectations in general. Participants found speech control easier to learn than BCI control. They indicated that BCI control induced more fatigue than they expected.

References

[1]

J. Bieger and G. G. Molina. Light stimulation properties to influence brain activity: A brain-computer interface application. Technical Report TN-2010-00315, Philips Research, Eindhoven, the Netherlands, 2010.

[2]

G. Edlinger, C. Holzner, C. Guger, C. Groenegress, and M. Slater. Brain-computer interfaces for goal orientated control of a virtual smart home environment. In 4th International IEEE/EMBS Conference on Neural Engineering, pages 463--465. IEEE, Piscataway, NJ, USA, 2009.

[3]

H. Gürkök, G. Hakvoort, and M. Poel. Evaluating user experience with respect to user expectations in brain-computer interface games. In Proceedings of the 5th International BCI Conference. TU Graz, Graz, Austria, 2011. To appear.

[4]

G. Hakvoort, H. Gürkök, D. Plass-Oude Bos, M. Obbink, and M. Poel. Measuring immersion and affect in a brain-computer interface game. In Human-Computer Interaction -- INTERACT 2011. 13th IFIP TC 13 International Conference. Springer, 2011. To appear.

Digital Library

[5]

M. Hassenzahl. The thing and I: understanding the relationship between user and product. In Funology: from usability to enjoyment, pages 31--42. Kluwer Academic Publishers, Dordrecht, the Netherlands, 2004.

[6]

J.-P. Haton. Automatic speech recognition: A review. In Enterprise Information Systems V, pages 6--11. Springer, Dordrecht, the Netherlands, 2005.

[7]

C. S. Herrmann. Human EEG responses to 1--100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena. Experimental Brain Research, 137(3--4):346--353. 2001.

[8]

ISO 9241-11:1998. Ergonomic requirements for office work with visual display terminals (VDTs) -- Part 11: Guidance on usability. ISO, Geneva. Switzerland, 1998.

[9]

H. H. Jasper. Report of the committee on methods of clinical examination in electroencephalography: 1957. Electroencephalography and Clinical Neurophysiology, 10(2):370--375, 1958.

[10]

I. McLoughlin and H. R. Sharifzadeh. Speech recognition for smart homes. In Speech Recognition, Technologies and Applications, pages 477--494. I-Tech, Vienna, Austria, 2008.

[11]

C. S. Nam, Y. Li, Y. Jeon, Y.-J. Kim, and H.-Y. Yoon. Usability of the P300 speller: Towards a more sustainable brain-computer interface. e-Minds: International Journal on Human-Computer Interaction, 1(5), 2009.

[12]

A. Nijholt, B. Reuderink, and D. Oude Bos. Turning shortcomings into challenges: Brain-computer interfaces for games. In Intelligent Technologies for Interactive Entertainment, pages 153--168. Springer-Verlag. Berlin/Heidelberg, Germany, 2009.

[13]

E. Pasqualotto, A. Simonetta, V. Gnisci, S. Federici, and M. O. Belardinelli. Toward a usability evaluation of BCIs. International Journal of Bioelectromagnetism, 13(1), 2011. To appear.

[14]

A. Schlögl, J. Kronegg, J. E. Huggins, and S. G. Mason. Evaluation criteria for BCI research. In Toward Brain-Computer Interfacing, pages 327--342. The MIT Press, Cambridge, MA, USA, 2007.

[15]

D. Tan and A. Nijholt, editors. Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction. Springer-Verlag, London, UK, 2010.

Digital Library

[16]

M. Turunen, J. Hakulinen, A. Melto, T. Heimonen, T. Laivo, and J. Hella. SUXES - user experience evaluation method for spoken and multimodal interaction. In 10th Annual Conference of the International Speech Communication Association, pages 2567--2570. ISCA, 2009.

[17]

M. Turunen, H. Soronen. S. Pakarinen, J. Hella, T. Laivo, J. Hakulinen, A. Melto, J.-P. Rajaniemi, E. Mäkinen, T. Heimonen, J. Rantala, P. Valkama, T. Miettinen, and R. Raisamo. Accessible multimodal media center application for blind and partially sighted people. Computers in Entertainment, 8:16, 2010.

Digital Library

[18]

I. Wechsung and A. Naumann. Evaluation methods for multimodal systems: A comparison of standardized usability questionnaires. In Perception in Multimodal Dialogue Systems, pages 276--284. Springer, Berlin/Heidelberg, Germany, 2008.

Digital Library

Cited By

Auda JGruenefeld UKosch TSchneegass S(2022)The Butterfly Effect: Novel Opportunities for Steady-State Visually-Evoked Potential Stimuli in Virtual RealityProceedings of the Augmented Humans International Conference 202210.1145/3519391.3519397(254-266)Online publication date: 13-Mar-2022
https://dl.acm.org/doi/10.1145/3519391.3519397
Barzilai GRampino L(2020)Just a Natural Talk? The Rise of Intelligent Personal Assistants and the (Hidden) Legacy of Ubiquitous ComputingDesign, User Experience, and Usability. Design for Contemporary Interactive Environments10.1007/978-3-030-49760-6_2(18-39)Online publication date: 10-Jul-2020
https://doi.org/10.1007/978-3-030-49760-6_2
Hair AMonroe PAhmed BBallard KGutierrez-Osuna RGiannakos MJaccheri LDivitini M(2018)Apraxia worldProceedings of the 17th ACM Conference on Interaction Design and Children10.1145/3202185.3202733(119-131)Online publication date: 19-Jun-2018
https://dl.acm.org/doi/10.1145/3202185.3202733
Show More Cited By

Index Terms

User expectations and experiences of a speech and thought controlled computer game
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Buses and high-speed links
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Modality switching and performance in a thought and speech controlled computer game
ICMI '11: Proceedings of the 13th international conference on multimodal interfaces

Providing multiple modalities to users is known to improve the overall performance of an interface. Weakness of one modality can be overcome by the strength of another one. Moreover, with respect to their abilities, users can choose between the ...
Meeting the Expectations from Brain-Computer Interfaces
Theoretical and Practical Computer Applications in Entertainment

Brain-computer interfaces (BCIs) are often evaluated in terms of performance and seldom for usability. However in some application domains, such as entertainment computing, user experience evaluation is vital. User experience evaluation in BCI systems, ...
Evaluating user experience in a selection based brain-computer interface game a comparative study: a comparative study
ICEC'11: Proceedings of the 10th international conference on Entertainment Computing

In human-computer interaction, it is important to offer the users correct modalities for particular tasks and situations. Unless the user has the suitable modality for a task, neither task performance nor user experience can be optimised. The aim of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ACE '11: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology

November 2011

562 pages

ISBN:9781450308274

DOI:10.1145/2071423

General Chairs:
Teresa Romão
FCT/UNL, Portugal
,
Nuno Correia
FCT/UNL, Portugal
,
Masahiko Inami
Keio University, Japan
,
Organizing Chairs:
Eduardo Dias
FCT/UNL, Portugal
,
Teresa Chambel
FC/UL, Portugal
,
Program Chairs:
Hirokasu Kato
Nara Institute of Science and Technology, Japan
,
Rui Prada
Instituto Superior Técnico/UTL and INESC-ID, Portugal
,
Tsutomu Terada
Kobe University, Japan

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

FCT: Foundation for Science and Technology

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ACE '11

Sponsor:

FCT

ACE '11: International Conference on Advances in Computer Entertainment Technology

November 8 - 11, 2011

Lisbon, Portugal

Acceptance Rates

Overall Acceptance Rate 36 of 90 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
360
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Auda JGruenefeld UKosch TSchneegass S(2022)The Butterfly Effect: Novel Opportunities for Steady-State Visually-Evoked Potential Stimuli in Virtual RealityProceedings of the Augmented Humans International Conference 202210.1145/3519391.3519397(254-266)Online publication date: 13-Mar-2022
https://dl.acm.org/doi/10.1145/3519391.3519397
Barzilai GRampino L(2020)Just a Natural Talk? The Rise of Intelligent Personal Assistants and the (Hidden) Legacy of Ubiquitous ComputingDesign, User Experience, and Usability. Design for Contemporary Interactive Environments10.1007/978-3-030-49760-6_2(18-39)Online publication date: 10-Jul-2020
https://doi.org/10.1007/978-3-030-49760-6_2
Hair AMonroe PAhmed BBallard KGutierrez-Osuna RGiannakos MJaccheri LDivitini M(2018)Apraxia worldProceedings of the 17th ACM Conference on Interaction Design and Children10.1145/3202185.3202733(119-131)Online publication date: 19-Jun-2018
https://dl.acm.org/doi/10.1145/3202185.3202733
Vasiljevic Gde Miranda Lde Menezes B(2018)Zen Cat: A Meditation-Based Brain-Computer Interface GameComputational Science and Its Applications – ICCSA 201810.1007/978-3-319-95162-1_20(294-309)Online publication date: 4-Jul-2018
https://doi.org/10.1007/978-3-319-95162-1_20
Yáñez-Gómez RCascado-Caballero DSevillano J(2017)Academic methods for usability evaluation of serious gamesMultimedia Tools and Applications10.1007/s11042-016-3845-976:4(5755-5784)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s11042-016-3845-9
Mekler EBopp JTuch AOpwis KJones MPalanque PSchmidt AGrossman T(2014)A systematic review of quantitative studies on the enjoyment of digital entertainment gamesProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2557078(927-936)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2556288.2557078
Joselli MBinder FClua ESoluri E(2014)MindninjaProceedings of the 2014 Brazilian Symposium on Computer Games and Digital Entertainment10.1109/SBGAMES.2014.14(123-132)Online publication date: 12-Nov-2014
https://dl.acm.org/doi/10.1109/SBGAMES.2014.14

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten