Article

Use of eye movements for video game control

Authors:

J. David Smith,

T. C. Nicholas GrahamAuthors Info & Claims

ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology

Pages 20 - es

https://doi.org/10.1145/1178823.1178847

Published: 14 June 2006 Publication History

Abstract

We present a study that explores the use of a commercially available eye tracker as a control device for video games. We examine its use across multiple gaming genres and present games that utilize the eye tracker in a variety of ways. First, we describe a first-person shooter that uses the eyes to control orientation. Second, we study the use of eye movements for more natural interaction with characters in a role playing game. And lastly, we examine the use of eye tracking as a means to control a modified version of the classic action/arcade game Missile Command. Our results indicate that the use of an eye tracker can increase the immersion of a video game and can significantly alter the gameplay experience.

References

[1]

Bioware, Inc. Neverwinter Nights nwn.bioware.com, 2006.]]

[2]

Bytonic Software. Jake2. www.bytonic.de, 2006.]]

[3]

Cournia, N., Smith, J. D., Duchowski, A. T. "Gaze- vs. Hand-Based Pointing in Virtual Environments", in SIGCHI 2003 (Short Talks & Interactive Posters), April 5-10, 2003, Ft. Lauderdale, Fl.]]

Digital Library

[4]

Duchowski, A. T. Eye Tracking Methodology: Theory & Practice. Springer Verlag, London, UK, 2003.]]

Digital Library

[5]

Electronic Arts, Inc. Madden NFL 06. www.easports.com, 2006.]]

[6]

Id Software, inc. Quake 2. www.idsoftware.com 2006.]]

[7]

Iwata, Satoru. Tokyo Game Show Keynote Address, 2005.]]

[8]

Jacob, R. J. What You Look at is What You Get: Eye Movement-Based Interaction Techniques. In CHI '90 Proceedings, 1990, pp. 11--18.]]

Digital Library

[9]

Juggernart.com, Lunar Command. www.juggernart.com, 2006.]]

[10]

Maglio, P., Matlock, T., Campbell, C., Zhai, Z., Smith, B. Gaze and speech in attentive user interfaces. In Proceedings of the International Conference on Multimodal Interfaces. Berlin: Springer-Verlag, 2000.]]

Digital Library

[11]

Morimoto, C. H., D. Koon, A. Amir, and M. Flickner. Pupil detection and tracking using multiple light sources. Image and Vision Computing 18, 2000, pp. 331--334.]]

[12]

Murphy, H., Duchowski, A. T., "Gaze-Contingent Level Of Detail Rendering", in EuroGraphics 2001 (Short Presentations), September 4--7, 2001, Manchester, UK, EuroGraphics.]]

[13]

NaturalPoint, Inc. TrackIR www.naturalpoint.com. 2006.]]

[14]

Nintendo of America, Inc. The Legend of Zelda: The Wind Waker. www.nintendo.com, 2003.]]

[15]

Oh, A., Fox, H., Van Kleek, M., Adler, A,. Gajos, K., Morency, L-P, and T. Darrell. Evaluating Look-to-Talk: A gaze-aware interface in a collaborative environment. In Extended Abstracts of CHI 2002. Seattle: ACM Press, 2002, pp. 650--651.]]

Digital Library

[16]

Planet Gamecube. http://www.planetgamecube.com, 2006.]]

[17]

Polhemus Inc. Visiontrak etl-400, June 2005. http://www.polhemus.com/VisionTrak.htm.]]

[18]

Selker, T., Lockerd, A., Martinez J., Eye-R, a glassesmounted eye motion detection interface, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington.]]

Digital Library

[19]

Shell, J. S., Vertegaal, R., Cheng, D., Skaburskis, A. W., Sohn, C., Stewart, A. J., Aoudeh, O., Dickie, C. ECSGlasses and EyePliances: Using Attention to open Sociable Windows of Interaction. In Proceedings of ACM Eye Tracking Research and Applications Symposium 04, San Antonio, TX, 2004.]]

Digital Library

[20]

Smith, J. D., Vertegaal, R., Sohn, C. "ViewPointer: Lightweight Calibration-Free Eye Tracking for Ubiquitous Hands-Free Deixis". In ACM User Interface Software and Technology 2005. Seattle, WA: ACM Press, 2005.]]

Digital Library

[21]

Sony Computer Entertainment America Inc. Eye Toy. www.eyetoy.com, 2006.]]

[22]

Tanriverdi, V., Jacob, R. J. K. Interacting with Eye Movements in Virtual Environments. In CHI '00 Proceedings (2000), ACM, pp. 265--272.]]

Digital Library

[23]

Tobii Technology, Inc. Tobii 1750, www.tobii.se, 2006.]]

[24]

Vertegaal, R. The GAZE Groupware System: Mediating joint Attention in Multiparty Communication and Collaboration. In Proceedings of CHI'99. Pittsburgh: ACM Press, 1999. pp. 294--301.]]

Digital Library

[25]

Vertegaal, R., Van der Veer, G. and Vons, H. Effects of Gaze on Multiparty Mediated Communication. In Proceedings of Graphics Interface 2000, 2000, pp.95--102.]]

[26]

Zhai, S., Morimoto, C., Ihde, S., Manual and gaze input cascaded (MAGIC) pointing, Proceedings of the CHI'99 Conference on Human Factors in Computing Systems, 1999, pp. 246--253.]]

Digital Library

Cited By

Smith PDombrowski MMacdonald CWilliams CPradeep MBarnum ERivera VSparkman JManero A(2024)Initial Evaluation of a Hybrid eye tracking and Electromyography Training Game for Hands-Free Wheelchair UseProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653006(1-8)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653006
Taheri AGomez-Monroy CBorja VSra M(2024)MouseClicker: Exploring Tactile Feedback and Physical Agency for People with Hand Motor ImpairmentsACM Transactions on Accessible Computing10.1145/364868517:1(1-31)Online publication date: 28-Mar-2024
https://dl.acm.org/doi/10.1145/3648685
Colley MWanner BRädler MRötzer MFrommel JHirzle TJansen PRukzio E(2024)Effects of a Gaze-Based 2D Platform Game on User Enjoyment, Perceived Competence, and Digital Eye StrainProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641909(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641909
Show More Cited By

Index Terms

Use of eye movements for video game control
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Video game design using an eye-movement-dependent model of visual attention

Eye movements can be used to infer the allocation of covert attention. In this article, we propose to model the allocation of attention in a task-dependent manner based on different eye movement conditions, specifically fixation and pursuit. We show ...
Analysing EOG signal features for the discrimination of eye movements with wearable devices
PETMEI '11: Proceedings of the 1st international workshop on pervasive eye tracking & mobile eye-based interaction

Eye tracking research in human-computer interaction and experimental psychology traditionally focuses on stationary devices and a small number of common eye movements. The advent of pervasive eye tracking promises new applications, such as eye-based ...
Simplifying game mechanics: gaze as an implicit interaction method
SA '17: SIGGRAPH Asia 2017 Technical Briefs

This paper explores the possibilities of using player gaze as an implicit interaction method, to simplify game mechanics in a space shooting video game. First, a set of five experienced players were eye-tracked while playing the game Ikaruga where gaze ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology

June 2006

572 pages

ISBN:1595933808

DOI:10.1145/1178823

General Chairs:
Hiroshi Ishii
Tangible Media Group, MIT Media Laboratory
,
Newton Lee
Association for Computing Machinery (ACM), Disney Online, Woodbury University, and Bell Labs
,
Stephane Natkin
CNAM Paris, CEDRIC
,
Katsuhide Tsushima
Osaka Electro-Communication University, Japan

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ACE2006

Sponsor:

SIGCHI

ACE2006: International Conference in Advances in Computer Entertainment Technology

June 14 - 16, 2006

California, Hollywood, USA

Acceptance Rates

Overall Acceptance Rate 36 of 90 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

123
Total Citations
View Citations
2,547
Total Downloads

Downloads (Last 12 months)103
Downloads (Last 6 weeks)11

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Smith PDombrowski MMacdonald CWilliams CPradeep MBarnum ERivera VSparkman JManero A(2024)Initial Evaluation of a Hybrid eye tracking and Electromyography Training Game for Hands-Free Wheelchair UseProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653006(1-8)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653006
Taheri AGomez-Monroy CBorja VSra M(2024)MouseClicker: Exploring Tactile Feedback and Physical Agency for People with Hand Motor ImpairmentsACM Transactions on Accessible Computing10.1145/364868517:1(1-31)Online publication date: 28-Mar-2024
https://dl.acm.org/doi/10.1145/3648685
Colley MWanner BRädler MRötzer MFrommel JHirzle TJansen PRukzio E(2024)Effects of a Gaze-Based 2D Platform Game on User Enjoyment, Perceived Competence, and Digital Eye StrainProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641909(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641909
Wang YTian JXiao LHe JNiu Y(2024)Research on a spatial–temporal characterisation of blink-triggered eye control interactionsAdvanced Engineering Informatics10.1016/j.aei.2023.10229759(102297)Online publication date: Jan-2024
https://doi.org/10.1016/j.aei.2023.102297
Guzsvinecz T(2024)Video game accessibility in the top-level genresUniversal Access in the Information Society10.1007/s10209-024-01154-7Online publication date: 30-Sep-2024
https://doi.org/10.1007/s10209-024-01154-7
Palmquist AJedel IGoethe OPalmquist AJedel IGoethe O(2024)Assistive Technologies for Attainable Gaming ExperiencesUniversal Design in Video Games10.1007/978-3-031-30595-5_4(101-129)Online publication date: 23-Apr-2024
https://doi.org/10.1007/978-3-031-30595-5_4
Berkman M(2024)Eye Tracking in Virtual RealityEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_170(681-688)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_170
Wei YShi RYu DWang YLi YYu LLiang H(2023)Predicting Gaze-based Target Selection in Augmented Reality Headsets based on Eye and Head Endpoint DistributionsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581042(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581042
Huang LWestin TEladhari MMagnússon SChen H(2023)Eyes can draw: A high-fidelity free-eye drawing method with unimodal gaze controlInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102966170(102966)Online publication date: Feb-2023
https://doi.org/10.1016/j.ijhcs.2022.102966
Marín-Lora CChover MMartín MGarcía-Rytman L(2023)Comparative study of interaction methods for mobile gaming while running on a treadmillComputers & Graphics10.1016/j.cag.2023.10.020117(164-171)Online publication date: Dec-2023
https://doi.org/10.1016/j.cag.2023.10.020
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents