course

Possibilities and challenges with eye tracking in video games and virtual reality applications

Authors:

Veronica Sundstedt,

Julian MautnerAuthors Info & Claims

SA '16: SIGGRAPH ASIA 2016 Courses

Article No.: 17, Pages 1 - 150

https://doi.org/10.1145/2988458.2988466

Published: 28 November 2016 Publication History

Abstract

Due to an increase in affordable, reliable and non-intrusive eye trackers the technology has recently been used by the video game industry. This course offers participants the opportunity to get an update on research and developments in gaze-based interaction techniques in combination with other sensors. The course consists of three parts: (1) a review of eye tracking analysis and interaction in video games and virtual reality applications, (2) possibilities and challenges with gaze-based interaction, and (3) lessons learned from developing a commercial video game application using eye tracking along with alternative virtual reality technologies. This course is relevant for everyone who is interested in developing games that use eye tracking as an interaction device. The content is suitable for beginners or experienced delegates who want to learn more about the state of the art and future possibilities in eye tracking combined with other sensors as interaction devices. We believe that games and virtual reality applications have just started to incorporate these new techniques and further research and developments are needed in order to evaluate novel ways to enhance gameplay.

References

[1]

Ahmadi H., Tootaghaj S Z., Mowlaei S., Hashemi M. R., and Shirmohammadi S. 2016. GSET somi: a game-specific eye tracking dataset for somi. In Proceedings of the 7th International Conference on Multimedia Systems (MMSys '16). ACM, New York, NY, USA, Article 42, 6 pages.

Digital Library

[2]

Almeida S., 2009. Augmenting Video Game Development with Eye Movement Analysis, Master Thesis, Universidade de Aveiro

[3]

Almeida S., Veloso A., Roque L., Mealha Ó, 2011. The Eyes and Games: A Survey of Visual Attention and Eye Tracking Input in Video Games, SBC - Proceedings of SBGames, November 7th - 9th

[4]

Almeida S., Mealha O., Veloso A. 2010, Interaction Behavior of Hardcore and Inexperienced Players: "Call of Duty: Modern Warfare" Context, Proceedings of SBGames

[5]

Ambinder M., Biofeedback in Gameplay: How Valve Measures Physiology to Enhance Gaming Experience, PhD March 3rd, 2011 GDC: http://www.valvesoftware.com/publications/2011/ValveBiofeedback-Ambinder.pdf

[6]

Bates, R.; Vickers, S.; Istance, H. 2010, Gaze interaction with virtual on-line communities: levelling the playing field for disabled users, Universal Access in the Information Society; Aug2010, Vol. 9 Issue 3, p261, August

Digital Library

[7]

Bednarik R., Gowases T., and Tukiainen M. 2009, Gaze interaction enhances problem solving: Effects of dwell-time based, gaze-augmented, and mouse interaction on problem-solving strategies and user experience. Journal of Eye Movement Research 3, 1, 1--10.

[8]

Benyon D. 2014, "Designing Interactive Systems: a comprehensive guide to HCI, UX and interaction design". Third edition, Pearson education limited, Harlow, U.K.

[9]

Bulling A., Roggen D., Tröster G. 2008, EyeMote - Towards Context-Aware Gaming Using Eye Movements Recorded from Wearable Electrooculography, Fun and Games, Volume 5294 of the series Lecture Notes in Computer Science pp 33--45

Digital Library

[10]

Bojko A. 2013, Eye Tracking the User Experience: A Practical Guide to Research, Rosenfeld Media; 1st edition

[11]

Bolt R A. 1981. Gaze-orchestrated dynamic windows. In Proceedings of the 8th annual conference on Computer graphics and interactive techniques (SIGGRAPH '81). ACM, New York, NY, USA, 109--119.

Digital Library

[12]

Carter M., Newn J., Velloso E., and Vetere F. 2015, Remote Gaze and Gesture Tracking on the Microsoft Kinect: Investigating the Role of Feedback. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI '15), Bernd Ploderer, Marcus Carter, Martin Gibbs, Wally Smith, and Frank Vetere (Eds.). ACM, New York, NY, USA, 167--176.

Digital Library

[13]

Castellina E., Corno F. 2008, Multimodal Gaze Interaction in 3D Virtual Environments. In Proceedings of the 4th COGAIN Annual Conference on Communication by Gaze Interaction, Environment and Mobility Control by Gaze

[14]

Cederholm H., Hilborn O., Lindley C., Sennersten C., Eriksson J. 2011, The Aiming Game: Using a Game with Biofeedback for Training in Emotion Regulation, Proceedings of DIGRA

[15]

Chang W., Shen P-A., Ponnam K., Barbosa H., Chen M., and Bermudez S. 2013, WAYLA: novel gaming experience through unique gaze interaction. In ACM SIGGRAPH 2013 Emerging Technologies (SIGGRAPH '13). ACM, New York, NY, USA, Article 16, 1 pages.

Digital Library

[16]

Conati, C., Jaques, N. & Muir, M. 2013, Understanding Attention to Adaptive Hints in Educational Games: An Eye-Tracking Study, Int J Artif Intell Educ, 23: 136.

[17]

Djamasbi S., Mortazavi S. 2015. Generation Y, Baby Boomers, and Gaze Interaction Experience in Gaming. In Proceedings of the 2015 48th Hawaii International Conference on System Sciences (HICSS '15). IEEE Computer Society, Washington, DC, USA, 482--490.

Digital Library

[18]

Dorr, M., Böhme, M., Martinetz, T., Brath, E. 2007, Gaze beats mouse: a case study. In: Proceedings of COGAIN, pp. 16--19

[19]

Duchowski A. T. 2003, Eye Tracking Methodology: Theory and Practice, Springer-Verlag

Digital Library

[20]

Duchowski, A. T. 2001. Eye Tracking Techniques for Perceptually Adaptive Graphics, ACM SIGGRAPH, EUROGRAPHICS Campfire

[21]

Duchowski A T. 2009, Eye Tracking Methodology: Theory and Practice 2nd Edition, Springer; 2nd edition

Digital Library

[22]

Ekman, I. M., Poikola, A. W., and Mäkäräinen, M. K. 2008, Invisible eni: using gaze and pupil size to control a game. In CHI '08 Extended Abstracts on Human Factors in Computing Systems, CHI '08. ACM, New York, NY, 3135--3140

Digital Library

[23]

Ekman, I., Poikola, A., Mäkäräinen, M., Takala, T., and Hämäläinen, P. 2008, Voluntary pupil size change as control in eyes only interaction. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications - ETRA '08. ACM, New York, NY, 115--118

Digital Library

[24]

Flatla D R., Gutwin C., Nacke L E., Bateman S., and Mandryk R L. 2011, Calibration games: making calibration tasks enjoyable by adding motivating game elements. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, New York, NY, USA, 403--412.

Digital Library

[25]

Goldberg, H. J. and Kotval, X. P. 1999, Computer interface evaluation using eye movements: Methods and constructs. International Journal of Industrial Ergonomics, 24, 631--645

[26]

Gowases, T. 2007, Gaze vs. Mouse: An evaluation of user experience and planning in problem solving games. Master's thesis May 2, 2007. Department of Computer Science, University of Joensuu, Finland.

[27]

Gowases, T., Bednarik, R., and Tukiainen, M. 2008, Gaze vs. Mouse in Games: The Effects on User Experience. In Proceedings of the International Conference on Computers in Education, ICCE 2008, pp. 773--777.

[28]

Hillaire S., Lecuyer A., Cozot R., and Casiez, G. 2008, Using an Eye-Tracking System to Improve Depth-of-Field Blur Effects and Camera Motions in Virtual Environments, Proceedings of IEEE Virtual Reality (VR) Reno, Nevada, USA, pp. 47--51

[29]

Holmqvist K., Nyström M., Andersson R., Dewhurst R., Jarodzka H., and van de Weijer J. 2015, Eye Tracking - A comprehensive guide to methods and measures, Oxford University Press

[30]

Hülsmann F, Dankert T, Pfeiffer T. 2011, Comparing gaze-based and manual interaction in a fast-paced gaming task in Virtual Reality, Proceedings of the Workshop Virtuelle & Erweiterte Realität 2011. Bohn C-A, Mostafawy S (Eds);Aachen: Shaker Verlag: 1--12.

[31]

Isokoski P., Joos M., Spakov O., and Martin B. 2009, Gaze controlled games. Univers. Access Inf. Soc. 8, 4 (October 2009), 323--337.

Digital Library

[32]

Isokoski P., Hyrskykari A., Kotkaluoto S., Martin B. 2007, Gamepad and Eye Tracker Input in FPS Games: data for the first 50 min. In Proceedings of COGAIN, pp. 10--15.

[33]

Istance H.O., Bates R., Hyrskykari A. and Vickers S. 2008, Snap Clutch, a Moded Approach to Solving the Midas Touch Problem. Proceedings of the 2008 symposium on Eye tracking research & applications ETRA '08, ACM Press, Savannah, March

Digital Library

[34]

Istance H., Vickers S., Hyrskykari A. 2009, Gaze-Based Interaction with Massively Multiplayer On-line Games, CHI 2009, April 4-9, Boston, MA, USA, ACM 978-1-60558-247-4/09/04

Digital Library

[35]

Istance H., Hyrskykari A., Vickers S., and Chaves T. 2009, For Your Eyes Only: Controlling 3D Online Games by Eye-Gaze, Lecture Notes in Computer Science, Springer Berlin / Heidelberg

[36]

Istance H., Hyrskykari A., Immonen L., Mansikkamaa S., and Vickers S. 2010, Designing gaze gestures for gaming: an investigation of performance. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications (ETRA '10). ACM, New York, NY, USA, 323--330.

Digital Library

[37]

Itti L., Koch C., and Niebur E. 1998, A Model of Saliency-Based Visual Attention for Rapid Scene Analysis. IEEE Trans. Pattern Anal. Mach. Intell., 20(11):1254--1259

Digital Library

[38]

Jacob R. J. K. 1990, What you look at is what you get: eye movement-based interaction techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI '90), Jane Carrasco Chew and John Whiteside (Eds.). ACM, New York, NY, USA, 11--18.

Digital Library

[39]

Jie L. and Clark J. J. 2008, "Video Game Design Using an Eye Movement Dependent Model of Visual Attention," ACM Transactions on Multimedia Computing, Communications, and Applications, vol. 4, no. 3, pp. 22:1--16,

Digital Library

[40]

Johansen, S. A., Noergaard, M. & Rau, J. 2008, Can Eye Tracking Boost Usability Evaluation of Computer Games, CHI 2008: Evaluating User Experiences in Games

[41]

Just, M. A., and Carpenter, P. A. 1976, Eye fixations and cognitive processes. Cognitive Psychology, 8, 441--480

[42]

Jönsson E. 2005, If Looks Could Kill - An Evaluation of EyeTracking in Computer Games. Master's thesis, KTH Royal Institute of Technology, Sweden

[43]

Kenny A., Koesling H., Delaney D., Mcloone S., Ward T. 2005, A Preliminary Investigation into Eye Gaze Data in a First Person Shooter Game. In Proceedings of the 19th European Conference on Modelling and Simulation

[44]

Kivikangas J. M., Ekman I., Chanel G., Järvelä S., Cowley B., Salminen M., Henttonen P., Ravaja N., 2010, Review on psychophysiological methods in game research, Nordic DiGRA

[45]

Kolko, J. 2010, "Abductive Thinking and Sensemaking: The Drivers of Design Synthesis" in Design Issues, Vol. 26, Num. 1, Massachusetts institute of Technology

[46]

Lankes M. and Wagner S. 2015, Taking a Look at the Player's Gaze: The Effects of Gaze Visualizations on the Perceived Presence in Games. Proceedings of DiGRA 2015: Diversity of play: Games - Cultures - Identities.

[47]

Lankes M., Mirlacher T., Wagner S., and W. Hochleitner. 2014, Whom are you looking for?: the effects of different player representation relations on the presence in gaze-based games. In Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play (CHI PLAY '14). ACM, New York, NY, USA, 171--179.

Digital Library

[48]

Lee E-C. and Park K-R. 2005, "3D First Person Shooting Game by Using Eye Gaze Tracking," The KIPS transactions. Part B, vol. b12, no. 4, pp. 465--472,

[49]

Leyba, J. and Malcolm, J. 2004, Eye Tracking as an Aiming Device in a Computer Game. Course work (CPSC 412/612 Eye Tracking Methodology and Applications by A.Duchowski), Clemson University.

[50]

Lin C-S., Huan C-C., Chan C-N., Yeh M-S., Chiu C-C. 2004, Design of a computer game using an eye-tracking device for eye's activity rehabilitation, Optics and Lasers in Engineering, Volume 42, Issue 1, Pages 91--108.

[51]

Majaranta P., Aoki H., Donegan M., Witzner Hansen D., Paulin Hansen, Hyrskykari A., and Räihä K-J. 2011, Gaze Interaction and Applications of Eye Tracking: Advances in Assistive Technologies, IGI Global

Digital Library

[52]

McDonnell R., Larkin M., Hernández B., Rudomin I., and O'Sullivan C. 2009, Eye-catching crowds: saliency based selective variation. In ACM SIGGRAPH 2009 papers (SIGGRAPH '09), Hugues Hoppe (Ed.). ACM, New York, NY, USA, Article 55, 10 pages.

Digital Library

[53]

McDonnell R., Larkin M., Hernández B., Rudomin I., and O'Sullivan C. 2009, Eye-catching crowds: saliency based selective variation. ACM Trans. Graph. 28, 3, Article 55 (July 2009), 10 pages.

Digital Library

[54]

Muñoz J., Yannakakis G .N., Mulvey F., Witzner Hansen D., Gutierrez D., Sanchis A. 2011, Towards Gaze-Controlled Platform Games, 2011 IEEE Conference on Computational Intelligence and Games (CIG)

[55]

Murphy H. and Duchowski A. T. 2001, Gaze-Contingent Level Of Detail Rendering, Eurographics

[56]

Nacke L., Lindley C., and Stellmach S. 2008, "Log Who's Playing: Psychophysiological Game Analysis Made Easy through Event Logging," Fun and Games, pp. 150--157,

Digital Library

[57]

Nacke L E., Stellmach S., Sasse D., Niesenhaus J., Dachselt R. 2011, LAIF: A logging and interaction framework for gaze-based interfaces in virtual entertainment environments, Entertainment Computing, Volume 2, Issue 4, Pages 265--273

[58]

Navarro D. 2014, Improving Player Performance by Developing Gaze Aware Games, Master's Thesis, Blekinge Institute of Technology

[59]

Navarro D. and Sundstedt V. 2014, Improving player experience by developing gaze aware games, CHI Play Workshop paper

[60]

Møller Nielsen A., Lerchedahl Petersen A., and Paulin Hansen J. 2012, Gaming with gaze and losing with a smile. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '12), Stephen N. Spencer (Ed.). ACM, New York, NY, USA, 365--368.

Digital Library

[61]

Nilsson T. 2009, A Tobii Technology Introduction and Presentation, And How Tobii Eye Tracking Could be used in advertising, at Beyond AdAsia2007, Jeju Island, Korea

[62]

Noton D. and Stark L. W. 1971, Scanpath in Saccadic Eye Movements While Viewing and Recognizing Patterns. Vision Research, 11:929--942

[63]

O'Donovan J., Ward J., Hodgins S., and Sundstedt V. 2009, "Rabbit Run: Gaze and Voice Based Game Interaction," in Eurographics Ireland Workshop

[64]

O'Donovan, J. 2009, Gaze and Voice Based Game Interaction. University of Dublin, Trinity College. Master of Computer Science in Interactive Entertainment Technology

[65]

Olsen A., Schmidt A., Marshall P., and Sundstedt V. 2011, Using eye tracking for interaction. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, New York, NY, USA, 741--744.

Digital Library

[66]

Perreira da Silva M., Courboulay V., Prigent A. 2007, Gameplay experience based on a gaze tracking system. "Gaze-based Creativity, Interacting with Games and On-line Communities" INPROCEEDINGS in proceedings of COGAIN 2007 (Communication by Gaze Interaction IST FP6 European Project), Sep 2007, Leicester, Royaume-Uni. pp.25--28

[67]

Peters, R. J., and Itti, L. 2008, Applying computational tools to predict gaze direction in interactive visual environments. ACM Transactions on Applied Perception 5, 2, 22

Digital Library

[68]

Peters R. J. and Itti L. 2006, Computational mechanisms for gaze direction in interactive visual environments. In Proceedings of the 2006 symposium on Eye tracking research & applications (ETRA '06). ACM, New York, NY, USA, 27--32.

Digital Library

[69]

Petrini A. and Forslin H. 2016, Evaluation of Player Performance with a Brain Computer Interface and Eye Tracking Control in an Entertainment Game Application, Master's Thesis, Blekinge Institute of Technology

[70]

Isokoski P., Joos M., Spakov O., and Martin B. 2009, Gaze controlled games. Univers. Access Inf. Soc. 8, 4, 323--337.

Digital Library

[71]

Poole, A. 2005, Tips for Using Eyetrackers in HCI Experiments, Lancaster University, Lecture

[72]

Poole, A. and Ball, L. J. 2004, Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects. In Ghaoui, Claude (Ed.)

[73]

Rensink R. A. 2003, Visual Attention. In L. Nadel, editor, Encyclopedia of Cognitive Science, pages 509--515. Nature Publishing Group

[74]

Renshaw T, Stevens R., Denton P. D. 2009, "Towards understanding engagement in games: an eye-tracking study", On the Horizon, Vol. 17 Iss: 4, pp. 408 -- 420.

[75]

Romano Bergstrom J., Schall A. J. 2014, Eye Tracking in User Experience Design, Morgan Kaufmann

Digital Library

[76]

Rothkopf C. A. and Pelz J. B. 2004, Head movement estimation for wearable eye tracker. In ETRA '04: Proceedings of the 2004 symposium on Eye tracking research & applications, pages 123--130, New York, NY, USA, ACM Press

Digital Library

[77]

San Agustin Lopez J. 2009, Off-the-Shelf Gaze Interaction, PhD Thesis, IT University of Copenhagen

[78]

San Agustin, J., C. Mateo, J., Hansen, J.P., & Villanueva, A. 2009, Evaluation of the Potential of Gaze Input for Game Interaction. PsychNology Journal, 7(2), 213 -- 236. Retrieved {September} {19}, {2016}, from www.psychnology.org.

[79]

Sasse, D. 2008, A Framework for Psychophysiological Data Acquisition in Digital Games. Master's Thesis

[80]

Seif El-Nasr, M., Drachen, A., Canossa, A. (Eds.). 2013, Game Analytics - Maximizing the Value of Player Data, Springer

Digital Library

[81]

Seif El-Nasr M. and Yan S. 2006, Visual attention in 3D video games. In Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology (ACE '06). ACM, New York, NY, USA, Article 22.

Digital Library

[82]

Sennersten, C. 2004, Eye movements in an Action Game Tutorial. Student Paper. Department of Cognitive Science. Lund University, Sweden

[83]

Sennersten, C., Alfredseon, J., Castor, M., Hedström, J., Lindhal, B, Lindley, C., and Svensson, E. 2007, Verification of an Experimental Platform Integrating a Tobii Eyetracking System with the HiFi Game Engine. Command and Control Systems, Methodology Report, FOI-R--2227- SE, ISSN 1650-1942, FOI Devence Research Agency

[84]

Sennersten C. and Lindley C. 2008, "Evaluation of Real-time Eye Gaze Logging by a 3D Game Engine," 12th IMEKO TC1 & TC7 Joint Symposium on Man Science & Measurement

[85]

Sennersten C. 2008, Gameplay (3D Game Engine + Ray Tracing = Visual Attention Through Eye Tracking), Licentiate Thesis, Blekinge Institute of Technology

[86]

Stellmach, S. 2007, A Psychophysiological Logging System for a Digital Game Modification. Technical Bachelor's Report

[87]

Stellmach S. and Dachselt R. 2012, Designing Gaze-based User Interfaces for Steering in Virtual Environments. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '12). ACM, New York, NY, USA, 131--138.

Digital Library

[88]

Schnipke S. K. and Todd M. W. 2000, Trials and tribulations of using an eye-tracking system. In CHI '00 Extended Abstracts on Human Factors in Computing Systems (CHI EA '00). ACM, New York, NY, USA, 273--274.

Digital Library

[89]

Smith J. D. and Graham T. C. N. 2006, Use of eye movements for video game control. In Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology (ACE '06). ACM, New York, NY, USA, Article 20.

Digital Library

[90]

Snowden R., Thompson P., and Troscianko T. 2006, Basic Vision: an introduction to visual perception. Oxford University Press

[91]

Špakov O. 2005, EyeChess: the tutoring game with visual attentive interface, Alternative Access: Feelings & Games'05, Spring, University of Tampere

[92]

Spillers F. 2004, Eye-Tracking studies- Usability holy grail?

[93]

Starker I. and Bolt R. A. 1990, A gaze-responsive self-disclosing display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90), Jane Carrasco Chew and John Whiteside (Eds.). ACM, New York, NY, USA, 3--10.

Digital Library

[94]

Sundstedt V. 2010, Gazing at games: using eye tracking to control virtual characters. In ACM SIGGRAPH 2010 Courses (SIGGRAPH '10). ACM, New York, NY, USA, Article 5, 160 pages.

Digital Library

[95]

Sundstedt V., Stavrakis E., Wimmer M., and Reinhard E. 2008, A psychophysical study of fixation behavior in a computer game. In Proceedings of the 5th symposium on Applied perception in graphics and visualization (APGV '08). ACM, New York, NY, USA, 43--50.

Digital Library

[96]

Sundstedt V. 2012, Gazing at Games: An Introduction to Eye Tracking Control, Synthesis Lectures on Computer Graphics and Animation, 113 pages.

Digital Library

[97]

Tall M. 2008, NeoVisus - Gaze Interaction Interface Components, Master Thesis, Department of Cognitive Science, Lund University

[98]

Turner J., Velloso E., Gellersen H., and Sundstedt V. 2014, EyePlay: applications for gaze in games. In Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play (CHI PLAY '14). ACM, New York, NY, USA, 465--468.

Digital Library

[99]

Tobii. 2006, UserManual: Tobii Eye Tracker, ClearView analysis software, February

[100]

Tobii. 2009, Usability Testing Brochure: See through the eyes of the user, January

[101]

Velloso E. and Carter M. 2016, The Emergence of EyePlay: A Survey of Eye Interaction in Games Conference: The ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play (CHI PLAY), At Austin, Texas, October 2016.

Digital Library

[102]

Velloso E., Fleming A., Alexander J., and Gellersen H. 2015, Gaze-Supported Gaming: MAGIC Techniques for First Person Shooters. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 343--347.

Digital Library

[103]

Vickers, S., Istance, H., Hyrskykari, A. Ali, N., and Bates, R. 2008, Keeping an Eye on the Game: Eye Gaze Interaction with Massively Multiplayer Online Games and Virtual Communities for Motor Impaired Users. Proceedings of the 7th International Conference on Disability, Virtual Reality and Associated Technologies; ICDVRAT 2008, Maia, Portugal, 8th- 10th September 2008

[104]

Vickers S., Bates R., and Istance, H O. 2008, Gazing into a Second Life: gaze-driven adventures, control barriers, and the need for disability privacy in an online virtual world, Proc. 7th ICDVRAT 2008, Maia, Portugal

[105]

Vickers S., Istance H., and Smalley M. 2010, EyeGuitar: making rhythm based music video games accessible using only eye movements. In Proceedings of the 7th International Conference on Advances in Computer Entertainment Technology (ACE '10). ACM, New York, NY, USA, 36--39.

Digital Library

[106]

Vickers, S., Istance, H., and Hyrskykari, A. 2013, Performing locomotion tasks in immersive computer games with an adapted eye-tracking interface. ACM Trans. Access. Comput. 5, 1, Article 2 (September 2013), 33 pages

Digital Library

[107]

Vickers S., Istance H., and Heron M. J. 2013, Accessible gaming for people with physical and cognitive disabilities: a framework for dynamic adaptation. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 19--24.

Digital Library

[108]

Vidal M. 2014, Shynosaurs: a game of attention dilemma. In Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play (CHI PLAY '14). ACM, New York, NY, USA, 391--394.

Digital Library

[109]

Vidal M., Bismuth R., Bulling A., and Gellersen H. 2015, The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 115--124.

Digital Library

[110]

Vidal M. and Bismuth R. 2014, The Royal Corgi: a game of social gaze. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology (ACE '14). ACM, New York, NY, USA, Article 68, 5 pages.

Digital Library

[111]

Vilis T. 2006, The Physiology of the Senses Transformations for Perception and Action. Course Notes, University of Western Ontario, Canada

[112]

Ware C. and Mikaelian H. H. 1986, An evaluation of an eye tracker as a device for computer input2. In Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface (CHI '87), John M. Carroll and Peter P. Tanner (Eds.). ACM, New York, NY, USA, 183--188.

Digital Library

[113]

Wilcox T., Evans M., Pearce C., Pollard N., and Sundstedt V. 2008, Gaze and voice based game interaction: the revenge of the killer penguins. In ACM SIGGRAPH 2008 posters (SIGGRAPH '08). ACM, New York, NY, USA, Article 81, 1 pages.

Digital Library

[114]

Wetzel S., Spiel K., and Bertel S. 2014, Dynamically adapting an AI game engine based on players' eye movements and strategies. In Proceedings of the 2014 ACM SIGCHI symposium on Engineering interactive computing systems (EICS '14). ACM, New York, NY, USA, 3--12.

Digital Library

[115]

Yarbus, A. L. 1967, Eye Movements and Vision, Plenum Press

[116]

Zammitto V., Seif El-Nasr M., Newton P. 2010, Exploring Quantitative Methods for Evaluating Sports Games, CHI 2010, April 10-15, Atlanta, Georgia, USA, ACM 978-1-60558-930-5/10/04

[117]

Zhai S., Morimoto C., and Ihde S. 1999, Manual and gaze input cascaded (MAGIC) pointing. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 246--253.

Digital Library

[118]

Web references {1191 Tobii EyeX Controller http://www.tobii.com/xperience/

[119]

SteelSeries Sentry https://steelseries.com/gaming-controllers/sentry

[120]

SMI Sensomotorics Instrument RED-oem http://www.smivision.com/oem-eye-tracking/

[121]

CHI PLAY - ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play https://chiplay.acm.org/

[122]

ETRA - Symposium on Eye Tracking Research & Applications http://etra.fxpal.com/2016/

[123]

The Scandinavian Workshop on Applied Eye Tracking http://swaet2016.utu.fi/index.html

[124]

PETMEI - Pervasive Eye Tracking and Mobile Eye-Based Interaction http://2016.petmei.org/ (6th International Workshop)

[125]

ACM SAP - ACM Symposium on Applied Perception http://sap.acm.org/

[126]

ACM TAP - ACM Transactions on Applied Perception http://tap.acm.org/

[127]

INTERACT http://www.interact2017.org/

[128]

ACM CHI - ACM CHI Conference on Human Factors in Computing Systems https://chi2017.acm.org/

[129]

Lankes M. and Wagner S. 2015, Taking a Look at the Player's Gaze: The Effects of Gaze Visualizations on the Perceived Presence in Games. Proceedings of DiGRA 2015: Diversity of play: Games - Cultures - Identities. https://www.youtube.com/watch?v=2UiCheb62LQ

[130]

Deus Ex: Mankind Divided, by developer Eidos Montreal and publisher Square Enix, Tobii website http://gaming.tobii.com/deus-ex

[131]

Son of Nor by stillalive studios http://www.tobii.com/xperience/apps/son-of-nor/

[132]

STILLALIVE STUDIOS, 2016 http://stillalive-studios.com

[133]

Vijayakumar A., Chen H., Shen L. and Wu K. 2013, Aquario - Eye tracking game https://www.youtube.com/watch?v=xebRLgfYuB4

Cited By

Nawaz OKhatibi SSheikh MFiedler M(2024)Eye Tracking and Human Influence Factors’ Impact on Quality of Experience of Mobile GamingFuture Internet10.3390/fi1611042016:11(420)Online publication date: 13-Nov-2024
https://doi.org/10.3390/fi16110420
Fuhl W(2024)Zero Shot Learning in Pupil DetectionProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3655641(1-3)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3655641
Nugroho MAbdurohman MErfianto BSulistiyo M(2024)Meticulous Acquisition System for Tracking User’s Natural Kinetics (MAS TUNK): An Approach in Eye Tracking Dataset Collection for Neural Network TrainingProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653941(1-8)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653941
Show More Cited By

Index Terms

Possibilities and challenges with eye tracking in video games and virtual reality applications

Index terms have been assigned to the content through auto-classification.

Recommendations

Eye tracking and virtual reality
SA '19: SIGGRAPH Asia 2019 Courses

Virtual Reality has the potential to transform the way we work, rest and play. We are seeing use cases as diverse as education and pain management, with new applications being imagined every day. VR technology comes with new challenges, and many ...
The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended Reality
With innovations in the field of gaze and eye tracking, a new concentration of research in the area of gaze-tracked systems and user interfaces has formed in the field of Extended Reality (XR). Eye trackers are being used to explore novel forms of spatial ...
Video-oculography eye tracking towards clinical applications: A review
Abstract
Most neurological diseases are usually accompanied by a broad spectrum of oculomotor alterations. Being able to record and analyze these different types of eye movements would be a valuable tool to understand the functional integrity ...
Highlights
- Invariance to head movements is one of the biggest challenges in eye tracking.
- ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SA '16: SIGGRAPH ASIA 2016 Courses

November 2016

1732 pages

ISBN:9781450345385

DOI:10.1145/2988458

Conference Chair:
Niloy J. Mitra
University College London, United Kingdom

Copyright © 2016 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2016

Check for updates

Qualifiers

Course

Conference

SA '16

Sponsor:

SIGGRAPH

SA '16: SIGGRAPH Asia 2016

December 5 - 8, 2016

Macau

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
969
Total Downloads

Downloads (Last 12 months)84
Downloads (Last 6 weeks)7

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nawaz OKhatibi SSheikh MFiedler M(2024)Eye Tracking and Human Influence Factors’ Impact on Quality of Experience of Mobile GamingFuture Internet10.3390/fi1611042016:11(420)Online publication date: 13-Nov-2024
https://doi.org/10.3390/fi16110420
Fuhl W(2024)Zero Shot Learning in Pupil DetectionProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3655641(1-3)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3655641
Nugroho MAbdurohman MErfianto BSulistiyo M(2024)Meticulous Acquisition System for Tracking User’s Natural Kinetics (MAS TUNK): An Approach in Eye Tracking Dataset Collection for Neural Network TrainingProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653941(1-8)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653941
Maquiling VByrne SNyström MKasneci ENiehorster D(2023)V-ir-Net: A Novel Neural Network for Pupil and Corneal Reflection Detection trained on Simulated Light DistributionsProceedings of the 25th International Conference on Mobile Human-Computer Interaction10.1145/3565066.3608690(1-7)Online publication date: 26-Sep-2023
https://dl.acm.org/doi/10.1145/3565066.3608690
Hos’ovecký M(2023)Serious games: The Possibilities of Data Mining and Data Analysis through Neuro and Biofeedback2023 21st International Conference on Emerging eLearning Technologies and Applications (ICETA)10.1109/ICETA61311.2023.10343961(195-199)Online publication date: 26-Oct-2023
https://doi.org/10.1109/ICETA61311.2023.10343961
Nam SChoi J(2023)Development of a user evaluation system in virtual reality based on eye-tracking technologyMultimedia Tools and Applications10.1007/s11042-023-14583-y82:14(21117-21130)Online publication date: 18-Feb-2023
https://dl.acm.org/doi/10.1007/s11042-023-14583-y
Cocha Toabanda EErazo MYoo S(2023)Gaze Tracking: A Survey of Devices, Libraries and ApplicationsModelling and Development of Intelligent Systems10.1007/978-3-031-27034-5_2(18-41)Online publication date: 26-Feb-2023
https://doi.org/10.1007/978-3-031-27034-5_2
Lankes MRamirez Gomez A(2022)GazeCues: Exploring the Effects of Gaze-based Visual Cues in Virtual Reality Exploration GamesProceedings of the ACM on Human-Computer Interaction10.1145/35495006:CHI PLAY(1-25)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3549500
Navarro DSundstedt VGarro V(2021)Biofeedback Methods in Entertainment Video GamesProceedings of the ACM on Human-Computer Interaction10.1145/34746955:CHI PLAY(1-32)Online publication date: 6-Oct-2021
https://dl.acm.org/doi/10.1145/3474695
Ramirez Gomez ALankes M(2021)EyestheticsProceedings of the ACM on Human-Computer Interaction10.1145/34746865:CHI PLAY(1-24)Online publication date: 6-Oct-2021
https://dl.acm.org/doi/10.1145/3474686
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten