Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3311350.3347150acmconferencesArticle/Chapter ViewAbstractPublication Pageschi-playConference Proceedingsconference-collections
research-article

Looking Outside the Box: Reflecting on Gaze Interaction in Gameplay

Published: 17 October 2019 Publication History

Abstract

Gaze interaction in games moved from being a tool for accessibility to be at the core of mass-market game franchises, offering enhanced controller performance and greater immersion. We propose to explore three different popular gaze-based interaction mechanics to create novel opportunities in the game design space. We developed Twileyed, a collection of three games that challenge the "common" use of gaze as a pointer to navigate; select; and aim; to pose a challenging new way to play with the eyes. We used the games as data to reflect on the gaze design space. We asked users to play the games to validate them, and we observed their experience and strategies. Based on the observations, we discussed through 5 themes, the dimensions of gaze interactions and the potential outcomes to create engaging and playful gaze-enabled games. We contribute a position in gaze gameplay design, but also a conversation starter to engage the EyePlay research community.

Supplementary Material

MP4 File (fp1533vf.mp4)
Supplemental video
MP4 File (p625-ramirez-gomez.mp4)

References

[1]
Mahdieh Abbaszadegan, Sohrab Yaghoubi, and I Scott MacKenzie. 2018. TrackMaze: A Comparison of Head-Tracking, Eye-Tracking, and Tilt as Input Methods for Mobile Games. In International Conference on Human-Computer Interaction. Springer, 393--405.
[2]
Saskia Bakker and Karin Niemantsverdriet. 2016. The interaction-attention continuum: considering various levels of human attention in interaction design. International Journal of Design 10, 2 (2016).
[3]
Paulo Bala, Lucilia Noóbrega, Guilherme Neves, Lai's Lopes, Joana Morna, João Camacho, and Cristina Freitas. 2015. Keyewai: Looking at Cooperation in a Holographic Projection Screen. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 61--64.
[4]
Joseph Baldwin, Alistair Burleigh, Robert Pepperell, and Nicole Ruta. 2016. The Perceived Size and Shape of Objects in Peripheral Vision. i-Perception 7, 4 (2016), 2041669516661900.
[5]
Richard Bates, Stephen Vickers, and Howell O Istance. 2010. Gaze interaction with virtual on-line communities: levelling the playing field for disabled users. Universal Access in the Information Society 9, 3 (2010), 261--272.
[6]
Eric PS Baumer, Vera Khovanskaya, Mark Matthews, Lindsay Reynolds, Victoria Schwanda Sosik, and Geri Gay. 2014. Reviewing reflection: on the use of reflection in interactive system design. In Proceedings of the 2014 conference on Designing interactive systems. ACM, 93--102.
[7]
Max V Birk, Cheralyn Atkins, Jason T Bowey, and Regan L Mandryk. 2016. Fostering intrinsic motivation through avatar identification in digital games. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2982--2995.
[8]
David Boud, Rosemary Keogh, and David Walker. 2013. Reflection: Turning experience into learning. Routledge.
[9]
Marcus Carter, Fraser Allison, John Downs, and Martin Gibbs. 2015. Player identity dissonance and voice interaction in games. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play. ACM, 265--269.
[10]
Marcus Carter, Martin Gibbs, and Michael Arnold. 2012. Avatars, characters, players and users: multiple identities at/in play. In Proceedings of the 24th Australian Computer-Human Interaction Conference. ACM, 68--71.
[11]
Marcus Carter, Joshua Newn, Eduardo Velloso, and Frank Vetere. 2015. Remote gaze and gesture tracking on the microsoft kinect: Investigating the role of feedback. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction. ACM, 167--176.
[12]
Emiliano Castellina and Fulvio Corno. 2008. Multimodal gaze interaction in 3D virtual environments. COGAIN 8 (2008), 33--37.
[13]
Matthieu Perreira Da Silva, Vincent Courboulay, and Armelle Prigent. 2007. Gameplay experience based on a gaze tracking system. In "Gaze-based Creativity, Interacting with Games and On-line Communities" INPROCEEDINGS in proceedings of COGAIN 2007 (Communication by Gaze Interaction IST FP6 European Project). 25--28.
[14]
Frederik De Grove, Cédric Courtois, and Jan Van Looy. 2015. How to be a gamer! Exploring personal and social indicators of gamer identity. Journal of Computer-Mediated Communication 20, 3 (2015), 346--361.
[15]
Soussan Djamasbi and Siavash Mortazavi. 2015. Generation Y, baby boomers, and gaze interaction experience in gaming. In 2015 48th Hawaii International Conference on System Sciences. IEEE, 482--490.
[16]
Michael Dorr, Laura Pomarjanschi, and Erhardt Barth. 2009. Gaze beats mouse: A case study on a gaze-controlled breakout. PsychNology Journal 7, 2 (2009), 197--211.
[17]
Nicolas Ducheneaut, Ming-Hui Wen, Nicholas Yee, and Greg Wadley. 2009. Body and mind: a study of avatar personalization in three virtual worlds. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1151--1160.
[18]
Inger M Ekman, Antti W Poikola, and Meeri K Mäkäräinen. 2008. Invisible eni: using gaze and pupil size to control a game. In CHI'08 extended abstracts on Human factors in computing systems. ACM, 3135--3140.
[19]
Massive Entertainment. 2019. Tom Clancy's The Division 2. Game. (15 March 2019).
[20]
Mary Flanagan, Daniel C Howe, and Helen Nissenbaum. 2005. Values at play: Design tradeoffs in socially-oriented game design. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 751--760.
[21]
Rowanne Fleck and Geraldine Fitzpatrick. 2010. Reflecting on reflection: framing a design landscape. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction. ACM, 216--223.
[22]
Tobii Gaming. PC Games with Eye Tracking gameplay. (????). https://gaming.tobii.com/games
[23]
William W Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a resource for design. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 233--240.
[24]
James Paul Gee. 2003. What video games have to teach us about learning and literacy. Computers in Entertainment (CIE) 1, 1 (2003), 20--20.
[25]
Casper Harteveld, Rui Guimarães, Igor S Mayer, and Rafael Bidarra. 2010. Balancing play, meaning and reality: The design philosophy of LEVEE PATROLLER. Simulation & Gaming 41, 3 (2010), 316--340.
[26]
Sébastien Hillaire, Anatole Lécuyer, Rémi Cozot, and Géry Casiez. 2008. Using an eye-tracking system to improve camera motions and depth-of-field blur effects in virtual environments. In Virtual Reality Conference, 2008. VR'08. IEEE. IEEE, 47--50.
[27]
Zaheer Hussain and Mark D Griffiths. 2008. Gender swapping and socializing in cyberspace: An exploratory study. CyberPsychology & Behavior 11, 1 (2008), 47--53.
[28]
Beyond Infinity. 2015. Glimpse of Fear. Game. (22 October 2015).
[29]
Katherine Isbister, Mary Flanagan, and Chelsea Hash. 2010. Designing games for learning: insights from conversations with designers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2041--2044.
[30]
Poika Isokoski, Markus Joos, Oleg Spakov, and Benoît Martin. 2009. Gaze controlled games. Universal Access in the Information Society 8, 4 (2009), 323--337.
[31]
Poika Isokoski and Benot Martin. 2006. Eye tracker input in first person shooter games. In Proceedings of the 2nd Conference on Communication by Gaze Interaction: Communication by Gaze Interaction-COGAIN 2006: Gazing into the Future. 78--81.
[32]
Howell Istance, Aulikki Hyrskykari, Lauri Immonen, Santtu Mansikkamaa, and Stephen Vickers. 2010. Designing gaze gestures for gaming: an investigation of performance. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications. ACM, 323--330.
[33]
Howell Istance, Aulikki Hyrskykari, Stephen Vickers, and Thiago Chaves. 2009. For your eyes only: Controlling 3d online games by eye-gaze. In Human-Computer Interaction--INTERACT 2009. Springer, 314--327.
[34]
Robert J. K. Jacob. 1990. What you look at is what you get: eye movement-based interaction techniques. In Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people (CHI '90). ACM, New York, NY, USA, 11--18.
[35]
Shahram Jalaliniya and Diako Mardanbegi. 2016. Eyegrip: Detecting targets in a series of uni-directional moving objects using optokinetic nystagmus eye movements. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5801--5811.
[36]
Rilla Khaled. 2018. Questions over answers: Reflective game design. In Playful Disruption of Digital Media. Springer, 3--27.
[37]
Mohamed Khamis, Carl Oechsner, Florian Alt, and Andreas Bulling. 2018. VRpursuits: interaction in virtual reality using smooth pursuit eye movements. (2018).
[38]
Michael Lankes, Thomas Mirlacher, Stefan Wagner, and Wolfgang Hochleitner. 2014. Whom are you looking for?: the effects of different player representation relations on the presence in gaze-based games. In Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play. ACM, 171--179.
[39]
Michael Lankes and Barbara Stiglbauer. 2016. GazeAR: Mobile gaze-based interaction in the context of augmented reality games. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics. Springer, 397--406.
[40]
Michael Lankes and Stefan Wagner. 2015. Taking a Look at the Player's Gaze: The Effects of Gaze Visualizations on the Perceived Presence in Games. In DiGRA Conference.
[41]
Bernhard Maurer, Ilhan Aslan, Martin Wuchse, Katja Neureiter, and Manfred Tscheligi. 2015. Gaze-based onlooker integration: exploring the in-between of active player and passive spectator in co-located gaming. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play. ACM, 163--173.
[42]
Elisa D Mekler, Ioanna Iacovides, and Julia Ayumi Bopp. 2018. A Game that Makes You Question...: Exploring the Role of Reflection for the Player Experience. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. ACM, 315--327.
[43]
Eidos Montreal. 2018. Shadow of the Tomb Raider. Game. (14 September 2018).
[44]
Sheila C Murphy. 2004. 'Live in your world, play in ours': The spaces of video game identity. Journal of visual culture 3, 2 (2004), 223--238.
[45]
Lennart Erik Nacke, Michael Kalyn, Calvin Lough, and Regan Lee Mandryk. 2011. Biofeedback game design: using direct and indirect physiological control to enhance game interaction. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 103--112.
[46]
Lennart E Nacke, Sophie Stellmach, Dennis Sasse, and Craig A Lindley. 2010. Gameplay experience in a gaze interaction game. arXiv preprint arXiv:1004.0259 (2010).
[47]
Dong Nguyen. 2013. Flappy Bird. Game [Phone]. (24 May 2013).
[48]
Anders Møller Nielsen, Anders Lerchedahl Petersen, and John Paulin Hansen. 2012. Gaming with gaze and losing with a smile. In Proceedings of the Symposium on Eye Tracking Research and Applications. ACM, 365--368.
[49]
J O'Donovan, J Ward, S Hodgins, and V Sundstedt. 2009. Rabbit run: Gaze and voice based game interaction. In Eurographics Ireland Workshop, December.
[50]
Pablo Ortiz and D Fox Harrell. 2018. Enabling Critical Self-Reflection through Roleplay with Chimeria: Grayscale. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. ACM, 353--364.
[51]
Ken Pfeuffer, Jason Alexander, and Hans Gellersen. 2016. GazeArchers: Playing with Individual and Shared Attention in a Two-player Look&Shoot Tabletop Game. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (MUM '16). ACM, New York, NY, USA, 213--216.
[52]
Argenis Ramirez Gomez and Hans Gellersen. 2019. SuperVision: Playing with Gaze Aversion and Peripheral Vision. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 473.
[53]
Ruth Rosenholtz. 2016. Capabilities and limitations of peripheral vision. Annual Review of Vision Science 2 (2016), 437--457.
[54]
Pedro Sanches, Kristina Hook, Corina Sas, and Anna Stahl. 2019. Ambiguity as a resource to inform proto-practices: The case of skin conductance. ACM Transactions on Computer-Human Interaction (TOCHI) (2019).
[55]
C Schaefer, R Menges, K Schmidt, M Kuich, and T Walber. 2014. Schau genau! an eye tracking game with a purpose. Applications for Gaze in Games (2014).
[56]
Phoebe Sengers, Kirsten Boehner, Shay David, and Joseph'Jofish' Kaye. 2005. Reflective design. In Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility. ACM, 49--58.
[57]
J David Smith and TC Graham. 2006. Use of eye movements for video game control. In Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology. ACM, 20.
[58]
India Starker and Richard A. Bolt. 1990. A Gaze-responsive Self-disclosing Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90). ACM, New York, NY, USA, 3--10.
[59]
Robert Louis Stevenson. 2018. Strange Case of Dr Jekyll and Mr Hyde. In Medicine and Literature, Volume Two. CRC Press, 105--118.
[60]
Starbreeze Studios. 2013. Brothers: A Tale of Two Sons. Game. (7 August 2013).
[61]
Stillalive Studios. 2015. Son of Nor. Game. (28 April 2015).
[62]
Techland. 2018. Dying Light: Bad Blood. Game. (13 September 2018).
[63]
Sabine Trepte and Leonard Reinecke. 2010. Avatar creation and video game enjoyment. Journal of Media Psychology (2010).
[64]
Jayson Turner, Eduardo Velloso, Hans Gellersen, and Veronica Sundstedt. 2014. EyePlay: applications for gaze in games. In Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play. ACM, 465--468.
[65]
Ubisoft. 2016. Watch Dogs 2. Game. (29 November 2016).
[66]
Ubisoft. 2018. Assassin's Creed Odyssey. Game. (5 October 2018).
[67]
Ubisoft Montreal and Ubisoft Toronto. 2018. Far Cry 5. Game [Xbox][Windows][PlayStation]. (27 March 2018).
[68]
MUHTAR ÇA GKAN ULUDA GLI and CENG? IZ ACARTÜRK. 2018. User interaction in hands-free gaming: a comparative study of gaze-voice and touchscreen interface control. Turkish Journal of Electrical Engineering & Computer Sciences 26, 4 (2018), 1967--1976.
[69]
Eva A Van Reijmersdal, Jeroen Jansz, Oscar Peters, and Guda Van Noort. 2013. Why girls go pink: Game character identification and game-players' motivations. Computers in Human Behavior 29, 6 (2013), 2640--2649.
[70]
Boris Velichkovsky, Andreas Sprenger, and Pieter Unema. 1997. Towards gaze-mediated interaction: Collecting solutions of the "Midas touch problem". In Human-Computer Interaction INTERACT. Springer, 509--516.
[71]
Eduardo Velloso and Marcus Carter. 2016. The Emergence of EyePlay: A Survey of Eye Interaction in Games. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 171--185.
[72]
Eduardo Velloso, Amy Fleming, Jason Alexander, and Hans Gellersen. 2015a. Gaze-Supported Gaming: MAGIC Techniques for First Person Shooters. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 343--347.
[73]
Eduardo Velloso, Carl Oechsner, Katharina Sachmann, Markus Wirth, and Hans Gellersen. 2015b. Arcade+: A Platform for Public Deployment and Evaluation of Multi-Modal Games. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 271--275.
[74]
Stephen Vickers, Howell Istance, and Matthew Smalley. 2010. EyeGuitar: making rhythm based music video games accessible using only eye movements. In Proceedings of the 7th International Conference on Advances in Computer Entertainment Technology. ACM, 36--39.
[75]
Melodie Vidal. 2014. Shynosaurs: A Game of Attention Dilemma. In Proceedings of the First ACM SIGCHI Annual Symposium on Computer-human Interaction in Play (CHI PLAY '14). ACM, New York, NY, USA, 391--394.
[76]
Melodie Vidal, Remi Bismuth, Andreas Bulling, and Hans Gellersen. 2015. The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 115--124.
[77]
Mélodie Vidal, Andreas Bulling, and Hans Gellersen. 2013. Pursuits: Spontaneous Interaction with Displays Based on Smooth Pursuit Eye Movement and Moving Targets. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, New York, NY, USA, 439--448.
[78]
David Whitney and Dennis M Levi. 2011. Visual crowding: A fundamental limit on conscious perception and object recognition. Trends in cognitive sciences 15, 4 (2011), 160--168.
[79]
Tom Wilcox, Mike Evans, Chris Pearce, Nick Pollard, and Veronica Sundstedt. 2008. Gaze and voice based game interaction: the revenge of the killer penguins. SIGGRAPH Posters 81 (2008).
[80]
Oscar Wilde and Joseph Bristow. 2006. The picture of dorian gray. OUP Oxford.
[81]
Shumin Zhai, Carlos Morimoto, and Steven Ihde. 1999. Manual and gaze input cascaded (MAGIC) pointing. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 246--253.

Cited By

View all
  • (2024)Eye Ball: Gazing as a Dilemma in a Competitive Virtual Reality GameExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650876(1-7)Online publication date: 11-May-2024
  • (2024)Effects of a Gaze-Based 2D Platform Game on User Enjoyment, Perceived Competence, and Digital Eye StrainProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641909(1-14)Online publication date: 11-May-2024
  • (2023)Eyes can drawInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102966170:COnline publication date: 1-Feb-2023
  • Show More Cited By

Index Terms

  1. Looking Outside the Box: Reflecting on Gaze Interaction in Gameplay

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI PLAY '19: Proceedings of the Annual Symposium on Computer-Human Interaction in Play
    October 2019
    680 pages
    ISBN:9781450366885
    DOI:10.1145/3311350
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 October 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. game design
    2. games
    3. gaze interaction

    Qualifiers

    • Research-article

    Conference

    CHI PLAY '19
    Sponsor:

    Acceptance Rates

    CHI PLAY '19 Paper Acceptance Rate 51 of 181 submissions, 28%;
    Overall Acceptance Rate 421 of 1,386 submissions, 30%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)34
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 09 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Eye Ball: Gazing as a Dilemma in a Competitive Virtual Reality GameExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650876(1-7)Online publication date: 11-May-2024
    • (2024)Effects of a Gaze-Based 2D Platform Game on User Enjoyment, Perceived Competence, and Digital Eye StrainProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641909(1-14)Online publication date: 11-May-2024
    • (2023)Eyes can drawInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102966170:COnline publication date: 1-Feb-2023
    • (2022)GazeCues: Exploring the Effects of Gaze-based Visual Cues in Virtual Reality Exploration GamesProceedings of the ACM on Human-Computer Interaction10.1145/35495006:CHI PLAY(1-25)Online publication date: 31-Oct-2022
    • (2022)Investigating gaze interaction to support children’s gameplayInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2021.10034930:COnline publication date: 9-Apr-2022
    • (2021)EyestheticsProceedings of the ACM on Human-Computer Interaction10.1145/34746865:CHI PLAY(1-24)Online publication date: 6-Oct-2021
    • (2020)Social Gaze in Minimalist GamesProceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3410404.3414265(450-460)Online publication date: 2-Nov-2020
    • (2020)KryptonEyed: Playing with Gaze Without LookingProceedings of the 15th International Conference on the Foundations of Digital Games10.1145/3402942.3403017(1-4)Online publication date: 15-Sep-2020
    • (2020)Screen-Light Decomposition Framework for Point-of-Gaze Estimation Using a Single Uncalibrated Camera and Multiple Light SourcesJournal of Mathematical Imaging and Vision10.1007/s10851-020-00947-862:4(585-605)Online publication date: 15-Feb-2020
    • (2020)A Study on Gaze Control - Game Accessibility Among Novice Players and Motor Disabled PeopleComputers Helping People with Special Needs10.1007/978-3-030-58796-3_25(205-216)Online publication date: 9-Sep-2020

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media