research-article

Socialeyes: social gaze in collaborative 3D games

Authors:

Michael Lankes,

Bernhard MaurerAuthors Info & Claims

FDG '18: Proceedings of the 13th International Conference on the Foundations of Digital Games

Article No.: 3, Pages 1 - 10

https://doi.org/10.1145/3235765.3235766

Published: 07 August 2018 Publication History

Abstract

This paper examines the effects of social gaze regarding social presence in an on-line collaborative game setting. We propose a novel approach of integrating gaze-based interactions in social settings by augmenting social gaze-based behaviors (e.g., joint attention, mutual gaze, etc.) through interaction mechanics and visualizations. In detail, we want to find out if players experience a higher degree of social presence (co-presence, psycho-behavioral interactions) in our social gaze-supported approach in comparison to settings that either only include basic (i.e., gaze is integrated without taking any social behavior into account) or no gaze features. To get answers, we conducted an experiment consisting of a collaborative 3D game prototype for two players with three different conditions (gaze, social gaze, no gaze). Furthermore, players were confronted with three construction challenges that had to be solved cooperatively. Our study findings highlight the positive influence of social gaze on the perceived social presence. The inclusion of social gaze features received better ratings on both social presence sub-scales. With the gathered results we want to provide insights for game designers and researchers regarding the inclusion of social gaze-based interaction in remote and cooperative gaming settings.

References

[1]

Deepak Akkil, Jobin Mathew James, Poika Isokoski, and Jari Kangas. 2016. GazeTorch: Enabling Gaze Awareness in Collaborative Physical Tasks. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 1151--1158.

Digital Library

[2]

Paulo Bala, Lucilia Noóbrega, Guilherme Neves, Lai's Lopes, Joana Morna, João Camacho, and Cristina Freitas. 2015. Keyewai: Looking at Cooperation in a Holographic Projection Screen. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 61--64.

Digital Library

[3]

Steve Benford, John Bowers, Lennart E. Fahlén, Chris Greenhalgh, and Dave Snowdon. 1995. User Embodiment in Collaborative Virtual Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '95). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 242--249.

Digital Library

[4]

Frank Biocca and Chad Harms. 2003. Guide to the Networked Minds Social Presence Inventory v. 1.2. (2003). http://cogprints.org/6743/

[5]

Frank Biocca and Chad Harms. 2003. Networked Minds Social Presence Inventory: Measures of co-presence, social presence, subjective symmetry, and intersubjective symmetry. (2003). http://cogprints.org/6742/

[6]

Blizzard. 2018. World of Warcraft. https://worldofwarcraft.com/en-us/.

[7]

John Bowers, James Pycock, and Jon O'Brien. 1996. Talk and Embodiment in Collaborative Virtual Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '96). ACM, New York, NY, USA, 58--65.

Digital Library

[8]

Mauro Cherubini, Rodrigo de Oliveira, Nuria Oliver, and Christian Ferran. 2010. Gaze and Gestures in Telepresence: multimodality, embodiment, and roles of collaboration. CoRR abs/1001.3150 (2010). arXiv:1001.3150 http://arxiv.org/abs/1001.3150

[9]

N.J. Emery. 2000. The eyes have it: the neuroethology, function and evolution of social gaze. Neuroscience & Biobehavioral Reviews 24, 6 (2000), 581 -- 604.

[10]

Teresa Farroni, Gergely Csibra, Francesca Simion, and Mark H. Johnson. 2002. Eye contact detection in humans from birth. Proceedings of the National Academy of Sciences 99, 14 (2002), 9602--9605. :http://www.pnas.org/content/99/14/9602.full.pdf

[11]

K. Gupta, G. A. Lee, and M. Billinghurst. 2016. Do You See What I See? The Effect of Gaze Tracking on Task Space Remote Collaboration. IEEE Transactions on Visualization and Computer Graphics 22, 11 (Nov 2016), 2413--2422.

Digital Library

[12]

Chad Harms and Frank Biocca. 2004. Internal Consistency and Reliability of the Networked Minds Measure of Social Presence. (2004). http://cogprints.org/7026/

[13]

Adam Kendon. 1967. Some functions of gaze-direction in social interaction. Acta psychologica 26 (1967), 22--63.

[14]

Michael Lankes, Daniel Rammer, and Bernhard Maurer. 2017. Eye Contact: Gaze as a Connector Between Spectators and Players in Online Games. Springer International Publishing, Cham, 310--321.

[15]

Bernhard Maurer, Michael Lankes, Barbara Stiglbauer, and Manfred Tscheligi. 2016. EyeCo: Effects of Shared Gaze on Social Presence in an Online Cooperative Game. In International Conference on Entertainment Computing. Springer, 102--114.

[16]

Bernhard Maurer, Michael Lankes, and Manfred Tscheligi. 2018. Where the eyes meet: Lessons learned from shared gaze-based interactions in cooperative and competitive online games. Entertainment Computing 27 (2018), 47 -- 59.

[17]

Joshua Newn, Eduardo Velloso, Fraser Allison, Yomna Abdelrahman, and Frank Vetere. 2017. Evaluating Real-Time Gaze Representations to Infer Intentions in Competitive Turn-Based Strategy Games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '17). ACM, New York, NY, USA, 541--552.

Digital Library

[18]

Joshua Newn, Eduardo Velloso, Marcus Carter, and Frank Vetere. 2016. Exploring the Effects of Gaze Awareness on Multiplayer Gameplay. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI PLAY Companion '16). ACM, New York, NY, USA, 239--244.

Digital Library

[19]

Ulrike Schultze. 2010. Embodiment and presence in virtual worlds: a review. Journal of Information Technology 25, 4 (01 Dec 2010), 434--449.

[20]

Atsushi Senju and Mark H. Johnson. 2009. Atypical eye contact in autism: Models, mechanisms and development. Neuroscience and Biobehavioral Reviews 33, 8 (2009), 1204 -- 1214. Special Section: Neuroscience and Biobehavioral Research: A Chinese Perspective.

[21]

Suleman Shahid, Emiel Krahmer, and Marc Swerts. 2012. Video-mediated and co-present gameplay: Effects of mutual gaze on game experience, expressiveness and perceived social presencefh. Interacting with Computers 24, 4 (2012), 292--305.

Digital Library

[22]

Tobii. 2018. How to Play Assassin's Creed Origins with Tobii Eye Tracking. https://www.youtube.com/watch?time_continue=2&v=ZSoDSiI0mZw.

[23]

Tobii. 2018. Tobii Gaming, PC Games with Eye Tracking, Top Games from Steam, Uplay. https://tobiigaming.com/games/.

[24]

Ubisoft. 2017. Assassins's Creed Origins. https://assassinscreed.ubisoft.com/game/en-us/home/.

[25]

Ubisot. 2017. For Honor. https://www.ubisot.com/en-us/game/for-honor/.

[26]

Eduardo Velloso and Marcus Carter. 2016. The Emergence of EyePlay: A Survey of Eye Interaction in Games. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 171--185.

Digital Library

[27]

Melodie Vidal. 2014. Shynosaurs: A Game of Attention Dilemma. In Proceedings of the First ACM SIGCHI Annual Symposium on Computer-human Interaction in Play (CHI PLAY '14). ACM, New York, NY, USA, 391--394.

Digital Library

[28]

Melodie Vidal, Remi Bismuth, Andreas Bulling, and Hans Gellersen. 2015. The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 115--124.

Digital Library

[29]

Tom Wilcox, Mike Evans, Chris Pearce, Nick Pollard, and Veronica Sundstedt. 2008. Gaze and Voice Based Game Interaction: The Revenge of the Killer Penguins. In ACM SIGGRAPH 2008 Posters (SIGGRAPH '08). ACM, New York, NY, USA, Article 81, 1 pages.

Digital Library

Cited By

Lankes MGhosh SLesser CIsbister K(2024)Eye Ball: Gazing as a Dilemma in a Competitive Virtual Reality GameExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650876(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650876
Combe TFribourg RDetto LNorm J(2024)Exploring the Influence of Virtual Avatar Heads in Mixed Reality on Social Presence, Performance and User Experience in Collaborative TasksIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337205130:5(2206-2216)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372051
Gonçalves DPais PGerling KGuerreiro TRodrigues A(2023)Social gamingComputers in Human Behavior10.1016/j.chb.2023.107851147:COnline publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1016/j.chb.2023.107851
Show More Cited By

Index Terms

Socialeyes: social gaze in collaborative 3D games
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Social Gaze in Minimalist Games
CHI PLAY '20: Proceedings of the Annual Symposium on Computer-Human Interaction in Play

Social gaze-based interactions in games form a timely field of research as they can enrich communicative acts within the game world. Apart from portraying gaze via realistic-looking characters, we deem that these aspects could also be applied to non-...
Eye-based head gestures
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

A novel method for video-based head gesture recognition using eye information by an eye tracker has been proposed. The method uses a combination of gaze and eye movement to infer head gestures. Compared to other gesture-based methods a major advantage ...
Eye&Head: Synergetic Eye and Head Movement for Gaze Pointing and Selection
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Eye gaze involves the coordination of eye and head movement to acquire gaze targets, but existing approaches to gaze pointing are based on eye-tracking in abstraction from head motion. We propose to leverage the synergetic movement of eye and head, and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

FDG '18: Proceedings of the 13th International Conference on the Foundations of Digital Games

August 2018

503 pages

ISBN:9781450365710

DOI:10.1145/3235765

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 August 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

FDG '18

FDG '18: Foundations of Digital Games 2018

August 7 - 10, 2018

Malmö, Sweden

Acceptance Rates

FDG '18 Paper Acceptance Rate 39 of 95 submissions, 41%;

Overall Acceptance Rate 152 of 415 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
273
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)3

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lankes MGhosh SLesser CIsbister K(2024)Eye Ball: Gazing as a Dilemma in a Competitive Virtual Reality GameExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650876(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650876
Combe TFribourg RDetto LNorm J(2024)Exploring the Influence of Virtual Avatar Heads in Mixed Reality on Social Presence, Performance and User Experience in Collaborative TasksIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337205130:5(2206-2216)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372051
Gonçalves DPais PGerling KGuerreiro TRodrigues A(2023)Social gamingComputers in Human Behavior10.1016/j.chb.2023.107851147:COnline publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1016/j.chb.2023.107851
Lankes MRamirez Gomez A(2022)GazeCues: Exploring the Effects of Gaze-based Visual Cues in Virtual Reality Exploration GamesProceedings of the ACM on Human-Computer Interaction10.1145/35495006:CHI PLAY(1-25)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3549500
Hedeshy RKumar CLauer MStaab S(2022)All Birds Must Fly: The Experience of Multimodal Hands-free Gaming with Gaze and Nonverbal Voice SynchronizationProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556593(278-287)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556593
Wang XZhang JZhang HZhao SLiu H(2022)Vision-Based Gaze Estimation: A ReviewIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2021.306646514:2(316-332)Online publication date: Jun-2022
https://doi.org/10.1109/TCDS.2021.3066465
Ramirez Gomez ALankes M(2021)EyestheticsProceedings of the ACM on Human-Computer Interaction10.1145/34746865:CHI PLAY(1-24)Online publication date: 6-Oct-2021
https://dl.acm.org/doi/10.1145/3474686
Kurzweg MReinhardt JStoll MWirth JWolf K(2020)PLAY ME! Influencing Game Decisions through Suggestions made by Augmented CharactersProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3428406(288-298)Online publication date: 22-Nov-2020
https://dl.acm.org/doi/10.1145/3428361.3428406
Lankes MMirza-Babaei PMcArthur VVanden Abeele VBirk M(2020)Social Gaze in Minimalist GamesProceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3410404.3414265(450-460)Online publication date: 2-Nov-2020
https://dl.acm.org/doi/10.1145/3410404.3414265
Ramirez Gomez ALankes M(2019)Towards Designing Diegetic Gaze in Games: The Use of Gaze Roles and MetaphorsMultimodal Technologies and Interaction10.3390/mti30400653:4(65)Online publication date: 21-Sep-2019
https://doi.org/10.3390/mti3040065
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten