research-article

Video game design using an eye-movement-dependent model of visual attention

Authors:

James J. ClarkAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 4, Issue 3

Article No.: 22, Pages 1 - 16

https://doi.org/10.1145/1386109.1386115

Published: 18 September 2008 Publication History

Abstract

Eye movements can be used to infer the allocation of covert attention. In this article, we propose to model the allocation of attention in a task-dependent manner based on different eye movement conditions, specifically fixation and pursuit. We show that the image complexity at eye fixation points during fixation, and the pursuit direction during pursuit are significant factors in attention allocation. Results of the study are applied to the design of an interactive computer game. Real-time eye movement information is taken as one of inputs for the game. The utility of such eye information for controlling game difficulty is shown.

References

[1]

Dye, M. and Bavelier, D. 2004. Playing video games enhances visual attention in children. J. Vis. 4, 11, Abstract 40, 40a.

[2]

Felzenszwalb, P. and Huttenlocher, D. 2004. Efficient graph-based images segmentation. Internat. J. Comput. Vis. 59, 2 (Sept), 167--181.

Digital Library

[3]

Green, C. and Bavelier, D. 2003. Action video game modifies visual selective attention. Nature 423, 534--537.

[4]

Green, C. and Bavelier, D. 2007. Action-video-game experience alters the spatial resolution of vision. Psychol. Sci. 18, 1, 88--94.

[5]

Guo, K., Mahmoodi, S., Robertson, R., and Young, M. 2006. Longer fixation duration while viewing face images. Exp. Brain Res. 171, 1, 91--98.

[6]

Henderson, J. and Hollingworth, A. 1998. Eye movements during scene viewing: an overview. In Eye Guidance in Reading and Scene Perception, G. Underwood, Ed. 269--283.

[7]

Henderson, J., Weeks, P., and Hollingworth, A. 1999. The effects of semantic consistency on eye movements during complex scene viewing. J. Exp. Psychol.: Hum. Perc. Perf. 25, 210--228.

[8]

Itti, L. and Koch, C. 2000. A saliency-based search mechanism for overt and covert shift of visual attention. Vision Res. 40, 10--12, 1489--1506.

[9]

Jie, L. and Clark, J. 2005. Microsaccadic eye movements during ocular pursuit. Vision Sciences Society Annual Meeting (VSS) 5, 8, Abstract, 697a.

[10]

Kayser, C., Nielsen, K., and Logothetis, N. 2006. Fixations in natural scenes: interaction of image structure and image content. Vision Res. 46, 16, 2535--2545.

[11]

Land, M. and Hayhoe, M. 2001. In what ways do eye movements contribute to everyday activities&quest; Vision Res. 41, 3559--3565.

[12]

Loftus, G. 1985. Picture perception: effects of luminance on available information and information-extraction rate. J. Exp. Psychol. Gen 114, 3, 342--356.

[13]

Loftus, G., Kaufman, L., Nishimoto, T., and Ruthruff, E. 1992. Effects of visual degradation on eye-fixation durations, perceptual processing, and long-term visual memory. In Eye Movements and Visual Cognition: Scene Perception and Reading, K. Reyner, Ed. 203--226.

[14]

Mannan, S., Ruddock, K., and Wooding, D. 1996. The relationship between the locations of spatial features and those fixations made during visual examination of briefly presented images. Spatial Vision 10, 3, 165--188.

[15]

Mannan, S., Ruddock, K., and Wooding, D. 1997. Fixation sequences made during visual examination of briefly presented 2d images. Spatial Vision 11, 2, 157--178.

[16]

Oliva, A., Torralba, A., Castelhano, M., and Henderson, J. 2003. Top-down control of visual attention in object detection. In Proceedings of the IEEE International Conference on Image Processing. IEEE Computer Society Press, Los Alamitos, CA, 253--256.

[17]

Parkhurst, D. and Niebur, E. 2003. Scene content selected by active vision. Spatial Vis. 16, 2, 125--154.

[18]

Pomplun, M. 2006. Saccadic selectivity in complex visual search displays. Vision Res. 46(12), 1886--1900.

[19]

Raj, R., Geisler, W., Frazor, R., and Bovik, A. 2005. Contrast statistics for foveated visual systems: Fixation selection by minimizing contrast entropy. J. Opt. Soc. Am. A. 22, 10, 2039--2049.

[20]

Rajashekar, U., Cormack, L., and Bovik, A. 2003. Image features that draw fixations. In Proceedings of the IEEE International Conference on Image Processing. IEEE Computer Society Press, Los Alamitos, CA, 313--316.

[21]

Rayner, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124, 372--422.

[22]

Reichle, E., Pollatsek, A., Fisher, D., and Rayner, K. 1998. Toward a model of eye movement control in reading. Psychol. Rev. 105, 125--157.

[23]

Rueda, M., Rothbart, M., McCandliss, B., Saccomanno, L., and Posner, M. 2005. From the cover: Training, maturation, and genetic influences on the development of executive attention. PNAS 102, 14931--14936.

[24]

Seif El-Nasr, M. and Rao, C. 2004. Visually directing user's attention in interactive 3d environments. International Conference on Computer Graphics and Interactive Technique ACM SIGGRAPH Poster Session. ACM, New York.

Digital Library

[25]

Seif El-Nasr, M. and Yan, S. 2006. Visual attention in 3d video games. In Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (Hollywood, CA). ACM, New York.

Digital Library

[26]

Stiefelhagen, R. and Zhu, J. 2002. Head orientation and gaze direction in meeting. Conference on Human Factors in Computing Systems (CHI2002), 858--859.

Digital Library

[27]

Torralba, A., Oliva, A., Castelhano, M., and Henderson, J. 2006. Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychol. Rev. 113, 766--786.

[28]

Turano, K. A., Geruschat, D., and Baker, F. 2003. Oculomotor strategies for the direction of gaze tested with a real-world activity. Vision Res. 43, 333--346.

[29]

Van Donkelaar, P. and Drew, A. 2002. The allocation of attention during smooth pursuit eye movements. Prog. Brain. Res. 140, 267--277.

[30]

Vinje, W. and Gallant, J. 2000. Sparse coding and decorrelationin primary visual cortex during natural vision. Science 287, 1273V1276.

[31]

Wolfe, J., Cave, K., and Franzel, S. 1989. Guided search: An alternative to the feature integration model for visual search. J. Exp. Psychol.: Hum. Perc. Perf. 15, 419--433.

[32]

Yarbus, A. 1967. Eye Movements and Vision. Plenum Press, New York.

Cited By

Škrdla J(2024)Analýza světů digitálních her: prostorová sémiotika a její recepceAnalysis of Digital Game Worlds: Spatial Semiotics and Its ReceptionTeorie vědy / Theory of Science10.46938/tv.2024.627Online publication date: 31-Dec-2024
https://doi.org/10.46938/tv.2024.627
Reinke NWursthorn TJessen J(2023)MEDUSA - A View-Tracking Pong GameExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583825(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583825
Caroux LDelmas MCahuzac MAder MGazagne BRavassa A(2022)Head-up displays in action video games: the effects of physical and semantic characteristics on player performance and experienceBehaviour & Information Technology10.1080/0144929X.2022.208160942:10(1466-1486)Online publication date: 27-May-2022
https://doi.org/10.1080/0144929X.2022.2081609
Show More Cited By

Index Terms

Video game design using an eye-movement-dependent model of visual attention

Recommendations

Use of eye movements for video game control
ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology

We present a study that explores the use of a commercially available eye tracker as a control device for video games. We examine its use across multiple gaming genres and present games that utilize the eye tracker in a variety of ways. First, we ...
User Eye Fatigue Detection via Eye Movement Behavior
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

In this study we propose and evaluate a novel approach that allows detection of physical eye fatigue. The proposed approach is based on the analysis of the recorded eye movements via what is called behavioral scores. These easy-to-compute scores can be ...
Human Visual Scanpath Prediction Based on RGB-D Saliency
ICIGP '18: Proceedings of the 2018 International Conference on Image and Graphics Processing

Human visual perception is considered as a dynamic process of information acquisition, while the visual scanpath can clearly reflect the shift of our eye fixations. In the previous study of visual attention, researchers generally do the saliency ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 4, Issue 3

August 2008

136 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/1386109

Issue’s Table of Contents

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2008

Accepted: 01 October 2007

Revised: 01 July 2007

Received: 01 April 2007

Published in TOMM Volume 4, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
1,059
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Škrdla J(2024)Analýza světů digitálních her: prostorová sémiotika a její recepceAnalysis of Digital Game Worlds: Spatial Semiotics and Its ReceptionTeorie vědy / Theory of Science10.46938/tv.2024.627Online publication date: 31-Dec-2024
https://doi.org/10.46938/tv.2024.627
Reinke NWursthorn TJessen J(2023)MEDUSA - A View-Tracking Pong GameExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583825(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583825
Caroux LDelmas MCahuzac MAder MGazagne BRavassa A(2022)Head-up displays in action video games: the effects of physical and semantic characteristics on player performance and experienceBehaviour & Information Technology10.1080/0144929X.2022.208160942:10(1466-1486)Online publication date: 27-May-2022
https://doi.org/10.1080/0144929X.2022.2081609
Caroux LMouginé A(2022)Influence of visual background complexity and task difficulty on action video game players’ performanceEntertainment Computing10.1016/j.entcom.2021.10047141(100471)Online publication date: Mar-2022
https://doi.org/10.1016/j.entcom.2021.100471
Delmas MCaroux LLemercier C(2022)Searching in clutter: Visual behavior and performance of expert action video game playersApplied Ergonomics10.1016/j.apergo.2021.10362899(103628)Online publication date: Feb-2022
https://doi.org/10.1016/j.apergo.2021.103628
Marre QCaroux LSakdavong J(2021)Video Game Interfaces and Diegesis: The Impact on Experts and Novices’ Performance and Experience in Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2020.1870819(1-15)Online publication date: 25-Jan-2021
https://doi.org/10.1080/10447318.2020.1870819
Fowler ANesbitt KCanossa A(2019)Identifying Cognitive Load in a Computer Game: An exploratory study of young children2019 IEEE Conference on Games (CoG)10.1109/CIG.2019.8848064(1-6)Online publication date: Aug-2019
https://doi.org/10.1109/CIG.2019.8848064
(2018)Influence of head-up displays' characteristics on user experience in video gamesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2015.11.00187:C(65-79)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1016/j.ijhcs.2015.11.001
Hasanzadeh SEsmaeili BDodd M(2017)Measuring the Impacts of Safety Knowledge on Construction Workers’ Attentional Allocation and Hazard Detection Using Remote Eye-Tracking TechnologyJournal of Management in Engineering10.1061/(ASCE)ME.1943-5479.000052633:5Online publication date: Sep-2017
https://doi.org/10.1061/(ASCE)ME.1943-5479.0000526
Hasanzadeh SEsmaeili BDodd M(2017)Impact of Construction Workers’ Hazard Identification Skills on Their Visual AttentionJournal of Construction Engineering and Management10.1061/(ASCE)CO.1943-7862.0001373143:10Online publication date: Oct-2017
https://doi.org/10.1061/(ASCE)CO.1943-7862.0001373
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents