extended-abstract

To Lag or Not to Lag: Understanding and Compensating Latency in Video Games

Author:

David HalbhuberAuthors Info & Claims

CHI PLAY '22: Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play

Pages 370 - 373

https://doi.org/10.1145/3505270.3558364

Published: 07 November 2022 Publication History

Abstract

Latency, the temporal delay between in- and output, is inherently part of the communication between humans and computers. In video games, high latency reduces player performance and experience. These adverse effects are particularly pronounced in fast-paced video games, such as first-person shooters. Previous work shines light on how latency affects video games and how to counteract latency in video games. However, there are still unknown aspects to latency and its compensation. Thus, in the first step, we investigate novel approaches to understand latency in video games, for example, the effects of long-term switching latency. In the second step, we propose new approaches to compensate for latency in video games. We present a novel avenue to latency compensation utilizing deep learning models predicting either internal game states or external user actions.

References

[1]

Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies 135 (2020), 102370. https://doi.org/10.1016/j.ijhcs.2019.102370

Digital Library

[2]

Michelle Annett, Fraser Anderson, Walter F. Bischof, and Anoop Gupta. 2014. The Pen is Mightier: Understanding Stylus Behaviour While Inking on Tablets. In Proceedings of Graphics Interface 2014 (Montreal, Quebec, Canada) (GI ’14). Canadian Information Processing Society, CAN, 193–200. https://doi.org/10.5555/2619648.2619680

Digital Library

[3]

Grenville Armitage. 2003. An experimental estimation of latency sensitivity in multiplayer Quake 3. In The 11th IEEE International Conference on Networks, 2003. ICON2003. IEEE, 137–141.

[4]

Tom Beigbeder, Rory Coughlan, Corey Lusher, John Plunkett, Emmanuel Agu, and Mark Claypool. 2004. The Effects of Loss and Latency on User Performance in Unreal Tournament 2003®. In Proceedings of 3rd ACM SIGCOMM Workshop on Network and System Support for Games (Portland, Oregon, USA) (NetGames ’04). Association for Computing Machinery, New York, NY, USA, 144–151. https://doi.org/10.1145/1016540.1016556

Digital Library

[5]

Stuart Card, Thomas Moran, and Allen Newell. 1986. The model human processor- An engineering model of human performance. Handbook of perception and human performance. 2, 45–1(1986). https://doi.org/10.1177/107118138102500180

[6]

Mark Claypool, Ragnhild Eg, and Kjetil Raaen. 2016. The Effects of Delay on Game Actions: Moving Target Selection with a Mouse. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (Austin, Texas, USA) (CHI PLAY Companion ’16). Association for Computing Machinery, New York, NY, USA, 117–123. https://doi.org/10.1145/2968120.2987743

Digital Library

[7]

Mark Claypool and David Finkel. 2014. The effects of latency on player performance in cloud-based games. In 2014 13th Annual Workshop on Network and Systems Support for Games. IEEE, 1–6.

[8]

Mark Claypool, David Finkel, Alexander Grant, and Michael Solano. 2014. On the performance of OnLive thin client games. Multimedia systems 20, 5 (2014), 471–484. https://doi.org/10.1007/s00530-014-0362-4

Digital Library

[9]

Ragnhild Eg, Kjetil Raaen, and Mark Claypool. 2018. Playing with delay: With poor timing comes poor performance, and experience follows suit. In 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 1–6. https://doi.org/10.1109/QoMEX.2018.8463382

[10]

Carl Gutwin, Steve Benford, Jeff Dyck, Mike Fraser, Ivan Vaghi, and Chris Greenhalgh. 2004. Revealing delay in collaborative environments. In Proceedings of the SIGCHI conference on human factors in computing systems. 503–510.

Digital Library

[11]

David Halbhuber, Niels Henze, and Valentin Schwind. 2021. Increasing Player Performance and Game Experience in High Latency Systems. Proc. ACM Hum.-Comput. Interact. 5, CHI PLAY, Article 283 (oct 2021), 20 pages. https://doi.org/10.1145/3474710

Digital Library

[12]

David Halbhuber, Höpfinger Julian, Schwind Valentin, and Niels Henze. Forthcoming. A Dataset to Investigate First-Person Shooter Players. (Forthcoming).

[13]

David Halbhuber, Huber Maximilian, Schwind Valentin, and Niels Henze. Forthcoming. Understanding Player Performance and Gaming Experience while Playing a First-Person Shooter with Auditory Latency. (Forthcoming).

[14]

David Halbhuber, Valentin Schwind, and Niels Henze. Forthcoming. Don’t Break my Flow: Effects of Switching Latency in Shooting Video Games. (Forthcoming).

[15]

David Halbhuber, Maximilian Seewald, Fabian Schiller, Mattias Götz, Jakob Fehle, and Niels Henze. Forthcoming. Using Artificial Neural Networks to Compensate Negative Effects of Latency in Commercial Real-Time Strategy Games. (Forthcoming).

[16]

Niels Henze, Markus Funk, and Alireza Sahami Shirazi. 2016. Software-reduced touchscreen latency. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services. 434–441. https://doi.org/10.1145/2935334.2935381

Digital Library

[17]

Wijnand A IJsselsteijn, Yvonne AW de Kort, and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven (2013), 3–9.

[18]

Ricardo Jota, Albert Ng, Paul Dietz, and Daniel Wigdor. 2013. How Fast is Fast Enough? A Study of the Effects of Latency in Direct-Touch Pointing Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 2291–2300. https://doi.org/10.1145/2470654.2481317

Digital Library

[19]

S. W. K. Lee and R. K. C. Chang. 2017. On "shot around a corner" in first-person shooter games. In 2017 15th Annual Workshop on Network and Systems Support for Games (NetGames). 1–6. https://doi.org/10.1109/NetGames.2017.7991545

[20]

Huy Viet Le, Valentin Schwind, Philipp Göttlich, and Niels Henze. 2017. PredicTouch: A System to Reduce Touchscreen Latency Using Neural Networks and Inertial Measurement Units. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. 230–239. https://doi.org/10.1145/3132272.3134138

Digital Library

[21]

Injung Lee, Sunjun Kim, and Byungjoo Lee. 2019. Geometrically compensating effect of end-to-end latency in moving-target selection games. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12. https://doi.org/10.1145/3290605.3300790

Digital Library

[22]

Wai-Kiu Lee and Rocky KC Chang. 2015. Evaluation of lag-related configurations in first-person shooter games. In 2015 International Workshop on Network and Systems Support for Games (NetGames). IEEE, 1–3. https://doi.org/10.5555/2984075.2984086

Digital Library

[23]

Shengmei Liu, Mark Claypool, Atsuo Kuwahara, James Scovell, and Jamie Sherman. 2021. The Effects of Network Latency on Competitive First-Person Shooter Game Players. In 2021 13th International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 151–156.

[24]

Shengmei Liu, Mark Claypool, Atsuo Kuwahara, Jamie Sherman, and James J Scovell. 2021. Lower is Better? The Effects of Local Latencies on Competitive First-Person Shooter Game Players. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[25]

Shengmei Liu, Xiaokun Xu, and Mark Claypool. 2022. A Survey and Taxonomy of Latency Compensation Techniques for Network Computer Games. ACM Computing Surveys (CSUR)(2022).

[26]

I Scott MacKenzie. 2012. Human-computer interaction: An empirical research perspective. (2012).

[27]

I Scott MacKenzie and Colin Ware. 1993. Lag as a determinant of human performance in interactive systems. In Proceedings of the INTERACT’93 and CHI’93 conference on Human factors in computing systems. 488–493. https://doi.org/10.1145/169059.169431

Digital Library

[28]

Albert Ng, Michelle Annett, Paul Dietz, Anoop Gupta, and Walter F. Bischof. 2014. In the Blink of an Eye: Investigating Latency Perception during Stylus Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 1103–1112. https://doi.org/10.1145/2556288.2557037

Digital Library

[29]

Valentin Schwind, David Halbhuber, Jakob Fehle, Jonathan Sasse, Andreas Pfaffelhuber, Christoph Tögel, Julian Dietz, and Niels Henze. 2020. The Effects of Full-Body Avatar Movement Predictions in Virtual Reality Using Neural Networks. In 26th ACM Symposium on Virtual Reality Software and Technology (Virtual Event, Canada) (VRST ’20). Association for Computing Machinery, New York, NY, USA, Article 28, 11 pages. https://doi.org/10.1145/3385956.3418941

Digital Library

[30]

Roland Thomaschke, Annika Wagener, Andrea Kiesel, and Joachim Hoffmann. 2011. The scope and precision of specific temporal expectancy: Evidence from a variable foreperiod paradigm. Attention, Perception, & Psychophysics 73, 3 (2011), 953–964. https://doi.org/10.3758/s13414-010-0079-1

[31]

Vero Vanden Abeele, Lennart E. Nacke, Elisa D. Mekler, and Daniel Johnson. 2016. Design and Preliminary Validation of The Player Experience Inventory(CHI PLAY Companion ’16). Association for Computing Machinery, New York, NY, USA, 335–341. https://doi.org/10.1145/2968120.2987744

Digital Library

[32]

Gregor Volberg and Roland Thomaschke. 2017. Time-based expectations entail preparatory motor activity. Cortex 92(2017), 261–270. https://doi.org/10.1016/j.cortex.2017.04.019

[33]

Annika Wagener and Joachim Hoffmann. 2010. Temporal cueing of target-identity and target-location. Experimental Psychology(2010). https://doi.org/10.1027/1618-3169/a000054

Cited By

Журавчак ЛСеньків ВСеньків Н(2024)Реалізація багатокористувацької гри засобами рушія Unreal Engine 5Scientific Bulletin of UNFU10.36930/4034041234:4(93-101)Online publication date: 23-May-2024
https://doi.org/10.36930/40340412
Wührl CSchmid AHößl SWimmer R(2024)Comparing the Effectiveness and Ergonomics of Smartphone-Based GamepadsProceedings of Mensch und Computer 202410.1145/3670653.3670676(207-218)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670676
Samac AKovačević JPekez N(2024)Optimization of Immersive Audio Technologies Start-up Time in Home Theatre Environment2024 Zooming Innovation in Consumer Technologies Conference (ZINC)10.1109/ZINC61849.2024.10579403(199-203)Online publication date: 22-May-2024
https://doi.org/10.1109/ZINC61849.2024.10579403
Show More Cited By

Recommendations

Don't Break my Flow: Effects of Switching Latency in Shooting Video Games
CHI PLAY

Latency is inherently part of every interactive computing system and particularly important for video games. Previous work shows that constant latency above 25 ms reduces game experience and player performance. However, latency in the wild varies and is ...
The Effects of Latency and In-Game Perspective on Player Performance and Game Experience

Previous work shows that high latency, a prolonged delay between player in- and system output, negatively affects player experience and performance. However, previous work also comes to contrary conclusions about how the in-game perspective alters the ...
Understanding Player Performance and Gaming Experience while Playing a First-Person Shooter with Auditory Latency
CHI PLAY '22: Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play

Visual latency is known to decrease player performance and experience starting at 25 ms. Less is known about the effects of auditory latency in video games. To investigate the effects of auditory latency, we added auditory latency to a publicly ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI PLAY '22: Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play

November 2022

419 pages

ISBN:9781450392112

DOI:10.1145/3505270

Editors:
Kathrin Gerling
KU Leuven, Belgium
,
Jo Iacovides
University of York, UK
,
Rainer Malaka
University of Bremen, Germany
,
Beth Bonsignore
University of Maryland, College Park, USA
,
Julian Frommel
Utrecht University, The Netherlands

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2022

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

CHI PLAY '22

Sponsor:

SIGCHI

CHI PLAY '22: The Annual Symposium on Computer-Human Interaction in Play

November 2 - 5, 2022

Bremen, Germany

Acceptance Rates

Overall Acceptance Rate 421 of 1,386 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
137
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)2

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Журавчак ЛСеньків ВСеньків Н(2024)Реалізація багатокористувацької гри засобами рушія Unreal Engine 5Scientific Bulletin of UNFU10.36930/4034041234:4(93-101)Online publication date: 23-May-2024
https://doi.org/10.36930/40340412
Wührl CSchmid AHößl SWimmer R(2024)Comparing the Effectiveness and Ergonomics of Smartphone-Based GamepadsProceedings of Mensch und Computer 202410.1145/3670653.3670676(207-218)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670676
Samac AKovačević JPekez N(2024)Optimization of Immersive Audio Technologies Start-up Time in Home Theatre Environment2024 Zooming Innovation in Consumer Technologies Conference (ZINC)10.1109/ZINC61849.2024.10579403(199-203)Online publication date: 22-May-2024
https://doi.org/10.1109/ZINC61849.2024.10579403
Schmid ABierschneider MHoffmann JLiu YWimmer R(2023)Effects of Text Input Latency on Performance and Task LoadProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627784(99-107)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3627784

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents