research-article

Heuristic evaluation for games: usability principles for video game design

Authors:

Tadeusz StachAuthors Info & Claims

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1453 - 1462

https://doi.org/10.1145/1357054.1357282

Published: 06 April 2008 Publication History

Abstract

Most video games require constant interaction, so game designers must pay careful attention to usability issues. However, there are few formal methods for evaluating the usability of game interfaces. In this paper, we introduce a new set of heuristics that can be used to carry out usability inspections of video games. The heuristics were developed to help identify usability problems in both early and functional game prototypes. We developed the heuristics by analyzing PC game reviews from a popular gaming website, and the review set covered 108 different games and included 18 from each of 6 major game genres. We analyzed the reviews and identified twelve common classes of usability problems seen in games. We developed ten usability heuristics based on the problem categories, and they describe how common game usability problems can be avoided. A preliminary evaluation of the heuristics suggests that they help identify game-specific usability problems that can easily be overlooked otherwise.

References

[1]

Annett, J. and Duncan, K.D. Task analysis and training design. Occupational Psychology 12, (1967), 211--221.

[2]

Barr, P., Noble, J., and Biddle, R. Video game values: Human-computer interaction and games. In Journal of Interacting with Computers, 19, 2. (2007), 180--195.

Digital Library

[3]

Bias, R. Walkthroughs: Efficient collaborative testing. IEEE Software 8(5), (1991), 94--95.

Digital Library

[4]

Bias, R. The pluralistic usability walkthrough: coordinated empathies. In Usability Inspection Methods, Nielsen, J. and Mack, R.L., Eds. John Wiley& Sons, New York, (1994), 65--78.

Digital Library

[5]

Clanton, C. An Interpreted Demonstration of Computer Game Design. In Proc. CHI 1998, 1--2.

Digital Library

[6]

Cockton, G., and Woolrych, A. Sale must end: Should discount methods be cleared off HCI's shelves? interactions, 9(5) 2002, pp. 13--18.

Digital Library

[7]

Desurvire, H., Caplan, M., and Toth, J. A. Using heuristics to evaluate the playability of games. Ext. Abstracts CHI 2004, 1509--1512.

Digital Library

[8]

Dulin, R. Review of Druuna: Morbus Gravis, http://www.gamespot.com/pc/adventure/druunamorbusgravis/review.html, 2002.

[9]

Dyck, J., Pinelle, D., Brown, B., and Gutwin, C. Learning from Games: HCI Design Innovations in Entertainment Software. Proceedings of Graphics Interface 2003, pp. 237--246.

[10]

Dykstra, D.J. A Comparison of Heuristic Evaluation and Usability Testing: The Efficacy of a Domain-Specific Heuristic Checklist. Ph.D. dissertation, Department of Industrial Engineering, Texas A&M University, 1993.

[11]

Entertainment Software Association, Essential Facts about the Computer and Video Game Industry 2007, http://www.theesa.com/archives/2007/07/2007_essential.php.

[12]

Federoff, M. Heuristics and Usability Guidelines for the Creation and Evaluation of Fun in Video Games. Indiana University Master of Science Thesis, 2002.

[13]

Fullerton, T., Swain, C., Hoffman, S. Game Design Workshop: Designing, Prototyping, and Playtesting Games, CMP Books, 2004.

Digital Library

[14]

Goble, G. Review of Rugby 2004, http://www. gamespot.com/pc/sports/rugby2004/review.html, 2003.

[15]

Jeffries, R., Miller, J. R., Wharton, C., Uyeda, K.M. User interface evaluation in the real world: a comparison of four techniques. Proc. CHI '91, 119--124.

Digital Library

[16]

Johnson, C. G., and Jones, G. J. F., Effective Affective Communication in Virtual Environments. In Daniel Ballin (editor), Second Workshop on Intelligent Virtual Agents, (1999), 135--138.

[17]

Jørgensen, A. H., Marrying HCI/Usability and computer games: a preliminary look. In Proc. of NordiCHI, (2004), 393--396.

Digital Library

[18]

Karat, C., Campbell, R. L., and Fiegel, T. 1992. Comparison of empirical testing and walkthrough methods in user interface evaluation. In Proc. CHI 1992, 397--404.

Digital Library

[19]

Lewis, C., Polson, P., Wharton, C., and Rieman, J. Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces. In Proc. CHI 1990, 235--242.

Digital Library

[20]

Malone, T.W., Heuristics for designing enjoyable user interfaces: Lessons from computer games. In John C. Thomas and M. L. Schneider (editors), Human Factors in Computing Systems, Norwood, NJ: Ablex Publishing Corporation, 1982.

Digital Library

[21]

Mueller, G. Review of Eragon, http://www.gamespot. com/pc/action/eragon/review.html, 2006.

[22]

Mueller, G. Review of Mage Knight Apocalypse, http://www.gamespot.com/pc/rpg/mageknightapocalypse/review.html, 2006.

[23]

Nielsen, J. Enhancing the Explanatory Power of Usability Heuristics. In Proc. CHI 1994, 152--158.

Digital Library

[24]

Nielsen, J., and Mack, R.L. (Eds.), Usability Inspection Methods, John Wiley & Sons, New York, NY, 1994.

Digital Library

[25]

Nielsen, J. How to Conduct a Heuristic Evaluation. www.useit.com/papers/heuristic/heuristic_evaluation.html, 2007.

[26]

Nielsen, J. Severity Ratings for Usability Problems. http://www.useit.com/papers/heuristic/severityrating.html, 2007.

[27]

Ocampo, J. Review of Vietcong 2, http://www. gamespot.com/pc/action/vietcong2/review.html, 2005.

[28]

Parker, S. Review of Pax Romana, http://www. gamespot.com/pc/strategy/paxromana/review.html, 2004.

[29]

Polson, P., Lewis, C., Rieman, J., and Wharton, C. Cognitive walkthroughs: a method for theory-based evaluation of user interfaces. International Journal of Man-Machine Studies 36, (1992), 741--73.

Digital Library

[30]

Shepherd, A. Analysis and training in information technology tasks. In Task Analysis for Human-Computer Interaction, Diaper, D., Ed. Ellis Horwood, Chichester, (1989), 15--55.

[31]

Todd, B. Review of Paradise Cracked, http://www. gamespot.com/pc/rpg/paradisecracked/ review.html, 2003.

[32]

Todd, B. Review of Total Extreme Wrestling 2004, http://www.gamespot.com/pc/sports/totalextremewarfare/review.html, 2004.

[33]

Todd, B. Review of DMZ: North Korea, http://www. gamespot.com/pc/action/dmznorthkorea/review.html, 2007.

[34]

Todd, B. Review of Genesis Rising: The Universal Crusade, http://www.gamespot.com/pc/strategy/ genesisrising/review.html, 2007.

[35]

Todd, B. Review of Secrets of the Ark: A Broken Sword Game, http://www.gamespot.com/pc/adventure/ brokensword4/review.html, 2007.

[36]

Wolpaw, E. Review of Soldner: Secret Wars, http://www.gamespot.com/pc/action/soldnersecretwars/review.html, 2004.

Cited By

Barz NBenick MDörrenbächer-Ulrich LPerels F(2025)The evaluation of an educational game to promote pre-service teachers’ self-regulated learningEntertainment Computing10.1016/j.entcom.2024.10083652(100836)Online publication date: Jan-2025
https://doi.org/10.1016/j.entcom.2024.100836
JIKIHARA SINOUE HTETSUTANI N(2024)Research on Measures Against Occlusion for Improving Visibility in Video Gamesビデオゲームの視認性を向上するオクルージョン対策手法の検討Transactions of Japan Society of Kansei Engineering10.5057/jjske.TJSKE-D-23-0006423:1(61-68)Online publication date: 2024
https://doi.org/10.5057/jjske.TJSKE-D-23-00064
Feng ZSun SZeng QZheng L(2024)Design a Game for Eyes: Experiencing Eye Tracking as the Primary Control Mechanism in Slumber SuburbanProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3656972(1-4)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3656972
Show More Cited By

Index Terms

Heuristic evaluation for games: usability principles for video game design
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Using genres to customize usability evaluations of video games
Future Play '08: Proceedings of the 2008 Conference on Future Play: Research, Play, Share

Video games are varied, with vastly different visual layouts and interaction styles; however, most games that share a common genre still have many user interface similarities. These similarities suggest that genres can be used as a conceptual framework ...
Heuristic usability evaluation on games: a modular approach

Heuristic evaluation is the preferred method to assess usability in games when experts conduct this evaluation. Many heuristics guidelines have been proposed attending to specificities of games but they only focus on specific subsets of games or ...
Heuristics for Video Games Evaluation: How Players Rate Their Relevance for Different Game Genres According to Their Experience
IHM '13: Proceedings of the 25th Conference on l'Interaction Homme-Machine

This paper reports a study evaluating the relative relevance of evaluation heuristics for different game genres and players. 120 players (amateur or e-Sport players) were invited to assess the relevance of 47 heuristics for different game genre (Real ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2008

1870 pages

ISBN:9781605580111

DOI:10.1145/1357054

General Chairs:
Mary Czerwinski
Microsoft Research, USA
,
Arnie Lund
Microsoft, USA
,
Program Chair:
Desney Tan
Microsoft Research, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '08

Sponsor:

CHI '08: CHI Conference on Human Factors in Computing Systems

April 5 - 10, 2008

Florence, Italy

Acceptance Rates

CHI '08 Paper Acceptance Rate 157 of 714 submissions, 22%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

275
Total Citations
View Citations
10,881
Total Downloads

Downloads (Last 12 months)493
Downloads (Last 6 weeks)63

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Barz NBenick MDörrenbächer-Ulrich LPerels F(2025)The evaluation of an educational game to promote pre-service teachers’ self-regulated learningEntertainment Computing10.1016/j.entcom.2024.10083652(100836)Online publication date: Jan-2025
https://doi.org/10.1016/j.entcom.2024.100836
JIKIHARA SINOUE HTETSUTANI N(2024)Research on Measures Against Occlusion for Improving Visibility in Video Gamesビデオゲームの視認性を向上するオクルージョン対策手法の検討Transactions of Japan Society of Kansei Engineering10.5057/jjske.TJSKE-D-23-0006423:1(61-68)Online publication date: 2024
https://doi.org/10.5057/jjske.TJSKE-D-23-00064
Feng ZSun SZeng QZheng L(2024)Design a Game for Eyes: Experiencing Eye Tracking as the Primary Control Mechanism in Slumber SuburbanProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3656972(1-4)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3656972
Duan PWarner JLi YHartmann B(2024)Generating Automatic Feedback on UI Mockups with Large Language ModelsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642782(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642782
Rosa FGomes SMartinho C(2024)Exploring the Impact of Player Personality on Cooperative Game Reward Sharing2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645577(1-8)Online publication date: 5-Aug-2024
https://doi.org/10.1109/CoG60054.2024.10645577
P.K. PMittal AAggarwal ASingh NMantri A(2024)The COVID-19 fighter: an interactive learning platformInformation Discovery and Delivery10.1108/IDD-11-2022-0111Online publication date: 31-May-2024
https://doi.org/10.1108/IDD-11-2022-0111
Iyer RNdulue CMeier SOrji R(2024)Smartphone Games Heuristics (SmGH) – Towards a Standard Set of Platform-Centric Heuristic for Smartphone Games EvaluationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2356911(1-22)Online publication date: 11-Jun-2024
https://doi.org/10.1080/10447318.2024.2356911
Stratigakis IKatsanos CTso AKovaios DTsiatsos T(2024)EPICommunity Platform: Towards an Academic Social Network Designed for Researchers by ResearchersSocial Computing and Social Media10.1007/978-3-031-61305-0_14(201-218)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-61305-0_14
Palmquist AJedel IGoethe OPalmquist AJedel IGoethe O(2024)From Universal Design to Attainable Game ExperiencesUniversal Design in Video Games10.1007/978-3-031-30595-5_1(1-35)Online publication date: 23-Apr-2024
https://doi.org/10.1007/978-3-031-30595-5_1
Clegg BOrme RPetridis P(2023)Developing a Serious Game for Rail Services: Improving Passenger Information During Disruption (PIDD)Information10.3390/info1408046414:8(464)Online publication date: 17-Aug-2023
https://doi.org/10.3390/info14080464
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents