Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

PX-MBT: : A framework for model-based player experience testing

Published: 18 July 2024 Publication History

Abstract

As video games become more complex and widespread, player experience (PX) testing becomes crucial in the game industry. Attracting and retaining players are key elements to guarantee the success of a game in the highly competitive market. Although a number of techniques have been introduced to measure the emotional aspect of the experience, automated testing of player experience still needs to be explored. This paper presents PX-MBT, a framework for automated player experience testing with emotion pattern verification. PX-MBT (1) utilizes a model-based testing approach for test suite generation, (2) employs a computational model of emotions developed based on a psychological theory of emotions to model players' emotions during game-plays with an intelligent agent, and (3) verifies emotion patterns given by game designers on executed test suites to identify PX-issues. We explain PX-MBT architecture and provide an example along with its result in emotion pattern verification, which asserts the evolution of emotions over time, and heat-maps to showcase the spatial distribution of emotions on the game map.

References

[1]
X. Fang, S. Chan, J. Brzezinski, C. Nair, Development of an instrument to measure enjoyment of computer game play, Int. J. Hum.-Comput. Interact. 26 (9) (2010) 868–886.
[2]
K. Procci, A.R. Singer, K.R. Levy, C. Bowers, Measuring the flow experience of gamers: an evaluation of the dfs-2, Comput. Hum. Behav. 28 (6) (2012) 2306–2312.
[3]
C. Jennett, A.L. Cox, P. Cairns, S. Dhoparee, A. Epps, T. Tijs, A. Walton, Measuring and defining the experience of immersion in games, Int. J. Hum.-Comput. Stud. 66 (9) (2008) 641–661.
[4]
G.J. Myers, C. Sandler, T. Badgett, The Art of Software Testing, John Wiley & Sons, 2011.
[5]
A.P. Vermeeren, E.L.-C. Law, V. Roto, M. Obrist, J. Hoonhout, K. Väänänen-Vainio-Mattila, User experience evaluation methods: current state and development needs, in: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, 2010.
[6]
R. Alves, P. Valente, N.J. Nunes, The state of user experience evaluation practice, in: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, 2014, pp. 93–102.
[7]
C. Guckelsberger, C. Salge, J. Gow, P. Cairns, Predicting player experience without the player. an exploratory study, in: Proceedings of the Annual Symposium on Computer-Human Interaction in Play, 2017.
[8]
L.E. Nacke, Games user research and physiological game evaluation, in: Game User Experience Evaluation, Springer, 2015, pp. 63–86.
[9]
P. Mirza-Babaei, L.E. Nacke, J. Gregory, N. Collins, G. Fitzpatrick, How does it play better? Exploring user testing and biometric storyboards in games user research, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2013, pp. 1499–1508.
[10]
A. Ortony, G. Clore, A. Collins, The Cognitive Structure of Emotions, Cambridge University Press, Cambridge, England, 1988.
[11]
C.D. Elliott, The affective reasoner: a process model of emotions in a multiagent system, Ph.D. thesis Northwestern University, 1992.
[12]
C. Bartneck, Integrating the occ Model of Emotions in Embodied Characters, 2002.
[13]
W.S. Reilly, Believable social and emotional agents, Tech. Rep. Carnegie-Mellon Univ Pittsburgh pa Dept of Computer Science, 1996.
[14]
M. Ochs, C. Pelachaud, D. Sadek, An empathic virtual dialog agent to improve human-machine interaction, in: 7th International Joint Conference on Autonomous Agents and Multiagent Systems-Volume 1, 2008.
[15]
V. Demeure, R. Niewiadomski, C. Pelachaud, How is believability of a virtual agent related to warmth, competence, personification, and embodiment?, Presence 20 (5) (2011) 431–448.
[16]
L. Nacke, C.A. Lindley, Flow and immersion in first-person shooters: measuring the player's gameplay experience, in: Proceedings of the 2008 Conference on Future Play: Research, Play, Share, 2008, pp. 81–88.
[17]
P. Desmet, P. Hekkert, Framework of product experience, Int. J. Des. 1 (1) (2007).
[18]
S.G. Ansari, Toward automated assessment of user experience in extended reality, in: 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST), IEEE, 2020, pp. 430–432.
[19]
S.G. Ansari, I.S.W.B. Prasetya, M. Dastani, F. Dignum, G. Keller, An appraisal transition system for event-driven emotions in agent-based player experience testing, in: 9th International Workshop on Engineering Multi-Agent Systems (EMAS), Revised Selected Papers, Springer Nature, 2021.
[20]
R. Ferdous, C.-k. Hung, F. Kifetew, D. Prandi, A. Susi, Evombt: evolutionary model based testing, Sci. Comput. Program. 227 (2023).
[21]
A. Panichella, F.M. Kifetew, P. Tonella, Automated test case generation as a many-objective optimisation problem with dynamic selection of the targets, IEEE Trans. Softw. Eng. 44 (2) (2017).
[22]
C. Baier, J.-P. Katoen, Principles of Model Checking, MIT Press, 2008.
[23]
J. Callahan, F. Schneider, S. Easterbrook, et al., Automated Software Testing Using Model-Checking, Proceedings 1996 SPIN Workshop, vol. 353, Citeseer, 1996.
[24]
S.G. Ansari, I. Prasetya, D. Prandi, F.M. Kifetew, M. Dastani, F. Dignum, G. Keller, Model-based player experience testing with emotion pattern verification, in: International Conference on Fundamental Approaches to Software Engineering, Springer Nature, 2023.
[25]
I. Prasetya, M. Dastani, R. Prada, T.E. Vos, F. Dignum, F. Kifetew, Aplib: tactical agents for testing computer games, in: International Workshop on Engineering Multi-Agent Systems, Springer, 2020.
[26]
R. Ferdous, F. Kifetew, D. Prandi, A. Susi, Towards agent-based testing of 3D games using reinforcement learning, in: 37th IEEE/ACM International Conference on Automated Software Engineering, 2022.
[27]
M. Kwiatkowska, G. Norman, D. Parker, Prism: probabilistic symbolic model checker, in: International Conference on Modelling Techniques and Tools for Computer Performance Evaluation, Springer, 2002.
[28]
R. Hebig, C. Seidl, T. Berger, J.K. Pedersen, A. Wasowski, Model transformation languages under a magnifying glass: a controlled experiment with Xtend, ATL, and QVT, in: 26th ESEC/FSE, 2018.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Science of Computer Programming
Science of Computer Programming  Volume 236, Issue C
Sep 2024
300 pages

Publisher

Elsevier North-Holland, Inc.

United States

Publication History

Published: 18 July 2024

Author Tags

  1. PX testing
  2. Emotion modeling
  3. Model-based testing
  4. Agent-based testing

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Nov 2024

Other Metrics

Citations

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media