Abstract
In interactive digital media, such as video games, bringing about an adaptive or personalised experience requires a mechanism for correctly classifying or identifying the player style, before attempting to modify the experience in some way that improves player interest and immersion. This work presents a framework for solving this problem of in-game real time playstyle classification. We propose a hybrid probabilistic supervised learning approach, using Bayesian Inference informed by a K-Nearest Neighbors based likelihood, that is able to classify players in real time at every step within a given game level using only the latest player action or state observation. This improves on current approaches dependent on previous episodic player action trajectories in order to classify the player. Furthermore, we highlight the effect that this representation of the player state-action observation has on the in-game playstyle classification’s accuracy, prediction stability, and generalisability. We apply and test our framework using MiniDungeons, a rogue-like dungeon exploration game, and further evaluate our framework using a natural dataset containing human player action data from the platforming game Super Mario Bros. The experimental results obtained from our approach outperforms existing work in both domains. Furthermore, the evaluation results highlights the ability of our framework to generalise to unseen levels, without the need for additional retraining. Additionally, the Super Mario evaluation results illustrates the scalability of our framework to a more complex game environment with human player data.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bakkes, S., Spronck, P., Lankveld, G.V.: Player behavioural modelling for video games. Entertainment Comput. 3, 71–79 (2012). https://doi.org/10.1016/j.entcom.2011.12.001
Bontchev, B.: Holistic player modeling for controling adaptation in video games. In: Proceedings of the 14th International Conference e-Society 2016 (2016)
Charles, D., Black, M.: Dynamic player modelling: a framework for player-centred digital games. In: Proceedings of the International Conference on Computer Games: Artificial Intelligence, Design and Education (2004)
Gonzalez-Duque, M., Palm, R.B., Risi, S.: Fast game content adaptation through Bayesian-based player modelling. In: 2021 IEEE Conference on Games (CoG), pp. 01–08 (2021). https://doi.org/10.1109/CoG52621.2021.9619018
Gow, J., Baumgarten, R., Cairns, P., Colton, S., Miller, P.: Unsupervised modeling of player style with LDA. IEEE Trans. Comput. Intell. AI Games 4(3), 152–166 (2012). https://doi.org/10.1109/TCIAIG.2012.2213600
Guzdial, M., Riedl, M.O.: Game level generation from gameplay videos. In: Proceedings of the Twelfth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 12, pp. 44–50 (2016). https://aaai.org/ocs/index.php/AIIDE/AIIDE16/paper/view/14008/13593
Hernandez-Leal, P., Taylor, M.E., Rosman, B., Sucar, L.E., de Cote, E.M.: Identifying and tracking switching, non-stationary opponents: a Bayesian approach. In: AAAI Workshop: Multiagent Interaction without Prior Coordination (2016)
Holmgard, C., Liapis, A., Togelius, J., Yannakakis, G.: Monte-Carlo tree search for persona based player modeling. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 11, no. 5, pp. 8–14 (2021). https://ojs.aaai.org/index.php/AIIDE/article/view/12849
Holmgard, C., Liapis, A., Togelius, J., Yannakakis, G.N.: Evolving personas for player decision modeling. In: 2014 IEEE Conference on Computational Intelligence and Games, pp. 1–8 (2014). https://doi.org/10.1109/CIG.2014.6932911
Holmgård, C., Liapis, A., Togelius, J., Yannakakis, G.N.: Personas versus clones for player decision modeling. In: Pisan, Y., Sgouros, N.M., Marsh, T. (eds.) ICEC 2014. LNCS, vol. 8770, pp. 159–166. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-45212-7_20
Hunter, J.D.: Matplotlib: a 2D graphics environment. Comput. Sci. Eng. 9(3), 90–95 (2007). https://doi.org/10.1109/MCSE.2007.55
Iawasaki, Y., Hasebe, K.: Identifying playstyles in games with neat and clustering. In: 2021 IEEE Conference on Games (CoG), pp. 1–4 (2021). https://doi.org/10.1109/CoG52621.2021.9619024
Ingram, B.: Generating tailored advice in video games through play-style identification and player modelling. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 17, no. 1, pp. 228–231 (2021). https://ojs.aaai.org/index.php/AIIDE/article/view/18913
Ingram, B., Rosman, B., van Alten, C., Klein, R.: Play-style identification through deep unsupervised clustering of trajectories. In: 2022 IEEE Conference on Games (CoG), pp. 393–400 (2022). https://doi.org/10.1109/CoG51982.2022.9893680
Iwasaki, Y., Hasebe, K.: A framework for generating playstyles of game AI with clustering of play logs. In: Proceedings of the 14th International Conference on Agents and Artificial Intelligence, ICAART, vol. 3, pp. 605–612. INSTICC, SciTePress (2022). https://doi.org/10.5220/0010869500003116
Kodinariya, T., Makwana, P.: Review on determining of cluster in k-means clustering. Int. J. Adv. Res. Comput. Sci. Manag. Stud. 1, 90–95 (2013)
Normoyle, A., Jensen, S.: Bayesian clustering of player styles for multiplayer games. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 11, no. 1, pp. 163–169 (2021). https://ojs.aaai.org/index.php/AIIDE/article/view/12805
Pedersen, C., Togelius, J., Yannakakis, G.: Modeling player experience in super mario bros, pp. 132–139 (2009). https://doi.org/10.1109/CIG.2009.5286482
Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12 (2011)
Russell, S.J., Norvig, P.: Artificial Intelligence: A Modern Approach, 3rd edn. Pearson, London (2009)
Scott, G., Khosmood, F.: Complementary companion behavior in video games. Master’s thesis, School of Computer Science, California Polytechnic State University, San Luis Obispo (2017). https://digitalcommons.calpoly.edu/theses/1744. https://doi.org/10.15368/theses.2017.55. arXiv Short Paper Version https://arxiv.org/abs/1808.09079
Togelius, J., Nardi, R.D., Lucas, S.M.: Making racing fun through player modeling and track evolution (2006)
Tremblay, J., Verbrugge, C.: Adaptive companions in FPS games. In: FDG (2013)
Tychsen, A., Canossa, A.: Defining personas in games using metrics. In: Future Play (2008). https://doi.org/10.1145/1496984.1496997
Valls-Vargas, J., Ontañón, S., Zhu, J.: Exploring player trace segmentation for dynamic play style prediction. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 11, no. 1, pp. 93–99 (2021). https://ojs.aaai.org/index.php/AIIDE/article/view/12782
Waskom, M.L.: Seaborn: statistical data visualization. J. Open Source Softw. 6 (2021). https://doi.org/10.21105/joss.03021
Yannakakis, G., Spronck, P., Loiacono, D., Andre, E.: Player Modeling. Dagstuhl Follow-Ups, vol. 6, pp. 45–59. Dagstuhl Publishing (2013)
Zhang, M., Verbrugge, C.: Modelling player understanding of non-player character paths. In: Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, vol. 14, no. 1 (2018). https://dl.acm.org/doi/abs/10.5555/3505378.3505415
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Arendse, L.J., Ingram, B., Rosman, B. (2022). Real Time In-Game Playstyle Classification Using a Hybrid Probabilistic Supervised Learning Approach. In: Pillay, A., Jembere, E., Gerber, A. (eds) Artificial Intelligence Research. SACAIR 2022. Communications in Computer and Information Science, vol 1734. Springer, Cham. https://doi.org/10.1007/978-3-031-22321-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-22321-1_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-22320-4
Online ISBN: 978-3-031-22321-1
eBook Packages: Computer ScienceComputer Science (R0)