Abstract
The Cloud Gaming sector is burgeoning with an estimated annual growth of more than 50%, poised to reach a market value of $22 billion by 2030, and notably, GeForce Now, launched in 2020, reached 20 million users by August 2022. Cloud gaming presents cost-effective advantages for users and developers by eliminating hardware investments and game purchases, reducing development costs, and optimizing distribution efforts. However, it introduces challenges for network operators and providers, demanding low latency and substantial computational power. User satisfaction in cloud gaming depends on various factors, including game content, network type, and context, all shaping Quality of Experience. This study extends prior research, merging datasets from wired and mobile cloud gaming services to create an Expanded stacking model. All data gathering involves actual users engaging in gameplay within a realistic test environment, employing protocols akin to those utilized by the Geforce Now cloud gaming platform. Results indicate significant improvements in QoE estimation across different gaming contexts, highlighting the feasibility of a versatile predictive model for cloud gaming experiences, building upon previous stacking learning approaches.
Similar content being viewed by others
Data Availability
No datasets were generated or analysed during the current study.
Notes
We started the collection with GeForce Experience and Gamestream, but Nvidia ended support by February of 2023 [22]. We then switched to sunshine, an open source version of Gamestream that start development in 2020 [23]. We did several tests comparing the Gamestream and sunshine, and there is no lost/gain in performance.
References
Allied Market Research: Cloud Gaming Market Statistics: 2030. https://www.alliedmarketresearch.com/cloud-gaming-market-A07461. Accessed 22 May 2022.
Michael Kan: Nvidia GeForce Now Game Streaming Service Tops 20 Million users. https://www.pcmag.com/news/nvidias-geforce-now-game-streaming-service-tops-20-million-users. Accessed 19 Oct 2022.
Sabet, S.S., Schmidt, S., Zadtootaghaj, S., Griwodz, C., Moller, S.: Delay sensitivity classification of cloud gaming content. Int. Workshop Immers. Mixed Virtual Environ. Syst. (MMVE’20) (2020). https://doi.org/10.1145/3386293.3397116
Slivar, I., Skorin-Kapov, L., Suznjevic, M.: Cloud gaming qoe models for deriving video encoding adaptation strategies. Proc. 7th Int. Conf. Multimedia Syst. (2016). https://doi.org/10.1145/2910017.2910602
Cai, W., Hong, Z., Wang, X., Chan, H.C.B., Leung, V.C.M.: Quality-of-experience optimization for a cloud gaming system with ad hoc cloudlet assistance. IEEE Trans. Circuit Syst. Video Technol. 25(12), 2092–2104 (2015). https://doi.org/10.1109/TCSVT.2015.2450153
International Telecommunication Union: ITU-T P809: Subjective Evaluation Methods for Gaming Quality. https://www.itu.int/rec/T-REC-P.809/en. Accessed 22 May 2022.
Barman, N.: An objective and subjective quality assessment for passive gaming video streaming. PhD thesis, Kingston University London (2019)
Jarschel, M., Schlosser, D., Scheuring, S., Hossfeld, T.: An evaluation of QoE in cloud gaming based on subjective tests. 2011 Fifth Int. Conf. Innov. Mobile Internet Serv. Ubiquitous Comput. (2011). https://doi.org/10.1109/IMIS.2011.92
Soares, D., Carvalho, M., Macedo, D.F.: A stacking learning-based qoe model for cloud gaming. NOMS 2023-2023 IEEE/IFIP Network Oper. Manage. Symp. (2023). https://doi.org/10.1109/NOMS56928.2023.10154380
Carvalho, M., Soares, D., Macedo, D.F.: Transfer learning-based qoe estimation for different cloud gaming contexts. 2023 IEEE 9th Int. Conf. Network Softwar. (NetSoft) (2023). https://doi.org/10.1109/NetSoft57336.2023.10175441
Elwerghemmi, R., Heni, M., Ksantini, R., Bouallegue, R.: Online qoe prediction model based on stacked multiclass incremental support vector machine. 2019 8th Int. Conf. Model. Simul. Appl. Optim. (ICMSAO) (2019). https://doi.org/10.1109/ICMSAO.2019.8880302
Callet, P.L., Möller, S., Perkis, A.: Qualinet white paper on definitions of quality of experience. Eur. Network Quality Exp. Multimed. Syst. Services (COST Action IC 1003) 4(5), 2 (2012)
Casas, P., Seufert, M., Wehner, N., Schwind, A., Wamser, F.: Enhancing machine learning based qoe prediction by ensemble models. 2018 IEEE 38th Int. Conf. Distrib. Comput. Syst. (ICDCS) (2018). https://doi.org/10.1109/ICDCS.2018.00186
Ganaie, M.A., Hu, M., Malik, A.K., Tanveer, M., Suganthan, P.N.: Densemble deep learning: a review now. Eng. Appl. Artif. Intell. 115, 105151 (2022). https://doi.org/10.1016/j.engappai.2022.105151
Peñaherrera-Pulla, O.S., Baena, C., Fortes, S., Baena, E., Barco, R.: Measuring key quality indicators in cloud gaming: framework and assessment over wireless networks. Sensors (2021). https://doi.org/10.3390/s21041387
Slivar, I., Skorin-Kapov, L., Suznjevic, M.: Qoe-aware resource allocation for multiple cloud gaming users sharing a bottleneck link. 2019 22nd Conf. Innov. Clouds Internet Networks Workshops (ICIN) (2019). https://doi.org/10.1109/ICIN.2019.8685890
Rossi, H.S., Mitra, K., Åhlund, C., Cotanis, I., Örgen, N., Johansson, P.: Objective qoe models for cloud-based first person shooter game over mobile networks. 2024 IEEE 21st Consum. Commun. Network. Conf. (CCNC) (2024). https://doi.org/10.1109/CCNC51664.2024.10454666
Abar, T., Letaifa, A.B., El Asmi, S.: Real time anomaly detection-based qoe feature selection and ensemble learning for http video services. 2019 7th Int. Conf. ICT Access. (ICTA) (2019). https://doi.org/10.1109/ICTA49490.2019.9144867
Youssef, Y.B., Afif, M., Ksantini, R., Tabbane, S.: A novel qoe model based on boosting support vector regression. 2018 IEEE Wireless Commun. Network. Conf. (WCNC) (2018). https://doi.org/10.1109/WCNC.2018.8377092
Steam: Steam Hardware Survey. https://store.steampowered.com/hwsurvey/Steam-Hardware-Software-Survey-Welcome-to-Steam. Accessed 27 March 2020.
Moonlight: Moonlight. https://moonlight-stream.org/. Accessed 22 May 2024.
Nvidia: GameStream End of Service Notification. https://nvidia.custhelp.com/app/answers/detail/a_id/5436//gamestream-end-of-service-notification. Accessed 22 May 2024.
GitHub user LizardByte: Sunshine Documentation. https://docs.lizardbyte.dev/projects/sunshine/en/latest/. Accessed 19 Nov 2020.
Saif, A., Othman, M.: Network load and packet loss optimization during handoff using multi-scan approach. Int. Arab J. Inform. Technol. 8(1), 16 (2011)
Lundberg, S.M., Lee, S.-I.: A unified approach to interpreting model predictions. Adv. Neural Inform. Proc. Syst. 30, 4765–4774 (2017)
Sabet, S.S., Schmidt, S., Zadtootaghaj, S., Griwodz, C., Möller, S.: Delay sensitivity classification of cloud gaming content. Proc. 12th ACM Int. Workshop Immers. Mixed Virtual Environ. Syst. (2020). https://doi.org/10.1145/3386293.3397116
Catherine Gluckstein: Xbox Cloud gaming Growth and Evolution. https://news.xbox.com/en-us/2022/05/05/xbox-cloud-gaming-growth-and-evolution/. Accessed 22 May 2024.
Michael Harradence: Sony Confirms PS Now Has Reached 3.2 Million Subscribers up 2.2 Million Since Relaunch. https://www.psu.com/news/sony-confirms-ps-now/has-reached-3-2-million-subscribers-up-2-2-million-since-relaunch/. Accessed 22 May 2022.
Acknowledgements
This work was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior-Brasil (CAPES)-Finance Code 001, CNPq (funding agency from the Brazilian federal government), FAPEMIG (Minas Gerais State Funding Agency), and São Paulo Research Foundation (FAPESP) with Brazilian Internet Steering Committee (CGI.br), grants 2018/23097-3 and 2020/05182-3.
Author information
Authors and Affiliations
Contributions
Each of the three authors made equal contributions to this work. We engaged in collective discussions throughout the developmental phase of the article, collaborated on the writing process, and collectively reviewed each other's sections.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Soares, D., Carvalho, M. & Macedo, D.F. Enhancing Cloud Gaming QoE Estimation by Stacking Learning. J Netw Syst Manage 32, 58 (2024). https://doi.org/10.1007/s10922-024-09836-6
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10922-024-09836-6