Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Public Access

End-to-end Characterization of Game Streaming Applications on Mobile Platforms

Published: 28 February 2022 Publication History

Abstract

With the advent of 5G, supporting high-quality game streaming applications on edge devices has become a reality. This is evidenced by a recent surge in cloud gaming applications on mobile devices. In contrast to video streaming applications, interactive games require much more compute power for supporting improved rendering (such as 4K streaming) with the stipulated frames-per second (FPS) constraints. This in turn consumes more battery power in a power-constrained mobile device. Thus, the state-of-the-art gaming applications suffer from lower video quality (QoS) and/or energy efficiency. While there has been a plethora of recent works on optimizing game streaming applications, to our knowledge, there is no study that systematically investigates the <QoS, Energy> design pairs on the end-to-end game streaming pipeline across the cloud, network, and edge devices to understand the individual contributions of the different stages of the pipeline for improving the overall QoS and energy efficiency. In this context, this paper presents a comprehensive performance and power analysis of the entire game streaming pipeline consisting of the server/cloud side, network, and edge. Through extensive measurements with a high-end workstation mimicking the cloud end, an open-source platform (Moonlight-GameStreaming) emulating the edge device/mobile platform, and two network settings (WiFi and 5G) we conduct a detailed measurement-based study with seven representative games with different characteristics. We characterize the performance in terms of frame latency, QoS, bitrate, and energy consumption for different stages of the gaming pipeline. Our study shows that the rendering stage and the encoding stage at the cloud end are the bottlenecks to support 4K streaming. While 5G is certainly more suitable for supporting enhanced video quality with 4K streaming, it is more expensive in terms of power consumption compared to WiFi. Further, fluctuations in 5G network quality can lead to huge frame drops thus affecting QoS, which needs to be addressed by a coordinated design between the edge device and the server. Finally, the network interface and the decoder units in a mobile platform need more energy-efficient design to support high quality games at a lower cost. These observations should help in designing more cost-effective future cloud gaming platforms.

References

[1]
NVIDIA Corporation. 2021. GeForce Now . "https://www.nvidia.com/en-us/geforce-now/" .
[2]
Amazon.com, Inc. 2020. Amazon Luna . "https://www.amazon.com/luna/landing-page" .
[3]
Andrew Burnes. 2020. FrameView Performance and Power Benchmarking App: Free Download Available Now . "https://www.nvidia.com/en-us/geforce/news/nvidia-frameview-power-and-performance-benchmarking-app-download/" .
[4]
Amit Ahlawat Anju. 2016. Performance Analysis of Image Compression Technique. Image (2016), 107--111.
[5]
Anritsu. 2020. Measuring Path Loss of 5G FR2 Transmissions Through Common Materials Found in the Signal Path . "https://dl.cdn-anritsu.com/en-us/test-measurement/files/Application-Notes/Application-Note/11410-01189A.pdf" .
[6]
Niranjan Balasubramanian, Aruna Balasubramanian, and Arun Venkataramani. 2009. Energy Consumption in Mobile Phones: A Measurement Study and Implications for Network Applications. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement. Association for Computing Machinery, New York, NY, USA, 280--293.
[7]
Bethesda Softworks LLC. 2021. Skyrim . "https://elderscrolls.bethesda.net/en/skyrim" .
[8]
Bethesda Softworks LLC. 2022. Return to Castle Wolfenstein . "https://store.steampowered.com/app/9010/Return_to_Castle_Wolfenstein/" .
[9]
Bungie, Inc. 2021. Destiny 2 . "https://www.bungie.net/en/pub/aboutdestiny" .
[10]
Wei Cai, Zhen Hong, Xiaofei Wang, Henry C. B. Chan, and Victor C. M. Leung. 2015. Quality-of-Experience Optimization for a Cloud Gaming System With Ad Hoc Cloudlet Assistance. IEEE Transactions on Circuits and Systems for Video Technology (2015), 2092--2104.
[11]
Wei Cai, Ryan Shea, Chun-Ying Huang, Kuan-Ta Chen, Jiangchuan Liu, Victor C. M. Leung, and Cheng-Hsin Hsu. 2016. A Survey on Cloud Gaming: Future of Computer Games. IEEE Access (2016), 7605--7620.
[12]
Cameron Gutman, Diego Waxemberg, Aaron Neyer, Andrew Hennessy. 2013. Moonlight Android . "https://github.com/moonlight-stream/moonlight-android" .
[13]
Cameron Gutman, Diego Waxemberg, Aaron Neyer, Michelle Bergeron, Andrew Hennessy, Aidan Campbell. 2013. Moonlight . "https://moonlight-stream.org/" .
[14]
Cameron Gutman, Diego Waxemberg, Aaron Neyer, Michelle Bergeron, Andrew Hennessy, Aidan Campbell. 2021. Moonlight Internet Hosting Tool . "https://github.com/moonlight-stream/Internet-Hosting-Tool" .
[15]
Aaron Carroll and Gernot Heiser. 2010. An Analysis of Power Consumption in a Smartphone. In Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference. USENIX Association, USA, 21.
[16]
Kuan-Ta Chen, Yu-Chun Chang, Hwai-Jung Hsu, De-Yu Chen, Chun-Ying Huang, and Cheng-Hsin Hsu. 2014. On the Quality of Service of Cloud Gaming Systems. IEEE Transactions on Multimedia (2014), 480--495.
[17]
Nachiappan Chidambaram Nachiappan, Praveen Yedlapalli, Niranjan Soundararajan, Mahmut Taylan Kandemir, Anand Sivasubramaniam, and Chita R. Das. 2014. GemDroid: A Framework to Evaluate Mobile Platforms. In The 2014 ACM International Conference on Measurement and Modeling of Computer Systems . Association for Computing Machinery, New York, NY, USA, 355--366.
[18]
Philip A Chou and Zhourong Miao. 2006. Rate-distortion Optimized Streaming of Packetized Media . IEEE Transactions on Multimedia (2006), 390--404.
[19]
Dean Takahashi. 2021. Newzoo: Cloud gaming will reach 23.7M paying users and generate $1.6B in 2021 . "https://venturebeat.com/2021/08/26/newzoo-cloud-gaming-will-reach-23--7m-paying-users-and-generate-1--6b-in-2021/" .
[20]
Dror Gill. 2019. How To Cut Cloud Gaming Bitrates In Half So That Twice As Many Users Can Play . "https://blog.beamr.com/2019/11/19/how-to-cut-cloud-gaming-bitrates-in-half-so-that-twice-as-many-users-can-play/" .
[21]
Epic Games, Inc. 2021. Fortnite . "https://www.epicgames.com/fortnite/en-US/home" .
[22]
Fernando A. Fardo, Victor H. Conforto, Francisco C. de Oliveira, and Paulo S. Rodrigues. 2016. A Formal Evaluation of PSNR as Quality Measuremen Parameter for Image Segmentation Algorithms. CoRR (2016), arXiv:1605.07116.
[23]
Nick Feamster and Hari Balakrishnan. 2002. Packet Loss Recovery For Streaming Video. In 12th International Packet Video Workshop. PA: Pittsburgh, 9--16.
[24]
FFmpeg team. 2000. FFmpeg . "https://www.ffmpeg.org/" .
[25]
Sebastian Flinck Lindström, Markus Wetterberg, and Niklas Carlsson. 2020. Cloud Gaming: A QoE Study of Fast-paced Single-player and Multiplayer Gaming. In 2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC). 34--45.
[26]
Fredrik Fornwall. 2021. Termux . "https://termux.com/" .
[27]
Google. 2019. Stadia - One place for all the ways we play . "https://stadia.google.com/" .
[28]
Habtegebreil Haile, Karl-Johan Grinnemo, Simone Ferlin, Per Hurtig, and Anna Brunstrom. 2021. End-to-end Congestion Control Approaches for High Throughput and Low Delay in 4G/5G Cellular Networks . Computer Networks (2021), 107692.
[29]
Wenjie Hu and Guohong Cao. 2015. Energy-aware video streaming on smartphones. In 2015 IEEE Conference on Computer Communications (INFOCOM). Institute of Electrical and Electronics Engineers Inc., United States, 1185--1193.
[30]
Chun-Ying Huang, Kuan-Ta Chen, De-Yu Chen, Hwai-Jung Hsu, and Cheng-Hsin Hsu. 2014a. GamingAnywhere: The First Open Source Cloud Gaming System. ACM Trans. Multimedia Comput. Commun. Appl. (2014).
[31]
Chun-Ying Huang, Cheng-Hsin Hsu, Yu-Chun Chang, and Kuan-Ta Chen. 2013. GamingAnywhere: An Open Cloud Gaming System. In Proceedings of the 4th ACM Multimedia Systems Conference. Association for Computing Machinery, New York, NY, USA, 36--47.
[32]
Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014b. A Buffer-Based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proceedings of the 2014 ACM Conference on SIGCOMM. Association for Computing Machinery, New York, NY, USA, 187--198.
[33]
Yiming Huo, Xiaodai Dong, and Wei Xu. 2017. 5G Cellular User Equipment: From Theory to Practical Hardware Design . IEEE Access (2017), 13992--14010.
[34]
Mikel Irazabal Bengoa. 2021. Enhanced Quality of Service Mechanisms for 5G Networks . (2021).
[35]
Bart Jansen, Timothy Goodwin, Varun Gupta, Fernando Kuipers, and Gil Zussman. 2018. Performance Evaluation of WebRTC-Based Video Conferencing. SIGMETRICS Perform. Eval. Rev. (2018), 56--68.
[36]
Junchen Jiang, Vyas Sekar, and Hui Zhang. 2012. Improving Fairness, Efficiency, and Stability in HTTP-Based Adaptive Video Streaming with FESTIVE. In Proceedings of the 8th International Conference on Emerging Networking Experiments and Technologies . Association for Computing Machinery, New York, NY, USA, 97--108.
[37]
Julz. 2021. What's the Best Frame Rate for Gaming ? "https://www.build-gaming-computers.com/best-frame-rate-for-pc-gaming.html" .
[38]
Mark Kalman, Eckehard Steinbach, and Bernd Girod. 2002. Rate-distortion Optimized Video Streaming with Adaptive Playout. In Proceedings. International Conference on Image Processing. IEEE, III--III.
[39]
Kuba Kaszyk, Harry Wagstaff, Tom Spink, Björn Franke, Mike O'Boyle, Bruno Bodin, and Henrik Uhrenholt. 2019. Full-System Simulation of Mobile CPU/GPU Platforms. In 2019 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) . IEEE Computer Society, Los Alamitos, CA, USA, 68--78.
[40]
Kozakoff,Dennis J. and Corallo, Carlo A. and Petra, D. and Roovers, Wilhelmus Cornelus Wal. 2016. 5G Cellular Electromagnetic Window Considerations . "https://www.dsm.com/content/dam/dsm/dyneema/en_GB/Downloads/Researchpapers/5G_Cellular_article.pdf" .
[41]
KRAFTON, Inc. 2021. PUBG Mobile . "https://www.pubgmobile.com/en-US/home.shtml" .
[42]
KRAFTON, Inc. 2022. PUBG: Battlegrounds . "https://store.steampowered.com/app/578080/PUBG_BATTLEGROUNDS/" .
[43]
Xin Li, Mian Dong, Zhan Ma, and Felix C.A. Fernandes. 2012. GreenTube: Power Optimization for Mobile Videostreaming via Dynamic Cache Management. In Proceedings of the 20th ACM International Conference on Multimedia. Association for Computing Machinery, New York, NY, USA, 279--288.
[44]
Licidy. 2019. Known Issue: Performance Issues with Low FPS . "https://forums.ageofempires.com/t/known-issue-performance-issues-with-low-fps/60111" .
[45]
Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural Adaptive Video Streaming with Pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. Association for Computing Machinery, New York, NY, USA, 197--210.
[46]
Marshall Honorof. 2021. Can't find a PS5, Xbox Series X or GPU? Embrace it . "https://www.tomsguide.com/news/ps5-xbox-series-x-gpu-semiconductor-shortage" .
[47]
Microsoft. 2021 a. Age of Empires-uppercaseexpandafterromannumeral2: Definitive Edition. "https://www.ageofempires.com/games/aoeiide/" .
[48]
Microsoft. 2021 b. Age of Empires-uppercaseexpandafterromannumeral3: Definitive Edition. "https://www.ageofempires.com/games/aoeiiide" .
[49]
Microsoft. 2021 c. Xbox Cloud Gaming (Beta) with Xbox Game Pass . "https://www.xbox.com/en-US/xbox-game-pass/cloud-gaming" .
[50]
Mojang Studios. 2011. Minecraft . "https://www.minecraft.net/en-us" .
[51]
Mordor Intelligence. 2021. Cloud Gaming Market - Growth, Trends, COVID-19 Impact, and Forecasts (2021 - 2026) . "https://www.mordorintelligence.com/industry-reports/cloud-gaming-market" .
[52]
Motion Twin. 2021. Dead CellS . "https://dead-cells.com/" .
[53]
Nachiket Mhatre. 2021. Here's What Caused The Ongoing Global Chip Shortage & Why It Will Only Get Worse . "https://onsitego.com/blog/global-chip-shortage-explained-causes-future/" .
[54]
Arvind Narayanan, Xumiao Zhang, Ruiyang Zhu, Ahmad Hassan, Shuowei Jin, Xiao Zhu, Xiaoxuan Zhang, Denis Rybkin, Zhengxuan Yang, Zhuoqing Morley Mao, Feng Qian, and Zhi-Li Zhang. 2021. A Variegated Look at 5G in the Wild: Performance, Power, and QoE Implications. In Proceedings of the 2021 ACM SIGCOMM 2021 Conference (SIGCOMM '21). Association for Computing Machinery, New York, NY, USA, 610--625.
[55]
NVIDIA Corporation. 2019. An Introduction to the NVIDIA Optical Flow SDK . "https://developer.nvidia.com/blog/an-introduction-to-the-nvidia-optical-flow-sdk/" .
[56]
NVIDIA Corporation. 2021 a. GeForce Experience . "https://www.nvidia.com/en-us/geforce/geforce-experience/" .
[57]
NVIDIA Corporation. 2021 b. NVIDIA GameStream . "https://www.nvidia.com/en-us/shield/support/shield-tv/gamestream/" .
[58]
NVIDIA Corporation. 2021 c. ShadowPlay: Record, Share Game Videos & Screenshots . "https://www.nvidia.com/en-us/geforce/geforce-experience/shadowplay/" .
[59]
Opensignal. 2021. Opensignal - 5G, 4G, 3G Internet & WiFi Speed Test . "https://play.google.com/store/apps/details?id=com.staircase3.opensignal&hl=en_US&gl=US" .
[60]
Junho Park, Heechang Seong, Yong Nam Whang, and Wonbin Hong. 2019. Energy-efficient 5G Phased Arrays Incorporating Vertically Polarized Endfire Planar Folded Slot Antenna for mmWave Mobile Terminals . IEEE Transactions on Antennas and Propagation (2019), 230--241.
[61]
Pelham Smithers, Omri Wallach, Clayton Wodsworth. 2020. The Rise Of Gaming Revenue Visualized . "https://www.visualcapitalist.com/wp-content/uploads/2020/11/history-of-gaming-by-revenue-share-full-size.html" .
[62]
Oswaldo Sebastian Peñaherrera-Pulla, Carlos Baena, Sergio Fortes, Eduardo Baena, and Raquel Barco. 2021. Measuring Key Quality Indicators in Cloud Gaming: Framework and Assessment Over Wireless Networks. Sensors (2021).
[63]
Qualcomm Technologies Inc. 2018. First 5G mmWave Antenna Module for Smartphones . "https://www.microwavejournal.com/articles/31448-first-5g-mmwave-antenna-module-for-smartphones" .
[64]
Eman Ramadan, Arvind Narayanan, Udhaya Kumar Dayalan, Rostand AK Fezeu, Feng Qian, and Zhi-Li Zhang. 2021. Case for 5G-aware video streaming applications . In Proceedings of the 1st Workshop on 5G Measurements, Modeling, and Use Cases. Association for Computing Machinery, 27--34.
[65]
Sam Desatoff. 2021. Report: Cloud gaming market to reach $6.5 billion by 2024 (Newzoo) . "https://gamedaily.biz/article/2143/report-cloud-gaming-market-to-reach-65-billion-by-2024-newzoo" .
[66]
Aaron Schulman, Vishnu Navda, Ran Ramjee, Neil Spring, Pralhad Deshp, Calvin Grunewald, Kamal Jain, and Venkata N. Padmanabhan. 2010. Bartendr: A Practical Approach to Energy-aware Cellular Data Scheduling. In Proceedings of the Sixteenth Annual International Conference on Mobile Computing and Networking. Association for Computing Machinery, New York, NY, USA, 85--96.
[67]
Sony Interactive Entertainment LLC. 2021. PlayStation Now . "https://www.playstation.com/en-us/ps-now/" .
[68]
Kevin Spiteri, Rahul Urgaonkar, and Ramesh K. Sitaraman. 2016. BOLA: Near-optimal bitrate adaptation for online videos. In IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications . IEEE Press, 1--9.
[69]
Team Cherry. 2021. Hollow Knight . "https://www.hollowknight.com/" .
[70]
Ninad Warty, Ramanujan K. Sheshadri, Wei Zheng, and Dimitrios Koutsonikolas. 2012. A First Look at 802.11n Power Consumption in Smartphones. In Proceedings of the First ACM International Workshop on Practical Issues and Applications in next Generation Wireless Networks. Association for Computing Machinery, New York, NY, USA, 27--32.
[71]
Wikipedia Contributor. 2021. Games as a service . "https://en.wikipedia.org/wiki/Games_as_a_service" .
[72]
Dongzhu Xu, Anfu Zhou, Xinyu Zhang, Guixian Wang, Xi Liu, Congkai An, Yiming Shi, Liang Liu, and Huadong Ma. 2020. Understanding Operational 5G: A First Measurement Study on Its Coverage, Performance and Energy Consumption. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM '20). Association for Computing Machinery, New York, NY, USA, 479--494.
[73]
Hyunho Yeo, Chan Ju Chong, Youngmok Jung, Juncheol Ye, and Dongsu Han. 2020. NEMO: Enabling Neural-Enhanced Video Streaming on Commodity Mobile Devices. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking . Association for Computing Machinery, New York, NY, USA, bibinfonumpages14 pages.
[74]
Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication . Association for Computing Machinery, New York, NY, USA, 325--338.
[75]
Chanmin Yoon, Dongwon Kim, Wonwoo Jung, Chulkoo Kang, and Hojung Cha. 2012. AppScope: Application Energy Metering Framework for Android Smartphone Using Kernel Activity Monitoring. In 2012 USENIX Annual Technical Conference (USENIX ATC 12). USENIX Association, Boston, MA, 387--400.
[76]
ZeroTier, Inc. 2021. ZeroTier . "https://www.zerotier.com/" .
[77]
Haibo Zhang, Prasanna Venkatesh Rengasamy, Shulin Zhao, Nachiappan Chidambaram Nachiappan, Anand Sivasubramaniam, Mahmut T. Kandemir, Ravi Iyer, and Chita R. Das. 2017. Race-to-Sleep
[78]
Content Caching
[79]
Display Caching: A Recipe for Energy-Efficient Video Streaming on Handhelds. In Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture . Association for Computing Machinery, New York, NY, USA, 517--531.

Cited By

View all
  • (2024)Do Cloud Games Adapt to Client Settings and Network Conditions?2024 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking62109.2024.10619817(482-488)Online publication date: 3-Jun-2024
  • (2024)Incentive-Vacation Queueing for Edge Crowd ComputingIEEE Internet of Things Journal10.1109/JIOT.2023.334744211:8(13167-13179)Online publication date: 15-Apr-2024
  • (2024)GameStreamSR: Enabling Neural-Augmented Game Streaming on Commodity Mobile Platforms2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA)10.1109/ISCA59077.2024.00097(1309-1322)Online publication date: 29-Jun-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Measurement and Analysis of Computing Systems
Proceedings of the ACM on Measurement and Analysis of Computing Systems  Volume 6, Issue 1
POMACS
March 2022
695 pages
EISSN:2476-1249
DOI:10.1145/3522731
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 February 2022
Published in POMACS Volume 6, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 5g
  2. cloud gaming
  3. energy efficiency
  4. performance
  5. smartphones

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)418
  • Downloads (Last 6 weeks)52
Reflects downloads up to 07 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Do Cloud Games Adapt to Client Settings and Network Conditions?2024 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking62109.2024.10619817(482-488)Online publication date: 3-Jun-2024
  • (2024)Incentive-Vacation Queueing for Edge Crowd ComputingIEEE Internet of Things Journal10.1109/JIOT.2023.334744211:8(13167-13179)Online publication date: 15-Apr-2024
  • (2024)GameStreamSR: Enabling Neural-Augmented Game Streaming on Commodity Mobile Platforms2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA)10.1109/ISCA59077.2024.00097(1309-1322)Online publication date: 29-Jun-2024
  • (2022)Assessing Unsupervised Machine Learning Solutions for Anomaly Detection in Cloud Gaming SessionsProceedings of the 18th International Conference on Network and Service Management10.5555/3581644.3581714(1-7)Online publication date: 31-Oct-2022

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media