research-article

Nebula: Reliable Low-latency Video Transmission for Mobile Cloud Gaming

Authors:

Pan HuiAuthors Info & Claims

WWW '22: Proceedings of the ACM Web Conference 2022

Pages 3407 - 3417

https://doi.org/10.1145/3485447.3512276

Published: 25 April 2022 Publication History

Abstract

Mobile cloud gaming enables high-end games on constrained devices by streaming the game content from powerful servers through mobile networks. Mobile networks suffer from highly variable bandwidth, latency, and losses that affect the gaming experience. This paper introduces, an end-to-end cloud gaming framework to minimize the impact of network conditions on the user experience. relies on an end-to-end distortion model adapting the video source rate and the amount of frame-level redundancy based on the measured network conditions. As a result, it minimizes the motion-to-photon (MTP) latency while protecting the frames from losses. We fully implement and evaluate its performance against the state-of-the-art techniques and latest research in real-time mobile cloud gaming transmission on a physical testbed over emulated and real wireless networks. consistently balances MTP latency (<140 ms) and visual quality (>31dB) even in highly variable environments. A user experiment confirms that maximizes the user experience with high perceived video quality, playability, and low user load.

References

[1]

Jim Bankoski, Paul Wilkins, and Yaowu Xu. 2011. Technical overview of VP8, an open source video codec for the web. In 2011 IEEE International Conference on Multimedia and Expo. IEEE, Klagenfurt, Austria, 1–6. https://doi.org/10.1109/ICME.2011.6012227

Digital Library

[2]

James Bankoski, Paul Wilkins, and Yaowu Xu. 2011. VP8 data format and decoding guide. RFC 6386(2011), 1–304.

[3]

A. Bentaleb, B. Taani, A. C. Begen, C. Timmerer, and R. Zimmermann. 2019. A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP. IEEE Communications Surveys Tutorials 21, 1 (2019), 562–585. https://doi.org/10.1109/COMST.2018.2862938

[4]

Gaetano Carlucci, Luca De Cicco, Stefan Holmer, and Saverio Mascolo. 2016. Analysis and Design of the Google Congestion Control for Web Real-Time Communication (WebRTC). In Proceedings of the 7th International Conference on Multimedia Systems (Klagenfurt, Austria) (MMSys ’16). Association for Computing Machinery, New York, NY, USA, Article 13, 12 pages. https://doi.org/10.1145/2910017.2910605

Digital Library

[5]

Marc Carrascosa and Boris Bellalta. 2020. Cloud-gaming: Analysis of Google Stadia traffic. CoRR abs/2009.09786(2020), 1–15. arXiv:2009.09786https://arxiv.org/abs/2009.09786

[6]

De-Yu Chen and Magda El-Zarki. 2019. A Framework for Adaptive Residual Streaming for Single-Player Cloud Gaming. ACM Trans. Multimedia Comput. Commun. Appl. 15, 2s, Article 66 (July 2019), 23 pages. https://doi.org/10.1145/3336498

Digital Library

[7]

Kuan-Ta Chen, Yu-Chun Chang, Po-Han Tseng, Chun-Ying Huang, and Chin-Laung Lei. 2011. Measuring the Latency of Cloud Gaming Systems. In Proceedings of the 19th ACM International Conference on Multimedia (Scottsdale, Arizona, USA) (MM ’11). Association for Computing Machinery, New York, NY, USA, 1269–1272. https://doi.org/10.1145/2072298.2071991

Digital Library

[8]

Lorenzo Corneo, Maximilian Eder, Nitinder Mohan, Aleksandr Zavodovski, Suzan Bayhan, Walter Wong, Per Gunningberg, Jussi Kangasharju, and Jörg Ott. 2021. Surrounded by the Clouds: A Comprehensive Cloud Reachability Study. In Proceedings of the Web Conference 2021 (Ljubljana, Slovenia) (WWW ’21). Association for Computing Machinery, New York, NY, USA, 295–304. https://doi.org/10.1145/3442381.3449854

Digital Library

[9]

Andrea Di Domenico, Gianluca Perna, Martino Trevisan, Luca Vassio, and Danilo Giordano. 2021. A Network Analysis on Cloud Gaming: Stadia, GeForce Now and PSNow. Network 1, 3 (2021), 247–260. https://doi.org/10.3390/network1030015

[10]

K. Fouli, M. Médard, and K. Shroff. 2018. Coding the Network: Next Generation Coding for Flexible Network Operation. https://www.comsoc.org/publications/ctn/coding-network-next-generation-coding-flexible-network-operation

[11]

P. Frossard and O. Verscheure. 2001. Joint source/FEC rate selection for quality-optimal MPEG-2 video delivery. IEEE Transactions on Image Processing 10, 12 (2001), 1815–1825. https://doi.org/10.1109/83.974566

Digital Library

[12]

H. Fu, H. Yuan, M. Li, Z. Sun, and F. Li. 2016. Models and analysis of video streaming end-to-end distortion over LTE network. In 2016 IEEE 11th Conference on Industrial Electronics and Applications (ICIEA). IEEE, Hefei, China, 516–521. https://doi.org/10.1109/ICIEA.2016.7603638

[13]

Jim Gettys. 2011. Bufferbloat: Dark buffers in the internet. IEEE Internet Computing 15, 3 (2011), 96–96.

Digital Library

[14]

Dongyu Guo, Yiwen Han, Wei Cai, Xiaofei Wang, and Victor C. M. Leung. 2019. QoE-Oriented Resource Optimization for Mobile Cloud Gaming: A Potential Game Approach. In ICC 2019 - 2019 IEEE International Conference on Communications (ICC). IEEE, Shanghai, China, 1–6. https://doi.org/10.1109/ICC.2019.8761510

[15]

Sangtae Ha, Injong Rhee, and Lisong Xu. 2008. CUBIC: A New TCP-Friendly High-Speed TCP Variant. SIGOPS Oper. Syst. Rev. 42, 5 (July 2008), 64–74. https://doi.org/10.1145/1400097.1400105

Digital Library

[16]

Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908.

[17]

J Heide, S Shi, K Fouli, M Medard, and V Chook. 2018. Random linear network coding (rlnc)-based symbol representation. Working Draft, IETF Secretariat, Internet-Draft draft-heide-nwcrg-rlnc-02, July 2019 (2018).

[18]

Te-Yuan Huang, Ramesh Johari, and Nick McKeown. 2013. Downton Abbey without the Hiccups: Buffer-Based Rate Adaptation for HTTP Video Streaming. In Proceedings of the 2013 ACM SIGCOMM Workshop on Future Human-Centric Multimedia Networking (Hong Kong, China) (FhMN ’13). Association for Computing Machinery, New York, NY, USA, 9–14. https://doi.org/10.1145/2491172.2491179

Digital Library

[19]

Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014. A Buffer-Based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proceedings of the 2014 ACM Conference on SIGCOMM(Chicago, Illinois, USA) (SIGCOMM ’14). Association for Computing Machinery, New York, NY, USA, 187–198. https://doi.org/10.1145/2619239.2626296

Digital Library

[20]

Bart Jansen, Timothy Goodwin, Varun Gupta, Fernando Kuipers, and Gil Zussman. 2018. Performance evaluation of WebRTC-based video conferencing. ACM SIGMETRICS Performance Evaluation Review 45, 3 (2018), 56–68.

Digital Library

[21]

Kyungmin Lee, David Chu, Eduardo Cuervo, Johannes Kopf, Yury Degtyarev, Sergey Grizan, Alec Wolman, and Jason Flinn. 2015. Outatime: Using Speculation to Enable Low-Latency Continuous Interaction for Mobile Cloud Gaming. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services (Florence, Italy) (MobiSys ’15). Association for Computing Machinery, New York, NY, USA, 151–165. https://doi.org/10.1145/2742647.2742656

Digital Library

[22]

Shengmei Liu, Mark Claypool, Atsuo Kuwahara, Jamie Sherman, and James J Scovell. 2021. Lower is Better? The Effects of Local Latencies on Competitive First-Person Shooter Game Players. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 326, 12 pages. https://doi.org/10.1145/3411764.3445245

Digital Library

[23]

Matthew J. Luckie, Anthony J. McGregor, and Hans-Werner Braun. 2001. Towards Improving Packet Probing Techniques. In Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement (San Francisco, California, USA) (IMW ’01). Association for Computing Machinery, New York, NY, USA, 145–150. https://doi.org/10.1145/505202.505221

Digital Library

[24]

Morten V. Pedersen, Janus Heide, and Frank H. P. Fitzek. 2011. Kodo: An Open and Research Oriented Network Coding Library. In NETWORKING 2011 Workshops, Vicente Casares-Giner, Pietro Manzoni, and Ana Pont (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 145–152.

[25]

Pablo Pérez, Jesús Macías, Jaime J Ruiz, and Narciso García. 2011. Effect of packet loss in video quality of experience. Bell Labs Technical Journal 16, 1 (2011), 91–104.

Digital Library

[26]

Darijo Raca, Jason J. Quinlan, Ahmed H. Zahran, and Cormac J. Sreenan. 2018. Beyond Throughput: A 4G LTE Dataset with Channel and Context Metrics. In Proceedings of the 9th ACM Multimedia Systems Conference (Amsterdam, Netherlands) (MMSys ’18). Association for Computing Machinery, New York, NY, USA, 460–465. https://doi.org/10.1145/3204949.3208123

Digital Library

[27]

Evan James Williams. 1949. Experimental designs balanced for the estimation of residual effects of treatments. Australian Journal of Chemistry 2, 2 (1949), 149–168.

[28]

J. Wu, B. Cheng, C. Yuen, Y. Shang, and J. Chen. 2015. Distortion-Aware Concurrent Multipath Transfer for Mobile Video Streaming in Heterogeneous Wireless Networks. IEEE Transactions on Mobile Computing 14, 4 (2015), 688–701. https://doi.org/10.1109/TMC.2014.2334592

Digital Library

[29]

Jiyan Wu, Yanlei Shang, Jun Huang, Xue Zhang, Bo Cheng, and Junliang Chen. 2013. Joint source-channel coding and optimization for mobile video streaming in heterogeneous wireless networks. EURASIP Journal on Wireless Communications and Networking 2013, 1(2013), 283.

[30]

J. Wu, C. Yuen, and J. Chen. 2015. Leveraging the Delay-Friendliness of TCP With FEC Coding in Real-Time Video Communication. IEEE Transactions on Communications 63, 10 (2015), 3584–3599. https://doi.org/10.1109/TCOMM.2015.2469296

[31]

Jiyan Wu, Chau Yuen, Ngai-Man Cheung, Junliang Chen, and Chang Wen Chen. 2015. Enabling adaptive high-frame-rate video streaming in mobile cloud gaming applications. IEEE Transactions on Circuits and Systems for Video Technology 25, 12(2015), 1988–2001.

Digital Library

[32]

Jiyan Wu, Chau Yuen, Ngai-Man Cheung, Junliang Chen, and Chang Wen Chen. 2017. Streaming Mobile Cloud Gaming Video Over TCP With Adaptive Source-FEC Coding.IEEE Trans. Circuits Syst. Video Techn. 27, 1 (2017), 32–48.

Digital Library

[33]

J. Xiao, T. Tillo, C. Lin, and Y. Zhao. 2012. Dynamic Sub-GOP Forward Error Correction Code for Real-Time Video Applications. IEEE Transactions on Multimedia 14, 4 (2012), 1298–1308. https://doi.org/10.1109/TMM.2012.2194274

Digital Library

[34]

Jimin Xiao, Tammam Tillo, and Yao Zhao. 2013. Real-time video streaming using randomized expanding Reed–Solomon code. IEEE transactions on circuits and systems for video technology 23, 11(2013), 1825–1836.

Digital Library

[35]

C. Yu, Y. Xu, B. Liu, and Y. Liu. 2014. “Can you SEE me now?” A measurement study of mobile video calls. In IEEE INFOCOM 2014 - IEEE Conference on Computer Communications. IEEE, Toronto, ON, Canada, 1456–1464. https://doi.org/10.1109/INFOCOM.2014.6848080

[36]

Xunqi Yu, James W Modestino, Ragip Kurceren, and Yee Sin Chan. 2008. A model-based approach to evaluation of the efficacy of FEC coding in combating network packet losses. IEEE/ACM Transactions On Networking 16, 3 (2008), 628–641.

Digital Library

[37]

Pengyuan Zhou, Wenxiao Zhang, Tristan Braud, Pan Hui, and Jussi Kangasharju. 2018. ARVE: Augmented Reality Applications in Vehicle to Edge Networks. In Proceedings of the 2018 Workshop on Mobile Edge Communications (Budapest, Hungary) (MECOMM’18). Association for Computing Machinery, New York, NY, USA, 25–30. https://doi.org/10.1145/3229556.3229564

Digital Library

Cited By

Ishioka TFukui TFujiwara TNarikawa SFujihashi TSaruwatari SWatanabe T(2024)Traffic Reduction for Speculative Video Transmission in Cloud Gaming SystemsIEICE Transactions on Communications10.23919/transcom.2023EBP3108E107-B:5(408-418)Online publication date: May-2024
https://doi.org/10.23919/transcom.2023EBP3108
Xu CWang JLi RLi ZWu HWang J(2024)An Efficient FEC Scheme with SLA Consideration for Low Latency TransmissionsNOMS 2024-2024 IEEE Network Operations and Management Symposium10.1109/NOMS59830.2024.10575194(1-9)Online publication date: 6-May-2024
https://doi.org/10.1109/NOMS59830.2024.10575194
Afifi HPochaba SBoltres ALaniewski DHaberer JPaeleke LPoorzare RStolpmann DWehner NRedder ASamikwa ESeufert M(2024)Machine Learning With Computer Networks: Techniques, Datasets, and ModelsIEEE Access10.1109/ACCESS.2024.338446012(54673-54720)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3384460
Show More Cited By

Index Terms

Nebula: Reliable Low-latency Video Transmission for Mobile Cloud Gaming

Index terms have been assigned to the content through auto-classification.

Recommendations

Enhance the latency of mobile cloud gaming system

The Mobile Cloud Gaming (MCG) is a large network that comprises Cloud Computing and wireless network services. It is a network that provides online gaming services to mobile users. This paper proposes a model to enhance the existing MCG model by ...
To Cloud or Not to Cloud: Measuring the Performance of Mobile Gaming
MobiGames '15: Proceedings of the 2nd Workshop on Mobile Gaming

Mobile cloud gaming allows gamers to play games on resource-constrained mobile devices, and a measurement study to quantity the client performance and energy consumption is crucial to attract and retain gamers. In this paper, we adopt an open source ...
Low Bit-rate Mobile Cloud Gaming
MobiGames '16: Proceedings of the 3rd Workshop on Mobile Gaming

In mobile cloud gaming, high-quality, high-frame-rate game images of immense data-size need to be delivered to the clients under stringent delay requirement. For good gaming experience, reducing the transmission bit-rate of the game images is necessary. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '22: Proceedings of the ACM Web Conference 2022

April 2022

3764 pages

ISBN:9781450390965

DOI:10.1145/3485447

Editors:
Frédérique Laforest
INSA Lyon, France
,
Raphaël Troncy
EURECOM, France
,
Elena Simperl
King’s College London, UK
,
Deepak Agarwal
Pinterest, USA
,
Aristides Gionis
KTH Royal Institute of Technology, Sweden
,
Ivan Herman
W3C / retired
,
Lionel Médini
Université Lyon 1, France

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Research Grants Council of Hong Kong
Academy of Finland

Conference

WWW '22

Sponsor:

SIGWEB

WWW '22: The ACM Web Conference 2022

April 25 - 29, 2022

Virtual Event, Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
550
Total Downloads

Downloads (Last 12 months)220
Downloads (Last 6 weeks)6

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ishioka TFukui TFujiwara TNarikawa SFujihashi TSaruwatari SWatanabe T(2024)Traffic Reduction for Speculative Video Transmission in Cloud Gaming SystemsIEICE Transactions on Communications10.23919/transcom.2023EBP3108E107-B:5(408-418)Online publication date: May-2024
https://doi.org/10.23919/transcom.2023EBP3108
Xu CWang JLi RLi ZWu HWang J(2024)An Efficient FEC Scheme with SLA Consideration for Low Latency TransmissionsNOMS 2024-2024 IEEE Network Operations and Management Symposium10.1109/NOMS59830.2024.10575194(1-9)Online publication date: 6-May-2024
https://doi.org/10.1109/NOMS59830.2024.10575194
Afifi HPochaba SBoltres ALaniewski DHaberer JPaeleke LPoorzare RStolpmann DWehner NRedder ASamikwa ESeufert M(2024)Machine Learning With Computer Networks: Techniques, Datasets, and ModelsIEEE Access10.1109/ACCESS.2024.338446012(54673-54720)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3384460
Ishioka TFukui TFujiwara TNarikawa SFujihashi TSaruwatari SWatanabe T(2024)Pattern Reduction for Low-Traffic Speculative Video Transmission in Cloud Gaming SystemIEEE Access10.1109/ACCESS.2024.335243512(8902-8911)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3352435
Braud TLee LAlhilal AFernández CHui P(2023)DiOS—An Extended Reality Operating System for the MetaverseIEEE MultiMedia10.1109/MMUL.2022.321135130:2(70-80)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/MMUL.2022.3211351
Ansyar HWahid ALamada MParenreng J(2023)Implementation of Cloud gaming using the Chrome Remote Desktop Method2023 IEEE 8th International Conference on Recent Advances and Innovations in Engineering (ICRAIE)10.1109/ICRAIE59459.2023.10468414(1-6)Online publication date: 2-Dec-2023
https://doi.org/10.1109/ICRAIE59459.2023.10468414
Yu JAlhilal AZhou THui PTsang D(2023)QoE Optimization for VR Streaming: a Continual RL Framework in Digital Twin-empowered MECGLOBECOM 2023 - 2023 IEEE Global Communications Conference10.1109/GLOBECOM54140.2023.10437100(6249-6254)Online publication date: 4-Dec-2023
https://doi.org/10.1109/GLOBECOM54140.2023.10437100
Lam KYang LAlhilal ALee LTyson GHui PJiang SAizawa KChen PYanai K(2022)Human-Avatar Interaction in MetaverseProceedings of the 4th ACM International Conference on Multimedia in Asia10.1145/3551626.3564936(1-7)Online publication date: 13-Dec-2022
https://dl.acm.org/doi/10.1145/3551626.3564936

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents