Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

VidCloud: Joint Stall and Quality Optimization for Video Streaming over Cloud

Published: 21 January 2021 Publication History

Abstract

As video-streaming services have expanded and improved, cloud-based video has evolved into a necessary feature of any successful business for reaching internal and external audiences. In this article, video streaming over distributed storage is considered where the video segments are encoded using an erasure code for better reliability. We consider a representative system architecture for a realistic (typical) content delivery network (CDN). Given multiple parallel streams/link between each server and the edge router, we need to determine, for each client request, the subset of servers to stream the video, as well as one of the parallel streams from each chosen server. To have this scheduling, this article proposes a two-stage probabilistic scheduling. The selection of video quality is also chosen with a certain probability distribution that is optimized in our algorithm. With these parameters, the playback time of video segments is determined by characterizing the download time of each coded chunk for each video segment. Using the playback times, a bound on the moment generating function of the stall duration is used to bound the mean stall duration. Based on this, we formulate an optimization problem to jointly optimize the convex combination of mean stall duration and average video quality for all requests, where the two-stage probabilistic scheduling, video quality selection, bandwidth split among parallel streams, and auxiliary bound parameters can be chosen. This non-convex problem is solved using an efficient iterative algorithm. Based on the offline version of our proposed algorithm, an online policy is developed where servers selection, quality, bandwidth split, and parallel streams are selected in an online manner. Experimental results show significant improvement in QoE metrics for cloud-based video as compared to the considered baselines.

References

[1]
V. Aggarwal, J. Fan, and T. Lan. 2017. Taming tail latency for erasure-coded, distributed storage systems. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOM’17).
[2]
V. Aggarwal, V. Gopalakrishnan, R. Jana, K. K. Ramakrishnan, and V. A. Vaishampayan. 2013. Optimizing cloud resources for delivering IPTV services through virtualization. IEEE Trans. Multimedia 15, 4 (June 2013), 789--801.
[3]
Vaneet Aggarwal and Tian Lan. 2016. Tail index for a distributed storage system with pareto file size distribution. arXiv:1607.06044. Retrieved from http://arxiv.org/abs/1607.06044
[4]
Vaneet Aggarwal and Tian Lan. 2020. Modeling and optimization of latency in erasure-coded storage systems. arXiv:2005.10855. Retrieved from https://arxiv.org/abs/2005.10855.
[5]
Abubakr Al-Abbasi, Vaneet Aggarwal, Tian Lan, Yu Xiang, Moo-Ryong Ra, and Yih-Farn Chen. 2019b. FastTrack: Minimizing stalls for CDN-based over-the-top video streaming systems. IEEE Trans. Cloud Comput. (2019).
[6]
A. O. Al-Abbasi and V. Aggarwal. 2018a. Mean latency optimization in erasure-coded distributed storage systems. In Proceedings of the IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS’18). 432--437.
[7]
A. O. Al-Abbasi and V. Aggarwal. 2018b. Stall-quality tradeoff for cloud-based video streaming. In 2018 International Conference on Signal Processing and Communications (SPCOM'18). 6--10.
[8]
A. O. Al-Abbasi and V. Aggarwal. 2018c. Video streaming in distributed erasure-coded storage systems: Stall duration analysis. IEEE/ACM Trans. Netw. 26, 4 (2018), 1921--1932.
[9]
A. O. Al-Abbasi, V. Aggarwal, and T. Lan. 2019. TTLoC: Taming tail latency for erasure-coded cloud storage systems. IEEE Trans. Netw. Serv. Manage. 16, 4 (Dec. 2019), 1609--1623.
[10]
Abubakr O. Al-Abbasi, Vaneet Aggarwal, and Moo-Ryong Ra. 2019a. Multi-tier caching analysis in CDN-based over-the-top video streaming systems. IEEE/ACM Trans. Netw. 27, 2 (2019), 835--847.
[11]
Barry C. Arnold. 2015. Pareto Distribution. Wiley StatsRef: Statistics Reference Online. 1--10.
[12]
F. Baccelli, A. Makowski, and A. Shwartz. 1989. The fork-join queue and related systems with synchronization constraints: Stochastic ordering and computable bounds. Advances in Applied Probability (1989), 629--660.
[13]
Ajay Badita, Parimal Parag, and Vaneet Aggarwal. 2020. Sequential addition of coded tasks for straggler mitigation. In IEEE International Conference on Computer Communications (INFOMCOM’20).
[14]
Amrit Singh Bedi, Ketan Rajawat, and Vaneet Aggarwal. 2019. Escaping saddle points with the successive convex approximation algorithm. arXiv:1903.01932. Retrieved from https://arxiv.org/abs/1903.01932.
[15]
Dorian Burihabwa, Pascal Felber, Hugues Mercier, and Valerio Schiavoni. 2016. A performance evaluation of erasure coding libraries for cloud-based data stores. In Proceedings of the IFIP International Conference on Distributed Applications and Interoperable Systems. Springer, 160--173.
[16]
Hong-Yi Chang, Kwei-Bor Chen, and Hsin-Che Lu. 2017. A novel resource allocation mechanism for live cloud-based video streaming service. Multimedia Tools Appl. 76, 19 (2017), 19689--19706.
[17]
Min Chen. 2012. AMVSC: A framework of adaptive mobile video streaming in the cloud. In Proceedings of the 2012 IEEE Global Communications Conference (GLOBECOM’12). IEEE, 2042--2047.
[18]
S. Chen, Y. Sun, U. C. Kozat, L. Huang, P. Sinha, G. Liang, X. Liu, and N. B. Shroff. 2014. When queuing meets coding: Optimal-latency data retrieving scheme in storage clouds. In Proceedings of IEEE International Conference on Computer Communications (INFOCOM’14).
[19]
J. Ciancutti. 2010. Four reasons we choose Amazon’s cloud as our computing platform. Netflix, Technical Report, The Netflix Tech Blog (2010).
[20]
Peter J. Denning and Ted G. Lewis. 2016. Exponential laws of computing growth. Commun. ACM 60, 1 (Dec. 2016), 54--65.
[21]
A. G. Dimakis, P. B. Godfrey, Y. Wu, M. J. Wainwright, and K. Ramchandran. 2010. Network coding for distributed storage systems. IEEE Trans. Inf. Theory 56, 9 (Sep. 2010), 4539--4551.
[22]
Anis Elgabli and Vaneet Aggarwal. 2020. FastScan: Robust low-complexity rate adaptation algorithm for video streaming over HTTP. IEEE Trans. Circuits Syst. Vid. Technol. 30, 7 (2020), 2240--2249.
[23]
Anis Elgabli, Vaneet Aggarwal, Shuai Hao, Feng Qian, and Subhabrata Sen. 2018. LBP: Robust rate adaptation algorithm for SVC video streaming. IEEE/ACM Trans. Netw. 26, 4 (2018), 1633--1645.
[24]
Andrew Fikes. 2010. Storage Architecture and Challenges (Talk at the Google Faculty Summit). Technical Report. http://bit.ly/nUylRW.
[25]
Jian He, Yonggang Wen, Jianwei Huang, and Di Wu. 2014. On the Cost–QoE tradeoff for cloud-based video streaming under Amazon EC2’s pricing models. IEEE Trans. Circ. Syst. Vid. Technol. 24, 4 (2014), 669--680.
[26]
Tim Hellemans and Benny Van Houdt. 2018. On the power-of-d-choices with least loaded server selection. Proc. ACM Meas. Anal. Comput. Syst. 2, 2 (2018), 27.
[27]
Cheng Huang, Huseyin Simitci, Yikang Xu, Aaron Ogus, Brad Calder, Parikshit Gopalan, Jin Li, and Sergey Yekhanin. 2012b. Erasure coding in windows azure storage. In Proceedings of the 2012 USENIX Conference on Annual Technical Conference (USENIX ATC’12). USENIX Association.
[28]
Longbo Huang, S. Pawar, Hao Zhang, and K. Ramchandran. 2012a. Codes can reduce queueing delay in data centers. In Proceedings of the IEEE International Symposium on Information Theory Proceedings (ISIT’12). 2766--2770.
[29]
Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2015. A buffer-based approach to rate adaptation: Evidence from a large video streaming service. ACM SIGCOMM Comput. Commun. Rev. 44, 4 (2015), 187--198.
[30]
Zixia Huang, Chao Mei, Li Erran Li, and Thomas Woo. 2011. CloudStream: Delivering high-quality streaming videos through a cloud-based SVC proxy. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOM’11). IEEE, 201--205.
[31]
Christian Kreuzberger, Daniel Posch, and Hermann Hellwagner. 2015. A scalable video coding dataset and toolchain for dynamic adaptive streaming over HTTP. In Proceedings of the 6th ACM Multimedia Systems Conference. ACM, 213--218.
[32]
Marek Kuczma. 2009. An Introduction to the Theory of Functional Equations and Inequalities: Cauchy’s Equation and Jensen’s Inequality. Springer Science 8 Business Media.
[33]
Kangwook Lee, Lisa Yan, Abhay Parekh, and Kannan Ramchandran. 2013. A VoD system for massively scaled, heterogeneous environments: Design and implementation. In Proceedings of the 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems. IEEE, 1--10.
[34]
Market-Research-Future. 2017. Global Cloud Video Streaming Market—Forecast 2023. Retrieved from https://www.marketresearchfuture.com/reports/cloud-video-streaming-market-4122.
[35]
Neel Oza and NB Gohil. 2016. Implementation of cloud based live streaming for surveillance. In Proceedings of the International Conference on Communication and Signal Processing (ICCSP’16). IEEE, 0996--0998.
[36]
Vaidyanathan Ramaswami, Kaustubh Jain, Rittwik Jana, and Vaneet Aggarwal. 2014. Modeling heavy tails in traffic sources for network performance evaluation. In Computational Intelligence, Cyber Security and Computational Models. Advances in Intelligent Systems and Computing, Vol. 246. Springer India, 23--44.
[37]
Maheswaran Sathiamoorthy, Megasthenis Asteris, Dimitris Papailiopoulos, Alexandros G. Dimakis, Ramkumar Vadali, Scott Chen, and Dhruba Borthakur. 2013. Xoring elephants: Novel erasure codes for big data. In Proceedings of the 39th International Conference on Very Large Data Bases.
[38]
Gesualdo Scutari, Francisco Facchinei, Lorenzo Lampariello, and Peiran Song. 2014. Parallel and distributed methods for nonconvex optimization. Part I: Theory. IEEE Trans. Signal Process (2014).
[39]
N. Shah, K. Lee, and K. Ramachandran. 2012. The MDS queue: Analyzing latency performance of codes and redundant requests. arXiv:1211.5405. Retrieved from https://arxiv.org/abs/1211.5405.
[40]
Nikita Dmitrievna Vvedenskaya, Roland L’vovich Dobrushin, and Fridrikh Izrailevich Karpelevich. 1996. Queueing system with selection of the shortest of two queues: An asymptotic approach. Probl. Peredachi Inf. 32, 1 (1996), 20--34.
[41]
Hakim Weatherspoon and John Kubiatowicz. 2002. Erasure coding Vs. replication: A quantitative comparison. In Revised Papers from the 1st International Workshop on Peer-to-Peer Systems (IPTPS’01). Springer-Verlag.
[42]
Y. Xiang, V. Aggarwal, Y. R. Chen, and T. Lan. 2019. Differentiated latency in data center networks with erasure coded files through traffic engineering. IEEE Trans. Cloud Comput. 7, 2 (Apr. 2019), 495--508.
[43]
Y. Xiang, T. Lan, V. Aggarwal, and Y. Chen. 2017. Optimizing differentiated latency in multi-tenant, erasure-coded storage. IEEE Trans. Netw. Serv. Manage. 14, 1 (Mar. 2017), 204--216.
[44]
Yu Xiang, Tian Lan, Vaneet Aggarwal, and Yih Farn R. Chen. 2014. Joint latency and cost optimization for erasure-coded data center storage. SIGMETRICS Perform. Eval. Rev. 42, 2 (Sep. 2014), 3--14.
[45]
Y. Xiang, T. Lan, V. Aggarwal, and Y. F. R. Chen. 2016. Joint latency and cost optimization for erasure-coded data center storage. IEEE/ACM Trans. Netw. 24, 4 (Aug. 2016), 2443--2457.
[46]
Lei Ying, R. Srikant, and Xiaohan Kang. 2015. The power of slightly more than one sample in randomized load balancing. In Proceedings of the IEEE Conference on Computer Communications (INFOCOM’15). IEEE, 1131--1139.
[47]
A. P. Zwart and Onno J. Boxma. 2000. Sojourn time asymptotics in the M/G/1 processor sharing queue. Que. Syst. 35, 1--4 (2000), 141--166.

Cited By

View all
  • (2022)Machine Translation of Scheduling Joint Optimization Algorithm in Japanese Passive StatisticsScientific Programming10.1155/2022/40558092022Online publication date: 1-Jan-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Modeling and Performance Evaluation of Computing Systems
ACM Transactions on Modeling and Performance Evaluation of Computing Systems  Volume 5, Issue 4
December 2020
85 pages
ISSN:2376-3639
EISSN:2376-3647
DOI:10.1145/3447813
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 January 2021
Accepted: 01 November 2020
Revised: 01 June 2020
Received: 01 August 2018
Published in TOMPECS Volume 5, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Video streaming over cloud
  2. erasure codes
  3. mean stall duration
  4. two-stage probabilistic scheduling
  5. video quality

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • National Science Foundation

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)160
  • Downloads (Last 6 weeks)26
Reflects downloads up to 01 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2022)Machine Translation of Scheduling Joint Optimization Algorithm in Japanese Passive StatisticsScientific Programming10.1155/2022/40558092022Online publication date: 1-Jan-2022

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media