research-article

ABR streaming of VBR-encoded videos: characterization, challenges, and solutions

Authors:

K. R. Pattipati,

Subhabrata Sen,

Chaoqun YueAuthors Info & Claims

CoNEXT '18: Proceedings of the 14th International Conference on emerging Networking EXperiments and Technologies

Pages 366 - 378

https://doi.org/10.1145/3281411.3281439

Published: 04 December 2018 Publication History

Abstract

Adaptive Bitrate (ABR) video streaming is widely used for over-the-top (OTT) video delivery. Recently, streaming providers have been moving towards using Variable Bitrate (VBR) encodings for the video content, spurred by the potential of improving user QoE (Quality of Experience) and reducing network bandwidth requirements compared to Constant Bitrate (CBR) encodings. However VBR introduces new challenges for ABR streaming, whose nature and implications are little understood. We explore these challenges across diverse video genres, encoding technologies, and platforms. We identify distinguishing characteristics of VBR encodings that impact user QoE and should be factored in any ABR adaptation decision. Traditional ABR adaptation strategies designed for the CBR case are not adequate for VBR. We develop novel best practice design principles to guide ABR rate adaptation for VBR encodings. As a proof of concept, we design a novel and practical control-theoretic rate adaptation scheme, CAVA (Control-theoretic Adaption for VBR-based ABR streaming), incorporating these concepts. Extensive evaluations show that CAVA substantially outperforms existing state-of-the-art adaptation techniques, validating the importance of these design principles.

Supplementary Material

MP4 File (p366-qin.mp4)

Download
261.40 MB

References

[1]

Zahaib Akhtar, Yun Seong Nam, Ramesh Govindan, Sanjay Rao, Jessica Chen, Ethan Katz-Bassett, Bruno Ribeiro, Jibin Zhan, and Hui Zhang. 2018. Oboe: auto-tuning video ABR algorithms to network conditions. In Sigcomm. ACM.

Digital Library

[2]

Apple. 2017. Apple's HTTP Live Streaming. https://goo.gl/eyDmBc. (2017).

[3]

Apple. 2017. HLS Authoring Specification for Apple Devices. (2017). https://goo.gl/kYrCW5

[4]

Karl Johan Åström and Richard M. Murray. 2008. Feedback Systems: An Introduction for Scientists and Engineers. Princeton University Press.

Digital Library

[5]

Chao Chen, Yao-Chung Lin, Anil Kokaram, and Steve Benting. 2017. Encoding Bitrate Optimization Using Playback Statistics for HTTP-based Adaptive Video Streaming. arXiv preprint arXiv:1709.08763 (2017).

[6]

J. Chen, R. Mahindra, M. A. Khojastepour, S. Rangarajan, and M. Chiang. 2013. A Scheduling Framework for Adaptive Video Delivery over Cellular Networks. In Proc. of ACM MobiCom.

Digital Library

[7]

Federico Chiariotti, Stefano D'Aronco, Laura Toni, and Pascal Frossard. 2016. Online Learning Adaptation Strategy for DASH Clients. In Proc. ACM Multimedia systems. ACM.

Digital Library

[8]

L. De Cicco, S. Mascolo, and V. Palmisano. 2011. Feedback Control for Adaptive Live Video Streaming. In Proc. of ACM MMSys.

Digital Library

[9]

Maxim Claeys, Steven LatrÃl' Jeroen Famaey, Tingyao Wu, Werner Van Leekwijck, and Filip De Turck. {n. d.}. Design and optimisation of a (FA)Q-learning-based HTTP adaptive streaming client. Connection Science 26, 1 ({n. d.}).

[10]

Federal Communications Commission. 2016. Measuring Fixed Broadband Report. https://goo.gl/STv4pg. (December 2016).

[11]

Jan De Cock, Aditya Mavlankar, Anush Moorthy, and Anne Aaron. 2016. A large-scale video codec comparison of x264, x265 and libvpx for practical VOD applications. In SPIE, Applications of Digital Image Processing.

[12]

Wolfgang Effelsberg, Otto Spaniol, André Danthine, and Domenico Ferrari. 1996. High-speed networking for multimedia applications. Springer.

[13]

FFmpeg. 2017. FFmpeg Project. https://www.ffmpeg.org/. (2017).

[14]

International Organization for Standardization. 2012. ISO/IEC DIS 23009-1.2 Dynamic adaptive streaming over HTTP (DASH). (2012).

[15]

DASH Industry Forum. 2017. Reference Client 2.4.1. https://goo.gl/XJcciV. (2017).

[16]

Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014. A buffer-based approach to rate adaptation: Evidence from a large video streaming service. In Proc. of ACM SIGCOMM.

Digital Library

[17]

MulticoreWare Inc. 2018. H.265 Video Codec. http://x265.org/hevc-h265/. (2018).

[18]

ITU. 2017. H.264 : Advanced video coding for generic audiovisual services. https://www.itu.int/rec/T-REC-H.264. (2017).

[19]

ITU-T P. 910. 2008. Subjective Video Quality Assessment Methods for Multimedia Applications. (2008).

[20]

Junchen Jiang, Vyas Sekar, and Hui Zhang. 2012. Improving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE. In Proc. of ACM CoNEXT.

Digital Library

[21]

Robert Kuschnig, Ingo Kofler, and Hermann Hellwagner. 2010. An evaluation of TCP-based rate-control algorithms for adaptive internet streaming of H.264/SVC. In Proc. ACM Multimedia systems.

Digital Library

[22]

TV Lakshman, Antonio Ortega, and Amy R Reibman. 1998. VBR video: Tradeoffs and potentials. Proc. IEEE (1998).

[23]

Zhi Li, Ali Begen, Joshua Gahm, Yufeng Shan, Bruce Osler, and David Oran. 2014. Streaming video over HTTP with consistent quality. In ACM MMSys.

Digital Library

[24]

J. Y. Lin, T.-J. Liu, E. C.-H. Wu, and C.-C. J. Kuo. 2014. A Fusion-based Video Quality Assessment (FVQA) Index. APSIPA Transactions on Signal and Information Processing (2014).

[25]

Yao-Chung Lin, Hugh Denman, and Anil Kokaram. 2015. Multipass encoding for reducing pulsing artifacts in cloud based video transcoding. In Image Processing (ICIP), 2015 IEEE International Conference on. IEEE, 907--911.

[26]

Linux. 2014. tc. https://linux.die.net/man/8/tc. (2014).

[27]

T.-J. Liu, J. Y. Lin, W. Lin, and C.-C. J. Kuo. 2013. Visual Quality Assessment: Recent Developments, Coding Applications and Future Trends. APSIPA Transactions on Signal and Information Processing (2013).

[28]

Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural Adaptive Video Streaming with Pensieve. In Proc. of ACM SIGCOMM.

Digital Library

[29]

Netflix. 2015. Per-Title Encode Optimization. https://goo.gl/hahDG4. (2015).

[30]

Netflix. 2016. VMAF score aggregation. https://github.com/Netflix/vmaf/issues/20. (2016).

[31]

Jan Ozer. 2017. Finding the Just Noticeable Difference with Netflix VMAF. https://goo.gl/TGWCGV. (September 2017).

[32]

Selenium Projects. 2017. Selenium Web Browser Automation. http://www.seleniumhq.org. (2017).

[33]

Yanyuan Qin, Ruofan Jin, Shuai Hao, Krishna R Pattipati, Feng Qian, Subhabrata Sen, Bing Wang, and Chaoqun Yue. 2017. A Control Theoretic Approach to ABR Video Streaming: A Fresh Look at PID-based Rate Adaptation. In INFOCOM.

[34]

Reza Rassool. 2017. VMAF reproducibility: Validating a perceptual practical video quality metric. In IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[35]

Andrew Reed and Benjamin Klimkowski. 2016. Leaky streams: Identifying variable bitrate DASH videos streamed over encrypted 802.11n connections. In Consumer Communications & Networking Conference. IEEE.

[36]

Werner Robitza. 2017. CRF Guide (Constant Rate Factor in x264 and x265). http://slhck.info/video/2017/02/24/crf-guide.html. (February 2017).

[37]

Kevin Spiteri, Ramesh Sitaraman, and Daniel Sparacio. 2018. From Theory to Practice: Improving Bitrate Adaptation in the DASH Reference Player (MMSys '18). ACM.

Digital Library

[38]

Kevin Spiteri, Rahul Urgaonkar, and Ramesh K Sitaraman. 2016. BOLA: Near-Optimal Bitrate Adaptation for Online Videos. In INFOCOM. IEEE.

[39]

Yi Sun, Xiaoqi Yin, Junchen Jiang, Vyas Sekar, Fuyuan Lin, Nanshu Wang, Tao Liu, and Bruno Sinopoli. 2016. CS2P: Improving video bitrate selection and adaptation with data-driven throughput prediction. In SIGCOMM. ACM.

Digital Library

[40]

Kiyotsugu Takaba. 2003. A tutorial on preview control systems. In SICE.

[41]

Guibin Tian and Yong Liu. 2012. Towards agile and smooth video adaptation in dynamic HTTP streaming. In Proc. of ACM CoNEXT.

Digital Library

[42]

Jeroen van der Hooft, Stefano Petrangeli, Maxim Claeys, Jeroen Famaey, and Filip De Turck. 2015. A learning-based algorithm for improved bandwidth-awareness of adaptive streaming clients. In IFIP/IEEE International Symposium on Integrated Network Management.

[43]

Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4 (2004).

Digital Library

[44]

Xiufeng Xie, Xinyu Zhang, Swarun Kumar, and Li Erran Li. 2015. piStream: Physical Layer Informed Adaptive Video Streaming Over LTE. In Proc. of ACM MobiCom.

Digital Library

[45]

Xiph.Org. 2016. Xiph.org Video Test Media. https://media.xiph.org/video/derf/. (2016).

[46]

Shichang Xu, Z. Morley Mao, Subhabrata Sen, and Yunhan Jia. 2017. Dissecting VOD Services for Cellular: Performance, Root Causes and Best Practices. In Proc. of IMC.

Digital Library

[47]

Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proc. of ACM SIGCOMM.

Digital Library

[48]

youtube-dl developers. 2018. youtube-dl. https://goo.gl/mgghW8. (2018).

[49]

Tong Zhang, Fengyuan Ren, Wenxue Cheng, Xiaohui Luo, Ran Shu, and Xiaolan Liu. 2017. Modeling and analyzing the influence of chunk size variation on bitrate adaptation in DASH. In INFOCOM. IEEE.

[50]

Li Zhi, Aaron Anne, Katsavounidis Ioannis, Moorthy Anush, and Manohara Megha. 2016. Toward A Practical Perceptual Video Quality Metric. (2016). https://medium.com/netflix-techblog/toward-a-practical-perceptual-video-quality-metric-653f208b9652

[51]

Xuan Kelvin Zou, Jeffrey Erman, Vijay Gopalakrishnan, Emir Halepovic, Rittwik Jana, Xin Jin, Jennifer Rexford, and Rakesh K. Sinha. 2015. Can Accurate Predictions Improve Video Streaming in Cellular Networks?. In Proc. of HotMobile.

Digital Library

Cited By

Park CShende CSen SWang B(2024)C2: ABR Streaming in Cognizant of Consumption Context for Improved QoE and Resource Usage TradeoffsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365251720:9(1-27)Online publication date: 16-Aug-2024
https://dl.acm.org/doi/10.1145/3652517
Zhao YWu QLv GYang FZhang JPeng FLiu YLi ZChen YGuo HXie GRizk AVega M(2024)JitBright: towards Low-Latency Mobile Cloud Rendering through Jitter Buffer OptimizationProceedings of the 34th edition of the Workshop on Network and Operating System Support for Digital Audio and Video10.1145/3651863.3651881(36-42)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3651863.3651881
Lv GWu QLiu YLi ZTan QYang FChen WMa YGuo HChen YXie GGanesan DShi W(2024)Chorus: Coordinating Mobile Multipath Scheduling and Adaptive Video StreamingProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649359(246-262)Online publication date: 29-May-2024
https://dl.acm.org/doi/10.1145/3636534.3649359
Show More Cited By

Index Terms

ABR streaming of VBR-encoded videos: characterization, challenges, and solutions
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia streaming

Recommendations

Performance of Low-Latency HTTP-based Streaming Players
MHV '23: Proceedings of the 2nd Mile-High Video Conference

Reducing end-to-end streaming latency is critical to HTTP-based live video streaming. There are currently two main technologies in this domain: Low-Latency HTTP Live Streaming (LL-HLS) and Low-Latency Dynamic Adaptive Streaming over HTTP (LL-DASH). ...
Improving QoE of ABR Streaming Sessions through QUIC Retransmissions
MM '18: Proceedings of the 26th ACM international conference on Multimedia

While adaptive bitrate (ABR) streaming has contributed significantly to the reduction of video playout stalling, ABR clients continue to suffer from the variation of bit rate qualities over the duration of a streaming session. Similar to stalling, these ...
DASH Streaming traffic influence over energy efficient ethernet to improve energy savings
Abstract
Dynamic Streaming over HTTP (DASH) is the main standard used in online video streaming services, given that more than 1.2 billion pay subscribers around the world use this standard. This fact entails billions of streaming connections ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '18: Proceedings of the 14th International Conference on emerging Networking EXperiments and Technologies

December 2018

408 pages

ISBN:9781450360807

DOI:10.1145/3281411

General Chairs:
Xenofontas Dimitropoulos
University of Crete and FORTH, Greece
,
Alberto Dainotti
CAIDA, University of California, San Diego
,
Program Chairs:
Laurent Vanbever
ETH Zurich, Switzerland
,
Theophilus Benson
Brown University

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 December 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Paper

Author Tags

Qualifiers

Research-article

Conference

CoNEXT '18

Sponsor:

SIGCOMM

CoNEXT '18: The 14th International Conference on emerging Networking EXperiments and Technologies

December 4 - 7, 2018

Heraklion, Greece

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

47
Total Citations
View Citations
1,046
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)4

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Park CShende CSen SWang B(2024)C2: ABR Streaming in Cognizant of Consumption Context for Improved QoE and Resource Usage TradeoffsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365251720:9(1-27)Online publication date: 16-Aug-2024
https://dl.acm.org/doi/10.1145/3652517
Zhao YWu QLv GYang FZhang JPeng FLiu YLi ZChen YGuo HXie GRizk AVega M(2024)JitBright: towards Low-Latency Mobile Cloud Rendering through Jitter Buffer OptimizationProceedings of the 34th edition of the Workshop on Network and Operating System Support for Digital Audio and Video10.1145/3651863.3651881(36-42)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3651863.3651881
Lv GWu QLiu YLi ZTan QYang FChen WMa YGuo HChen YXie GGanesan DShi W(2024)Chorus: Coordinating Mobile Multipath Scheduling and Adaptive Video StreamingProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649359(246-262)Online publication date: 29-May-2024
https://dl.acm.org/doi/10.1145/3636534.3649359
Lv GWu QTan QWang WLi ZXie G(2024)Accurate Throughput Prediction for Improving QoE in Mobile Adaptive StreamingIEEE Transactions on Mobile Computing10.1109/TMC.2023.3313592(1-18)Online publication date: 2024
https://doi.org/10.1109/TMC.2023.3313592
Li WHuang JLiu JJiang WWang J(2024)Learning Audio and Video Bitrate Selection Strategies via Explicit RequirementsIEEE Transactions on Mobile Computing10.1109/TMC.2023.326538023:4(2849-2863)Online publication date: Apr-2024
https://doi.org/10.1109/TMC.2023.3265380
Yang CZhou GHu MZhao QWu D(2024)CoarseUCB: A Context-Aware Bitrate Adaptation Algorithm for VBR-encoded Video Streaming2024 International Wireless Communications and Mobile Computing (IWCMC)10.1109/IWCMC61514.2024.10592326(592-597)Online publication date: 27-May-2024
https://doi.org/10.1109/IWCMC61514.2024.10592326
Li WHuang JSu QJiang WWang J(2024)A learning-based approach for video streaming over fluctuating networks with limited playback buffersComputer Communications10.1016/j.comcom.2023.11.027214(113-122)Online publication date: Jan-2024
https://doi.org/10.1016/j.comcom.2023.11.027
Li WHuang JLiang YLiu JZhang WLyu WWang J(2024)CAST: An Intricate-Scene Aware Adaptive Bitrate Approach for Video Streaming via Parallel TrainingAlgorithms and Architectures for Parallel Processing10.1007/978-981-97-0859-8_8(131-147)Online publication date: 27-Feb-2024
https://doi.org/10.1007/978-981-97-0859-8_8
Hu NWu HZhao HNi SCheng G(2024)Breaking Through the Diversity: Encrypted Video Identification Attack Based on QUIC FeaturesComputer Security – ESORICS 202410.1007/978-3-031-70903-6_9(166-186)Online publication date: 5-Sep-2024
https://doi.org/10.1007/978-3-031-70903-6_9
Wu RBao WGe LZhou BMostefaoui ASun P(2023)ASRSR: Adaptive Sending Resolution and Super-resolution for Real-time Video StreamingProceedings of the 19th ACM International Symposium on QoS and Security for Wireless and Mobile Networks10.1145/3616391.3622763(61-68)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3616391.3622763
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents