Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3204949.3204957acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
research-article

Favor: fine-grained video rate adaptation

Published: 12 June 2018 Publication History

Abstract

Video rate adaptation has large impact on quality of experience (QoE). However, existing video rate adaptation is rather limited due to a small number of rate choices, which results in (i) under-selection, (ii) rate fluctuation, and (iii) frequent rebuffering. Moreover, selecting a single video rate for a 360° video can be even more limiting, since not all portions of a video frame are equally important. To address these limitations, we identify new dimensions to adapt user QoE - dropping video frames, slowing down video play rate, and adapting different portions in 360° videos. These new dimensions along with rate adaptation give us a more fine-grained adaptation and significantly improve user QoE. We further develop a simple yet effective learning strategy to automatically adapt the buffer reservation to avoid performance degradation beyond optimization horizon. We implement our approach Favor in VLC, a well known open source media player, and demonstrate that Favor on average out-performs Model Predictive Control (MPC), rate-based, and buffer-based adaptation for regular videos by 24%, 36%, and 41%, respectively, and 2X for 360° videos.

References

[1]
2017. Derf's test media collection. (2017). https://media.xiph.org/video/derf/
[2]
2017. Example Test Video. (2017). https://media.xiph.org/video/derf/y4m/720p50mobcalter.y4m
[3]
2017. FCC Dataset. (2017). https://www.fcc.gov/general/measuring-broadband-america/
[4]
2017. FFmpeg. (2017). https://ffmpeg.org/
[5]
2017. H264/AVC Reference Software. (2017). http://iphome.hhi.de/suehring/tml/
[6]
2017. HSDPA-bandwidth logs for mobile HTTP streaming scenarios. (2017). http://home.ifi.uio.no/paalh/dataset/hsdpa-tcp-logs/
[7]
2017. Youtube Bitrates. (2017). https://support.google.com/youtube/answer/2853702?hl=en
[8]
Hamed Ahmadi, Omar Eltobgy, and Mohamed Hefeeda. 2017. Adaptive Multicast Streaming of Virtual Reality Content to Mobile Users. In Proceedings of the on Thematic Workshops of ACM Multimedia 2017. ACM, 170--178.
[9]
Saamer Akhshabi, Ali C Begen, and Constantine Dovrolis. 2011. An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP. In Proceedings of the second annual ACM conference on Multimedia systems. ACM, 157--168.
[10]
Yueh-Lun Chang, Ting-Lan Lin, and Pamela C Cosman. 2012. Network-based H. 264/AVC whole-frame loss visibility model and frame dropping methods. IEEE Transactions on Image Processing 21, 8 (2012), 3353--3363.
[11]
Yanjiao Chen, Kaishun Wu, and Qian Zhang. 2015. From QoS to QoE: A tutorial on video quality assessment. IEEE Communications Surveys & Tutorials 17, 2 (2015), 1126--1165.
[12]
Hsiao-Chiang Chuang, ChingYao Huang, and Tihao Chiang. 2007. Content-aware adaptive media playout controls for wireless video streaming. IEEE Transactions on Multimedia 9, 6 (2007), 1273--1283.
[13]
Xavier Corbillon, Alisa Devlic, Gwendal Simon, and Jacob Chakareski. 2016. Viewport-adaptive navigable 360-degree video delivery. arXiv preprint arXiv: 1609.08042 (2016).
[14]
Florin Dobrian, Vyas Sekar, Asad Awan, Ion Stoica, Dilip Joseph, Aditya Ganjam, Jibin Zhan, and Hui Zhang. 2011. Understanding the impact of video quality on user engagement. In ACM SIGCOMM Computer Communication Review, Vol. 41. ACM, 362--373.
[15]
Timothy G Feeman. 2002. Portraits of the Earth: A mathematician looks at maps. Vol. 18. American Mathematical Soc.
[16]
Mario Graf, Christian Timmerer, and Christopher Mueller. 2017. Towards bandwidth efficient adaptive streaming of omnidirectional video over http: Design, implementation, and evaluation. In Proceedings of the 8th ACM on Multimedia Systems Conference. ACM, 261--271.
[17]
Ravindra Guntur and Wei Tsang Ooi. 2012. On tile assignment for region-of-interest video streaming in a wireless LAN. In Proceedings of the 22nd international workshop on Network and Operating System Support for Digital Audio and Video. ACM, 59--64.
[18]
Yashuang Guo, Qinghai Yang, F Richard Yu, and Victor CM Leung. 2017. Dynamic Quality Adaptation and Bandwidth Allocation for Adaptive Streaming Over Time-Varying Wireless Networks. IEEE Transactions on Wireless Communications 16, 12 (2017), 8077--8091.
[19]
Qi He, Constantine Dovrolis, and Mostafa Ammar. 2005. On the predictability of large transfer TCP throughput. In ACM SIGCOMM Computer Communication Review, Vol. 35. ACM, 145--156.
[20]
Mohammad Hosseini and Viswanathan Swaminathan. 2016. Adaptive 360 VR Video Streaming: Divide and Conquer! CoRR abs/1609.08729 (2016). arXiv: 1609.08729 http://arxiv.org/abs/1609.08729
[21]
Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2015. A buffer-based approach to rate adaptation: Evidence from a large video streaming service. ACM SIGCOMM Computer Communication Review 44, 4 (2015), 187--198.
[22]
Quan Huynh-Thu and Mohammed Ghanbari. 2006. Impact of jitter and jerkiness on perceived video quality. In Proc. Workshop on Video Processing and Quality Metrics.
[23]
Junchen Jiang, Vyas Sekar, and Hui Zhang. 2012. Improving fairness, efficiency, and stability in http-based adaptive video streaming with festive. In Proceedings of the 8th international conference on Emerging networking experiments and technologies. ACM, 97--108.
[24]
Ying Ju, Zhaoming Lu, Dabing Ling, Xiangming Wen, Wei Zheng, and Wenmin Ma. 2014. QoE-based cross-layer design for video applications over LTE. Multimedia tools and applications 72, 2 (2014), 1093--1113.
[25]
Mark Kaiman, Eckehard Steinbach, and Bernd Girod. 2004. Adaptive media play-out for low-delay video streaming over error-prone channels. IEEE Transactions on Circuits and Systems for Video Technology 14, 6 (2004), 841--851.
[26]
Amin Abdel Khalek, Constantine Caramanis, and Robert W Heath. 2015. Loss visibility optimized real-time video transmission over MIMO systems. IEEE Transactions on Multimedia 17, 10 (2015), 1802--1817.
[27]
Jirka Klaue et al. 2003. Evalvid-A framework for video transmission and quality evaluation. In Proc. of Springer TOOLS.
[28]
Robert Kuschnig, Ingo Kofler, and Hermann Hellwagner. 2010. An evaluation of TCP-based rate-control algorithms for adaptive Internet streaming of H.264/SVC. In Proceedings of the first annual ACM SIGMM conference on Multimedia systems. ACM, 157--168.
[29]
E Kuzyakov et al. 2016. Next-generation video encoding techniques for 360 video and VR. (2016). https://code.facebook.com/posts/1126354007399553/next-generation-video-encoding-techniques-for-360-video-and-vr/
[30]
Zhi Li, Xiaoqing Zhu, Joshua Gahm, Rong Pan, Hao Hu, Ali C Begen, and David Oran. 2014. Probe and adapt: Rate adaptation for HTTP video streaming at scale. IEEE Journal on Selected Areas in Communications 32, 4 (2014), 719--733.
[31]
Yi J Liang, Nikolaus Farber, and Bernd Girod. 2003. Adaptive playout scheduling and loss concealment for voice communication over IP networks. IEEE Transactions on Multimedia 5, 4 (2003), 532--543.
[32]
Ting-Lan Lin, Sandeep Kanumuri, Yuan Zhi, David Poole, Pamela C Cosman, and Amy R Reibman. 2010. A versatile model for packet loss visibility and its application to packet prioritization. IEEE Transactions on Image Processing 19, 3 (2010), 722--735.
[33]
Chenghao Liu, Imed Bouazizi, and Moncef Gabbouj. 2011. Rate adaptation for adaptive HTTP streaming. In Proceedings of the second annual ACM conference on Multimedia systems. ACM, 169--174.
[34]
Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural adaptive video streaming with pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. ACM, 197--210.
[35]
Sue B. Moon et al. 1998. Packet audio playout delay adjustment: performance bounds and algorithms. Multimedia Systems 6, 1 (1998), 17--28.
[36]
Miroslaw Narbutt, Andrew Kelly, Philip Perry, and Liam Murphy. 2005. Adaptive VoIP playout scheduling: assessing user satisfaction. IEEE Internet Computing 9, 4 (2005), 28--34.
[37]
Yen-Fu Ou, Yan Zhou, and Yao Wang. 2010. Perceptual quality of video with frame rate variation: A subjective study. In Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on. IEEE, 2446--2449.
[38]
Yen-Fu Ou et al. 2014. Perceptual Quality of Video with Periodic Frame Rate and Quantization Variation-Subjective Studies and Analytical Modeling. arXiv preprint arXiv:1406.2018 (2014).
[39]
Feng Qian, Lusheng Ji, Bo Han, and Vijay Gopalakrishnan. 2016. Optimizing 360 video delivery over cellular networks. In Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges. ACM, 1--6.
[40]
Yanyuan Qin, Ruofan Jin, Shuai Hao, Krishna R Pattipati, Feng Qian, Subhabrata Sen, Bing Wang, and Chaoqun Yue. 2017. A control theoretic approach to ABR video streaming: A fresh look at PID-based rate adaptation. In INFOCOM 2017-IEEE Conference on Computer Communications, IEEE. IEEE, 1--9.
[41]
Patrice Rondao Alface, Maarten Aerts, Donny Tytgat, Sammy Lievens, Christoph Stevens, Nico Verzijp, and Jean-Francois Macq. 2017. 16K Cinematic VR Streaming. In Proceedings of the 2017 ACM on Multimedia Conference. ACM, 1105--1112.
[42]
Dale E Seborg et al. {n. d.}. Process dynamics and control. John Wiley & Sons.
[43]
Sayandeep Sen, Syed Gilani, Shreesha Srinath, Stephen Schmitt, and Suman Banerjee. 2010. Design and implementation of an approximate communication system for wireless media applications. In ACM SIGCOMM Computer Communication Review, Vol. 40. ACM, 15--26.
[44]
Ya-Fan Su, Yi-Hsuan Yang, Meng-Ting Lu, and Homer H Chen. 2009. Smooth control of adaptive media playout for video streaming. IEEE transactions on multimedia 11, 7 (2009), 1331--1339.
[45]
Guibin Tian and Yong Liu. 2012. Towards agile and smooth video adaptation in dynamic HTTP streaming. In Proceedings of the 8th international conference on Emerging networking experiments and technologies. ACM, 109--120.
[46]
Denis Tikunov and Toshikazu Nishimura. 2007. Traffic prediction for mobile network using Holt-Winters exponential smoothing. In Software, Telecommunications and Computer Networks, 2007. SoftCOM 2007. 15th International Conference on. IEEE, 1--5.
[47]
Yao Wang, Zhenyu Wu, and Jill M Boyce. 2006. Modeling of transmission-loss-induced distortion in decoded video. IEEE Transactions on Circuits and Systems for Video Technology 16, 6 (2006), 716--732.
[48]
Siyuan Xiang, Min Xing, Lin Cai, and Jianping Pan. 2015. Dynamic rate adaptation for adaptive video streaming in wireless networks. Signal Processing: Image Communication 39 (2015), 305--315.
[49]
Xiufeng Xie and Xinyu Zhang. 2017. POI360: Panoramic Mobile Video Telephony over LTE Cellular Networks. In Proceedings of the 13th International Conference on emerging Networking Experiments and Technologies. ACM, 336--349.
[50]
Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A control-theoretic approach for dynamic adaptive video streaming over HTTP. ACM SIGCOMM Computer Communication Review 45, 4 (2015), 325--338.

Cited By

View all
  • (2024)OASISProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3647610(45-55)Online publication date: 15-Apr-2024
  • (2023)VRCT: A Viewport Reconstruction-Based 360° Video Caching Solution for Tile-Adaptive StreamingIEEE Transactions on Broadcasting10.1109/TBC.2023.327435069:3(691-703)Online publication date: Sep-2023
  • (2021)Time-Scalable Low-Latency Video Bitrate Adaptation2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW53276.2021.9455998(1-6)Online publication date: 5-Jul-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MMSys '18: Proceedings of the 9th ACM Multimedia Systems Conference
June 2018
604 pages
ISBN:9781450351928
DOI:10.1145/3204949
  • General Chair:
  • Pablo Cesar,
  • Program Chairs:
  • Michael Zink,
  • Niall Murray
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 June 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 360° videos
  2. rate adaptation
  3. video streaming

Qualifiers

  • Research-article

Conference

MMSys '18
Sponsor:
MMSys '18: 9th ACM Multimedia Systems Conference
June 12 - 15, 2018
Amsterdam, Netherlands

Acceptance Rates

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)OASISProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3647610(45-55)Online publication date: 15-Apr-2024
  • (2023)VRCT: A Viewport Reconstruction-Based 360° Video Caching Solution for Tile-Adaptive StreamingIEEE Transactions on Broadcasting10.1109/TBC.2023.327435069:3(691-703)Online publication date: Sep-2023
  • (2021)Time-Scalable Low-Latency Video Bitrate Adaptation2021 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW53276.2021.9455998(1-6)Online publication date: 5-Jul-2021
  • (2020)Adaptive Bitrate Streaming in Wireless Networks With Transcoding at Network Edge Using Deep Reinforcement LearningIEEE Transactions on Vehicular Technology10.1109/TVT.2020.296849869:4(3879-3892)Online publication date: Apr-2020
  • (2019)Dissecting the Performance of VR Video Streaming through the VR-EXP Experimentation PlatformACM Transactions on Multimedia Computing, Communications, and Applications10.1145/336028615:4(1-23)Online publication date: 16-Dec-2019
  • (2019)VantageProceedings of the ACM Special Interest Group on Data Communication10.1145/3341302.3342064(380-393)Online publication date: 19-Aug-2019
  • (2019)BETAProceedings of the 10th ACM Multimedia Systems Conference10.1145/3304109.3306235(98-109)Online publication date: 18-Jun-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media