research-article

Public Access

AViC: a cache for adaptive bitrate video

Authors:

Ramesh Govindan,

Emir Halepovic,

Subhabrata SenAuthors Info & Claims

CoNEXT '19: Proceedings of the 15th International Conference on Emerging Networking Experiments And Technologies

Pages 305 - 317

https://doi.org/10.1145/3359989.3365423

Published: 03 December 2019 Publication History

Abstract

Video dominates Internet traffic today. Users retrieve on-demand video from Content Delivery Networks (CDNs) which cache video chunks at front-ends. In this paper, we describe AViC, a caching algorithm that leverages properties of video delivery, such as request predictability and the presence of highly unpopular chunks. AViC's eviction policy exploits request predictability to estimate a chunk's future request time and evict the chunk with the furthest future request time. Its admission control policy uses a classifier to predict singletons --- chunks evicted before a second reference. Using real world CDN traces from a commercial video service, we show that AViC outperforms a range of algorithm including LRU, GDSF, AdaptSize and LHD. In particular LRU requires up to 3.5× the cache size to match AViC's performance. Further, AViC has low time complexity and has memory complexity comparable to GDSF.

References

[1]

AdaptSize. https://github.com/dasebe/webcachesim.

[2]

Dash Industry Forum: Dash.js. https://github.com/Dash-Industry-Forum/dash.js.

[3]

Golang. https://golang.org/.

[4]

Golang: Debugging performance issues in Go programs. https://github.com/golang/go/wiki/Performance.

[5]

Golang: runtime package. https://golang.org/pkg/runtime/.

[6]

JW Player. https://www.jwplayer.com/.

[7]

LHD. https://github.com/CMU-CORGI/LHD.

[8]

Sandvine: Global Internet phenomena report. https://www.sandvine.com/downloads/general/global-internet-phenomena/2014/2h-2014-global-internetphenomena-report.pdf.

[9]

Cisco: It Came to Me in a Stream... . https://www.cisco.com/web/about/ac79/docs/sp/Online-Video-Consumption_Consumers.pdf, 2012.

[10]

Cisco: Visual Networking Index: Global Mobile Data Traffic Forecast Update 2016-2021. http://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/mobile-white-paper-c11-520862.html, 2017.

[11]

Z. Akhtar, Y. S. Nam, J. Chen, R. Govindan, E. Katz-Bassett, S. Rao, J. Zhan, and H. Zhang. Understanding video management planes. In Proceedings of the Internet Measurement Conference 2018, IMC '18, 2018.

Digital Library

[12]

Z. Akhtar, Y. S. Nam, R. Govindan, S. Rao, J. Chen, E. Katz-Bassett, B. M. Ribeiro, J. Zhan, and H. Zhang. Oboe:Auto-tuning video ABR algorithms to network conditions. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication, SIGCOMM '18, 2018.

[13]

G. Ananthanarayanan, A. Ghodsi, A. Wang, D. Borthakur, S. Kandula, S. Shenker, and I. Stoica. Pacman: Coordinated memory caching for parallel jobs. In Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation, NSDI'12, 2012.

Digital Library

[14]

M. F. Arlitt and C. L. Williamson. Internet web servers: workload characterization and performance implications. 1997.

[15]

N. Beckmann, H. Chen, and A. Cidon. LHD: Improving Cache Hit Rate by Maximizing Hit Density. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18), 2018.

Digital Library

[16]

L. A. Belady. A study of replacement algorithms for a virtual-storage computer. IBM Syst. J., 1966.

[17]

D. S. Berger. Towards lightweight and robust machine learning for cdn caching. In Proceedings of the 17th ACM Workshop on Hot Topics in Networks, HotNets '18, 2018.

Digital Library

[18]

D. S. Berger, N. Beckmann, and M. Harchol-Balter. Practical bounds on optimal caching with variable object sizes. Proc. ACM Meas. Anal. Comput. Syst., 2018.

Digital Library

[19]

D. S. Berger, R. K. Sitaraman, and M. Harchol-Balter. Adaptsize: Orchestrating the Hot Object Memory Cache in a Content Delivery Network. In Proceedings of the 14th USENIX Conference on Networked Systems Design and Implementation, NSDI'17, 2017.

[20]

M. Calder, X. Fan, Z. Hu, E. Katz-Bassett, J. Heidemann, and R. Govindan. Mapping the Expansion of Google's Serving Infrastructure. In Proceedings of the 2013 Conference on Internet Measurement Conference, IMC '13, 2013.

Digital Library

[21]

P. Cao and S. Irani. Cost-aware WWW Proxy Caching Algorithms. In Proceedings of the USENIX Symposium on Internet Technologies and Systems on USENIX Symposium on Internet Technologies and Systems, USITS'97, 1997.

Digital Library

[22]

L. Cherkasova. Improving WWW Proxies Performance with Greedy-Dual-Size-Frequency Caching Policy. 1998.

[23]

E. G. Coffman and P. J. Denning. Operating Systems Theory (Prentice-Hall series in automatic computation). Prentice Hall, 1973.

[24]

C. R. Cunha, A. Bestavros, and M. E. Crovella. Characteristics of www client-based traces. 1995.

[25]

G. Einziger, R. Friedman, and B. Manes. TinyLFU: A Highly Efficient Cache Admission Policy. volume 13, Nov. 2017.

[26]

N. Gast and B. Van Houdt. Transient and steady-state regime of a family of list-based cache replacement algorithms. In Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS '15, 2015.

Digital Library

[27]

Q. Huang, K. Birman, R. van Renesse, W. Lloyd, S. Kumar, and H. C. Li. An analysis of facebook photo caching. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, SOSP '13, 2013.

Digital Library

[28]

T.-Y. Huang, R. Johari, N. McKeown, M. Trunnell, and M. Watson. A Buffer-based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proceedings of the ACM Conference on Special Interest Group on Data Communication, SIGCOMM, 2014.

Digital Library

[29]

S. Jain, A. Kumar, S. Mandal, J. Ong, L. Poutievski, A. Singh, S. Venkata, J. Wanderer, J. Zhou, M. Zhu, J. Zolla, U. Hölzle, S. Stuart, and A. Vahdat. B4: Experience with a globally-deployed software defined wan. SIGCOMM Comput. Commun. Rev., 43(4), Aug. 2013.

[30]

J. Jiang, V. Sekar, and H. Zhang. Improving Fairness, Efficiency, and Stability in HTTP-based Adaptive Video Streaming with FESTIVE. In Proceedings of the ACM International Conference on Emerging Networking Experiments and Technologies, CoNEXT, 2012.

Digital Library

[31]

G. Ke, Q. Meng, T. Finley, T. Wang, W. Chen, W. Ma, Q. Ye, and T.-Y. Liu. Lightgbm: A highly efficient gradient boosting decision tree. In Advances in Neural Information Processing Systems 30, 2017.

[32]

V. Kirilin, A. Sundarrajan, S. Gorinsky, and R. K. Sitaraman. Rl-cache: Learning-based cache admission for content delivery. In Proceedings of the 2019 Workshop on Network Meets AI & ML, NetAI'19, 2019.

Digital Library

[33]

D. Lee, J. Choi, J.-H. Kim, S. H. Noh, S. L. Min, Y. Cho, and C. S. Kim. On the existence of a spectrum of policies that subsumes the least recently used (lru) and least frequently used (lfu) policies. In Proceedings of the 1999 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, SIGMETRICS '99, 1999.

Digital Library

[34]

J. Liu and B. Li. A qos-based joint scheduling and caching algorithm for multimedia objects. World Wide Web, 2004.

[35]

H. Mao, R. Netravali, and M. Alizadeh. Neural Adaptive Video Streaming with Pensieve. In Proceedings of the ACM Conference on Special Interest Group on Data Communication, SIGCOMM, 2017.

Digital Library

[36]

N. Megiddo and D. S. Modha. ARC: A Self-Tuning, Low Overhead Replacement Cache. In Proceedings of the 2Nd USENIX Conference on File and Storage Technologies, FAST '03.

[37]

A. Narayanan, S. Verma, E. Ramadan, P. Babaie, and Z.-L. Zhang. Deepcache: A deep learning based framework for content caching. In Proceedings of the 2018 Workshop on Network Meets AI & ML, NetAI'18, 2018.

Digital Library

[38]

E. J. O'Neil, P. E. O'Neil, and G. Weikum. The LRU-K Page Replacement Algorithm for Database Disk Buffering. In Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, SIGMOD '93, 1993.

Digital Library

[39]

S.-H. Shen and A. Akella. An information-aware qoe-centric mobile video cache. In Proceedings of the 19th Annual International Conference on Mobile Computing & Networking, MobiCom '13, 2013.

Digital Library

[40]

K. Spiteri, R. Urgaonkar, and R. K. Sitaraman. BOLA: Near-optimal Bitrate Adaptation for Online Videos. In Proceedings of the IEEE International Conference on Computer Communications, INFOCOM, 2016.

[41]

K. Suksomboon, S. Tarnoi, Y. Ji, M. Koibuchi, K. Fukuda, S. Abe, M. Nakamura, M. Aoki, S. Urushidani, and S. Yamada. Popcache: Cache more or less based on content popularity for information-centric networking. 10 2013.

[42]

O. Verscheure, C. Venkatramani, P. Frossard, and L. Amini. Joint server scheduling and proxy caching for video delivery. Proceedings of WCW 2001, 2001.

[43]

X. Yin, A. Jindal, V. Sekar, and B. Sinopoli. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication, SIGCOMM '15, London, United Kingdom, 2015.

Digital Library

[44]

N. E. Young. The K-Server Dual and Loose Competitiveness for Paging. CoRR, cs.DS/0205044, 2002.

Cited By

Lekharu AGupta PSur APatra M(2024)Collaborative Video Caching in the Edge Network using Deep Reinforcement LearningACM Transactions on Internet of Things10.1145/36646135:3(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3664613
Chen TLin YChristianson NAkhtar ZDharmaji SHajiesmaili MWierman ASitaraman RSekar VYu MSeneviratne AVeitch D(2024)SODA: An Adaptive Bitrate Controller for Consistent High-Quality Video StreamingProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672260(613-644)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672260
Lekharu AChauhan ASur APatra M(2024)Reinforcement Learning-Based Adaptive Bitrate Caching at MEC ServerIEEE Transactions on Network and Service Management10.1109/TNSM.2024.336733321:3(3292-3304)Online publication date: Jun-2024
https://doi.org/10.1109/TNSM.2024.3367333
Show More Cited By

Index Terms

AViC: a cache for adaptive bitrate video
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia streaming
2. Theory of computation
  1. Design and analysis of algorithms
    1. Online algorithms
      1. Caching and paging algorithms

Recommendations

Criticality aware tiered cache hierarchy: a fundamental relook at multi-level cache hierarchies
ISCA '18: Proceedings of the 45th Annual International Symposium on Computer Architecture

On-die caches are a popular method to help hide the main memory latency. However, it is difficult to build large caches without substantially increasing their access latency, which in turn hurts performance. To overcome this difficulty, on-die caches ...
Modeling LRU cache with invalidation

Least Recently Used (LRU) is a very popular caching replacement policy. It is very easy to implement and offers good performance, especially when data requests are temporally correlated, as in the case of web traffic.When the data content can change ...
The evicted-address filter: a unified mechanism to address both cache pollution and thrashing
PACT '12: Proceedings of the 21st international conference on Parallel architectures and compilation techniques

Off-chip main memory has long been a bottleneck for system performance. With increasing memory pressure due to multiple on-chip cores, effective cache utilization is important. In a system with limited cache space, we would ideally like to prevent 1) ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '19: Proceedings of the 15th International Conference on Emerging Networking Experiments And Technologies

December 2019

395 pages

ISBN:9781450369985

DOI:10.1145/3359989

General Chairs:
Aziz Mohaisen
University of Central Florida
,
Zhi-Li Zhang
University of Minnesota

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

CoNEXT '19

Sponsor:

SIGCOMM

CoNEXT '19: The 15th International Conference on emerging Networking EXperiments and Technologies

December 9 - 12, 2019

Florida, Orlando

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
690
Total Downloads

Downloads (Last 12 months)124
Downloads (Last 6 weeks)19

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lekharu AGupta PSur APatra M(2024)Collaborative Video Caching in the Edge Network using Deep Reinforcement LearningACM Transactions on Internet of Things10.1145/36646135:3(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3664613
Chen TLin YChristianson NAkhtar ZDharmaji SHajiesmaili MWierman ASitaraman RSekar VYu MSeneviratne AVeitch D(2024)SODA: An Adaptive Bitrate Controller for Consistent High-Quality Video StreamingProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672260(613-644)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672260
Lekharu AChauhan ASur APatra M(2024)Reinforcement Learning-Based Adaptive Bitrate Caching at MEC ServerIEEE Transactions on Network and Service Management10.1109/TNSM.2024.336733321:3(3292-3304)Online publication date: Jun-2024
https://doi.org/10.1109/TNSM.2024.3367333
Cui LNi EZhou YWang ZZhang LLiu JXu Y(2023)Towards Real-Time Video Caching at Edge Servers: A Cost-Aware Deep Q-Learning SolutionIEEE Transactions on Multimedia10.1109/TMM.2021.312580325(302-314)Online publication date: 2023
https://doi.org/10.1109/TMM.2021.3125803
Li CWang XZong TCao HLiu Y(2023)Predictive edge caching through deep mining of sequential patterns in user content retrievalsComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2023.109866233:COnline publication date: 1-Sep-2023
https://dl.acm.org/doi/10.1016/j.comnet.2023.109866
Waheed TQazi IAkhtar ZQazi ZBianchi GMei A(2022)Coal not diamondsProceedings of the 18th International Conference on emerging Networking EXperiments and Technologies10.1145/3555050.3569120(307-320)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3555050.3569120
Einziger GEytan OFriedman RManes B(2022)Lightweight Robust Size Aware Cache ManagementACM Transactions on Storage10.1145/350792018:3(1-23)Online publication date: 24-Aug-2022
https://dl.acm.org/doi/10.1145/3507920
Chung JZacherek WWisniewski ALiu ZBicer TKettimuthu RFoster IWeissman JChandra AGavrilovska ATiwari D(2022)SciStreamProceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing10.1145/3502181.3531475(185-198)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3502181.3531475
Zhang CTan HLi GHan ZJiang SLi X(2022)Online File Caching in Latency-Sensitive Systems with Delayed Hits and BypassingIEEE INFOCOM 2022 - IEEE Conference on Computer Communications10.1109/INFOCOM48880.2022.9796969(1059-1068)Online publication date: 2-May-2022
https://doi.org/10.1109/INFOCOM48880.2022.9796969
Zhang ALi QChen YMa XZou LJiang YXu ZMuntean G(2021)Video Super-Resolution and Caching—An Edge-Assisted Adaptive Video Streaming SolutionIEEE Transactions on Broadcasting10.1109/TBC.2021.307101067:4(799-812)Online publication date: Dec-2021
https://doi.org/10.1109/TBC.2021.3071010
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents