research-article

A framework for network aware caching for video on demand systems

Authors:

Bogdan Carbunar,

Rahul Potharaju,

Michael Pearce,

Venugopal Vasudevan,

Michael NeedhamAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 9, Issue 4

Article No.: 30, Pages 1 - 22

https://doi.org/10.1145/2501643.2501652

Published: 19 August 2013 Publication History

Abstract

Video on Demand (VoD) services allow users to select and locally consume remotely stored content. We investigate the use of caching to solve the scalability issues of several existing VoD providers. We propose metrics and goals that define the requirements of a caching framework for CDNs of VoD systems. Using data logs collected from Motorola equipment from Comcast VoD deployments we show that several classic caching solutions do not satisfy the proposed goals. We address this issue by developing novel techniques for predicting future values of several metrics of interest. We rely on computed predictions to define the penalty imposed on the system, both network and caching sites, when not storing individual items. We use item penalties to devise novel caching and static content placement strategies. We use the previously mentioned data logs to validate our solutions and show that they satisfy all the defined goals.

Supplementary Material

Originally published uncorrected version of A Framework for Network Aware Caching for Video on Demand Systems (a30-carbunar-supp.pdf)

This is the original published article as published with errors. As of October 6, 2014 the Corrected Version of Record is available as the main PDF for this citation. The errata were also published separately in the September 2014 issue of TOMM as DOI=http://dx.doi.org/10.1145/2661298.

Download
1.31 MB

References

[1]

Adamson, B., Bormann, C., Handley, M., and Macker, J. 2009. NACK-oriented reliable multicast (NORM) transport protocol. Internet Engineering Task Force (IETF) RFC 5740.

[2]

Amble, M., Parag, P., Shakkottai, S., and Ying, L. 2011. Content aware caching and traffic management in content distribution networks. In Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies.

[3]

Borst, S. C., Gupta, V., and Walid, A. 2010. Distributed caching algorithms for content distribution networks. In Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies.

Digital Library

[4]

Cao, P. and Irani, S. 1997. Cost-aware WWW proxy caching algorithms. In Proceedings of the USENIX Symposium on Internet Technologies and Systems.

Digital Library

[5]

Carbunar, B., Potharaju, R., Pearce, M., and Vasudevan, V. 2012. Network aware caching for video on demand systems. In Proceedings of the 13th International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[6]

Dabek, F., Cox, R., Kaashoek, F., and Morris, R. 2004. Vivaldi: A decentralized network coordinate system. ACM SIGCOMM Comput. Comm. Rev. 34, 15--26.

Digital Library

[7]

Dahlin, M. D., Wang, R. Y., Anderson, T. E., and Patterson, D. A. 1994. Cooperative caching: using remote client memory to improve file system performance. In Proceedings of the 1st USENIX Symposium on Operating Systems Design and Implementation.

Digital Library

[8]

Kangasharju, J., Roberts, J. W., and Ross, K. W. 2002. Object replication strategies in content distribution networks. Comput. Commun. 25, 4.

Digital Library

[9]

Karlsson, M. and Mahalingam, M. 2002. Do we need replica placement algorithms in content delivery networks&quest; In Proceedings of the 7th International Web Content Caching and Distribution Workshop.

[10]

Laoutaris, N., Smaragdakis, G., Bestavros, A., Matta, I., and Stavrakakis, I. 2007. Distributed selfish caching. IEEE Trans. Parallel Distrib. Syst. 18, 10, 1361--1376.

Digital Library

[11]

Leff, A., Wolf, J. L., and Yu, P. S. 1993. Replication algorithms in a remote caching architecture. IEEE Trans. Parallel Distrib. Syst. 4, 11, 1185--1204.

Digital Library

[12]

Leong, B., Liskov, B., and Morris, R. 2007. Greedy virtual coordinates for geographic routing. In Proceedings of the IEEE International Conference on Network Protocols. IEEE, 71--80.

[13]

Miner, M. 2012. A new cable deal for Chicago. http://www.chicagoreader.com/Bleader/archives/2012/05/02/a-new-cable-deal-for-chicago.

[14]

Motorola. 2012a. B-1 Video Server. http://www.motorola.com/Video-Solutions/US-EN/Products-and-Services/Video-Infrastructure/On-Demand-Systems/B-1_US-EN.

[15]

Motorola. 2012b. B-3: Motorola expands on demand platform to enhance support for rapidly growing on demand libraries. http://mediacenter.motorola.com/content/Detail.aspx&quest;ReleaseID=10874&NewsAreaID=2.

[16]

Park, S.-H., Lim, E.-J., and Chung, K.-D. 2001. Popularity-based partial caching for vod systems using a proxy server. In Proceedings of the 15th International Parallel and Distributed Processing Symposium.

Digital Library

[17]

Qiu, L., Padmanabhan, V. N., and Voelker, G. M. 2001. On the placement of web server replicas. In Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies. 1587--1596.

[18]

Ramesh, S., Rhee, I., and Guo, K. 2001. Multicast with cache (mcache): An adaptive zero-delay video-on-demand service. In Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies. 85--94.

[19]

Ratnasamy, S., Francis, P., Handley, M., Karp, R., and Shenker, S. 2001. A scalable content-addressable network. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM'01). ACM, New York, 161--172.

Digital Library

[20]

Ratnasamy, S., Karp, B., Yin, L., Yu, F., Estrin, D., Govindan, R., and Shenker, S. 2002. GHT: A geographic hash table for data-centric storage. In Proceedings of the 1st ACM International Workshop on Wireless Sensor Networks and Applications (WSNA'02). ACM, New York, 78--87.

Digital Library

[21]

Rowstron, A. I. T. and Druschel, P. 2001. Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms. Springer, 329--350.

Digital Library

[22]

Sen, S., Rexford, J., and Towsley, D. 1999. Proxy prefix caching formultimedia streams. In Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies.

[23]

Sorento. Solution architectures for cable video-on-demand. Sorento Networks, http://www.cascaderange.org/presentations/Solution_Architectures_for_Cable_Video_on_Demand.pdf.

[24]

Stoica, I., Morris, R., Liben-Nowell, D., Karger, D. R., Kaashoek, M. F., Dabek, F., and Balakrishnan, H. 2003. Chord: A scalable peer-to-peer lookup protocol for internet applications. IEEE/ACM Trans. Netw. 11, 1, 17--32.

Digital Library

[25]

Thatcher, J., Coughlin, T., Handy, J., and Ekker, N. 2009. Nand flash solid state storage for the enterprise, an in-depth look at reliability. In Solid State Storage Initiative (SSSI) of the SNIA.

[26]

Wang, B., Sen, S., Adler, M., and Towsley, D. 2004. Optimal proxy cache allocation for efficient streaming media distribution. IEEE Trans. Multimedia.

Digital Library

[27]

Wauters, T., Coppens, J., De Turck, F., Dhoedt, B., and Demeester, P. 2006. Replica placement in ring based content delivery networks. Comput. Commun. 29, 16, 3313--3326.

Digital Library

[28]

Wu, K.-L., Yu, P. S., and Wolf, J. L. 2001. Segment-based proxy caching of multimedia streams. In Proceedings of the International World Wide Web Conference.

Digital Library

[29]

Wujuan, L., Yong, L. S., and Leong, Y. K. 2006. A client-assisted interval caching strategy for video-on-demand systems. Comput. Comm. 29, 18.

Digital Library

[30]

Zaman, S. and Grosu, D. 2011. A distributed algorithm for the replica placement problem. IEEE Trans. Parallel Distrib. Syst. 22, 9, 1455--1468.

Digital Library

[31]

Zhao, B., Kubiatowicz, J., and Joseph, A. 2001. Tapestry: An infrastructure for fault-tolerant wide-area location and routing. Tech. rep. UCB/CSD-01-1141, University of California, Berkeley.

Digital Library

[32]

Zhuo, J., Li, J., Wu, G., and Xu, S. 2008. Efficient cache placement scheme for clustered time-shifted tv servers. IEEE Trans. Consum. Electron. 54, 4, 1947--1955.

Digital Library

Cited By

Yadav PKar S(2024)A cost-efficient content distribution optimization model for fog-based content delivery networksJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-024-00695-913:1Online publication date: 17-Sep-2024
https://dl.acm.org/doi/10.1186/s13677-024-00695-9
Yadav PKar S(2020)Evaluating the Impact of Region Based Content Popularity of Videos on the Cost of CDN Deployment2020 National Conference on Communications (NCC)10.1109/NCC48643.2020.9056021(1-6)Online publication date: Feb-2020
https://doi.org/10.1109/NCC48643.2020.9056021
Ayoub OMusumeci FTornatore MPattavina A(2017)Techno-Economic Evaluation of CDN Deployments in Metropolitan Area Networks2017 International Conference on Networking and Network Applications (NaNA)10.1109/NaNA.2017.29(314-319)Online publication date: Oct-2017
https://doi.org/10.1109/NaNA.2017.29
Show More Cited By

Index Terms

A framework for network aware caching for video on demand systems
1. Hardware
  1. Integrated circuits
    1. Semiconductor memory
      1. Dynamic memory

Recommendations

Criticality aware tiered cache hierarchy: a fundamental relook at multi-level cache hierarchies
ISCA '18: Proceedings of the 45th Annual International Symposium on Computer Architecture

On-die caches are a popular method to help hide the main memory latency. However, it is difficult to build large caches without substantially increasing their access latency, which in turn hurts performance. To overcome this difficulty, on-die caches ...
Trace-Driven Analysis of ICN Caching Algorithms on Video-on-Demand Workloads
CoNEXT '14: Proceedings of the 10th ACM International on Conference on emerging Networking Experiments and Technologies

Even though a key driver for Information-Centric Networking (ICN) has been the rise in Internet video traffic, there has been surprisingly little work on analyzing the interplay between ICN and video ? which ICN caching strategies work well on video ...
On-line restricted caching
Special issue: On-line algorithm part I

We study the on-line caching problem in a restricted cache where each memory item can be placed in only a restricted subset of cache locations. Examples of restricted caches in practice include victim caches, assist caches, and skew caches. To the best ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 9, Issue 4

August 2013

168 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/2501643

Issue’s Table of Contents

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 August 2013

Accepted: 01 March 2013

Revised: 01 January 2013

Received: 01 October 2012

Published in TOMM Volume 9, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
333
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yadav PKar S(2024)A cost-efficient content distribution optimization model for fog-based content delivery networksJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-024-00695-913:1Online publication date: 17-Sep-2024
https://dl.acm.org/doi/10.1186/s13677-024-00695-9
Yadav PKar S(2020)Evaluating the Impact of Region Based Content Popularity of Videos on the Cost of CDN Deployment2020 National Conference on Communications (NCC)10.1109/NCC48643.2020.9056021(1-6)Online publication date: Feb-2020
https://doi.org/10.1109/NCC48643.2020.9056021
Ayoub OMusumeci FTornatore MPattavina A(2017)Techno-Economic Evaluation of CDN Deployments in Metropolitan Area Networks2017 International Conference on Networking and Network Applications (NaNA)10.1109/NaNA.2017.29(314-319)Online publication date: Oct-2017
https://doi.org/10.1109/NaNA.2017.29
Wang YShen YJiao XZhang TSi XSalem ALiu J(2017)Exploiting Content Delivery Networks for covert channel communicationsComputer Communications10.1016/j.comcom.2016.07.01199:C(84-92)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1016/j.comcom.2016.07.011
Antaris SRafailidis D(2015)Similarity Search over the Cloud Based on Image Descriptors' Dimensions Value CardinalitiesACM Transactions on Multimedia Computing, Communications, and Applications10.1145/271631511:4(1-23)Online publication date: 2-Jun-2015
https://dl.acm.org/doi/10.1145/2716315

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents