research-article

Free access

A content propagation metric for efficient content distribution

Authors:

Ryan S. Peterson,

Emin Gun SirerAuthors Info & Claims

SIGCOMM '11: Proceedings of the ACM SIGCOMM 2011 conference

Pages 326 - 337

https://doi.org/10.1145/2018436.2018474

Published: 15 August 2011 Publication History

Abstract

Efficient content distribution in large networks comprising datacenters, end hosts, and distributed in-network caches is a difficult problem. Existing systems rely on mechanisms and metrics that fail to effectively utilize all available sources of bandwidth in the network. This paper presents a novel metric, called the Content Propagation Metric (CPM), for quantitatively evaluating the marginal benefit of available bandwidth to competing consumers, enabling efficient utilization of the bandwidth resource. The metric is simple to implement, imposes only a modest overhead, and can be retrofitted easily into existing content distribution systems. We have designed and implemented a high-performance content distribution system, called V-Formation, based on the CPM. The CPM guides V-Formation toward a global allocation of bandwidth that maximizes the aggregate download bandwidth of consumers. Results from a PlanetLab deployment and extensive simulations show that V-Formation achieves high aggregate bandwidth and that the CPM enables hosts to converge quickly on a stable allocation of resources in a wide range of deployment scenarios.

Supplementary Material

MP4 File (sigcomm_10_2.mp4)

Download
152.74 MB

References

[1]

BitTorrent. http://bittorrent.com.

[2]

FlixQ.com -- Videosharing For The Masses. http://flixq.com.

[3]

Ipoque -- Internet Studies http://www.ipoque.com/resources/internet-studies.

[4]

Velocix -- New Generation Content Delivery Network http://www.velocix.com.

[5]

Verivue -- OneVantage Content Delivery Solution http://verivue.com.

[6]

A. C. Bavier, M. Bowman, B. N. Chun, D. E. Culler, S. Karlin, S. Muir, L. L. Peterson, T. Roscoe, T. Spalink, and M. Wawrzoniak. Operating Systems Support For Planetary-scale Network Services. Symposium on Networked System Design and Implementation, San Francisco, CA, March 2004.

Digital Library

[7]

J. W. Byers, M. Luby, M. Mitzenmacher, and A. Rege. A Digital Fountain Approach To Reliable Distribution Of Bulk Data. SIGCOMM Conference, Vancouver, Canada, August 1998.

Digital Library

[8]

A. Chankhunthod, P. B. Danzig, C. Neerdaels, M. F. Schwartz, and K. J. Worrell. A Hierarchical Internet Object Cache. USENIX Annual Technical Conference, San Diego, CA, January 1996.

Digital Library

[9]

B. Cohen. Incentives Build Robustness In BitTorrent. Workshop on the Economics of Peer-to-Peer Systems, Berkeley, CA, May 2003.

[10]

J. Camp, M. Sirbu, and J. D. Tygar. Token And Notational Money In Electronic Commerce. USENIX Workshop on Electronic Commerce, New York, NY, July 1995.

Digital Library

[11]

D. R. Choffnes and F. E. Bustamante. Taming The Torrent: A Practical Approach To Reducing Cross-ISP Traffic In Peer-to-Peer Systems. SIGCOMM Conference, Seattle, WA, August 2008.

Digital Library

[12]

J. R. Douceur. The Sybil Attack. International Workshop on Peer-to-Peer Systems, Springer Lecture Notes in Computer Science 2429, Cambridge, MA, March 2002.

Digital Library

[13]

M. J. Freedman, C. Aperjis, and R. Johari. Prices Are Right: Managing Resources And Incentives In Peer-Assisted Content Distribution. International Workshop on Peer-to-Peer Systems, Tampa Bay, FL, February 2008.

Digital Library

[14]

M. J. Freedman, E. Freudenthal, and D. Mazières. Democratizing Content Publication With Coral. Symposium on Networked System Design and Implementation, San Francisco, CA, March 2004.

Digital Library

[15]

S. Gadde, J. S. Chase, and M. Rabinovich. Web Caching And Content Distribution: A View From The Interior. Computer Communications, 24(2), May 2001.

Digital Library

[16]

C. Huang, J. Li, and K. W. Ross. Can Internet Video-on-Demand Be Profitable? SIGCOMM Conference, 2007.

Digital Library

[17]

D. Karger, A. Sherman, A. Berkheimer, B. Bogstad, R. Dhanidina, K. Iwamoto, B. Kim, L. Matkins, and Y. Yerushalmi. Web Caching With Consistent Hashing. International World Wide Web Conference, Toronto, Canada, May 1999.

Digital Library

[18]

D. R. Karger, E. Lehman, F. T. Leighton, R. Panigrahy, M. S. Levine, and D. Lewin. Consistent Hashing And Random Trees: Distributed Caching Protocols For Relieving Hot Spots On The World Wide Web. ACM Symposium on Theory of Computing, El Paso, TX, May 1997.

Digital Library

[19]

D. Levin, K. LaCurts, N. Spring, and B. Bhattacharjee. BitTorrent Is An Auction: Analyzing And Improving BitTorrent's Incentives. SIGCOMM Conference, Seattle, WA, August 2008.

Digital Library

[20]

N. Laoutaris, P. Rodriguez, and L. Massoulie. Echos: Edge Capacity Hosting Overlays Of Nano Data Centers. ACM SIGCOMM: Computer Communication Review, 38, January 2008.

Digital Library

[21]

T. Locher, P. Moor, S. Schmid, and R. Wattenhofer. Free Riding In BitTorrent Is Cheap. Workshop on Hot Topics in Networks, Irvine, CA, November 2006.

[22]

H. C. Li, A. Clement, E. L. Wong, J. Napper, I. Roy, L. Alvisi, and M. Dahlin. Bar Gossip. Symposium on Operating System Design and Implementation, Seattle, WA, November 2006.

Digital Library

[23]

M. Manasse. The Millicent Protocol For Electronic Commerce. USENIX Workshop on Electronic Commerce, New York, NY, August 1995.

Digital Library

[24]

T.-W. Ngan, D. S. Wallach, and a. P. Druschel. Enforcing Fair Sharing Of Peer-to-Peer Resources. International Workshop on Peer-to-Peer Systems, Springer Lecture Notes in Computer Science 2735, Berkeley, CA, February 2003.

[25]

J. Pouwelse, P. Garbacki, D. Epema, and H. Sips. The BitTorrent P2P File-Sharing System: Measurements And Analysis. International Workshop on Peer-to-Peer Systems, Springer Lecture Notes in Computer Science 3640, Ithaca, NY, February 2005.

Digital Library

[26]

K. Park and V. S. Pai. Scale And Performance In Coblitz Large-file Distribution Service. Symposium on Networked System Design and Implementation, San Jose, CA, May 2006.

Digital Library

[27]

M. Piatek, T. Isdal, T. Anderson, A. Krishnamurthy, and A. Venkataramani. Do Incentives Build Robustness In BitTorrent? Symposium on Networked System Design and Implementation, Cambridge, MA, April 2007.

Digital Library

[28]

M. Piatek, T. Isdal, A. Krishnamurthy, and T. Anderson. One Hop Reputations For Peer To Peer File Sharing Workloads. Symposium on Networked System Design and Implementation, San Francisco, CA, April 2008.

Digital Library

[29]

M. Piatek, A. Krishnamurthy, A. Venkataramani, R. Yang, D. Zhang, and A. Jaffe. Contracts: Practical Contribution Incentives For P2P Live Streaming. Symposium on Networked System Design and Implementation, San Jose, CA, April 2010.

Digital Library

[30]

T. Poutanen, H. Hinton, and M. Stumm. Netcents: A Lightweight Protocol For Secure Micropayments. USENIX Workshop on Electronic Commerce, Boston, MA, August 1998.

Digital Library

[31]

J. A. Pouwelse, P. Garbacki, J. Wang, A. Bakker, J. Yang, A. Iosup, D.H.J. Epema, M. Reinders, M. van Steen, and H.J. Sips. International Workshop on Peer-to-Peer Systems, Santa Barbara, CA, February 2006.

[32]

R. S. Peterson and E. G. Sirer. Antfarm: Efficient Content Distribution With Managed Swarms. Symposium on Networked System Design and Implementation, Boston, MA, April 2009.

Digital Library

[33]

A. Sherman, J. Nieh, and C. Stein. Fairtorrent: Bringing Fairness To Peer-to-Peer Systems. Conference on emerging Networking EXperiments and Technologies, Rome, Italy, December 2009.

Digital Library

[34]

M. Sirivianos, J. H. Park, R. Chen, and X. Yang. Free-riding In BitTorrent Networks With The Large View Exploit. International Workshop on Peer-to-Peer Systems, Bellevue, WA, February 2007.

[35]

M. Sirivianos, X. Yang, and S. Jarecki. Dandelion: Cooperative Content Distribution With Robust Incentives. USENIX Annual Technical Conference, Santa Clara, CA, June 2007.

Digital Library

[36]

S. Saroiu, P. K. Gummadi, R. J. Dunn, S. D. Gribble, and H. M. Levy. An Analysis Of Internet Content Delivery Systems. Symposium on Operating System Design and Implementation, Boston, MA, December 2002.

Digital Library

[37]

A. Wolman, G. M. Voelker, N. Sharma, N. Cardwell, A. R. Karlin, and H. M. Levy. On The Scale And Performance Of Cooperative Web Proxy Caching. Symposium on Operating Systems Principles, Kiawah Island, SC, December 1999.

Digital Library

[38]

L. Wang, K. Park, R. Pang, V. S. Pai, and L. L. Peterson. Reliability And Security In The Codeen Content Distribution Network. USENIX Annual Technical Conference, Boston, MA, June 2004.

Digital Library

[39]

P. Wayner. Digital Cash: Commerce On The Net. Morgan Kaufmann, April 1996.

Digital Library

Cited By

Zhang XWang NCao YPeng LMeng H(2018)A Stochastic Analytical Modeling Framework on ISP–P2P Collaborations in Multidomain EnvironmentsIEEE Systems Journal10.1109/JSYST.2017.272591412:3(2320-2331)Online publication date: Sep-2018
https://doi.org/10.1109/JSYST.2017.2725914
Pacifici VLehrieder FDán G(2016)Cache bandwidth allocation for P2P file-sharing systems to minimize inter-ISP trafficIEEE/ACM Transactions on Networking10.1109/TNET.2014.236702124:1(437-448)Online publication date: 1-Feb-2016
https://dl.acm.org/doi/10.1109/TNET.2014.2367021
Sharma AVenkataramani ARocha A(2014)Pros & cons of model-based bandwidth control for client-assisted content delivery2014 Sixth International Conference on Communication Systems and Networks (COMSNETS)10.1109/COMSNETS.2014.6734893(1-8)Online publication date: Jan-2014
https://doi.org/10.1109/COMSNETS.2014.6734893
Show More Cited By

Index Terms

A content propagation metric for efficient content distribution
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

A content propagation metric for efficient content distribution
SIGCOMM '11

Efficient content distribution in large networks comprising datacenters, end hosts, and distributed in-network caches is a difficult problem. Existing systems rely on mechanisms and metrics that fail to effectively utilize all available sources of ...
Enabling content-aware traffic engineering

Today, a large fraction of Internet traffic is originated by Content Delivery Networks (CDNs). To cope with increasing demand for content, CDNs have deployed massively distributed infrastructures. These deployments pose challenges for CDNs as they have ...
Accounting and Accountability in Content Distribution Architectures: A Survey

Many content distribution architectures offer desirable elements that lead to less bandwidth usage, reduced network congestion, higher content availability, and reduced costs. However, their level of adoption and utilization in commercial environments ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '11: Proceedings of the ACM SIGCOMM 2011 conference

August 2011

502 pages

ISBN:9781450307970

DOI:10.1145/2018436

General Chairs:
Srinivasan Keshav
University of Waterloo, Canada
,
Jörg Liebeherr
University of Toronto, Canada
,
Program Chairs:
John Byers
Boston University, USA
,
Jeffrey Mogul
HP Labs, USA

ACM SIGCOMM Computer Communication Review Volume 41, Issue 4
SIGCOMM '11
August 2011
480 pages
ISSN:0146-4833
DOI:10.1145/2043164
Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 August 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGCOMM '11

Sponsor:

SIGCOMM

SIGCOMM '11: ACM SIGCOMM 2011 Conference

August 15 - 19, 2011

Ontario, Toronto, Canada

Acceptance Rates

SIGCOMM '11 Paper Acceptance Rate 32 of 223 submissions, 14%;

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
750
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)10

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang XWang NCao YPeng LMeng H(2018)A Stochastic Analytical Modeling Framework on ISP–P2P Collaborations in Multidomain EnvironmentsIEEE Systems Journal10.1109/JSYST.2017.272591412:3(2320-2331)Online publication date: Sep-2018
https://doi.org/10.1109/JSYST.2017.2725914
Pacifici VLehrieder FDán G(2016)Cache bandwidth allocation for P2P file-sharing systems to minimize inter-ISP trafficIEEE/ACM Transactions on Networking10.1109/TNET.2014.236702124:1(437-448)Online publication date: 1-Feb-2016
https://dl.acm.org/doi/10.1109/TNET.2014.2367021
Sharma AVenkataramani ARocha A(2014)Pros & cons of model-based bandwidth control for client-assisted content delivery2014 Sixth International Conference on Communication Systems and Networks (COMSNETS)10.1109/COMSNETS.2014.6734893(1-8)Online publication date: Jan-2014
https://doi.org/10.1109/COMSNETS.2014.6734893
Choy SWong BSimon GRosenberg C(2014)A hybrid edge-cloud architecture for reducing on-demand gaming latencyMultimedia Systems10.1007/s00530-014-0367-z20:5(503-519)Online publication date: 1-Oct-2014
https://dl.acm.org/doi/10.1007/s00530-014-0367-z
Hu CChen MXing C(2013)Towards efficient video chunk dissemination in peer-to-peer live streamingComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2013.07.00357:15(3009-3024)Online publication date: 1-Oct-2013
https://dl.acm.org/doi/10.1016/j.comnet.2013.07.003
Liu HWang YYang YWang HTian C(2012)Optimizing cost and performance for content multihomingACM SIGCOMM Computer Communication Review10.1145/2377677.237775342:4(371-382)Online publication date: 13-Aug-2012
https://dl.acm.org/doi/10.1145/2377677.2377753
Liu HWang YYang YWang HTian CEggert LOtt JPadmanabhan VVarghese G(2012)Optimizing cost and performance for content multihomingProceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication10.1145/2342356.2342432(371-382)Online publication date: 13-Aug-2012
https://dl.acm.org/doi/10.1145/2342356.2342432
Hamandi KSaab FKayssi A(2012)Enhanced Multi-rate Multicast for Optimal User Satisfaction and Efficient Bandwidth UtilizationProceedings of the 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications10.1109/TrustCom.2012.147(1481-1485)Online publication date: 25-Jun-2012
https://dl.acm.org/doi/10.1109/TrustCom.2012.147
Pacifici VLehrieder FDán G(2016)Cache bandwidth allocation for P2P file-sharing systems to minimize inter-ISP trafficIEEE/ACM Transactions on Networking10.1109/TNET.2014.236702124:1(437-448)Online publication date: 1-Feb-2016
https://dl.acm.org/doi/10.1109/TNET.2014.2367021

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents