research-article

Public Access

Redesigning CDN-Broker Interactions for Improved Content Delivery

Authors:

Matthew K. Mukerjee,

Ilker Nadi Bozkurt,

Bruce M. Maggs,

Srinivasan Seshan,

Hui ZhangAuthors Info & Claims

CoNEXT '17: Proceedings of the 13th International Conference on emerging Networking EXperiments and Technologies

Pages 68 - 80

https://doi.org/10.1145/3143361.3143366

Published: 28 November 2017 Publication History

Abstract

Various trends are reshaping Internet video delivery: exponential growth in video traffic, rising expectations of high video quality of experience (QoE), and the proliferation of varied content delivery network (CDN) deployments (e.g., cloud computing-based, content provider-owned datacenters, and ISP-owned CDNs). More fundamentally though, content providers are shifting delivery from a single CDN to multiple CDNs, through the use of a content broker. Brokers have been shown to invalidate many traditional delivery assumptions (e.g., shifting traffic invalidates short- and long-term traffic prediction) by not communicating their decisions with CDNs. In this work, we analyze these problems using data from a CDN and a broker. We examine the design space of potential solutions, finding that a marketplace design (inspired by advertising exchanges) potentially provides interesting tradeoffs. A marketplace allows all CDNs to profit on video delivery through fine-grained pricing and optimization, where CDNs learn risk-adverse bidding strategies to aid in traffic prediction. We implement a marketplace-based system (which we dub Video Delivery eXchange or VDX) in CDN and broker data-driven simulation, finding significant improvements in cost and data-path distance.

References

[1]

2012. Cisco Report: The CDN Federation - Solutions for SPs and Content Providers To Scale a Great Customer Experience. http://www.cisco.com/c/dam/en_us/about/ac79/docs/sp/CDN-Federation_Phase-2-Pilot.pdf. (2012).

[2]

2015. Conviva. http://www.conviva.com. (2015).

[3]

2017. Level3 Communications. http://www.level3.com/en/products/content-delivery-network/. (2017). http://www.level3.com/en/products/content-delivery-network/

[4]

Akamai. 2015. Financial Reports. http://www.ir.akamai.com/phoenix.zhtml?c=75943&p=irol-reportsannual. (2015).

[5]

Akamai. 2017. Akamai. https://www.akamai.com/. (2017).

[6]

Akamai. 2017. Akamai Reports First Quarter 2017 Financial Results. https://seekingalpha.com/pr/16818558-akamai-reports-first-quarter-2017-financial-results. (May 2017).

[7]

Akamai. 2017. Akamai Technologies 2017 Q1 Earnings Summary. https://seekingalpha.com/filing/3541289. (May 2017).

[8]

Amazon. Amazon Elastic Compute Cloude (Amazon EC2). http://aws.amazon.com/ec2/. (????).

[9]

Amazon. 2016. Amazon CloudFront. https://aws.amazon.com/cloudfront/. (2016).

[10]

Amazon. 2016. Amazon CloudFront Pricing. https://aws.amazon.com/cloudfront/pricing/. (2016).

[11]

arstechnica. 2014. It's not a fast lane but Comcast built a CDN to charge for video delivery. http://arstechnica.com/information-technology/2014/05/its-not-a-fast-lane-but-comcast-built-a-cdn-to-charge-for-video-delivery/. (2014).

[12]

Athula Balachandran, Vyas Sekar, Aditya Akella, and Srinivasan Seshan. 2013. Analyzing the Potential Benefits of CDN Augmentation Strategies for Internet Video Workloads. In Proceedings of the 2013 Conference on Internet Measurement Conference (IMC '13). ACM, New York, NY, USA, 43--56.

Digital Library

[13]

Athula Balachandran, Vyas Sekar, Aditya Akella, Srinivasan Seshan, Ion Stoica, and Hui Zhang. 2013. Developing a predictive model of quality of experience for internet video. In SIGCOMM '13: Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM. ACM Request Permissions.

Digital Library

[14]

Bizety. 2014. The Multi-CDN Strategy. https://www.bizety.com/2014/05/09/multi-cdn-strategy/. (2014).

[15]

Eric W Burger and Jan Seedorf. 2009. Application-layer traffic optimization (ALTO) problem statement. (2009).

[16]

Rajkumar Buyya, Mukaddim Pathan, and Athena Vakali. 2008. Content delivery networks. Vol. 9. Springer Science & Business Media.

Digital Library

[17]

Ignacio Castro, Aurojit Panda, Barath Raghavan, Scott Shenker, and Sergey Gorinsky. 2015. Route Bazaar: Automatic Interdomain Contract Negotiation. In 15th Workshop on Hot Topics in Operating Systems (HotOS XV). USENIX Association, Kartause Ittingen, Switzerland. https://www.usenix.org/conference/hotos15/workshop-program/presentation/castro

Digital Library

[18]

Cedexis. 2017. Cedexis. https://www.cedexis.com/. (2017).

[19]

Fangfei Chen, Ramesh K. Sitaraman, and Marcelo Torres. 2015. End-User Mapping: Next Generation Request Routing for Content Delivery. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (SIGCOMM '15). ACM, New York, NY, USA, 167--181.

Digital Library

[20]

CloudFlare. 2016. Bandwidth Costs Around the World. https://blog.cloudflare.com/bandwidth-costs-around-the-world/. (2016).

[21]

Benjamin Frank, Ingmar Poese, Yin Lin, Georgios Smaragdakis, Anja Feldmann, Bruce Maggs, Jannis Rake, Steve Uhlig, and Rick Weber. 2013. Pushing CDN-ISP Collaboration to the Limit. SIGCOMM Comput. Commun. Rev. 43, 3 (July 2013), 34--44.

Digital Library

[22]

Benjamin Frank, Ingmar Poese, Georgios Smaragdakis, Anja Feldmann, Bruce M Maggs, Steve Uhlig, Vinay Aggarwal, and Fabian Schneider. 2013. Collaboration opportunities for content delivery and network infrastructures. Recent Advances in Networking 1 (2013), 305--377.

[23]

Aditya Ganjam, Faisal Siddiqui, Jibin Zhan, Xi Liu, Ion Stoica, Junchen Jiang, Vyas Sekar, and Hui Zhang. 2015. C3: Internet-Scale Control Plane for Video Quality Optimization. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15). USENIX Association, Oakland, CA, 131--144. https://www.usenix.org/conference/nsdi15/technical-sessions/presentation/ganjam

Digital Library

[24]

Richard J Gibbens and Frank P Kelly. 1999. Resource pricing and the evolution of congestion control. Automatica 35, 12 (1999), 1969--1985.

Digital Library

[25]

Google. 2016. Google Cloud CDN. https://cloud.google.com/cdn/. (2016).

[26]

Google. 2017. AdWords. https://adwords.google.com/. (2017).

[27]

Google. 2017. DoubleClick by Google. https://www.doubleclickbygoogle.com/. (2017).

[28]

Gurobi. 2017. Gurobi Optimization. http://www.gurobi.com/. (2017).

[29]

Dongsu Han, Robert Grandl, Aditya Akella, and Srinivasan Seshan. 2013. FCP: a flexible transport framework for accommodating diversity. ACM SIGCOMM Computer Communication Review 43, 4 (2013), 135--146.

Digital Library

[30]

Huawei. 2017. Huawei. https://www.huawei.com/. (2017).

[31]

Virajith Jalaparti, Ivan Bliznets, Srikanth Kandula, Brendan Lucier, and Ishai Menache. 2016. Dynamic Pricing and Traffic Engineering for Timely Inter-Datacenter Transfers. In Proceedings of the 2016 conference on ACM SIGCOMM 2016 Conference. ACM, 73--86.

Digital Library

[32]

Junchen Jiang, Xi Liu, Vyas Sekar, Ion Stoica, and Hui Zhang. 2014. EONA: Experience-Oriented Network Architecture. In HotNets-XIII: Proceedings of the 13th ACM Workshop on Hot Topics in Networks. ACM Request Permissions.

Digital Library

[33]

Junchen Jiang, Vyas Sekar, Henry Milner, Davis Shepherd, Ion Stoica, and Hui Zhang. 2016. CFA: A Practical Prediction System for Video QoE Optimization. In Proceedings of the 13th Usenix Conference on Networked Systems Design and Implementation (NSDI'16). USENIX Association, Berkeley, CA, USA, 137--150. http://dl.acm.org/citation.cfm?id=2930611.2930621

Digital Library

[34]

Wenjie Jiang, Rui Zhang-Shen, Jennifer Rexford, and Mung Chiang. 2008. Cooperative Content Distribution and Traffic Engineering. In Proceedings of the 3rd International Workshop on Economics of Networked Systems (NetEcon '08). ACM, New York, NY, USA, 7--12.

Digital Library

[35]

Wenjie Jiang, Rui Zhang-Shen, Jennifer Rexford, and Mung Chiang. 2009. Cooperative Content Distribution and Traffic Engineering in an ISP Network. In Proceedings of the Eleventh International Joint Conference on Measurement and Modeling of Computer Systems (SIGMETRICS '09). ACM, New York, NY, USA, 239--250.

Digital Library

[36]

Frank P Kelly, Aman K Maulloo, and David KH Tan. 1998. Rate control for communication networks: shadow prices, proportional fairness and stability. Journal of the Operational Research society 49, 3 (1998), 237--252.

[37]

USC-Network Systems Lab. 2015. CDN Geographic Coverage. http://usc-nsl.github.io/cdn-coverage/. (2015).

[38]

Philip A Lisiecki, Cosmos Nicolaou, and Kyle R Rose. 2009. Scalable, high performance and highly available distributed storage system for Internet content. (Nov. 24 2009). US Patent 7,624,169.

[39]

Xi Liu, Florin Dobrian, Henry Milner, Junchen Jiang, Vyas Sekar, Ion Stoica, and Hui Zhang. 2012. A case for a coordinated internet video control plane. In Proc. ACM SIGCOMM. 359--370.

Digital Library

[40]

Bruce M Maggs and Ramesh K Sitaraman. 2015. Algorithmic nuggets in content delivery. ACM SIGCOMM Computer Communication Review 45, 3 (2015), 52--66.

Digital Library

[41]

Ratul Mahajan, David Wetherall, and Thomas E Anderson. 2007. Mutually Controlled Routing with Independent ISPs. In NSDI.

Digital Library

[42]

MarketWatch. 2015. Akamai Technologies profit falls, stock suffers. http://www.marketwatch.com/story/akamai-technologies-profit-falls-stock-suffers-2015-07-28. (July 2015).

[43]

MaxCDN. 2016. Which CDN Pricing Model Costs Less. https://www.maxcdn.com/blog/cdn-pricing-models/. (2016).

[44]

Microsoft. 2016. Content Delivery Network (CDN) Pricing. https://azure.microsoft.com/en-us/pricing/details/cdn/. (2016).

[45]

Matthew K Mukerjee, Ilker Nadi Bozkurt, Bruce Maggs, Srinivasan Seshan, and Hui Zhang. 2016. The Impact of Brokers on the Future of Content Delivery. In Proceedings of the 15th ACM Workshop on Hot Topics in Networks. ACM, 127--133.

Digital Library

[46]

Netlfix. 2016. Netflix Open Connect. https://openconnect.netflix.com/en/. (2016).

[47]

Limelight Networks. 2015. 2015 Annual Report. http://investors.limelight.com/. (2015).

[48]

Limelight Networks. 2017. 2017 First Quarterly. http://investors.limelight.com/. (2017).

[49]

Ben Niven-Jenkins, Francois Le Fauchuer, and Nabil Bitar. 2012. RFC 6707: Content Distribution Network Interconnection (CDNI) Problem Statement. https://tools.ietf.org/html/rfc6707. (2012).

[50]

NPAW. 2017. NicePeopleAtWork (NPAW). https://www.nicepeopleatwork.com/. (2017).

[51]

Erik Nygren, Ramesh K Sitaraman, and Jennifer Sun. 2010. The akamai network: a platform for high-performance internet applications. ACM SIGOPS Operating Systems Review 44, 3 (2010), 2--19.

Digital Library

[52]

OpenX. 2017. Ad Exchange vs. Ad Network: How Do They Compare? http://openx.com/whitepaper/ad-exchange-vs-ad-network-how-do-they-compare/. (2017).

[53]

PeeringDB. 2017. PeeringDB. https://www.peeringdb.com/. (2017).

[54]

Ingmar Poese, Benjamin Frank, Simon Knight, Niklas Semmler, and Georgios Smaragdakis. 2012. PaDIS emulator: an emulator to evaluate CDN-ISP collaboration. In SIGCOMM '12: Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication. ACM.

Digital Library

[55]

Ingmar Poese, Benjamin Frank, Georgios Smaragdakis, Steve Uhlig, Anja Feldmann, and Bruce Maggs. 2012. Enabling content-aware traffic engineering. SIGCOMM Computer Communication Review 42, 5 (Sept. 2012).

Digital Library

[56]

Dan Rayburn. 2016. Current State Of The CDN Market: DIY, Pricing Trends, Competitive Dynamics. http://blog.streamingmedia.com/wp-content/uploads/2016/05/2016CDNSummit-Rayburn-Pricing.pdf. (2016).

[57]

Yang Song, Arun Venkataramani, and Lixin Gao. 2013. On the CDN pricing game. In Computer Communications Workshops (INFOCOM WKSHPS), 2013 IEEE Conference on. IEEE, 339--344.

[58]

Rade Stanojevic, Ignacio Castro, and Sergey Gorinsky. 2011. CIPT: Using Tuangou to Reduce IP Transit Costs. In Proceedings of the Seventh COnference on Emerging Networking EXperiments and Technologies (CoNEXT '11). ACM, New York, NY, USA, Article 17, 12 pages.

Digital Library

[59]

Volker Stocker, Georgios Smaragdakis, William Lehr, and Steven Bauer. 2017. The growing complexity of content delivery networks: Challenges and implications for the Internet ecosystem. Telecommunications Policy (2017).

[60]

Brett Stone-Gross, Ryan Stevens, Apostolis Zarras, Richard Kemmerer, Chris Kruegel, and Giovanni Vigna. 2011. Understanding fraudulent activities in online ad exchanges. In Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference. ACM, 279--294.

Digital Library

[61]

Q. Wang, K. Ren, and X. Meng. 2012. When cloud meets eBay: Towards effective pricing for cloud computing. In 2012 Proceedings IEEE INFOCOM. 936--944.

[62]

Haiyong Xie, Y Richard Yang, Arvind Krishnamurthy, Yanbin Grace Liu, and Abraham Silberschatz. 2008. P4P: Provider portal for applications. ACM SIGCOMM Computer Communication Review 38, 4 (2008), 351--362.

Digital Library

[63]

Shuai Yuan, Jun Wang, and Xiaoxue Zhao. 2013. Real-time bidding for online advertising: measurement and analysis. In Proceedings of the Seventh International Workshop on Data Mining for Online Advertising. ACM, 3.

Digital Library

[64]

H. Zhang, H. Jiang, B. Li, F. Liu, A. V. Vasilakos, and J. Liu. 2016. A Framework for Truthful Online Auctions in Cloud Computing with Heterogeneous User Demands. IEEE Trans. Comput. 65, 3 (March 2016), 805--818.

Digital Library

[65]

Mingchen Zhao, Paarijaat Aditya, Ang Chen, Yin Lin, Andreas Haeberlen, Peter Druschel, Bruce Maggs, Bill Wishon, and Miroslav Ponec. 2013. Peer-assisted content distribution in akamai netsession. In Proceedings of the 2013 conference on Internet measurement conference. ACM, 31--42.

Digital Library

Cited By

Yang LLou W(2024)On designing a profitable system model to harmonize the tripartite dissension in content delivery applicationsJournal of Network and Computer Applications10.1016/j.jnca.2024.103965230(103965)Online publication date: Oct-2024
https://doi.org/10.1016/j.jnca.2024.103965
Midoglu CAvelino MGopalakrishnan SPham SHalvorsen PTimmerer CGrois DÇetinkaya ENguyen M(2022)Multimedia streaming analyticsProceedings of the 1st Mile-High Video Conference10.1145/3510450.3517321(62-69)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1145/3510450.3517321
Vathias EHadjiefthymiades S(2022)A stock options metaphor for content delivery networksNETNOMICS: Economic Research and Electronic Networking10.1007/s11066-022-09153-722:2-3(195-230)Online publication date: 6-Sep-2022
https://doi.org/10.1007/s11066-022-09153-7
Show More Cited By

Index Terms

Redesigning CDN-Broker Interactions for Improved Content Delivery
1. Networks
  1. Network algorithms
    1. Control path algorithms
  2. Network protocols
    1. Application layer protocols
    2. Network protocol design

Recommendations

Service Adoption and Pricing of Content Delivery Network (CDN) Services

Content delivery networks (CDNs) are a vital component of the Internet's content delivery value chain, servicing nearly a third of the Internet's most popular content sites. However, in spite of their strategic importance, little is known about the ...
Secure content delivery in information-centric networks: design, implementation, and analyses
ICN '13: Proceedings of the 3rd ACM SIGCOMM workshop on Information-centric networking

In this paper, we propose a novel secure content delivery framework, for an information-centric network, which will enable content providers (e.g., Netflix and Youtube) to securely disseminate their content to legitimate users via content distribution ...
Cost Effective Approaches for Content Placement in Cloud CDN Using Dynamic Content Delivery Model

Cloud providers give storage access and efficient content placement and delivery services to content providers by optimizing cloud-based content delivery. The cost-efficient model should not only consider the content delivery cost but also the storage ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '17: Proceedings of the 13th International Conference on emerging Networking EXperiments and Technologies

November 2017

492 pages

ISBN:9781450354226

DOI:10.1145/3143361

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Paper

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Science Foundation

Conference

CoNEXT '17

Sponsor:

SIGCOMM

CoNEXT '17: The 13th International Conference on emerging Networking EXperiments and Technologies

December 12 - 15, 2017

Incheon, Republic of Korea

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
813
Total Downloads

Downloads (Last 12 months)112
Downloads (Last 6 weeks)27

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yang LLou W(2024)On designing a profitable system model to harmonize the tripartite dissension in content delivery applicationsJournal of Network and Computer Applications10.1016/j.jnca.2024.103965230(103965)Online publication date: Oct-2024
https://doi.org/10.1016/j.jnca.2024.103965
Midoglu CAvelino MGopalakrishnan SPham SHalvorsen PTimmerer CGrois DÇetinkaya ENguyen M(2022)Multimedia streaming analyticsProceedings of the 1st Mile-High Video Conference10.1145/3510450.3517321(62-69)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1145/3510450.3517321
Vathias EHadjiefthymiades S(2022)A stock options metaphor for content delivery networksNETNOMICS: Economic Research and Electronic Networking10.1007/s11066-022-09153-722:2-3(195-230)Online publication date: 6-Sep-2022
https://doi.org/10.1007/s11066-022-09153-7
Baarzi AKesidis GJoe-Wong CShahrad M(2021)On Merits and Viability of Multi-Cloud ServerlessProceedings of the ACM Symposium on Cloud Computing10.1145/3472883.3487002(600-608)Online publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1145/3472883.3487002
Tashtarian FFalanji RBentaleb AErfanian AMashhadi PTimmerer CHellwagner HZimmermann R(2021)Quality Optimization of Live Streaming Services over HTTP with Reinforcement Learning2021 IEEE Global Communications Conference (GLOBECOM)10.1109/GLOBECOM46510.2021.9685933(1-6)Online publication date: Dec-2021
https://doi.org/10.1109/GLOBECOM46510.2021.9685933
Hsu KChoncholas JBhardwaj KGavrilovska AZhao BZheng HMadhyastha HPadmanabhan V(2020)DNS Does Not Suffice for MEC-CDNProceedings of the 19th ACM Workshop on Hot Topics in Networks10.1145/3422604.3425931(212-218)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.1145/3422604.3425931
Sierra-Arriaga FBranco RLee B(2020)Security Issues and Challenges for Virtualization TechnologiesACM Computing Surveys10.1145/338219053:2(1-37)Online publication date: 19-May-2020
https://dl.acm.org/doi/10.1145/3382190
Zolfaghari BSrivastava GRoy SNemati HAfghah FKoshiba TRazi ABibak KMitra PRai B(2020)Content Delivery NetworksACM Computing Surveys10.1145/338061353:2(1-34)Online publication date: 17-Apr-2020
https://dl.acm.org/doi/10.1145/3380613
Suaboot JFahad ATari ZGrundy JMahmood AAlmalawi AZomaya ADrira K(2020)A Taxonomy of Supervised Learning for IDSs in SCADA EnvironmentsACM Computing Surveys10.1145/337949953:2(1-37)Online publication date: 17-Apr-2020
https://dl.acm.org/doi/10.1145/3379499
Kannengießer NLins SDehling TSunyaev A(2020)Trade-offs between Distributed Ledger Technology CharacteristicsACM Computing Surveys10.1145/337946353:2(1-37)Online publication date: 29-May-2020
https://dl.acm.org/doi/10.1145/3379463
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents