research-article

Free access

Leveraging interconnections for performance: the serving infrastructure of a large CDN

Authors:

Florian Wohlfart,

Nikolaos Chatzis,

Caglar Dabanoglu,

Walter WillingerAuthors Info & Claims

SIGCOMM '18: Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication

Pages 206 - 220

https://doi.org/10.1145/3230543.3230576

Published: 07 August 2018 Publication History

Abstract

Today's large content providers (CP) are busy building out their service infrastructures or "peering edges" to satisfy the insatiable demand for content created by an ever-expanding Internet edge. One component of these serving infrastructures that features prominently in this build-out is their connectivity fabric; i.e., the set of all Internet interconnections that content has to traverse en route from the CP's various "deployments" or "serving sites" to end users. However, these connectivity fabrics have received little attention in the past and remain largely ill-understood.

In this paper, we describe the results of an in-depth study of the connectivity fabric of Akamai. Our study reveals that Akamai's connectivity fabric consists of some 6,100 different "explicit" peerings (i.e., Akamai is one of the two involved peers) and about 28,500 different "implicit" peerings (i.e., Akamai is neither of the two peers). Our work contributes to a better understanding of real-world serving infrastructures by providing an original account of implicit peerings and demonstrating the performance benefits that Akamai can reap from leveraging its rich connectivity fabric for serving its customers' content to end users.

References

[1]

IPv4 & IPv6 CIDR Report. http://www.cidr-report.org/as2.0. Accessed: Jan. 2017.

[2]

Vijay Kumar Adhikari, Yang Guo, Fang Hao, Volker Hilt, Zhi-Li Zhang, Matteo Varvello, and Moritz Steiner. Measurement Study of Netflix, Hulu, and a Tale of Three CDNs. IEEE/ACM TON, 23(6), 2015.

Digital Library

[3]

Vijay Kumar Adhikari, Sourabh Jain, Yingying Chen, and Zhi-Li Zhang. Vivisecting YouTube: An Active Measurement Study. In IEEE INFOCOM, 2012.

[4]

Bernhard Ager, Nikolaos Chatzis, Anja Feldmann, Nadi Sarrar, Steve Uhlig, and Walter Willinger. Anatomy of a Large European IXP. In ACM SIGCOMM, 2012.

Digital Library

[5]

Bernhard Ager, Wolfgang Mühlbauer, Georgios Smaragdakis, and Steve Uhlig. Web Content Cartography. In ACM IMC, 2011.

Digital Library

[6]

Seth Bennet. Facebook Scalable Interconnection. https://www.peering-forum.eu/system/documents/124/original/09.30_-_Facebook_-_Seth_Bennet.pdf.

[7]

Timm Böttger, Félix Cuadrado, Gareth Tyson, Ignacio Castro, and Steve Uhlig. A Hypergiant's View of the Internet. ACM CCR, 2017.

[8]

Samuel Henrique Bucke Brito, Mateus A. S. Santos, Ramon dos Reis Fontes, Danny Alex Lachos Perez, and Christian Esteve Rothenberg. Dissecting the Largest National Ecosystem of Public Internet eXchange Points in Brazil. In PAM, 2016.

[9]

Matt Calder, Xun Fan, Zi Hu, Ethan Katz-Bassett, John S. Heidemann, and Ramesh Govindan. Mapping the Expansion of Google's Serving Infrastructure. In ACM IMC, 2013.

Digital Library

[10]

Matt Calder, Ashley Flavel, Ethan Katz-Bassett, Ratul Mahajan, and Jitendra Padhye. Analyzing the Performance of an Anycast CDN. In ACM IMC, 2015.

Digital Library

[11]

Ignacio Castro, Juan Camilo Cardona, Sergey Gorinsky, and Pierre François. Remote Peering: More Peering without Internet Flattening. In ACM CoNEXT, 2014.

Digital Library

[12]

H. Chang, S. Jamin, and W. Willinger. Internet Connectivity at the AS-Level: An Optimization-Driven Modeling Approach. In ACM SIGCOMM Workshop on Models, Methods, and Tools for Reproducible Network Research, 2003.

Digital Library

[13]

Nikolaos Chatzis, Georgios Smaragdakis, Jan Böttger, Thomas Krenc, and Anja Feldmann. On the Benefits of Using a Large IXP As an Internet Vantage Point. In ACM IMC, 2013.

Digital Library

[14]

Fangfei Chen, Ramesh K. Sitaraman, and Marcelo Torres. End-User Mapping: Next Generation Request Routing for Content Delivery. In ACM SIGCOMM, 2015.

Digital Library

[15]

Yi-Ching Chiu, Brandon Schlinker, Abhishek Balaji Radhakrishnan, Ethan Katz-Bassett, and Ramesh Govindan. Are We One Hop Away from a Better Internet? In ACM IMC, 2015.

Digital Library

[16]

Amogh Dhamdhere and Constantine Dovrolis. The Internet is Flat: Modeling the Transition from a Transit Hierarchy to a Peering Mesh. In ACM CoNEXT, 2010.

Digital Library

[17]

Amogh Dhamdhere and Constantine Dovrolis. Twelve Years in the Evolution of the Internet Ecosystem. IEEE/ACM TON, 19(5), 2011.

Digital Library

[18]

Hurricane Electric. Internet Statistics. https://bgp.he.net/report/netstats. Accessed: Jan. 2017.

[19]

Equinix. Private Data Exchange Between Businesses Forecasted to Outpace the Public Internet by Nearly 2x in Growth and 6x in Volume by 2020. https://www.equinix.com/newsroom/press-releases/pr/123570/private-data-exchange-between-businesses-forecasted-to-outpace-the-public-internet-by-nearly-2x-in-growth-and-6x-in-volume-by-2020.

[20]

Facebook. Building Express Backbone: Facebook's new long-haul network. https://code.facebook.com/posts/1782709872057497/building-express-backbone-facebook-s-new-long-haul-network.

[21]

Benjamin Frank, Ingmar Poese, Yin Lin, Georgios Smaragdakis, Anja Feldmann, Bruce M. Maggs, Jannis Rake, Steve Uhlig, and Rick Weber. Pushing CDN-ISP Collaboration to the Limit. ACM CCR, 2013.

Digital Library

[22]

Phillipa Gill, Martin F. Arlitt, Zongpeng Li, and Anirban Mahanti. The Flattening Internet Topology: Natural Evolution, Unsightly Barnacles or Contrived Collapse? In PAM, 2008.

Digital Library

[23]

Google. Google Edge Network. https://peering.google.com.

[24]

Packet Clearing House. Daily Routing Snapshots. https://www.pch.net/resources/Routing_Data.

[25]

Cheng Huang, Angela Wang, Jin Li, and Keith W. Ross. Measuring and Evaluating Large-Scale CDNs. In ACM IMC, 2008.

[26]

Wenjie Jiang, Rui Zhang-Shen, Jennifer Rexford, and Mung Chiang. Cooperative Content Distribution and Traffic Engineering in an ISP network. In ACM SIGMETRICS/Performance, 2009.

Digital Library

[27]

Christian Kaufmann. Akamai ICN. https://pc.nanog.org/static/published/meetings/NANOG71/1532/20171003_Kaufmann_Lightning_Talk_Akamai_v1.pdf. NANOG 71 Light. Talk, 2017.

[28]

Christian Kaufmann. ICN - Akamai's Backbone. https://www.linx.net/wp-content/uploads/LINX101-Akamai-ICN-ChristianKaufmann.pdf. LINX Meeting 101, 2018.

[29]

Rupa Krishnan, Harsha V. Madhyastha, Sridhar Srinivasan, Sushant Jain, Arvind Krishnamurthy, Thomas E. Anderson, and Jie Gao. Moving Beyond End-to-End Path Information to Optimize CDN Performance. In ACM IMC, 2009.

Digital Library

[30]

Craig Labovitz, Scott Iekel-Johnson, Danny McPherson, Jon Oberheide, and Farnam Jahanian. Internet Inter-Domain Traffic. In ACM SIGCOMM, 2010.

Digital Library

[31]

RIPE NCC. RIS Raw Data. https://www.ripe.net/analyse/internet-measurements/routing-information-service-ris/ris-raw-data.

[32]

University of Oregon. Route Views Archive Project. http://archive.routeviews.org.

[33]

Ricardo V. Oliveira, Dan Pei, Walter Willinger, Beichuan Zhang, and Lixia Zhang. In Search of the Elusive Ground Truth: the Internet's AS-level Connectivity Structure. In ACM SIGMETRICS, 2008.

Digital Library

[34]

Ricardo V. Oliveira, Dan Pei, Walter Willinger, Beichuan Zhang, and Lixia Zhang. The (in)Completeness of the Observed Internet AS-level Structure. IEEE/ACM TON, 18(1), 2010.

Digital Library

[35]

Ricardo V. Oliveira, Beichuan Zhang, and Lixia Zhang. Observing the Evolution of Internet as Topology. In ACM SIGCOMM, 2007.

Digital Library

[36]

John S. Otto, Mario A. Sánchez, John P. Rula, and Fabián E. Bustamante. Content Delivery and the Natural Evolution of DNS: Remote DNS Trends, Performance Issues and Alternative Solutions. In ACM IMC, 2012.

Digital Library

[37]

Vern Paxson. End-to-end Routing Behavior in the Internet. In ACM SIGCOMM, 1996.

Digital Library

[38]

Ingmar Poese, Benjamin Frank, Bernhard Ager, Georgios Smaragdakis, and Anja Feldmann. Improving Content Delivery Using Provider-aided Distance Information. In ACM IMC, 2010.

Digital Library

[39]

Ingmar Poese, Benjamin Frank, Bernhard Ager, Georgios Smaragdakis, Steve Uhlig, and Anja Feldmann. Improving Content Delivery with PaDIS. IEEE Internet Computing, 16(3), 2012.

Digital Library

[40]

Philipp Richter, Georgios Smaragdakis, Anja Feldmann, Nikolaos Chatzis, Jan Böttger, and Walter Willinger. Peering at Peerings: On the Role of IXP Route Servers. In ACM IMC, 2014.

Digital Library

[41]

Matthew Roughan, Walter Willinger, Olaf Maennel, Debbie Perouli, and Randy Bush. 10 Lessons from 10 Years of Measuring and Modeling the Internet's Autonomous Systems. IEEE Journal on Selected Areas in Communications, 29(9), 2011.

[42]

Brandon Schlinker, Hyojeong Kim, Timothy Cui, Ethan Katz-Bassett, Harsha V. Madhyastha, Ítalo Cunha, James Quinn, Saif Hasan, Petr Lapukhov, and Hongyi Zeng. Engineering Egress with Edge Fabric: Steering Oceans of Content to the World. In ACM SIGCOMM, 2017.

Digital Library

[43]

Florian Streibelt, Jan Böttger, Nikolaos Chatzis, Georgios Smaragdakis, and Anja Feldmann. Exploring EDNS-Client-Subnet Adopters in Your Free Time. In ACM IMC, 2013.

Digital Library

[44]

Ao-Jan Su, David R. Choffnes, Aleksandar Kuzmanovic, and Fabián E. Bustamante. Drafting Behind Akamai (Travelocity-based Detouring). In ACM SIGCOMM, 2006.

Digital Library

[45]

Ruben Torres, Alessandro Finamore, Jin Ryong Kim, Marco Mellia, Maurizio M. Munafò, and Sanjay G. Rao. Dissecting Video Server Selection Strategies in the YouTube CDN. In IEEE ICDCS, 2011.

Digital Library

[46]

Marc Anthony Warrior, Uri Klarman, Marcel Flores, and Aleksandar Kuzmanovic. Drongo: Speeding Up CDNs with Subnet Assimilation from the Client. In ACM CoNEXT, 2017.

[47]

Kok-Kiong Yap, Murtaza Motiwala, Jeremy Rahe, Steve Padgett, Matthew J. Holliman, Gary Baldus, Marcus Hines, Taeeun Kim, Ashok Narayanan, Ankur Jain, Victor Lin, Colin Rice, Brian Rogan, Arjun Singh, Bert Tanaka, Manish Verma, Puneet Sood, Muhammad Mukarram Bin Tariq, Matt Tierney, Dzevad Trumic, Vytautas Valancius, Calvin Ying, Mahesh Kallahalla, Bikash Koley, and Amin Vahdat. Taking the Edge off with Espresso: Scale, Reliability and Programmability for Global Internet Peering. In ACM SIGCOMM, 2017.

Digital Library

[48]

Bahador Yeganeh, Reza Rejaie, and Walter Willinger. A View From The Edge: A Stub-AS Perspective of Traffic Localization and Its Implications. In IEEE TMA, 2017.

[49]

Hyunho Yeo, Sunghyun Do, and Dongsu Han. How will Deep Learning Change Internet Video Delivery? In ACM HotNets, 2017.

Digital Library

Cited By

Vemuganti SBaswade A(2024)Where is My Route? Enabling Source Routing in LEO Satellite Networks2024 IEEE 99th Vehicular Technology Conference (VTC2024-Spring)10.1109/VTC2024-Spring62846.2024.10683192(01-06)Online publication date: 24-Jun-2024
https://doi.org/10.1109/VTC2024-Spring62846.2024.10683192
Yang LLou W(2024)On designing a profitable system model to harmonize the tripartite dissension in content delivery applicationsJournal of Network and Computer Applications10.1016/j.jnca.2024.103965230(103965)Online publication date: Oct-2024
https://doi.org/10.1016/j.jnca.2024.103965
Gosain DSingh KSharma RSuresh Babu JChakravaty S(2024)Out in the Open: On the Implementation of Mobile App Filtering in IndiaPassive and Active Measurement10.1007/978-3-031-56252-5_2(19-36)Online publication date: 20-Mar-2024
https://doi.org/10.1007/978-3-031-56252-5_2
Show More Cited By

Index Terms

Leveraging interconnections for performance: the serving infrastructure of a large CDN
1. Networks
  1. Network architectures

Recommendations

Architecture and performance models for QoS-driven effective peering of content delivery networks
Content management and delivery through P2P-based content networks

The proprietary nature of existing Content Delivery Networks (CDNs) means they are closed and do not naturally cooperate. A CDN is expected to provide high performance Internet content delivery through global coverage, which might be an obstacle for new ...
An architecture for virtual organization (VO)-based effective peering of content delivery networks
UPGRADE '07: Proceedings of the second workshop on Use of P2P, GRID and agents for the development of content networks

The proprietary nature of existing Content Delivery Networks (CDNs) means they are closed and do not naturally cooperate, resulting in "islands" of CDNs. Finding ways for distinct CDNs to coordinate and cooperate with other CDNs is necessary to achieve ...
Routing-policy aware peering for large content providers

We investigate the impact of routing policies and peering policies on the selection of peering connections for content providers.We formulate the policy-aware peering problem, and prove that the problem is NP-complete.We provide a heuristic algorithm to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '18: Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication

August 2018

604 pages

ISBN:9781450355674

DOI:10.1145/3230543

General Chairs:
Sergey Gorinsky
IMDEA, Spain
,
János Tapolcai
BME, Hungary

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 August 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGCOMM '18

Sponsor:

SIGCOMM

SIGCOMM '18: ACM SIGCOMM 2018 Conference

August 20 - 25, 2018

Budapest, Hungary

Acceptance Rates

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
2,301
Total Downloads

Downloads (Last 12 months)167
Downloads (Last 6 weeks)23

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vemuganti SBaswade A(2024)Where is My Route? Enabling Source Routing in LEO Satellite Networks2024 IEEE 99th Vehicular Technology Conference (VTC2024-Spring)10.1109/VTC2024-Spring62846.2024.10683192(01-06)Online publication date: 24-Jun-2024
https://doi.org/10.1109/VTC2024-Spring62846.2024.10683192
Yang LLou W(2024)On designing a profitable system model to harmonize the tripartite dissension in content delivery applicationsJournal of Network and Computer Applications10.1016/j.jnca.2024.103965230(103965)Online publication date: Oct-2024
https://doi.org/10.1016/j.jnca.2024.103965
Gosain DSingh KSharma RSuresh Babu JChakravaty S(2024)Out in the Open: On the Implementation of Mobile App Filtering in IndiaPassive and Active Measurement10.1007/978-3-031-56252-5_2(19-36)Online publication date: 20-Mar-2024
https://doi.org/10.1007/978-3-031-56252-5_2
Blumenthal MGovindan RKatz-Bassett EKrishnamurthy AMcCauley JMerrill NNarechania TPanda AShenker S(2023)Can We Save the Public Internet?ACM SIGCOMM Computer Communication Review10.1145/3649171.364917553:3(18-22)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3649171.3649175
Li WLin ZAshiq MAben EFontugne RPhokeer AChung TMontpetit MLeivadeas AUhlig SJaved M(2023)RoVista: Measuring and Analyzing the Route Origin Validation (ROV) in RPKIProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624806(73-88)Online publication date: 24-Oct-2023
https://dl.acm.org/doi/10.1145/3618257.3624806
Kastanakis SGiotsas VLivadariu ISuri NMontpetit MLeivadeas AUhlig SJaved M(2023)Replication: 20 Years of Inferring Interdomain Routing PoliciesProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624799(16-29)Online publication date: 24-Oct-2023
https://dl.acm.org/doi/10.1145/3618257.3624799
Salamatian LArnold TCunha ÍZhu JZhang YKatz-Bassett ECalder M(2023)Who Squats IPv4 Addresses?ACM SIGCOMM Computer Communication Review10.1145/3594255.359426053:1(48-72)Online publication date: 20-Apr-2023
https://dl.acm.org/doi/10.1145/3594255.3594260
Mccauley JShenker SVarghese G(2023)Extracting the Essential Simplicity of the InternetCommunications of the ACM10.1145/354713766:2(64-74)Online publication date: 20-Jan-2023
https://dl.acm.org/doi/10.1145/3547137
Vermeulen KGurmericliler ECunha IChoffnes DKatz-Bassett EBarakat CPelsser CBenson TChoffnes D(2022)Internet scale reverse tracerouteProceedings of the 22nd ACM Internet Measurement Conference10.1145/3517745.3561422(694-715)Online publication date: 25-Oct-2022
https://dl.acm.org/doi/10.1145/3517745.3561422
Li XChen YZhou MGuo TWang CXiao YWan JWang X(2022)Artemis: A Latency-Oriented Naming and Routing SystemIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.320718933:12(4874-4890)Online publication date: 1-Dec-2022
https://doi.org/10.1109/TPDS.2022.3207189
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents