A Hop Away from Everywhere: A View of the Intercontinental Long-haul Infrastructure
Authors: 
Esteban Carisimo, Caleb J. Wang, Mia Weaver, Fabián E. Bustamante, Paul BarfordAuthors Info & Claims
Esteban Carisimo, Caleb J. Wang, Mia Weaver, Fabián E. Bustamante, Paul BarfordAuthors Info & ClaimsArticle No.: 47, Pages 1 - 26
Abstract
We present a longitudinal study of intercontinental long-haul links (LHLs) - links with latencies significantly higher than that of all other links in a traceroute path. Our study is motivated by the recognition of these LHLs as a network-layer manifestation of critical transoceanic undersea cables. We present a methodology and associated processing system for identifying long-haul links in traceroute measurements. We apply this system to a large corpus of traceroute data and report on multiple aspects of long haul connectivity including country-level prevalence, routers as international gateways, preferred long-haul destinations, and the evolution of these characteristics over a 7 year period. We identify 85,620 layer-3 links (out of 2.7M links in a large traceroute dataset) that satisfy our definition for intercontinental long haul with many of them terminating in a relatively small number of nodes. An analysis of connected components shows a clearly dominant component with a relative size that remains stable despite a significant growth of the long-haul infrastructure.
References
[1]
Bernhard Ager, Nikolas Chatzis adn Anja Feldmann, Nadi Sarrar, Steve Uhlig, and Walter Willinger. 2012. Anatomy of a large European IXP. In Proc. of ACM SIGCOMM.
[2]
Réka Albert and Albert-László Barabási. 2002. Statistical mechanics of complex networks. Reviews of modern physics, Vol. 74, 1 (2002), 47.
[3]
José Ignacio Alvarez-Hamelin, Luca Dall'Asta, Alain Barrat, and Alessandro Vespignani. 2008. K-core decomposition of Internet graphs: hierarchies, self-similarity and measurement biases. Networks and Heterogeneous Media, Vol. 3, 2 (2008), 371--393.
[4]
Scott Anderson, Loqman Slamanatian, Zachary S. Bischof, Alberto Dainotti, and Paul Barford. 2022. iGDB: Connecting the Physical and Logical Layers of the Internet. In Proc. of IMC.
[5]
ARUNO. 2022. ADTK Detectors. (2022).
[6]
Robert Beverly, Arthur Berger, and Geoffrey Xie. 2010. Primitives for active Internet topology mapping: Toward high-frequency characterization. In Proc. of IMC.
[7]
Zachary S. Bischof, Romain Fontugne, and Fabián E. Bustamante. 2018. Untangling the world-wide mesh of undersea cables. In Proc. of HotNets.
[8]
Ilker Nadi Bozkurt, Waqar Aqeel, Debopam Bhattacherjee, Balakrishnan Chandrasekaran, Philip Brighten Godfrey, Gregory Laughlin, Bruce M Maggs, and Ankit Singla. 2018. Dissecting Latency in the Internet's Fiber Infrastructure. arXiv preprint arXiv:1811.10737 (2018).
[9]
CAIDA. 2019. Macroscopic Internet Topology Data Kit (ITDK). http://www.caida.org/data/internet-topology-data-kit/. (2019).
[10]
CAIDA. 2023 a. Archipelago Measurement Infrastructure Updates. https://catalog.caida.org/details/media/2011_archipelago. (2023). Accessed: 2021--9--30.
[11]
CAIDA. 2023 b. AS Relationships (serial-1). https://catalog.caida.org/details/dataset/as_relationships_serial_1. (2023). Accessed: 2022--1--15.
[12]
CAIDA. 2023 c. CAIDA Ark IPv4 prefix-probing data. https://catalog.caida.org/details/dataset/ark_ipv4_prefix_probing. (2023). Accessed: 2021--12--22.
[13]
CAIDA. 2023 d. Internet eXchange Points Dataset. https://catalog.caida.org/details/dataset/ixps/. (2023). Accessed: 2022--1--17.
[14]
Esteban Carisimo, Julián M Del Fiore, Diego Dujovne, Cristel Pelsser, and J Ignacio Alvarez-Hamelin. 2020. A first look at the Latin American IXPs. ACM SIGCOMM Computer Communication Review, Vol. 50, 1 (2020), 18--24.
[15]
Esteban Carisimo, Alexander Gamero-Garrido, Alex C Snoeren, and Alberto Dainotti. 2021. Identifying ASes of state-owned internet operators. In Proc. of IMC.
[16]
Esteban Carisimo, Carlos Selmo, J Ignacio Alvarez-Hamelin, and Amogh Dhamdhere. 2019. Studying the evolution of content providers in IPv4 and IPv6 internet cores. The International Journal for the Computer and Telecommunications Industry, Vol. 145 (2019), 54--65.
[17]
Yi-Ching Chiu, Brandon Schlinker, Abhishek Balaji Radhakrishnan, Ethan Katz-Bassett, and Ramesh Govindan. 2015. Are we one hop away from a better internet?. In Proc. of IMC.
[18]
Aaron Clauset, Cosma Rohilla Shalizi, and Mark EJ Newman. 2009. Power-law distributions in empirical data. arXiV (2009).
[19]
Reuven Cohen, Keren Erez, Daniel ben Avraham, and Shlomo Havlin. 2000. Resilience of the Internet to Random Breakdowns. Phys. Rev. Lett., Vol. 85 (Nov 2000), 4626--4628. Issue 21. https://doi.org/10.1103/PhysRevLett.85.4626
[20]
Amogh Dhamdhere, David D Clark, Alexander Gamero-Garrido, Matthew Luckie, Ricky KP Mok, Gautam Akiwate, Kabir Gogia, Vaibhav Bajpai, Alex C Snoeren, and Kc Claffy. 2018. Inferring persistent interdomain congestion. In Proc. of ACM SIGCOMM.
[21]
Amogh Dhamdhere and Constantine Dovrolis. 2010. The Internet is flat: modeling the transition from a transit hierarchy to a peering mesh. In Proc. of CoNEXT.
[22]
Benoit Donnet, Matthew Luckie, Pascal Mérindol, and Jean-Jacques Pansiot. 2012. Revealing MPLS Tunnels Obscured from Traceroute. ACM SIGCOMM Computer Communication Review, Vol. 42, 2 (mar 2012), 87--93.
[23]
Ramakrishnan Durairajan, Paul Barford, Joel Sommers, and Walter Willinger. 2015. InterTubes: A Study of the US Long-haul Fiber-optic Infrastructure. In Proc. of ACM SIGCOMM.
[24]
Anne Edmundson, Roya Ensafi, Nick Feamster, and Jennifer Rexford. 2018. Nation-state hegemony in internet routing. In Proc. of the ACM SIGCAS Conference on Computing and Sustainable Societies.
[25]
European Comission. 2022. General Data Protection Regulation. https://www.gdpreu.org. (2022).
[26]
European Investment Bank. 2009. EU-Africa Infrastructure Trust Fund: Annual report 2009. https://www.eib.org/attachments/country/eu_africa_infrastructure_trust_fund_annual_report_2009_en.pdf. (2009).
[27]
Michalis Faloutsos, Petros Faloutsos, and Christos Faloutsos. 1999. On Power-Law Relationships of the Internet Topology. (1999).
[28]
Rodérick Fanou, Pierre Francois, and Emile Aben. 2015. On the diversity of interdomain routing in africa. In Proc. of PAM.
[29]
Rodérick Fanou, Bradley Huffaker, Ricky Mok, and Kimberly C Claffy. 2020. Unintended consequences: Effects of submarine cable deployment on Internet routing. In Proc. of PAM. Springer, 211--227.
[30]
Lixin Gao and Jennifer Rexford. 2001. Stable Internet routing without global coordination. IEEE/ACM Transactions on networking, Vol. 9, 6 (2001), 681--692.
[31]
Petros Gigis, Matt Calder, Lefteris Manassakis, George Nomikos, Vasileios Kotronis, Xenofontas Dimitropoulos, Ethan Katz-Bassett, and Georgios Smaragdakis. 2021. Seven years in the life of Hypergiants' off-nets. In Proc. of ACM SIGCOMM.
[32]
Vasileios Giotsas, Matthew Luckie, Bradley Huffaker, and KC Claffy. 2014. Inferring complex AS relationships. In Proc. of IMC.
[33]
Arpit Gupta, Matt Calder, Nick Feamster, Marshini Chetty, Enrico Calandro, and Ethan Katz-Bassett. 2014. Peering at the internet's frontier: A first look at isp interconnectivity in africa. In Proc. of PAM.
[34]
Melissa E Hathaway. 2014. Connected choices: how the Internet is challenging sovereign decisions. American Foreign Policy Interests, Vol. 36, 5 (2014), 300--313.
[35]
Rebecca Hersher. 2018. Rising Seas Could Cause Problems For Internet Infrastructure. https://www.npr.org/2018/07/16/627254166/rising-seas-could-cause-problems-for-internet-infrastructure. (2018).
[36]
Chi-Yao Hong, Srikanth Kandula, Ratul Mahajan, Ming Zhang, Vijay Gill, Mohan Nanduri, and Roger Wattenhofer. 2013. Achieving high utilization with software-driven WAN. In Proc. of ACM SIGCOMM.
[37]
Bradley Huffaker, Marina Fomenkov, and K Claffy. 2011. Geocompare: a comparison of public and commercial geolocation databases. In Proc. of NMMC.
[38]
The International Cable Protection Committee (ICPC). 2021. Statement at the 21st Meeting of Informal Consultative Process on Seal-level Rise and its Impacts. https://www.un.org/depts/los/consultative_process/icp21/ICP21_item%203_ICPC_English.pdf. (2021).
[39]
IODA. 2021. IODA Signals for Valle del Cauca between April 1 2021 and April 29 2021. https://bit.ly/3sGUtU0. (2021).
[40]
Quentin Jacquemart, Clément Pigout, and Guillaume Urvoy-Keller. 2019. Inferring the Deployment of Top Domains over Public Clouds using DNS Data. In Proc. of TMA.
[41]
Sushant Jain, Alok Kumar, Subhasree Mandal, Joon Ong, Leon Poutievski, Arjun Singh, Subbaiah Venkata, Jim Wanderer, Junlan Zhou, Min Zhu, et al. 2013. B4: Experience with a globally-deployed software defined WAN. In Proc. of ACM SIGCOMM.
[42]
Ethan Katz-Bassett, John P John, Arvind Krishnamurthy, David Wetherall, Thomas Anderson, and Yatin Chawathe. 2006. Towards IP geolocation using delay and topology measurements. In Proc. of IMC.
[43]
Ken Keys, Young Hyun, Matthew Luckie, and Kim Claffy. 2012. Internet-scale IPv4 alias resolution with MIDAR. IEEE/ACM TONS, Vol. 21, 2 (2012), 383--399.
[44]
Rowan Klöti, Bernhard Ager, Vasileios Kotronis, George Nomikos, and Xenofontas Dimitropoulos. 2016. A comparative look into public IXP datasets. ACM SIGCOMM Computer Communication Review, Vol. 46, 1 (2016), 21--29.
[45]
Rupa Krishnan, Harsha V Madhyastha, Sridhar Srinivasan, Sushant Jain, Arvind Krishnamurthy, Thomas Anderson, and Jie Gao. 2009. Moving beyond end-to-end path information to optimize CDN performance. In Proc. of ACM SIGCOMM.
[46]
Craig Labovitz, Scott Iekel-Johnson, Danny McPherson, Jon Oberheide, and Farnam Jahanian. 2010. Internet inter-domain traffic. In Proc. of ACM SIGCOMM.
[47]
Dave Levin, Youndo Lee, Luke Valenta, Zhihao Li, Victoria Lai, Cristian Lumezanu, Neil Spring, and Bobby Bhattacharjee. 2015. Alibi Routing. In Proc. of ACM SIGCOMM.
[48]
Shucheng Liu, Zachary S Bischof, Ishaan Madan, Peter K Chan, and Fabián E Bustamante. 2020. Out of Sight, Not Out of Mind: A User-View on the Criticality of the Submarine Cable Network. In Proc. of IMC.
[49]
Ioana Livadariu, Thomas Dreibholz, Anas Saeed Al-Selwi, Haakon Bryhni, Olav Lysne, Steinar Bjørnstad, and Ahmed Elmokashfi. 2020. On the Accuracy of Country-Level IP Geolocation. In Proceedings of the Applied Networking Research Workshop.
[50]
Aemen Lodhi, Natalie Larson, Amogh Dhamdhere, Constantine Dovrolis, and Kc Claffy. 2014. Using peeringDB to understand the peering ecosystem. ACM SIGCOMM Computer Communication Review, Vol. 44, 2 (2014), 20--27.
[51]
Matthew Luckie, Bradley Huffaker, Amogh Dhamdhere, Vasileios Giotsas, and KC Claffy. 2013. AS relationships, customer cones, and validation. In Proc. of IMC.
[52]
M. Luckie, B. Huffaker, A. Marder, Z. Bischof, M. Fletcher, and k. claffy. 2021. Learning to Extract Geographic Information from Internet Router Hostnames. In Proc. of CoNEXT.
[53]
M. Luckie, A. Marder, B. Huffaker, and k. claffy. 2021--12. Learning Regexes to Extract Network Names from Hostnames. In Asian Internet Engineering Conference (AINTEC).
[54]
Alexander Marder, Matthew Luckie, Amogh Dhamdhere, Bradley Huffaker, kc Claffy, and Jonathan M Smith. 2018. Pushing the boundaries with bdrmapit: Mapping router ownership at Internet scale. In Proc. of IMC.
[55]
Maxmind. 2023. Maxmind Geolocation Data. https://www.maxmind.com/en/geoip2-services-and-databases. (2023).
[56]
Thierry Mayer and Soledad Zignago. 2011. Notes on CEPII's distances measures: The GeoDist database. (2011).
[57]
The United Nations. 2016. Summary of the First Global Integrated Marine Assessment. https://www.un.org/depts/los/global_reporting/WOA_RPROC/Summary.pdf. (2016).
[58]
Jonathan A Obar and Andew Clement. 2012. Internet surveillance and boomerang routing: A call for Canadian network sovereignty. In TEM 2013: Proceedings of the Technology & Emerging Media Track-Annual Conference of the Canadian Communication Association (Victoria.
[59]
Abhinav Pathak, Mingn Zhang, Y Charlie Hu, Ratul Mahajan, and Dave Maltz. 2011. Latency inflation with MPLS-based traffic engineering. In Proc. of IMC.
[60]
Ingmar Poese, Steve Uhlig, Mohamed Ali Kaafar, Benoit Donnet, and Bamba Gueye. 2011. IP geolocation databases: Unreliable? ACM SIGCOMM Computer Communication Review, Vol. 41, 2 (2011), 53--56.
[61]
RCN Radio. 2021. Falla en cable del Pacífico afecta a miles de usuarios de Internet en todo el país. https://www.rcnradio.com/colombia/falla-en-cable-del-pacifico-afecta-miles-de-usuarios-de-internet-en-todo-el-pais. (2021).
[62]
Justine Sherry, Peter Xiang Gao, Soumya Basu, Aurojit Panda, Arvind Krishnamurthy, Christian Maciocco, Maziar Manesh, Jo ao Martins, Sylvia Ratnasamy, Luigi Rizzo, and Scott Shenker. 2015. Rollback-Recovery for Middleboxes. In Proc. of ACM SIGCOMM.
[63]
Joel Sommers, Paul Barford, and Brian Eriksson. 2011. On the prevalence and characteristics of MPLS deployments in the open Internet. In Proc. of IMC.
[64]
Richard A. Steenbergen. 2009. A practical guide to (correctly) troubleshooting with traceroute. NANOG.
[65]
the Federative Republic of Brazil. 2022. Brazilian General Data Protection Law. https://www.lgpdbrasil.com.br. (2022).
[66]
T-Mobile USA. 2020. T-Mobile Completes Merger with Sprint to Create the New T-Mobile. https://www.t-mobile.com/news/un-carrier/t-mobile-sprint-one-company. (2020).
[67]
Yves Vanaubel, Pascal Mérindol, Jean-Jacques Pansiot, and Benoit Donnet. 2017. Through the wormhole: Tracking invisible MPLS tunnels. In Proc. of IMC.
[68]
Colin Wall and Pierre Morcos. 2021. Invisible and Vital: Undersea cables and transatlantic security. Center for Strategic and International Studies June (2021).
[69]
Walter Willinger, David Alderson, and John C. Doyle. 2009. Mathematics and the internet: A source of enormous confusion and great potential. Notices of the American Mathematical Society, Vol. 56, 5 (2009), 586--599.
Index Terms
- A Hop Away from Everywhere: A View of the Intercontinental Long-haul Infrastructure
Recommendations
A Hop Away from Everywhere: A View of the Intercontinental Long-haul Infrastructure
SIGMETRICS '24We present a longitudinal study of intercontinental long-haul links (LHL) - links with latencies significantly higher than that of all other links in a traceroute path. Our study is motivated by the recognition of these LHLs as a network-layer ...
A Hop Away from Everywhere: A View of the Intercontinental Long-haul Infrastructure
SIGMETRICS/PERFORMANCE '24: Abstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer SystemsWe present a longitudinal study of intercontinental long-haul links (LHL) - links with latencies significantly higher than that of all other links in a traceroute path. Our study is motivated by the recognition of these LHLs as a network-layer ...
WDM-PONs Hold Promise for the Long Haul
As they face challenging times, networking-service providers are looking to save money by studying the use of relatively new wavelength-division-multiplexing-based passive optical networks to create more efficient systems that increase data rates.
Comments
Information & Contributors
Information
Published In
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 December 2023
Published in POMACS Volume 7, Issue 3
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 367Total Downloads
- Downloads (Last 12 months)367
- Downloads (Last 6 weeks)46
Reflects downloads up to 17 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in