Article

The web is smaller than it seems

Authors:

Andrew J. Kalafut,

Minaxi GuptaAuthors Info & Claims

IMC '07: Proceedings of the 7th ACM SIGCOMM conference on Internet measurement

Pages 123 - 128

https://doi.org/10.1145/1298306.1298324

Published: 24 October 2007 Publication History

Abstract

The Web has grown beyond anybody's imagination. While significant research has been devoted to understanding aspects of the Web from the perspective of the documents that comprise it, we have little data on the relationship among servers that comprise the Web. In this paper, we explore the extent to which Web servers are co-located with other Web servers in the Internet. In terms of the location of servers, we find that the Web is surprisingly smaller than it seems. Our work has important implications for the availability of Web servers in case of DoS attacks and blocklisting.

References

[1]

DMOZ, "Open directory project."

[2]

VeriSign, Inc., "COM NET Registry TLD Zone Access Program," http://www.verisign.com/information-services/naming-services/com-net-registry/page_001052.html.

[3]

VeriSign, "Domain name industry brief," June 2007, http://www.verisign.com/static/042161.pdf.

[4]

U of Oregon Advanced Network Technology Center, "Route Views project," http://www.routeviews.org/.

[5]

H. Chang, S. Jamin, Z. M. Mao, and W. Willinger, "An empirical approach to modeling inter-AS traffic matrices," in ACM SIGCOMM Internet Measurement Conference (IMC), 2005.

Digital Library

[6]

B. Claise, "Cisco systems NetFlow services export version 9," IETF RFC 3954, Oct. 2004.

[7]

Bluetack Internet Security Solutions, "B.I.S.S. Forums," http://www.bluetack.co.uk/forums/index.php.

[8]

P. Mockapetris, "Domain names - concepts and facilities," IETF RFC 1034, Nov. 1987.

Digital Library

[9]

R. Albert, H. Jeong, and A. Barabasi, "Diameter of the world wide web," Nature, vol. 401, pp. 130--131, 1999.

[10]

A. Ntoulas, J. Cho, and C. Olston, "What's new on the web?: the evolution of the web from a search engine perspective," in International World Wide Web Conference, 2004.

Digital Library

[11]

M. Crovella and A. Bestavros, "Self-similarity in world wide web traffic: evidence and possible causes," IEEE Transactions Of Networking, vol 5, no 6, pp. 835--846, 1997.

Digital Library

[12]

L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker, "Web caching and Zipf-like distributions: evidence and implications," in IEEE INFOCOM, 1999.

[13]

P. Barford and M. Crovella, "Generating representative web workloads for network and server performance evaluation," in ACM SIGMETRICS, 1998.

Digital Library

[14]

M. Arlitt and C. Williamson, "Web server workload characterization: the search for invariants," in ACM SIGMETRICS, 1996.

Digital Library

[15]

J. Pang, J. Hendricks, A. Akella, R. D. Prisco, B. Maggs, and S. Seshan, "Availability, usage, and deployment characteristics of the domain name system," in ACM SIGCOMM Internet Measurement Conference (IMC), 2004.

Digital Library

[16]

B. Edelman, "Web sites sharing IP addresses: Prevalence and significance," Sept. 2003, http://cyber.law.harvard.edu/people/edelman/ip-sharing/.

Cited By

Xu CZhang YShi FShan HGuo BLi YXue P(2023)Measuring the Centrality of DNS Infrastructure in the WildApplied Sciences10.3390/app1309573913:9(5739)Online publication date: 6-May-2023
https://doi.org/10.3390/app13095739
van der Toorn OMüller MDickinson SHesselman CSperotto Avan Rijswijk-Deij R(2022)Addressing the challenges of modern DNS a comprehensive tutorialComputer Science Review10.1016/j.cosrev.2022.10046945(100469)Online publication date: Aug-2022
https://doi.org/10.1016/j.cosrev.2022.100469
Ueda KTagami AWählisch MAfanasyev A(2021)Internet flattening and consolidation considered useful (for deploying new Internet architecture)Proceedings of the Interdisciplinary Workshop on (de) Centralization in the Internet10.1145/3488663.3493688(11-17)Online publication date: 7-Dec-2021
https://dl.acm.org/doi/10.1145/3488663.3493688
Show More Cited By

Index Terms

The web is smaller than it seems
1. Networks
  1. Network protocols
    1. Transport protocols
  2. Network types
    1. Public Internet

Recommendations

Understanding web documents: finding pagelets for transformation using structural patterns

Understanding a web document and the sections inside the document is very important for web transformation and information retrieval from web pages. Detecting pagelets, which are small features located inside a web page, in order to understand a web ...
Mining the web with hierarchical crawlers – a resource sharing based crawling approach

An important component of any web search engine is its crawler, which is also known as robot or spider. An efficient set of crawlers make any search engine more powerful, apart from its other measures of performance, such as its ranking algorithm, ...
Improving the performance of focused web crawlers

This work addresses issues related to the design and implementation of focused crawlers. Several variants of state-of-the-art crawlers relying on web page content and link information for estimating the relevance of web pages to a given topic are ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IMC '07: Proceedings of the 7th ACM SIGCOMM conference on Internet measurement

October 2007

390 pages

ISBN:9781595939081

DOI:10.1145/1298306

Program Chairs:
Constantine Dovrolis
Georgia Institute of Technology
,
Matthew Roughan
University of Adelaide, Australia

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

IMC07

Sponsor:

IMC07: Internet Measurement Conference

October 24 - 26, 2007

California, San Diego, USA

Acceptance Rates

Overall Acceptance Rate 277 of 1,083 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
292
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Xu CZhang YShi FShan HGuo BLi YXue P(2023)Measuring the Centrality of DNS Infrastructure in the WildApplied Sciences10.3390/app1309573913:9(5739)Online publication date: 6-May-2023
https://doi.org/10.3390/app13095739
van der Toorn OMüller MDickinson SHesselman CSperotto Avan Rijswijk-Deij R(2022)Addressing the challenges of modern DNS a comprehensive tutorialComputer Science Review10.1016/j.cosrev.2022.10046945(100469)Online publication date: Aug-2022
https://doi.org/10.1016/j.cosrev.2022.100469
Ueda KTagami AWählisch MAfanasyev A(2021)Internet flattening and consolidation considered useful (for deploying new Internet architecture)Proceedings of the Interdisciplinary Workshop on (de) Centralization in the Internet10.1145/3488663.3493688(11-17)Online publication date: 7-Dec-2021
https://dl.acm.org/doi/10.1145/3488663.3493688
Allman M(2020)Putting DNS in ContextProceedings of the ACM Internet Measurement Conference10.1145/3419394.3423659(309-316)Online publication date: 27-Oct-2020
https://dl.acm.org/doi/10.1145/3419394.3423659
Hoang NNiaki APolychronakis MGill P(2020)The web is still small after more than a decadeACM SIGCOMM Computer Communication Review10.1145/3402413.340241750:2(24-31)Online publication date: 25-May-2020
https://dl.acm.org/doi/10.1145/3402413.3402417
Hoang NAkhavan Niaki ABorisov NGill PPolychronakis MSun HShieh SGu GAteniese G(2020)Assessing the Privacy Benefits of Domain Name EncryptionProceedings of the 15th ACM Asia Conference on Computer and Communications Security10.1145/3320269.3384728(290-304)Online publication date: 5-Oct-2020
https://dl.acm.org/doi/10.1145/3320269.3384728
Allman M(2018)Comments on DNS RobustnessProceedings of the Internet Measurement Conference 201810.1145/3278532.3278541(84-90)Online publication date: 31-Oct-2018
https://dl.acm.org/doi/10.1145/3278532.3278541
Srinivasan BKountouras AMiramirkhani NAlam MNikiforakis NAntonakakis MAhamad MChampin PGandon FMédini LLalmas MIpeirotis P(2018)Exposing Search and Advertisement Abuse Tactics and Infrastructure of Technical Support ScammersProceedings of the 2018 World Wide Web Conference10.1145/3178876.3186098(319-328)Online publication date: 10-Apr-2018
https://dl.acm.org/doi/10.1145/3178876.3186098
Wählisch MSchmidt RSchmidt TMaennel OUhlig STyson Gde Oliveira JSmith JArgyraki KLevis P(2015)RiPKIProceedings of the 14th ACM Workshop on Hot Topics in Networks10.1145/2834050.2834102(1-7)Online publication date: 16-Nov-2015
https://dl.acm.org/doi/10.1145/2834050.2834102
Xu KWang FGu L(2014)Behavior analysis of internet traffic via bipartite graphs and one-mode projectionsIEEE/ACM Transactions on Networking10.1109/TNET.2013.226463422:3(931-942)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1109/TNET.2013.2264634
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents