research-article

On dominant characteristics of residential broadband internet traffic

Authors:

Mark AllmanAuthors Info & Claims

IMC '09: Proceedings of the 9th ACM SIGCOMM conference on Internet measurement

Pages 90 - 102

https://doi.org/10.1145/1644893.1644904

Published: 04 November 2009 Publication History

Abstract

While residential broadband Internet access is popular in many parts of the world, only a few studies have examined the characteristics of such traffic. In this paper we describe observations from monitoring the network activity for more than 20,000 residential DSL customers in an urban area. To ensure privacy, all data is immediately anonymized. We augment the anonymized packet traces with information about DSL-level sessions, IP (re-)assignments, and DSL link bandwidth.

Our analysis reveals a number of surprises in terms of the mental models we developed from the measurement literature. For example, we find that HTTP - not peer-to-peer - traffic dominates by a significant margin; that more often than not the home user's immediate ISP connectivity contributes more to the round-trip times the user experiences than the WAN portion of the path; and that the DSL lines are frequently not the bottleneck in bulk-transfer performance.

References

[1]

ABRAMS, M., STANDRIDGE, C. R., ABDULLA, G., WILLIAMS, S., AND FOX, E. A. Caching Proxies: Limitations and Potentials. In Proc. World Wide Web Conference (1995).

Digital Library

[2]

AIKAT, J., KAUR, J., SMITH, F. D., AND JEFFAY, K. Variability in TCP Round-trip Times. In Proc. ACM Internet Measurement Conference (2003).

Digital Library

[3]

ANDERSON, N. P2P Traffic Drops as Streaming Video Grows in Popularity. http://arstechnica.com/old/content/2008/09/p2p-traffic-drops-as-streaming-video-grows-in-popularity.ars.

[4]

ARLITT, M., AND WILLIAMSON, C. Internet Web Servers: Workload Characterization and Implications. IEEE/ACM Trans. Networking (1997).

Digital Library

[5]

BARFORD, P., BESTAVROS, A., BRADLEY, A., AND CROVELLA, M. Changes in Web Client Access Patterns: Characteristics and Caching Implications. World Wide Web 2 (1999).

Digital Library

[6]

BLANTON, E., AND ALLMAN, M. On Making TCP More Robust to Packet Reordering. ACM Computer Communication Review 32, 1 (Jan 2002), 20--30.

Digital Library

[7]

BONFIGLIO, D., MELLIA, M., MEO, M., ROSSI, D., AND TOFANELLI, P. Revealing Skype Traffic: When Randomness Plays With You. In Proc. ACM SIGCOMM (2007).

Digital Library

[8]

CHA, M., KWAK, H., RODRIGUEZ, P., AHN, Y.-Y., AND MOON, S. I Tube, You Tube, Everybody Tubes. In Proc. ACM Internet Measurement Conference (2007).

Digital Library

[9]

CHO, K., FUKUDA, K., ESAKI, H., AND KATO, A. The Impact and Implications of the Growth in Residential User-to-User Traffic. In Proc. ACM SIGCOMM (2006).

Digital Library

[10]

CHO, K., FUKUDA, K., ESAKI, H., AND KATO, A. Observing Slow Crustal Movement in Residential User Traffic. In Proc. ACM CoNEXT (2008).

Digital Library

[11]

CROVELLA, M., AND BESTAVROS, A. Self-Similarity in World Wide Web Traffic: Evidence and Possible Causes. IEEE/ACM Trans. Networking (1997).

Digital Library

[12]

DISCHINGER, M., HAEBERLEN, A., GUMMADI, K. P., AND SAROIU, S. Characterizing Residential Broadband Networks. In Proc. ACM Internet Measurement Conference (2007).

Digital Library

[13]

DREGER, H., FELDMANN, A., MAI, M., PAXSON, V., AND SOMMER, R. Dynamic Application-Layer Protocol Analysis for Network Intrusion Detection. In Proc. Usenix Security Symp. (2006).

Digital Library

[14]

ENDACE MEASUREMENT SYSTEMS. http://www.endace.com/, 2008.

[15]

ERMAN, J., GERBER, A., HAJIAGHAYI, M. T., PEI, D., AND SPATSCHECK, O. Network-aware Forward Caching. In World Wide Web (2009), pp. 291--300.

Digital Library

[16]

FELDMANN, A., CACERES, R., DOUGLIS, F., GLASS, G., AND RABINOVICH, M. Performance of Web Proxy Caching in Heterogeneous Bandwidth Environments. In Proc. IEEE INFOCOM (1999).

[17]

FELDMANN, A., GREENBERG, A., LUND, C., REINGOLD, N., REXFORD, J., AND TRUE, F. Deriving Traffic Demands for Operational IP Networks: Methodology and Experience. IEEE/ACM Trans. Networking 9 (2001).

Digital Library

[18]

FRALEIGH, C., MOON, S., LYLES, B., COTTON, C., KHAN, M., MOLL, D., ROCKELL, R., SEELY, T., AND DIOT, S. C. Packet-Level Traffic Measurements from the Sprint IP backbone. IEEE Network Magazine 17, 6 (2003).

Digital Library

[19]

FUKUDA, K., CHO, K., AND ESAKI, H. The Impact of Residential Broadband Traffic on Japanese ISP backbones. ACM Comp. Comm. Review 35, 1 (2005).

Digital Library

[20]

GILL, P., ARLITT, M., LI, Z., AND MAHANTI, A. YouTube Traffic Characterization: A View From the Edge. In Proc. ACM Internet Measurement Conference (2007).

Digital Library

[21]

GOLDER, S., WILKINSON, D., AND HUBERMAN, B. A. Rhythms of Social Interaction: Messaging within a Massive Online Network. In International Conference on Communities and Technologies (2007).

[22]

HENDERSON, T., KOTZ, D., AND ABYZOV, I. The Changing Usage of a Mature Campus-wide Wireless Network. In Proc. ACM MOBICOM (2004).

Digital Library

[23]

HYUN-CHUL, K., CLAFFY, K., FOMENKOV, M., BARMAN, D., FALOUTSOS, M., AND LEE, K. Internet Traffic Classification Demystified: Myths, Caveats, and the Best Practices. In Proc. ACM CoNEXT (2008).

Digital Library

[24]

ITU. ADSL standards ITU G.992.1-5.

[25]

JIANG, H., AND DOVROLIS, C. Passive Estimation of TCP Round-Trip Times. ACM Comp. Comm. Review 32, 3 (2002).

Digital Library

[26]

KARAGIANNIS, T., BROIDO, A., BROWNLEE, N., CLAFFY, K. C., AND FALOUTSOS, M. Is P2P dying or just hiding? In Proc. IEEE GLOBECOM (Nov 2004).

[27]

KARAGIANNIS, T., RODRIGUEZ, P., AND PAPAGIANNAKI, K. Should Internet Service Providers Fear Peer-Assisted Content Distribution? In Proc. ACM Internet Measurement Conference (2005).

Digital Library

[28]

KITZ.CO.UK. Interlaving Explained. http://www.kitz.co.uk/adsl/interleaving.htm.

[29]

KOTZ, D., AND ESSIEN, K. Characterizing Usage of a Campus-wide Wireless Network. Tech. rep., Dept. of Comp.Sci, Dartmouth College, Mar 2002.

[30]

KOTZ, D., AND ESSIEN, K. Analysis of a campus-wide Wireless Network. Wireless Networks 11, 1-2 (2005), 115--133.

Digital Library

[31]

KRISHNAMURTHY, B., AND REXFORD, J. Web Protocols and Practice. Addison-Wesley, 2001.

[32]

L7FILTER. Application Layer Packet Classifier for Linux. http://l7-filter.sourceforge.net/.

[33]

MATHIS, M., SEMKE, J., MAHDAVI, J., AND OTT, T. The Macroscopic Behavior of the TCP Congestion Avoidance Algorithm. Computer Communication Review 27, 3 (Jul 1997).

Digital Library

[34]

MEDINA, A., ALLMAN, M., AND FLOYD, S. Measuring the Evolution of Transport Protocols in the Internet. ACM Comp. Comm. Review 35, 2 (2004).

Digital Library

[35]

MOORE, D., SHANNON, C., AND CLAFFY, K. Code-Red: A Case Study on the Spread and Victims of an Internet Worm. In Proc. ACM Measurement Workshop (2002), pp. 273--284.

Digital Library

[36]

NAZIR, A., RAZA, S., AND CHUAH, C.-N. Unveiling Facebook: A Measurement Study of Social Network Based Applications. In Proc. ACM Internet Measurement Conference (2008).

Digital Library

[37]

NETZIKON. Zwangstrennung (in German). http://netzikon.net/lexikon/z/dsl-zwangstrennung.html, 2009.

[38]

OECD. OECD Broadband Portal. http://www.oecd.org/sti/ict/broadband, 2008.

[39]

PADHYE, J., FIROIU, V., TOWSLEY, D., AND KUROSE, J. Modeling TCP Throughput: A Simple Model and its Empirical Validation. In ACM SIGCOMM (Sep 1998).

Digital Library

[40]

PARKER, A. CacheLogic: P2P Media Summit.

[41]

PAXSON, V. Bro: A System for Detecting Network Intruders in Real-Time. Comuter Networks 31, 23--24 (1999).

Digital Library

[42]

RAPIDSHARE. http://www.rapidshare.com/, 2009.

[43]

RIGNEY, C., WILLENS, S., LIVINGSTON, RUBENS, A., MERIT, SIMPSON, W., AND DAYDREAMER. Remote Authentication Dial In User Service (RADIUS). RFC 2865, 2000.

Digital Library

[44]

SCHNEIDER, F., AGARWAL, S., ALPCAN, T., AND FELDMANN, A. The New Web: Characterizing AJAX Traffic. In Proc. Passive and Active Measurement Conference (2008).

Digital Library

[45]

SCHULZE, H., AND MOCHALSKI, K. Ipoque: Internet Study 2007.

[46]

SCHULZE, H., AND MOCHALSKI, K. Ipoque: Internet study 2008/2009.

[47]

SIEKKINEN, M., COLLANGE, D., URVOY KELLER, G., AND BIERSACK, E. W. Performance Limitations of ADSL Users: A Case Study. In Proc. Passive and Active Measurement Conference (2007).

Digital Library

[48]

SIEKKINEN, M., URVOY KELLER, G., BIERSACK, E. W., AND COLLANGE, D. A Root Cause Analysis Toolkit for TCP. Comuter Networks 52, 9 (Jun 2008).

Digital Library

[49]

SRIPANIDKULCHAI, K., MAGGS, B., AND ZHANG, H. An Analysis of Live Streaming Workloads on the Internet. In Proc. ACM Internet Measurement Conference (2004).

Digital Library

[50]

TOMLINSON, D. Plusnet report: More Record Breaking Streaming and the Latest iPlayer News. http://community.plus.net/blog/2008/07/17/more-record-breaking-streaming-and-thelatest-iplayer-news/.

[51]

VEAL, B., LI, K., AND LOWENTHAL, D. New Methods for Passive Estimation of TCP Round-Trip Times. In Proc. Passive and Active Measurement Conference (2005).

Digital Library

[52]

WIKIPEDIA. Zwangstrennung (in German). http://de.wikipedia.org/w/index.php?title=Zwangstrennung&oldid=56733242, 2009.

[53]

WILLS, C., AND MIKHAILOV, M. Studying the impact of more complete server information on Web caching. In Proc. of the 5th International Web Caching and Content Delivery Workshop (2000).

[54]

XIE, Y., YU, F., ACHAN, K., GILLUM, E., GOLDSZMIDT, M., AND WOBBER, T. How Dynamic are IP Addresses? In Proc. ACM SIGCOMM (2007).

Digital Library

[55]

YU, H., ZHENG, D., ZHAO, B. Y., AND ZHENG, W. Understanding User Behavior in Large-Scale Video-on-Demand Systems. ACM SIGOPS Operating System Review 40, 4 (2006).

Digital Library

[56]

ZHANG, Y., BRESLAU, L., PAXSON, V., AND SHENKER, S. On the Characteristics and Origins of Internet Flow Rates. In Proc. ACM SIGCOMM (2002).

Digital Library

[57]

ZINK, M., SUH, K., GU, Y., AND KUROSE., J. Watch Global, Cache Local: YouTube Network Traces at a Campus Network - Measurements and Implications. In Proc. ACM Multimedia Computing and Networking (2008).

Cited By

Figueiredo RWoesner HKassler AKarl H(2024)Quality of Service Performance of Multi-Core Broadband Network Gateways2024 8th Network Traffic Measurement and Analysis Conference (TMA)10.23919/TMA62044.2024.10559123(1-10)Online publication date: 21-May-2024
https://doi.org/10.23919/TMA62044.2024.10559123
Darwich ORimlinger HDreyfus MGouel MVermeulen KMontpetit MLeivadeas AUhlig SJaved M(2023)Replication: Towards a Publicly Available Internet Scale IP Geolocation DatasetProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624801(1-15)Online publication date: 24-Oct-2023
https://dl.acm.org/doi/10.1145/3618257.3624801
Liu HLi WPang YPei RHu YLiu YSuo LLi K(2023)Accelerating Data Delivery of Latency-Sensitive Applications in Container Overlay NetworkIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.330074534:12(3046-3058)Online publication date: Dec-2023
https://doi.org/10.1109/TPDS.2023.3300745
Show More Cited By

Index Terms

On dominant characteristics of residential broadband internet traffic
1. Networks
  1. Network protocols
  2. Network services
    1. Network monitoring

Recommendations

Characterizing residential broadband networks
IMC '07: Proceedings of the 7th ACM SIGCOMM conference on Internet measurement

A large and rapidly growing proportion of users connect to the Internet via residential broadband networks such as Digital Subscriber Lines (DSL) and cable. Residential networks are often the bottleneck in the last mile of today's Internet. Their ...
The impact of residential broadband traffic on Japanese ISP backbones

This paper investigates the effects of the rapidly-growing residential broadband traffic on commercial ISP backbone networks. We collected month-long aggregated traffic logs for different traffic groups from seven major ISPs in Japan in order to analyze ...
On traffic characteristics of a broadband wireless internet access
NGI'09: Proceedings of the 5th Euro-NGI conference on Next Generation Internet networks

Internet traffic measurements and traffic characterization are essential for managing and optimizing network infrastructures. The increasing number of wireless Internet users and the changing application demands require consecutive traffic measurements. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IMC '09: Proceedings of the 9th ACM SIGCOMM conference on Internet measurement

November 2009

468 pages

ISBN:9781605587714

DOI:10.1145/1644893

Program Chairs:
Anja Feldmann
Deutsche Telekom Laboratories / TU Berlin
,
Laurent Mathy
Lancaster University

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

In-Cooperation

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IMC '09

Sponsor:

SIGCOMM

IMC '09: Internet Measurement Conference

November 4 - 6, 2009

Illinois, Chicago, USA

Acceptance Rates

Overall Acceptance Rate 277 of 1,083 submissions, 26%

Upcoming Conference

IMC '24

Sponsor:
sigcomm
sigcomm

ACM Internet Measurement Conference

November 4 - 6, 2024

Madrid , AA , Spain

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

291
Total Citations
View Citations
2,049
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Figueiredo RWoesner HKassler AKarl H(2024)Quality of Service Performance of Multi-Core Broadband Network Gateways2024 8th Network Traffic Measurement and Analysis Conference (TMA)10.23919/TMA62044.2024.10559123(1-10)Online publication date: 21-May-2024
https://doi.org/10.23919/TMA62044.2024.10559123
Darwich ORimlinger HDreyfus MGouel MVermeulen KMontpetit MLeivadeas AUhlig SJaved M(2023)Replication: Towards a Publicly Available Internet Scale IP Geolocation DatasetProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624801(1-15)Online publication date: 24-Oct-2023
https://dl.acm.org/doi/10.1145/3618257.3624801
Liu HLi WPang YPei RHu YLiu YSuo LLi K(2023)Accelerating Data Delivery of Latency-Sensitive Applications in Container Overlay NetworkIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.330074534:12(3046-3058)Online publication date: Dec-2023
https://doi.org/10.1109/TPDS.2023.3300745
Cuba DKulkarni ARocha A(2023)Predicting Customer Quality of Service for a Large Fixed Broadband Service Provider2023 International Wireless Communications and Mobile Computing (IWCMC)10.1109/IWCMC58020.2023.10183169(669-674)Online publication date: 19-Jun-2023
https://doi.org/10.1109/IWCMC58020.2023.10183169
Gui XCao YYou IJi LLuo YLuo Z(2022)A Survey of techniques for fine-grained web traffic identification and classificationMathematical Biosciences and Engineering10.3934/mbe.202213819:3(2996-3021)Online publication date: 2022
https://doi.org/10.3934/mbe.2022138
Kuang YLi DHuang X(2022)KL-DectionWireless Communications & Mobile Computing10.1155/2022/50995082022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/5099508
Perdices DPerna GTrevisan MGiordano DMellia MBarakat CPelsser CBenson TChoffnes D(2022)When satellite is all you haveProceedings of the 22nd ACM Internet Measurement Conference10.1145/3517745.3561432(137-150)Online publication date: 25-Oct-2022
https://dl.acm.org/doi/10.1145/3517745.3561432
Ruth KFass AAzose JPearson MThomas ESadowski CDurumeric ZBarakat CPelsser CBenson TChoffnes D(2022)A world wide view of browsing the world wide webProceedings of the 22nd ACM Internet Measurement Conference10.1145/3517745.3561418(317-336)Online publication date: 25-Oct-2022
https://dl.acm.org/doi/10.1145/3517745.3561418
Zerwas JPoese ISchmid SBlenk A(2022)On the Benefits of Joint Optimization of Reconfigurable CDN-ISP InfrastructureIEEE Transactions on Network and Service Management10.1109/TNSM.2021.311913419:1(158-173)Online publication date: Mar-2022
https://doi.org/10.1109/TNSM.2021.3119134
Gomez JKfoury ECrichigno JSrivastava G(2022)A survey on TCP enhancements using P4-programmable devicesComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2022.109030212:COnline publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1016/j.comnet.2022.109030
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents