Article

Increasing web server throughput with network interface data caching

Authors:

Hyong-youb Kim,

Scott RixnerAuthors Info & Claims

ASPLOS X: Proceedings of the 10th international conference on Architectural support for programming languages and operating systems

Pages 239 - 250

https://doi.org/10.1145/605397.605423

Published: 01 October 2002 Publication History

Abstract

This paper introduces network interface data caching, a new technique to reduce local interconnect traffic on networking servers by caching frequently-requested content on a programmable network interface. The operating system on the host CPU determines which data to store in the cache and for which packets it should use data from the cache. To facilitate data reuse across multiple packets and connections, the cache only stores application-level response content (such as HTTP data), with application-level and networking headers generated by the host CPU. Network interface data caching can reduce PCI traffic by up to 57% on a prototype implementation of a uniprocessor web server. This traffic reduction results in up to 31% performance improvement, leading to a peak server throughput of 1571 Mb/s.

References

[1]

Alteon WebSystems. Gigabit Ethernet/PCI Network Interface Card: Host/NIC Software Interface Definition, July 1999. Revision 12.4.13.

[2]

Martin F. Arlitt and Carey L. Williamson. Internet Web Servers: Workload Characterization and Performance Implications. IEEE/ACM Transactions on Networking, 5(5):631-645, October 1997.

Digital Library

[3]

Gaurav Banga, Jeffrey C. Mogul, and Peter Druschel. A scalable and explicit event delivery mechanism for UNIX. In Proceedings of the USENIX 1999 Annual Technical Conference, pages 253-265, June 1999.

Digital Library

[4]

Lee Breslau, Pei Cao, Li Fan, Graham Phillips, and Scott Schenker. Web Caching and Zipf-like Distributions: Evidence and Implications. In Proceedings of IEEE INFOCOM '99, volume 1, pages 126-134, March 1999.

[5]

Philip Buonadonna and David Culler. Queue Pair IP: A Hybrid Architecture for System Area Networks. In Proceedings of the 29th International Symposium on Computer Architecture, pages 247-256, May 2002.

Digital Library

[6]

Pei Cao and Sandy Irani. Cost-Aware WWW Proxy Caching Algorithms. In Proceedings of the 1997 USENIX Symposium on Internet Technology and Systems, pages 193-206, December 1997.

Digital Library

[7]

Peter Druschel and Larry L. Peterson. Fbufs: A High-Bandwidth Cross-Domain Transfer Facility. In Proceedings of the 14th Symposium on Operating Systems Principles (SOSP-14), pages 189-202, December 1993.

Digital Library

[8]

R. Fielding, J. Gettys, J. Mogul, H. Frystyk, L. Masinter, P. Leach, and T. Berners-Lee. Hypertext Transfer Protocol - HTTP 1.1. IETF RFC 2616, June 1999.

Digital Library

[9]

Karl Kleinpaste, Peter Steenkiste, and Brian Zill. Software Support for Outboard Buffering and Checksumming. In Proceedings of the ACM SIGCOMM '95 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, pages 87-98, August 1995.

Digital Library

[10]

Raj Krishnamurthy, Karsten Schwan, Richard West, and Marcel-Cătălin Rosu. A Network Co-processor-Based Approach to Scalable Media Streaming in Servers. In Proceedings of the 2000 International Conference on Parallel Processing, pages 125-134, August 2000.

Digital Library

[11]

Erich M. Nahum, Tsipora Barzilai, and Dilip Kandlur. Performance Issues in WWW Servers. IEEE/ACM Transactions on Networking, 10(2):2-11, February 2002.

Digital Library

[12]

Vivek S. Pai, Peter Druschel, and Willy Zwaenepoel. Flash: An Efficient and Portable Web Server. In Proceedings of the USENIX 1999 Annual Technical Conference, pages 199-212, June 1999.

Digital Library

[13]

Vivek S. Pai, Peter Druschel, and Willy Zwaenepoel. I/O-Lite: A Unified I/O Buffering and Caching System. In Proceedings of the Third USENIX Symposium on Operating Systems Design and Implementation, pages 15-28, February 1999.

Digital Library

[14]

Fabrizio Petrini, Wu-Chun Feng, Adolfy Hoisie, Salvador Coll, and Eitan Frachtenberg. The Quadrics Network: High-Performance Clustering Technology. IEEE MICRO, 22(1):46-57, January 2002.

Digital Library

[15]

Jef Poskanzer. thttpd - tiny/turbo/throttling HTTP server. Acme Labs, February 2000. Unix manual page.

[16]

Gary Tyson, Matthew Farrens, John Matthews, and Andrew R. Pleszkun. A Modified Approach to Data Cache Management. In Proceedings of the 28th Annual International Symposium on Microarchitecture, pages 93-103, December 1995.

Digital Library

[17]

Darryl L. Willick, Derek L. Eager, and Richard B. Bunt. Disk Cache Replacement Policies for Network Fileservers. In Proceedings of the 13th International Conference on Distributed Computing Systems, pages 2-11, May 1993.

[18]

Ken Yocum and Jeff Chase. Payload Caching: High-Speed Data Forwarding for Network Intermediaries. In Proceedings of the 2001 Annual USENIX Technical Conference, pages 305-317, June 2001.

Digital Library

Cited By

(2018)High performance energy saving policy based on INDInternational Journal of High Performance Computing and Networking10.1504/IJHPCN.2018.09189211:3(214-222)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1504/IJHPCN.2018.091892
Rawal BKalutarage HVivek SPandey K(2016)The Disintegration Protocol: An Ultimate Technique for Cloud Data Security2016 IEEE International Conference on Smart Cloud (SmartCloud)10.1109/SmartCloud.2016.9(27-34)Online publication date: Nov-2016
https://doi.org/10.1109/SmartCloud.2016.9
Watkins LRobinson WBeyah R(2015)Using Network Traffic to Infer Hardware StateACM Transactions on Embedded Computing Systems10.1145/270009414:3(1-22)Online publication date: 30-Apr-2015
https://dl.acm.org/doi/10.1145/2700094
Show More Cited By

Increasing web server throughput with network interface data caching

Recommendations

Increasing web server throughput with network interface data caching
Special Issue: Proceedings of the 10th annual conference on Architectural Support for Programming Languages and Operating Systems

This paper introduces network interface data caching, a new technique to reduce local interconnect traffic on networking servers by caching frequently-requested content on a programmable network interface. The operating system on the host CPU determines ...
Increasing web server throughput with network interface data caching

This paper introduces network interface data caching, a new technique to reduce local interconnect traffic on networking servers by caching frequently-requested content on a programmable network interface. The operating system on the host CPU determines ...
Increasing web server throughput with network interface data caching

This paper introduces network interface data caching, a new technique to reduce local interconnect traffic on networking servers by caching frequently-requested content on a programmable network interface. The operating system on the host CPU determines ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ASPLOS X: Proceedings of the 10th international conference on Architectural support for programming languages and operating systems

October 2002

318 pages

ISBN:1581135742

DOI:10.1145/605397

Conference Chair:
Kourosh Gharachorloo
Compaq Western Research Lab
,
Program Chair:
David A. Wood

ACM SIGOPS Operating Systems Review Volume 36, Issue 5
December 2002
296 pages
ISSN:0163-5980
DOI:10.1145/635508
Issue’s Table of Contents
ACM SIGARCH Computer Architecture News Volume 30, Issue 5
Special Issue: Proceedings of the 10th annual conference on Architectural Support for Programming Languages and Operating Systems
December 2002
296 pages
ISSN:0163-5964
DOI:10.1145/635506
Issue’s Table of Contents
ACM SIGPLAN Notices Volume 37, Issue 10
October 2002
296 pages
ISSN:0362-1340
EISSN:1558-1160
DOI:10.1145/605432
Issue’s Table of Contents

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

ASPLOS02

Sponsor:

ASPLOS02: Tenth International Conference on Architectural Support for Programming Languages and Operating Systems

October 5 - 9, 2002

California, San Jose

Acceptance Rates

ASPLOS X Paper Acceptance Rate 24 of 175 submissions, 14%;

Overall Acceptance Rate 535 of 2,713 submissions, 20%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
971
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

(2018)High performance energy saving policy based on INDInternational Journal of High Performance Computing and Networking10.1504/IJHPCN.2018.09189211:3(214-222)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1504/IJHPCN.2018.091892
Rawal BKalutarage HVivek SPandey K(2016)The Disintegration Protocol: An Ultimate Technique for Cloud Data Security2016 IEEE International Conference on Smart Cloud (SmartCloud)10.1109/SmartCloud.2016.9(27-34)Online publication date: Nov-2016
https://doi.org/10.1109/SmartCloud.2016.9
Watkins LRobinson WBeyah R(2015)Using Network Traffic to Infer Hardware StateACM Transactions on Embedded Computing Systems10.1145/270009414:3(1-22)Online publication date: 30-Apr-2015
https://dl.acm.org/doi/10.1145/2700094
Lee DSubramanian LAusavarungnirun RChoi JMutlu O(2015)Decoupled Direct Memory AccessProceedings of the 2015 International Conference on Parallel Architecture and Compilation (PACT)10.1109/PACT.2015.51(174-187)Online publication date: 18-Oct-2015
https://dl.acm.org/doi/10.1109/PACT.2015.51
Bos HHuang KOnufryk PRamakrishnan KCrowley PWroclawski J(2009)CacheCardProceedings of the 5th ACM/IEEE Symposium on Architectures for Networking and Communications Systems10.1145/1882486.1882491(1-10)Online publication date: 19-Oct-2009
https://dl.acm.org/doi/10.1145/1882486.1882491
Wang JYao XMitchell CGu P(2009)A New Hierarchical Data Cache Architecture for iSCSI Storage ServerIEEE Transactions on Computers10.1109/TC.2008.16658:4(433-447)Online publication date: 1-Apr-2009
https://dl.acm.org/doi/10.1109/TC.2008.166
He LKarne RWijesinha AEmdadi A(2009)A Study of Bare PC Web Server Performance for Workloads with Dynamic and Static ContentProceedings of the 2009 11th IEEE International Conference on High Performance Computing and Communications10.1109/HPCC.2009.34(494-499)Online publication date: 25-Jun-2009
https://dl.acm.org/doi/10.1109/HPCC.2009.34
Shafer JRixner S(2007)RiceNICProceedings of the 2007 workshop on Experimental computer science10.1145/1281700.1281721(21-es)Online publication date: 13-Jun-2007
https://dl.acm.org/doi/10.1145/1281700.1281721
Schuff DPai VWillmann PRixner S(2007)Parallel Programmable Ethernet ControllersIEEE Network: The Magazine of Global Internetworking10.1109/MNET.2007.38646621:4(22-28)Online publication date: 1-Jul-2007
https://dl.acm.org/doi/10.1109/MNET.2007.386466
Schuff DPai V(2007)Design Alternatives for a High-Performance Self-Securing Ethernet Network Interface2007 IEEE International Parallel and Distributed Processing Symposium10.1109/IPDPS.2007.370290(1-10)Online publication date: Mar-2007
https://doi.org/10.1109/IPDPS.2007.370290
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents