Article

Free access

On the scale and performance of cooperative Web proxy caching

Authors:

Henry M. LevyAuthors Info & Claims

SOSP '99: Proceedings of the seventeenth ACM symposium on Operating systems principles

Pages 16 - 31

https://doi.org/10.1145/319151.319153

Published: 12 December 1999 Publication History

Abstract

While algorithms for cooperative proxy caching have been widely studied, little is understood about cooperative-caching performance in the large-scale World Wide Web environment. This paper uses both trace-based analysis and analytic modelling to show the potential advantages and drawbacks of inter-proxy cooperation. With our traces, we evaluate quantitatively the performance-improvement potential of cooperation between 200 small-organization proxies within a university environment, and between two large-organization proxies handling 23,000 and 60,000 clients, respectively. With our model, we extend beyond these populations to project cooperative caching behavior in regions with millions of clients. Overall, we demonstrate that cooperative caching has performance benefits only within limited population bounds. We also use our model to examine the implications of future trends in Web-access behavior and traffic.

References

[1]

J. Almeida, V. Almeida, and D. Yates. Measuring the behavior of a World Wide Web server. Technical Report 96-025, Boston University, Oct. 1996.

Digital Library

[2]

V. Almeida, A. Bestavros, M. Crovella, and A. de- Oliveira. Characterizing reference locality in the WWW. Technical Report 96-011, Boston University, June 1996.

Digital Library

[3]

T. E. Anderson, M. D. Dahlin, J. M. Neefe, D. A. Patterson, D. S. Roselli, and R. Y. Wang. Serverless network file systems. ACM Trans. on Computer Systems, 14(1):41-79, February 1996.

Digital Library

[4]

M.F. Arlitt and C. L. Williamson. Web server workload characterization: The search for invariants. In Prec. of the ACM SIGMETRICS '96 Conf., pages 126-137, May 1996.

Digital Library

[5]

L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web caching and Zipf-like distributions: Evidence and implications. In Prec. of IEEE INFOCOM '99, pages 126-134, March 1999.

[6]

R. Caceres, F. Douglis, A. Feldmann, G. Glass, and M. Rabinovich. Web proxy caching: The devil is in the details. In Workshop on Internet Server Performance, pages 111-118, June 1998.

Digital Library

[7]

P. Cao. Characterization of Web proxy traffic and Wisconsin proxy benchmark 2.0. http://www, cs.wisc.edu/ ~cao/w3c-webchar-position, Nov. 1998.

[8]

P. Cao and S. Irani. Cost-aware WWW proxy caching algorithms. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 193-206, Dec. 1997.

Digital Library

[9]

A. Chankhunthod, P. B. Danzig, C. Neerdaels, M. F. Schwartz, and K. J. Worrell. A hierarchical Intemet object cache. In Prec. of the 1996 USENIX Technical Conf., pages 153-163, January 1996.

Digital Library

[10]

M. E. Crovella and A. Bestavros. Self-similarity in World Wide Web traffic: Evidence and possible causes. In Prec. of the ACM SIGMETRICS '96 Conf., pages 160-169, May 1996.

Digital Library

[11]

C. R. Cunha, A. Bestavros, and M. E. Crovella. Characteristics of WWW client-based traces. Technical Report BU-CS-95-010, Boston University, July 1995.

Digital Library

[12]

P. Danzig. NetCache architecture and deployment. In Prec. of the 3rd Int. WWW Caching Workshop, http ://wwwc ache.j a. net/events/workshop/01/NetCache- 3_2.pdf, June 1998.

Digital Library

[13]

F. Douglis, A. Feldmann, B. Krishnamurthy, and J. Mogul. Rate of change and other metrics: a live study of the World Wide Web. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 147-158, Dec. 1997.

Digital Library

[14]

B. Duska, D. Marwood, and M. J. Feeley. The measured access characteristics of World Wide Web client proxy caches. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 23-36, Dec. 1997.

Digital Library

[15]

EMC Corporation, http://www'emc'c~m/pr~ducts/enterprise-st~rage-systems/systems'htm' Symmetrix 3000 and 5000 Enterprise Storage Systems Product Description Guide, 1999.

[16]

L. Fan, P. Cao, J. Almeida, and A. Z. Broder. Summary cache: A scalable wide-area web cache sharing protocol. In Prec. ef ACM SIGCOMM '98, August 1998.

Digital Library

[17]

M. J. Feeley, W. E. Morgan, F. H. Pighin, A. R. Karlin, H. M. Levy, and C. A. Thekkath. Implementing global memory management in a workstation cluster. In Prec. of the 15th ACM Syrup. on Operating Systems Principles, pages 201-212, Dec. 1995.

Digital Library

[18]

A. Feldmann, R. Caceres, F. Douglis, G. Glass, and M. Rabinovich. Performance of web proxy caching in heterogeneous bandwidth environments. In Prec. of IEEE INFOCOM ' 99, March 1999.

[19]

S. Glassman. A caching relay for the World Wide Web. In Prec. First Int. World Wide Web Conf., pages 60-76, May 1994.

Digital Library

[20]

S. D. Gribble and E. A. Brewer. System design issues for Internet middleware services: Deductions from a large client trace. In Prec. of the 1st USENIX Syrup. on Internet Technologies and Systems, pages 207-218, Dec. 1997.

Digital Library

[21]

D. Karger, T. Leighton, D. Lewin, and A. Sherman. Web caching with consistent hashing. In Prec. of the 8th Int. World Wide Web Conf., May 1999.

Digital Library

[22]

P. Krishnan and B. Sugla. Utility of co-operating Web proxy caches. In Prec. Seventh Int. World Wide Web Conf., April 1998.

Digital Library

[23]

T. M. Kroeger, D. D. E. Long, and J. C. Mogul. Exploring the bounds of Web latency reduction from caching and prefetching. In Prec. of the 1 st USENIX Syrup. on Internet Technologies and Systems, pages 13-22, Dec. 1997.

Digital Library

[24]

T. M. Kroeger, J. C. Mogul, and C. Maltzahn. Digital's Web proxy traces, ftp://ftp.digital.com/pub/DEC/ traces/proxy/webtraces.html, August 1996.

[25]

S. R. Lawrence and C. L. Giles. Accessibility of information on the Web. Nature, 400(6740):107-109, July 1999.

[26]

B. A. Mah. An empirical model of HTTP network traffic. In Prec. of IEEE INFOCOM '97, pages 592-600, April 1997.

Digital Library

[27]

J.-M. Menaud, V. Issarny, and M. Banatre. A new protocol for efficient transversal Web caching. In Prec. ef the 12th Int. Syrup. on Distributed Computing, pages 288-302, September 1998.

Digital Library

[28]

S. Michel, K. Nguyen, A. Rosenstein, L. Zhang, S. Floyd, and V. Jacobson. Adaptive Web Caching: Towards a New Global Caching Architecture. Computer Networks and ISDN Systems, 30(22-23):2169- 2177, Nov. 1998.

Digital Library

[29]

J. C. Mogul. Network behavior of a busy web server and its clients. Technical Report 95/5, DEC Western Research Laboratory, Oct. 1995.

[30]

M. Rabinovich, J. Chase, and S. Gadde. Not all hits are created equal: Cooperative proxy caching over a wide area network. In Prec. of the 3rd Int. WWW Caching Workshop, June 1998.

Digital Library

[31]

A. Rousskov, D. Wessels, and G. Chisholm. The first ircache web cache bake-off. Technical report, National Laboratory for Applied Network Research, April 1999.

[32]

Squid internet object cache, http://squid.nlanr.net.

[33]

R. Tewari, M. Dahlin, H. Vin, and J. Kay. Design considerations for distributed caching on the Internet. In The 19th IEEE Int. Conf. on Distributed Computing Systems, May 1999.

Digital Library

[34]

J. Touch. The LSAM proxy cache - a multicast distributed virtual cache. In Prec. of the 3rd Int. WWW Caching Workshop, June 1998.

Digital Library

[35]

V. Valloppillil and K. W. Ross. Cache array routing protocol v l.0. ftp://ftp.isi.edu/internet-drafts/draftvinod-carp-v 1-03.txt, Feb. 1998.

[36]

C. E. Wills and M. Mikhailov. Towards a better understanding of Web resources and server responses for improved caching. In Prec. of the Eighth Int. World Wide Web Conf., pages 153-165, May 1999.

Digital Library

[37]

A. Wolman, G. Voelker, N. Sharma, N. Cardwell, M. Brown, T. Landray, D. Pinnel, A. Karlin, and H. Levy. Organization-based analysis of Web-object sharing and caching. In Prec. ef the 2nd USENIX Syrup. on Internet Technologies and Systems, Oct. 1999.

Digital Library

Cited By

Borusu VAgarwala MR SKaramchandani NMoharir S(2023)Online Partial Service Hosting at the EdgeACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/36168669:1(1-31)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3616866
Zhang BKosar T(2022)SMURF: Efficient and Scalable Metadata Access for Distributed ApplicationsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.317559633:12(3915-3928)Online publication date: 1-Dec-2022
https://doi.org/10.1109/TPDS.2022.3175596
Poojary PMoharir SJagannathan K(2021)A Coupon Collector based approximation for LRU cache hits under Zipf requests2021 19th International Symposium on Modeling and Optimization in Mobile, Ad hoc, and Wireless Networks (WiOpt)10.23919/WiOpt52861.2021.9589882(1-8)Online publication date: 18-Oct-2021
https://doi.org/10.23919/WiOpt52861.2021.9589882
Show More Cited By

Index Terms

On the scale and performance of cooperative Web proxy caching
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

On the scale and performance of cooperative Web proxy caching

While algorithms for cooperative proxy caching have been widely studied, little is understood about cooperative-caching performance in the large-scale World Wide Web environment. This paper uses both trace-based analysis and analytic modelling to show ...
Cooperative Caching for Chip Multiprocessors

This paper presents CMP Cooperative Caching, a unified framework to manage a CMP's aggregate on-chip cache resources. Cooperative caching combines the strengths of private and shared cache organizations by forming an aggregate "shared" cache through ...
Collaborative Web caching based on proxy affinities
Special issue on proceedings of ACM SIGMETRICS 2000

With the exponential growth of hosts and traffic workloads on the Internet, collaborative web caching has been recognized as an efficient solution to alleviate web page server bottlenecks and reduce traffic. However, cache discovery, i.e., locating ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '99: Proceedings of the seventeenth ACM symposium on Operating systems principles

December 1999

300 pages

ISBN:1581131402

DOI:10.1145/319151

Chairmen:
David Kotz
Dartmouth College, Hanover, NH
,
John Wilkes
HP Laboratories

ACM SIGOPS Operating Systems Review Volume 33, Issue 5
Dec. 1999
291 pages
ISSN:0163-5980
DOI:10.1145/319344
Editors:
David Kotz
Dartmout College, Hanover, NH
,
John Wilkes
HP Laboratories
Issue’s Table of Contents

Copyright © 1999 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 1999

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SOSP99

Sponsor:

SIGOPS

SOSP99: 17th Symposium on Operating Systems Principles

December 12 - 15, 1999

South Carolina, Charleston, USA

Acceptance Rates

SOSP '99 Paper Acceptance Rate 19 of 90 submissions, 21%;

Overall Acceptance Rate 131 of 716 submissions, 18%

Upcoming Conference

SOSP '24

Sponsor:
sigops

ACM SIGOPS 30th Symposium on Operating Systems Principles

November 4 - 6, 2024

Austin , TX , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

351
Total Citations
View Citations
1,697
Total Downloads

Downloads (Last 12 months)132
Downloads (Last 6 weeks)27

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Borusu VAgarwala MR SKaramchandani NMoharir S(2023)Online Partial Service Hosting at the EdgeACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/36168669:1(1-31)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3616866
Zhang BKosar T(2022)SMURF: Efficient and Scalable Metadata Access for Distributed ApplicationsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.317559633:12(3915-3928)Online publication date: 1-Dec-2022
https://doi.org/10.1109/TPDS.2022.3175596
Poojary PMoharir SJagannathan K(2021)A Coupon Collector based approximation for LRU cache hits under Zipf requests2021 19th International Symposium on Modeling and Optimization in Mobile, Ad hoc, and Wireless Networks (WiOpt)10.23919/WiOpt52861.2021.9589882(1-8)Online publication date: 18-Oct-2021
https://doi.org/10.23919/WiOpt52861.2021.9589882
Pal AKant K(2021)A Neighborhood Aware Caching and Interest Dissemination Scheme for Content Centric NetworksIEEE Transactions on Network and Service Management10.1109/TNSM.2021.307932618:3(3900-3917)Online publication date: Sep-2021
https://doi.org/10.1109/TNSM.2021.3079326
Li TBraud TLi YHui P(2021)Lifecycle-Aware Online Video CachingIEEE Transactions on Mobile Computing10.1109/TMC.2020.298436420:8(2624-2636)Online publication date: 1-Aug-2021
https://doi.org/10.1109/TMC.2020.2984364
Narayana VAgarwala MKaramchandani NMoharir S(2021)Online Partial Service Hosting at the Edge2021 International Conference on Computer Communications and Networks (ICCCN)10.1109/ICCCN52240.2021.9522218(1-9)Online publication date: Jul-2021
https://doi.org/10.1109/ICCCN52240.2021.9522218
Dinh NKim Y(2020)An Efficient Correlation-Based Cache Retrieval Scheme at the Edge for Internet of ThingsSensors10.3390/s2023684620:23(6846)Online publication date: 30-Nov-2020
https://doi.org/10.3390/s20236846
Lakshmi Narayan BHamsavath PTaj MSatish EBharadwaj VRabendranath SYang Y(2019)Proficient Cooperative Caching in SWNET Using Twin Segments ApproachEnergy Transfer and Dissipation in Plasma Turbulence10.1007/978-981-13-5953-8_35(427-433)Online publication date: 3-May-2019
https://doi.org/10.1007/978-981-13-5953-8_35
Sudar SWelsh MAnderson RZegura E(2018)SiskinProceedings of the 1st ACM SIGCAS Conference on Computing and Sustainable Societies10.1145/3209811.3209820(1-7)Online publication date: 20-Jun-2018
https://dl.acm.org/doi/10.1145/3209811.3209820
Hachem JNiesen UDiggavi S(2018)Degrees of Freedom of Cache-Aided Wireless Interference NetworksIEEE Transactions on Information Theory10.1109/TIT.2018.282532164:7(5359-5380)Online publication date: Jul-2018
https://doi.org/10.1109/TIT.2018.2825321
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents