Abstract
With the advent of computational grids, networking performance over the wide-area network (WAN) has become a critical component in the grid infrastructure. Unfortunately, many high-performance grid applications only use a small fraction of their available bandwidth because operating systems and their associated protocol stacks are still tuned for yesterday’s WAN speeds. As a result, network gurus undertake the tedious process of manually tuning system buffers to allow TCP flow control to scale to today’s WAN grid environments. And although recent research has shown how to set the size of these system buffers automatically at connection set-up, the buffer sizes are only appropriate at the beginning of the connection’s lifetime. To address these problems, we describe an automated and lightweight technique called dynamic right-sizing that can improve throughput by as much as an order of magnitude while still abiding by TCP semantics.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Foster, I. and Kesselman, C.: The Grid: Blueprint for a New Computing Infrastructure. Morgan-Kaufmann Publishers. San Francisco, California (1998).
Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of Supercomputer Applications (2001).
Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. International Journal of Supercomputer Applications (2001).
Argonne National Laboratory, California Institute of Technology, Lawrence Berkeley National Laboratory, Stanford Linear Accelerator Center, Jefferson Laboratory, University of Wisconsin, Brookhaven National Laboratory, Fermi National Laboratory, and San Diego Supercomputing Center: The Particle Physics Data Grid. http://www.cacr.caltech.edu/ppdg/.
Childers, L., Disz, T., Olson, R. Papka, M., Stevens, R., Udeshi, T.: Access Grid: Immersive Group-to-Group Collaborative Visualization. Proceedings of the 4th International Immersive Projection Workshop (2000).
Partridge, C., Shepard, T.: TCP/IP Performance over Satellite Links. IEEE Network. 11 (1997) 44–49.
Allman, M., Glover, D., Sanchez, L.: Enhancing TCP Over Satellite Channels Using Standard Mechanisms. IETF RFC 2488 (1999).
Allman, M. et al.: Ongoing TCP Research Related to Satellites. IETF RFC 2760 (2000).
Feng, W., Tinnakornsrisuphap, P.: The Failure of TCP in High-Performance Computational Grids. Proceedings of SC 2000: High-Performance Networking and Computing Conference (2000).
Pittsburgh Supercomputing Center. Enabling High-Performance Data Transfers on Hosts. http://www.psc.edu/networking/perf_tune.html.
Tierney, B. TCP Tuning Guide for Distributed Applications on Wide-Area Networks. USENIX & SAGE Login. http://www-didc.lbl.gov/tcp-wan.html (2001).
Tirumala, A. and Ferguson, J.: IPERF Version 1.2. http://dast.nlanr.net/Projects/Iperf/index.html (2001).
Lai, K., Baker, M.: Nettimer: A Tool for Measuring Bottleneck Link Bandwidth. Proceedings of the USENIX Symposium on Internet Technologies and Systems (2001).
University of Kansas, Information & Telecommunication Technology Center: NetSpec: A Tool for Network Experimentation and Measurement. http://www.ittc.ukans.edu/netspec.
Lawrence Berkeley National Laboratory: Nettest: Secure Network Testing and Monitoring. http://www-itg.lbl.gov/nettest.
Mah, B.: pchar: A Tool for Measuring Internet Path Characteristics. http://www.employees.org/bmah/Software/pchar.
Jin., G., Yang, G., Crowley, B., Agrawal, D.: Network Characterization Service. Proceedings of the IEEE Symposium on High-Performance Distributed Computing (2001).
Liu, J., Ferguson, J.: Automatic TCP Socket Buffer Tuning. Proceedings of SC 2000: High-Performance Networking and Computing Conference (2000).
Tierney, B., Gunter, D., Lee, J., Stoufer, M.: Enabling Network-Aware Applications. Proceedings of the IEEE International Symposium on High-Performance Distributed Computing (2001).
National Center for Atmospheric Research, Pittsburgh Supercomputing Center, and National Center for Supercomputing Applications. The Web100 Project. http://www.web100.org.
Mathis, M.: Pushing Up Performance for Everyone. http://ncne.nlanr.net/training/techs/1999/991205/Talks/mathis_991205_Pushing_Up_Performance/ (1999).
Semke, J., Mahdavi, J., Mathis, M. Automatic TCP Buffer Tuning. Proceedings of ACM SIGCOMM (1998).
Fisk, M., Feng, W.: Dynamic Adjustment of TCP Window Sizes. Los Alamos National Laboratory Unclassified Report, LA-UR 00-3221 (2000).
Fisk, M., Feng, W.: Dynamic Right-Sizing: TCP Flow-Control Adaptation (poster). Proceedings of SC 2001: High-Performance Networking and Computing Conference (2001).
Dunigan, T., Fowler, F. Personal Communication with Web100 Project (2002).
Jacobson, V., Braden, R., Borman, D.: TCP Extensions for High Performance. IETF RFC 1323 (1992).
Postel, J., Reynolds, J. File Transfer Protocol (FTP). IETF RFC 959 (1985).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Feng, Wc., Fisk, M., Gardner, M., Weigle, E. (2002). Dynamic Right-Sizing: An Automated, Lightweight, and Scalable Technique for Enhancing Grid Performance. In: Carle, G., Zitterbart, M. (eds) Protocols for High Speed Networks. PfHSN 2002. Lecture Notes in Computer Science, vol 2334. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47828-0_5
Download citation
DOI: https://doi.org/10.1007/3-540-47828-0_5
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43658-4
Online ISBN: 978-3-540-47828-7
eBook Packages: Springer Book Archive