Abstract Replication is a commonly proposed solution to problems of scale associated with distributed services. However, when a service is replicated, each client must be assigned a server. Prior work has generally assumed that assignment to be static. In contrast, we propose dynamic server selection, and show that it enables application-level congestion avoidance. To make dynamic server selection practical, we demonstrate the use of three tools. In addition to direct measurements of round-trip latency, we introduce and validate two new tools: bprobe, which estimates the maximum possible bandwidth along a given path; and cprobe, which estimates the current congestion along a path. Using these tools we demonstrate dynamic server selection and compare it to previous static approaches. We show that dynamic server selection consistently outperforms static policies by as much as 50%. Furthermore, we demonstrate the importance of each of our tools in performing dynamic server selection.
Cited By
- Pessoa G, Ramos D, Costa R, Duarte A, Júnior J and Grigório F QD Framework Proceedings of the 21st Brazilian Symposium on Multimedia and the Web, (49-52)
- Voicu L, Schuldt H, Breitbart Y and Schek H Replicated data management in the grid Proceedings of the 1st ACM workshop on Data grids for eScience, (7-16)
- Vakhitov A and Panshenskov M Methods of linear transfer speed estimation in the data grid Proceedings of the 1st ACM workshop on Data grids for eScience, (29-34)
- Portoles-Comeras M, Cabellos-Aparicio A, Mangues-Bafalluy J, Banchs A and Domingo-Pascual J Impact of transient CSMA/CA access delays on active bandwidth measurements Proceedings of the 9th ACM SIGCOMM conference on Internet measurement, (397-409)
- Lee H, Hall V, Yum K, Kim K and Kim E (2018). Bandwidth estimation in wireless lans for multimedia streaming services, Advances in Multimedia, 2007:1, (9-9), Online publication date: 1-Jan-2007.
- Sun Y and Koehler G (2006). A location model for a web service intermediary, Decision Support Systems, 42:1, (221-236), Online publication date: 1-Oct-2006.
- Conti M, Gregori E and Lapenna W (2005). Client-side content delivery policies in replicated web services, Performance Evaluation, 59:2-3, (137-157), Online publication date: 1-Feb-2005.
- Kosar T and Livny M (2005). A framework for reliable and efficient data placement in distributed computing systems, Journal of Parallel and Distributed Computing, 65:10, (1146-1157), Online publication date: 1-Oct-2005.
- Strauss J, Katabi D and Kaashoek F A measurement study of available bandwidth estimation tools Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, (39-44)
- Wollman W, Jegers H, Loftus M and Wan C Plug and play server load balancing and global server load balancing for tactical networks Proceedings of the 2003 IEEE conference on Military communications - Volume II, (933-937)
- Freitas C, Coffin D and Murphy R (2003). The characterization of a wide area network computation, Parallel Computing, 29:7, (879-894), Online publication date: 1-Jul-2003.
- Lee S High quality VoD service architecture on broadband internet Proceedings of the 2003 international conference on Computational science and its applications: PartII, (419-426)
- Paul S and Fei Z (2019). Distributed caching with centralized control, Computer Communications, 24:2, (256-268), Online publication date: 1-Feb-2001.
- Yeom I and Reddy A (2019). ENDE, Multimedia Tools and Applications, 14:3, (269-296), Online publication date: 1-Aug-2001.
- Ardaiz O, Freitag F and Navarro L (2019). Estimating the service time of web clients using server logs, ACM SIGCOMM Computer Communication Review, 31:2 supplement, (108-123), Online publication date: 1-Apr-2001.
- Krishnamurthy S, Sanders W and Cukier M A Dynamic Replica Selection Algorithm for Tolerating Timing Faults Proceedings of the 2001 International Conference on Dependable Systems and Networks (formerly: FTCS), (107-116)
- McCann J (2019). The Kendra cache replacement policy and its distribution, World Wide Web, 3:4, (231-240), Online publication date: 1-Dec-2000.
- Wade R, Kara M and Dew P Study of a Transport Protocol Employing Bottleneck Probing and Token Bucket Flow Control Proceedings of the Fifth IEEE Symposium on Computers and Communications (ISCC 2000)
- Lu Z and McKinley K Partial replica selection based on relevance for information retrieval Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, (97-104)
- Lee C, Stepanek J, Wolski R, Kesselman C and Foster I A network performance tool for grid environments Proceedings of the 1999 ACM/IEEE conference on Supercomputing, (4-es)
- Faerman M, Su A, Wolski R and Berman F Adaptive performance prediction for distributed data-intensive applications Proceedings of the 1999 ACM/IEEE conference on Supercomputing, (36-es)
- Obraczka K and Gheorghiu G The performance of a service for network-aware applications Proceedings of the SIGMETRICS symposium on Parallel and distributed tools, (81-91)
- Balakrishnan H, Stemm M, Seshan S and Katz R Analyzing stability in wide-area network performance Proceedings of the 1997 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, (2-12)
- Balakrishnan H, Stemm M, Seshan S and Katz R (1997). Analyzing stability in wide-area network performance, ACM SIGMETRICS Performance Evaluation Review, 25:1, (2-12), Online publication date: 1-Jun-1997.
- Seshan S, Stemm M and Katz R SPAND Proceedings of the USENIX Symposium on Internet Technologies and Systems on USENIX Symposium on Internet Technologies and Systems, (13-13)
- Carter R and Crovella M Server Selection Using Dynamic Path Characterization in Wide-Area Networks Proceedings of the INFOCOM '97. Sixteenth Annual Joint Conference of the IEEE Computer and Communications Societies. Driving the Information Revolution
Recommendations
Reducing bandwidth requirement for delivering video over wide area networks with proxy server
Due to the high bandwidth requirement and rate variability of compressed video, delivering video across wide area networks (WANs) is a challenging issue. Proxy servers have been used to reduce network congestion and improve client access time on the ...
Secure dynamic anycasting for 'best' server selection using active networks
The networking community has tackled the resource-finding problem using several methods. The knowledge of the name or property of the resource enables one to find it over the network. Many techniques were proposed and investigated for a single instance ...
Server-Based Dynamic Server Selection Algorithms
ICOIN '02: Revised Papers from the International Conference on Information Networking, Wireless Communications Technologies and Network Applications-Part IIServer selection is an important problem in replicated server systems distributed over the Internet. In this paper, we study two server selection algorithms under a server-based framework we have developed. These algorithms utilize server load and ...