Distributed load management in anycast-based CDNs
Authors: 
Abhishek Sinha, Pradeepkumar Mani, Jie Liu, Ashley Flavel, David A. MaltzAuthors Info & Claims
Abhishek Sinha, Pradeepkumar Mani, Jie Liu, Ashley Flavel, David A. MaltzAuthors Info & ClaimsPages 74 - 82
Abstract
Anycast is an internet addressing protocol where multiple hosts share the same IP-address. A popular architecture for modern Content Distribution Networks (CDNs) for geo-replicated HTTP-services consists of multiple layers of proxy nodes for service and co-located DNS-servers for load-balancing on different proxies. Both the proxies and the DNS-servers use anycast addressing, which offers simplicity of design and high availability of service at the cost of partial loss of routing control. Due to the very nature of anycast, load-management actions by a co-located DNS-server also affects loads at nearby proxies in the network. This makes the problem of distributed load management highly challenging. In this paper, we propose an analytical framework to formulate and solve the load-management problem in this context. We consider two distinct algorithms. In the first half of the paper, we pose the load-management problem as a convex optimization problem. Following a dual decomposition technique, we propose a fully-distributed load-management algorithm by introducing FastControl packets. This algorithm utilizes the underlying anycast mechanism itself to enable effective coordination among the nodes, thus obviating the need for any external control channel. In the second half of the paper, we consider an alternative greedy load-management heuristic, currently in production in a major commercial CDN. We study its dynamical characteristics and analytically identify its operational and stability properties. Finally, we critically evaluate both the algorithms and explore their optimality-vs-complexity trade-off using trace-driven simulations.
References
[1]
“Fastroute: A scalable load-aware Anycast routing architecture for modern CDNs”, in 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15). Oakland, CA: USENIX Association, May 2015. [Online]. Available: https://www.usenix.org/conference/nsdi15/technical-sessions/presentation/flavel
[2]
R. Engel, V. Peris, D. Saha, E. Basturk, and R. Haas, “Using IP anycast for load distribution and server location”, in Proc. of IEEE Globecom Global Internet Mini Conference. Citeseer, 1998, pp. 27–35.
[3]
E. S.-J. Swildens, Z. Liu, and R. D. Day, “Global traffic management system using IP anycast routing and dynamic load-balancing”, Aug. 11 2009, 7, 574,499.
[4]
W. T. Zaumen, S. Vutukury, and J. Garcia-Luna-Aceves, “Load-balanced anycast routing in computer networks”, in Computers and Communications, 2000. Proceedings. ISCC 2000. Fifth IEEE Symposium on. IEEE, 2000, pp. 566–574.
[5]
E. Basturk, R. Engel, R. Haas, V. Peris, and D. Saha, “Using network layer anycast for load distribution in the Internet”, in Tech. Rep., IBM TJ Watson Research Center. Citeseer, 1997.
[6]
S. Sarat, V. Pappas, and A. Terzis, “On the use of anycast in DNS”, in Computer Communications and Networks, 2006. ICCCN 2006. Proceedings. 15th International Conference on. IEEE, 2006, pp. 71–78.
[7]
H. Miura, “Server selection policy in active anycast”, 2001.
[8]
H. B. Hashim and J.-L. A. Manan, “An active anycast RTT-based server selection technique”, in Networks, 2005. Jointly held with the 2005 IEEE 7th Malaysia International Conference on Communication., 2005 13th IEEE International Conference on, vol. 1. IEEE, 2005, pp. 5-pp.
[9]
H. A. Alzoubi, S. Lee, M. Rabinovich, O. Spatscheck, and J. Van der Merwe, “Anycast CDNs revisited”, in Proceedings of the 17th International Conference on World Wide Web, ser. WWW '08. New York, NY, USA: ACM, 2008.
[10]
M. Jaseemuddin, A. Nanthakumaran, and A. Leon-Garcia, “TE-friendly content delivery request routing in a CDN”, in Communications, 2006. ICC '06. IEEE International Conference on, vol. 1. IEEE, 2006, pp. 323–330.
[11]
J. Pang, A. Akella, A. Shaikh, B. Krishnamurthy, and S. Seshan, “On the responsiveness of DNS-based network control”, in Proceedings of the 4th ACM SIGCOMM conference on Internet measurement. ACM, 2004, pp. 21–26.
[12]
A. Shaikh, R. Tewari, and M. Agrawal, “On the effectiveness of DNS-based server selection”, in INFOCOM 2001. Twentieth Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE, vol. 3. IEEE, 2001, pp. 1801–1810.
[13]
“Microsoft azure”, http://azure.microsoft.com/en-us/.
[14]
S. Yu, W. Zhou, and Y. Wu, “Research on network anycast”, in Algorithms and Architectures for Parallel Processing, 2002. Proceedings. Fifth International Conference on. IEEE, 2002, pp. 154–161.
[15]
D. P. Bertsekas and R. G. Gallager, Data networks. Prentice-hall, 1987.
[16]
T. Roughgarden, Selfish routing and the price of anarchy. MIT press Cambridge, 2005, vol. 174.
[17]
D. P. Bertsekas, Nonlinear programming. Athena scientific Belmont, 1999.
[18]
F. Kelly, “Charging and rate control for elastic traffic”, European transactions on Telecommunications, vol. 8, no. 1, pp. 33–37, 1997.
[19]
I. Lobel and A. Ozdaglar, “Distributed subgradient methods for convex optimization over random networks”, Automatic Control, IEEE Transactions on, vol. 56, no. 6, pp. 1291–1306, 2011.
[20]
A. Eryilmaz, A. Ozdaglar, D. Shah, and E. Modiano, “Distributed cross-layer algorithms for the optimal control of multihop wireless networks”, IEEE/ACM Transactions on Networking (TON), vol. 18, no. 2, pp. 638–651, 2010.
[21]
A. Nedic and A. Ozdaglar, “Convex optimization in signal processing and communications, chapter cooperative distributed multi-agent optimization eds., eldar Y. and palomar D”, 2008.
[22]
A. Sinha, P. Mani, J. Liu, A. Flavel, and D. A. Maltz, “Distributed Load Management in Anycast-based CDNs”, Tech. Rep. [Online]. Available: http://arxiv.org/abs/1509.08194
[23]
D. Bertsekas, “Convex Optimization Algorithms”, Athena Scientific, United States, 2015.
[24]
S. H. Strogatz, Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering. Westview press, 2014.
Index Terms
- Distributed load management in anycast-based CDNs
Index terms have been assigned to the content through auto-classification.
Recommendations
Distributed load management algorithms in anycast-based CDNs
Anycast is an internet addressing protocol where multiple hosts share the same IP-address. A popular architecture for modern Content Distribution Networks (CDNs) for geo-replicated services consists of multiple layers of proxy nodes for service and co-...
Anycast CDNS revisited
WWW '08: Proceedings of the 17th international conference on World Wide WebBecause it is an integral part of the Internet routing apparatus, and because it allows multiple instances of the same service to be "naturally" discovered, IP Anycast has many attractive features for any service that involve the replication of multiple ...
Anycast as a load balancing feature
LISA'10: Proceedings of the 24th international conference on Large installation system administrationOur IT organization is made up of many sub-teams, each providing a service such as DNS, LDAP, HTTP proxy, and so on. Each one is deployed globally, using their own replication mechanisms. Our team provides Load Balancing and failover services in a way ...
Comments
Information & Contributors
Information
Published In
1528 pages
Copyright © 2015.
Publisher
IEEE Press
Publication History
Published: 01 September 2015
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 08 Feb 2025