research-article

Free access

DONAR: decentralized server selection for cloud services

Authors:

Patrick Wendell,

Joe Wenjie Jiang,

Michael J. Freedman,

Jennifer RexfordAuthors Info & Claims

SIGCOMM '10: Proceedings of the ACM SIGCOMM 2010 conference

Pages 231 - 242

https://doi.org/10.1145/1851182.1851211

Published: 30 August 2010 Publication History

Abstract

Geo-replicated services need an effective way to direct client requests to a particular location, based on performance, load, and cost. This paper presents DONAR, a distributed system that can offload the burden of replica selection, while providing these services with a sufficiently expressive interface for specifying mapping policies. Most existing approaches for replica selection rely on either central coordination (which has reliability, security, and scalability limitations) or distributed heuristics (which lead to suboptimal request distributions, or even instability). In contrast, the distributed mapping nodes in DONAR run a simple, efficient algorithm to coordinate their replica-selection decisions for clients. The protocol solves an optimization problem that jointly considers both client performance and server load, allowing us to show that the distributed algorithm is stable and effective. Experiments with our DONAR prototype--providing replica selection for CoralCDN and the Measurement Lab--demonstrate that our algorithm performs well "in the wild." Our prototype supports DNS- and HTTP-based redirection, IP anycast, and a secure update protocol, and can handle many customer services with diverse policy objectives.

References

[1]

Amazon Web Services, "http://aws.amazon.com/," 2010.

[2]

Akamai Technologies. http://www.akamai.com/, 2010.

[3]

AmazonAWS, Elastic load balancing. http://aws.amazon.com/ elasticloadbalancing/, 2010.

[4]

DynDNS. http://www.dyndns.com/, 2010.

[5]

UltraDNS. http://www.ultradns.com/, 2010.

[6]

B. Maggs, "Personal communication," 2009.

[7]

M. Colajanni, P. S. Yu, and D. M. Dias, "Scheduling algorithms for distributed web servers," in ICDCS, May 1997.

Digital Library

[8]

M. Conti, C. Nazionale, E. Gregori, and F. Panzieri, "Load distribution among replicated Web servers: A QoS-based approach," in Workshop Internet Server Perf., May 1999.

[9]

V. Cardellini, M. Colajanni, and P. S. Yu, "Geographic load balancing for scalable distributed web systems," in MASCOTS, Aug. 2000.

Digital Library

[10]

M. J. Freedman, K. Lakshminarayanan, and D. Mazières, OASIS: Anycast for any service," in NSDI, May 2006.

Digital Library

[11]

M. Pathan, C. Vecchiola, and R. Buyya, "Load and proximity aware request-redirection for dynamic load distribution in peering CDNs," in OTM, Nov. 2008.

Digital Library

[12]

Quova. http://www.quova.com/, 2010.

[13]

MeasurementLab. http://www.measurementlab.net/, 2010.

[14]

M. J. Freedman, E. Freudenthal, and D. Mazières, "Democratizing content publication with Coral," in NSDI, Mar. 2004.

Digital Library

[15]

B. Wong, A. Slivkins, and E. G. Sirer, "Meridian: A lightweight network location service without virtual coordinates," in SIGCOMM, Aug. 2005.

Digital Library

[16]

R. Krishnan, H. V. Madhyastha, S. Srinivasan, S. Jain, ishnamurthy, T. Anderson, and J. Gao, "Moving beyond end- to-end path information to optimize CDN performance," in SIGCOMM, Aug. 2009.

Digital Library

[17]

E. Ng and H. Zhang, "Predicting Internet network distance with coordinates-based approaches," in INFOCOM, June 2002.

[18]

F. Dabek, R. Cox, F. Kaashoek, and R. Morris, "Vivaldi: A decentralized network coordinate system," in SIGCOMM, Aug. 2004.

Digital Library

[19]

P. Francis, S. Jamin, C. Jin, Y. Jin, D. Raz, Y. Shavitt, and L. Zhang, "IDMaps: A global Internet host distance estimation service," Trans. Networking, Oct. 2001.

Digital Library

[20]

H. V. Madhyastha, T. Isdal, M. Piatek, C. Dixon, T. Anderson, A. Krishnamurthy, and A. Venkataramani, "iPlane: An information plane for distributed services," in OSDI, Nov. 2006.

Digital Library

[21]

D. K. Goldenberg, L. Qiu, H. Xie, Y. R. Yang, and Y. Zhang, Optimizing cost and performance for multihoming," in SIGCOMM, Aug. 2004.

Digital Library

[22]

PlanetLab." http://www.planet-lab.org/, 2008.

[23]

A. Bavier, N. Feamster, M. Huang, L. Peterson, and J. Rex- ford, "In VINI veritas: Realistic and controlled network experimentation," in SIGCOMM, Aug. 2006.

Digital Library

[24]

S. Thomson, Y. Rekhter, and J. Bound, "Dynamic updates in the domain name system (DNS UPDATE)," 1997. RFC 2136.

[25]

J. Terrace and M. J. Freedman, "Object storage on CRAQ: High-throughput chain replication for read-mostly workloads," in USENIX Annual, June 2009.

Digital Library

[26]

Zookeeper. http://hadoop.apache.org/zookeeper/, 2010.

[27]

D. Dean, E. W. Felten, and D. S. Wallach, "Java security: From HotJava to Netscape and beyond," in Symp. Security and Privacy, May 1996.

Digital Library

[28]

V. Valancius, N. Feamster, J. Rexford, and A. Nakao, "Wide area route control for distributed services," in USENIX An- nual, June 2010.

Digital Library

[29]

Internet2, "Network diagnostic tool (ndt). http://www.internet2.edu/performance/ndt/, 2010.

[30]

M. Mathis, J. Heffner, and R. Reddy, "Network path and application diagnosis (npad). http://www.psc.edu/networking/projects/pathdiag/, 2010.

[31]

M. Krohn, E. Kohler, and F. M. Kaashoek, "Events can make sense," in USENIX Annual, Aug. 2007.

Digital Library

[32]

MOSEK, "http://www.mosek.com/," 2010.

[33]

J. Guyton and M. Schwartz, "Locating nearby copies of repli- cated Internet servers," in SIGCOMM, Aug. 1995.

Digital Library

[34]

W. Theilmann and K. Rothermel, "Dynamic distance maps of the Internet," in IEEE INFOCOM, Mar. 2001.

[35]

Y. Chen, K. H. Lim, R. H. Katz, and C. Overton, "On the stability of network distance estimation," SIGMETRICS Perform. Eval. Rev., vol. 30, no. 2, pp. 21--30, 2002.

Digital Library

[36]

2005. http://cello.cs.uiuc.edu/cgi-bin/slamm/ip2ll/.

[37]

D. Moore, R. Periakaruppan, and J. Donohoe, "Where in the world is netgeo.caida.org?," in INET, June 2000.

[38]

V. N. Padmanabhan and L. Subramanian, "An investigation of geographic mapping techniques for Internet hosts," in SIG- COMM, Aug. 2001.

Digital Library

[39]

M. J. Freedman, M. Vutukuru, N. Feamster, and H. Balakrishnan, "Geographic locality of IP prefixes," in IMC, Oct. 2005.

Digital Library

[40]

B. Wong and E. G. Sirer, "ClosestNode.com: An open access, scalable, shared geocast service for distributed systems, SIGOPS OSR, vol. 40, no. 1, 2006.

Digital Library

[41]

H. A. Alzoubi, M. Rabinovich, and O. Spatscheck, MyXDNS: A resquest routing DNS server with decoupled server selection," in WWW, May 2007.

Digital Library

[42]

Z. M. Mao, C. D. Cranor, F. Douglis, M. Rabinovich, O. Spatscheck, and J. Wang, "A precise and efficient evaluation of the proximity between Web clients and their local DNS servers," in USENIX Annual, June 2002.

Digital Library

[43]

J. Pang, A. Akella, A. Shaikh, B. Krishnamurthy, and S. Seshan, "On the responsiveness of DNS-based network control, in IMC, Oct. 2004.

Digital Library

[44]

A. Schran, J. Rexford, and M. J. Freedman, "Namecast: A reliable, flexible, scalable DNS hosting system," Tech. Rep. TR-850-09, Princeton University, Apr. 2009.

[45]

D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods. Prentice Hall, 1989.

Digital Library

[46]

D. P. Bertsekas, Nonlinear Programming. Athena Scientific, 1999.

Cited By

Bothra RGandhi RBhagwan RPadmanabhan VLiang RCarlson SKamath VAcharyya SSueda KChaturmohta SSharma HSchulzrinne HKohler EMaltz DMisra V(2023)Switchboard: Efficient Resource Management for Conferencing ServicesProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604879(1000-1011)Online publication date: 10-Sep-2023
https://dl.acm.org/doi/10.1145/3603269.3604879
Zhan HTan HXu HZhang CNi HZhang PShan WLi X(2023)Online Midgress-Sensitive Traffic Allocation for Percentile Charging in Pracitcal CDNs2023 IEEE/ACM 31st International Symposium on Quality of Service (IWQoS)10.1109/IWQoS57198.2023.10188693(1-10)Online publication date: 19-Jun-2023
https://doi.org/10.1109/IWQoS57198.2023.10188693
Gu RChen XDai HWang SWang ZTu YHuang YChen G(2023)Time and Cost-Efficient Cloud Data Transmission based on Serverless Computing CompressionIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10229090(1-10)Online publication date: 17-May-2023
https://doi.org/10.1109/INFOCOM53939.2023.10229090
Show More Cited By

Index Terms

DONAR: decentralized server selection for cloud services
1. Information systems
  1. Information retrieval
    1. Search engine architectures and scalability
      1. Distributed retrieval
      2. Peer-to-peer retrieval
  2. Information storage systems
    1. Storage architectures
      1. Distributed storage

Recommendations

DONAR: decentralized server selection for cloud services
SIGCOMM '10

Geo-replicated services need an effective way to direct client requests to a particular location, based on performance, load, and cost. This paper presents DONAR, a distributed system that can offload the burden of replica selection, while providing ...
MyXDNS: a resquest routing dns server with decoupled server selection
WWW '07: Proceedings of the 16th international conference on World Wide Web

This paper presents the architecture and the preliminary evaluation ofa request routing DNS server that decouples server selectionfrom the rest of DNS functionality. Our DNS server, which we refer toas MyXDNS, exposes well-defined APIs for uploading an ...
End-User Mapping: Next Generation Request Routing for Content Delivery
SIGCOMM'15

Content Delivery Networks (CDNs) deliver much of the world's web, video, and application content on the Internet today. A key component of a CDN is the mapping system that uses the DNS protocol to route each client's request to a ``proximal'' server ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '10: Proceedings of the ACM SIGCOMM 2010 conference

August 2010

500 pages

ISBN:9781450302012

DOI:10.1145/1851182

General Chairs:
Shiv Kalyanaraman
IBM Research, India
,
Venkat Padmanabhan
Microsoft Research, India
,
K. K. Ramakrishnan
IBM Research, India
,
Rajeev Shorey
NIIT University, India
,
Program Chairs:
K. K. Ramakrishnan
IBM Research, India
,
Geoffrey M. Voelker
University of California, San Diego, USA

ACM SIGCOMM Computer Communication Review Volume 40, Issue 4
SIGCOMM '10
October 2010
481 pages
ISSN:0146-4833
DOI:10.1145/1851275
Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 August 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGCOMM '10

Sponsor:

SIGCOMM

SIGCOMM '10: ACM SIGCOMM 2010 Conference

August 30 - September 3, 2010

New Delhi, India

Acceptance Rates

Overall Acceptance Rate 554 of 3,547 submissions, 16%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

199
Total Citations
View Citations
1,836
Total Downloads

Downloads (Last 12 months)116
Downloads (Last 6 weeks)26

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bothra RGandhi RBhagwan RPadmanabhan VLiang RCarlson SKamath VAcharyya SSueda KChaturmohta SSharma HSchulzrinne HKohler EMaltz DMisra V(2023)Switchboard: Efficient Resource Management for Conferencing ServicesProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604879(1000-1011)Online publication date: 10-Sep-2023
https://dl.acm.org/doi/10.1145/3603269.3604879
Zhan HTan HXu HZhang CNi HZhang PShan WLi X(2023)Online Midgress-Sensitive Traffic Allocation for Percentile Charging in Pracitcal CDNs2023 IEEE/ACM 31st International Symposium on Quality of Service (IWQoS)10.1109/IWQoS57198.2023.10188693(1-10)Online publication date: 19-Jun-2023
https://doi.org/10.1109/IWQoS57198.2023.10188693
Gu RChen XDai HWang SWang ZTu YHuang YChen G(2023)Time and Cost-Efficient Cloud Data Transmission based on Serverless Computing CompressionIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10229090(1-10)Online publication date: 17-May-2023
https://doi.org/10.1109/INFOCOM53939.2023.10229090
Dou WXu XYu SDou WXu XYu S(2023)Architecture of Industrial Internet-Centric BPMIntelligent Industrial Internet Systems10.1007/978-981-99-5732-3_2(25-37)Online publication date: 21-Nov-2023
https://doi.org/10.1007/978-981-99-5732-3_2
Elbadry MYe FMilder PSchulzrinne HWählisch MZhang L(2022)OPSELProceedings of the 9th ACM Conference on Information-Centric Networking10.1145/3517212.3558090(22-32)Online publication date: 6-Sep-2022
https://dl.acm.org/doi/10.1145/3517212.3558090
Chen HZhan HTan HXu HShan WChen SLi X(2022)Online Traffic Allocation Based on Percentile Charging for Practical CDNs2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS)10.1109/IWQoS54832.2022.9812878(1-10)Online publication date: 10-Jun-2022
https://doi.org/10.1109/IWQoS54832.2022.9812878
Chen HZhan HZhang PTan H(2022)PeCo: Minimizing Bandwidth Cost for CDN Systems2022 8th International Conference on Big Data Computing and Communications (BigCom)10.1109/BigCom57025.2022.00017(71-78)Online publication date: Aug-2022
https://doi.org/10.1109/BigCom57025.2022.00017
Dou WLiu BDuan JDai FQi LXu X(2022)SeeMe: An intelligent edge server selection method for location‐aware business task computing over IIoTSoftware: Practice and Experience10.1002/spe.3179Online publication date: 11-Dec-2022
https://doi.org/10.1002/spe.3179
De Capitani di Vimercati SForesti SLivraga GPiuri VSamarati P(2021)Security-Aware Data Allocation in Multicloud ScenariosIEEE Transactions on Dependable and Secure Computing10.1109/TDSC.2019.2953068(1-1)Online publication date: 2021
https://doi.org/10.1109/TDSC.2019.2953068
El Amri AMeddeb A(2021)Optimal server selection for competitive service providers in network virtualization contextTelecommunication Systems10.1007/s11235-021-00764-3Online publication date: 9-Mar-2021
https://doi.org/10.1007/s11235-021-00764-3
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents