Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1005686.1005694acmconferencesArticle/Chapter ViewAbstractPublication PagesmetricsConference Proceedingsconference-collections
Article

Interposed proportional sharing for a storage service utility

Published: 01 June 2004 Publication History

Abstract

This paper develops and evaluates new share-based scheduling algorithms for differentiated service quality in network services, such as network storage servers. This form of resource control makes it possible to share a server among multiple request flows with probabilistic assurance that each flow receives a specified minimum share of a server's capacity to serve requests. This assurance is important for safe outsourcing of services to shared utilities such as Storage Service Providers.Our approach interposes share-based request dispatching on the network path between the server and its clients. Two new scheduling algorithms are designed to run within an intermediary (e.g., a network switch), where they enforce fair sharing by throttling request flows and reordering requests; these algorithms are adaptations of Start-time Fair Queuing (SFQ) for servers with a configurable degree of internal concurrency. A third algorithm, Request Windows (RW), bounds the outstanding requests for each flow independently; it is amenable to a decentralized implementation, but may restrict concurrency under light load. The analysis and experimental results show that these new algorithms can enforce shares effectively when the shares are not saturated, and that they provide acceptable performance isolation under saturation. Although the evaluation uses a storage service as an example, interposed request scheduling is non-intrusive and views the server as a black box, so it is useful for complex services with no internal support for differentiated service quality.

References

[1]
Tarek F. Abdelzaher, Kang G. Shin, and Nina Bhatti. Performance guarantees for Web server end-systems: A control-theoretical approach. IEEE Transactions on Parallel and Distributed Systems, To appear 2001.]]
[2]
Darrell C. Anderson and Jeffrey S. Chase. Fstress: A flexible network file service benchmark. Technical Report CS-2002-01, Duke University, Department of Computer Science, January 2002.]]
[3]
Darrell C. Anderson, Jeffrey S. Chase, and Amin M. Vahdat. Interposed request routing for scalable network storage. ACM Transactions on Computer Systems (TOCS) special issue: selected papers from the Fourth Symposium on Operating System Design and Implementation (OSDI), October 2000, 20(1), February 2002.]]
[4]
Mohit Aron. Differentiated and Predictable Quality of Service in Web Server Systems. PhD thesis, Department of Computer Science, Rice University, October 2000.]]
[5]
Gaurav Banga, Peter Druschel, and Jeffrey C. Mogul. Resource containers: A new facility for resource management in server systems. In Proceedings of the Third Symposium on Operating Systems Design and Implementation (OSDI), February 1999.]]
[6]
Jon C. R. Bennett and Hui Zhang. wf2q: Worst-case fair weighted fair queuing. In Proceedings of IEEE INFOCOM'96, San Francisco, CA, March 1996.]]
[7]
Jon C. R. Bennett and Hui Zhang. Hierarchical packet fair queueing algorithms. IEEE/ACM Transactions on Networking, 5(5):675--689, October 1997.]]
[8]
Josep M. Blanquer and Banu Ozden. Fair queuing for aggregated multiple links. In ACM SIGCOMM, August 2001.]]
[9]
John Bruno, Jose Brustoloni, Banu Ozden, and Abraham Silberschatz. Disk scheduling with quality of service guarantees. In IEEE International Conference on Multimedia Computing and Systems (ICMCS '99), June 1999.]]
[10]
David D. Chambliss, Guillermo A. Alvarez, Prashant Pandey, Divyesh Jadav, and Tzongyu P. Lee Jian Xu, Ram Menon. Performance virtualization for large-scale storage systems. In 22nd International Symposium on Reliable Distributed Systems (SRDS '03), October 2003.]]
[11]
Abhishek Chandra, Micah Adler, Pawan Goyal, and Prashant Shenoy. Surplus fair scheduling: A proportional-share CPU scheduling algorithm for symmetric multiprocessors. In Fourth Symposium on Operating System Design and Implementation (OSDI), October 2000.]]
[12]
Abhishek Chandra, Micah Adler, and Prashant Shenoy. Deadline fair scheduling: Bridging the theory and practice of proportionate fair scheduling in multiprocessor systems. In Seventh Real-Time Technology and Applications Symposium (RTAS '01), May 2001.]]
[13]
Jeffrey S. Chase, Darrell C. Anderson, Prachi N. Thakar, Amin M. Vahdat, and Ronald P. Doyle. Managing Energy and Server Resources in Hosting Centers. In Proceedings of the 18th ACM Symposium on Operating System Principles (SOSP), pages 103--116, October 2001.]]
[14]
Alan Demers, Srinivasan Keshav, and Scott Shenker. Analysis and simulation of a fair queuing algorithm. ACM SIGCOMM 89, 19(4):2--12, August 19-22, 1989.]]
[15]
Ron Doyle, Jeffrey S. Chase, Omer Asad, Wei Jin, and Amin Vahdat. Model-based resource provisioning in a Web service utility. In Proceedings of the Fourth Symposium on Internet Technologies and Systems (USITS), Seattle, Washington, USA, March 2003.]]
[16]
Boris Dragovic, Keir Fraser, Steve Hand, Tim Harris, Alex Ho, Ian Pratt, Andrew Warfield, Paul Barham, and Rolf Neugebauer. Xen and the Art of Virtualization. In Proceedings of the ACM Symposium on Operating Systems Principles, October 2003.]]
[17]
S. Jamal Golestani. A self-clocked fair queuing scheme for broadband applications. In Proceedings of the 13th Annual Joint Conference of the IEEE Computer and Communications Societies on Networking for Global Communciation. Volume 2, pages 636--646, Los Alamitos, CA, USA, June 1994. IEEE Computer Society Press.]]
[18]
P. Goyal, X. Guo, and H. Vin. A hierarchical CPU scheduler for multimedia operating systems. In Proceedings of Operating System Design and Implementation (OSDI'96), Seattle, pages 107--122, October 1996.]]
[19]
Pawan Goyal and Harrick M. Vin. Generalized guaranteed rate scheduling algorithms: a framework. IEEE/ACM Transactions on Networking, 5(4):561--571, August 1997.]]
[20]
Pawan Goyal, Harrick M. Vin, and Haichen Chen. Start-time fair queuing: A scheduling algorithm for integrated services packet switching networks. IEEE/ACM Transactions on Networking, 5(5):690--704, October 1997.]]
[21]
Lan Huang, Gang Peng, and Tzi cker Chiueh. Multi-dimensional storage virtualization. In Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS/Performance '04), June 2004.]]
[22]
Zhen Liu, Mark Squillante, and Joel Wolf. On maximizing service-level-agreement profits. In Proceedings of the 3rd ACM Conference on Electronic Commerce (EC-01), pages 213--223, New York, October 14-17 2001. ACM Press.]]
[23]
Christopher Lumb, Arif Merchant, and Guillermo A. Alvarez. Facade: Virtual storage devices with performance guarantees. In Proceedings of the 2nd USENIX Conference on File and Storage Technologies, San Francisco, CA, March 2003. ACM Press.]]
[24]
Kostas Magoutis, Salimah Addetia, Alexandra Fedorova, Margo Seltzer, Jeff Chase, Richard Kisley, Andrew Gallatin, Rajiv Wickremisinghe, and Eran Gabber. Structure and performance of the Direct Access File System. In USENIX Technical Conference, pages 1--14, June 2002.]]
[25]
Abhay K. Parekh and Robert G. Gallager. A generalized processor sharing approach to flow control in integrated services networks: the single-node case. IEEE/ACM Transactions on Networking, 1(3):344--357, June 1993.]]
[26]
Prashant J. Shenoy and Harrick M. Vin. Cello: A disk scheduling framework for next generation operating systems. In Proceedings of the 1998 ACM Sigmetrics Conference on Measurement and Modeling of Computer Systems, pages 44--55, 1998.]]
[27]
Dimitrios Stiliadis and Anujan Varma. Latency-rate servers: a general model for analysis of traffic scheduling algorithms. IEEE/ACM Transactions on Networking, 6(5):611--624, October 1998.]]
[28]
Bhuvan Urgaonkar, Prashant Shenoy, and Timothy Roscoe. Resource overbooking and application profiling in shared hosting platforms. In Proceedings of the Fifth Symposium on Operating Systems Design and Implementation (OSDI), Boston, MA, USA, December 2002.]]
[29]
Carl A. Waldspurger. Memory Resource Management in VMware ESX Server. In Symposium on Operating Systems Design and Implementation, December 2002.]]
[30]
Carl A. Waldspurger and William E. Weihl. Lottery Scheduling: Flexible Proportional-Share Resource Management. In Proceedings of the First Symposium on Operating Systems Design and Implementation (OSDI), pages 1--11, November 1994.]]
[31]
John Wilkes. Traveling to Rome: QoS specifications for automated storage system management. Lecture Notes in Computer Science, 2092:75--92, 2001.]]
[32]
Kenneth G. Yocum, Darrell C. Anderson, Jeffrey S. Chase, and Amin Vahdat. Anypoint: Extensible transport switching on the edge. In Proceedings of the Fourth USENIX Symposium on Internet Technologies and Systems (USITS), March 2003.]]
[33]
Lixia Zhang. Virtual Clock: A new traffic control algorithm for packet switching networks. In SIGCOMM '90 Symposium: Communications Architectures and Protocols, pages 19--29, September 1990.]]

Cited By

View all
  • (2020)Fair Allocation of Asymmetric Operations in Storage Systems2020 IEEE 27th International Conference on High Performance Computing, Data, and Analytics (HiPC)10.1109/HiPC50609.2020.00030(161-170)Online publication date: Dec-2020
  • (2020)I/O Schedulers for Proportionality and Stability on Flash-Based SSDs in Multi-Tenant EnvironmentsIEEE Access10.1109/ACCESS.2019.29630818(4451-4465)Online publication date: 2020
  • (2019)Multi-queue fair queueingProceedings of the 2019 USENIX Conference on Usenix Annual Technical Conference10.5555/3358807.3358834(301-314)Online publication date: 10-Jul-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGMETRICS '04/Performance '04: Proceedings of the joint international conference on Measurement and modeling of computer systems
June 2004
450 pages
ISBN:1581138733
DOI:10.1145/1005686
  • cover image ACM SIGMETRICS Performance Evaluation Review
    ACM SIGMETRICS Performance Evaluation Review  Volume 32, Issue 1
    June 2004
    432 pages
    ISSN:0163-5999
    DOI:10.1145/1012888
    Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. differentiated service
  2. fair sharing
  3. multiprocessor scheduling
  4. performance isolation
  5. proportional sharing
  6. quality of service
  7. storage services
  8. utility computing
  9. weighted fair queuing

Qualifiers

  • Article

Conference

SIGMETRICS04
SIGMETRICS04: SIGMETRICS 2004 / PERFORMANCE 2004
June 10 - 14, 2004
NY, New York, USA

Acceptance Rates

Overall Acceptance Rate 459 of 2,691 submissions, 17%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)32
  • Downloads (Last 6 weeks)1
Reflects downloads up to 01 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2020)Fair Allocation of Asymmetric Operations in Storage Systems2020 IEEE 27th International Conference on High Performance Computing, Data, and Analytics (HiPC)10.1109/HiPC50609.2020.00030(161-170)Online publication date: Dec-2020
  • (2020)I/O Schedulers for Proportionality and Stability on Flash-Based SSDs in Multi-Tenant EnvironmentsIEEE Access10.1109/ACCESS.2019.29630818(4451-4465)Online publication date: 2020
  • (2019)Multi-queue fair queueingProceedings of the 2019 USENIX Conference on Usenix Annual Technical Conference10.5555/3358807.3358834(301-314)Online publication date: 10-Jul-2019
  • (2019)Preemptive Multi-Queue Fair QueuingProceedings of the 28th International Symposium on High-Performance Parallel and Distributed Computing10.1145/3307681.3326605(147-158)Online publication date: 17-Jun-2019
  • (2019)Managing Tail Latency in Datacenter-Scale File Systems Under Production ConstraintsProceedings of the Fourteenth EuroSys Conference 201910.1145/3302424.3303973(1-15)Online publication date: 25-Mar-2019
  • (2019)vPFS+: Managing I/O Performance for Diverse HPC Applications2019 35th Symposium on Mass Storage Systems and Technologies (MSST)10.1109/MSST.2019.00-16(51-64)Online publication date: May-2019
  • (2019)A Page Cache Management Scheme in Cloud Computing Environments2019 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech)10.1109/DASC/PiCom/CBDCom/CyberSciTech.2019.00178(974-979)Online publication date: Aug-2019
  • (2018)Enforcing End-to-End I/O Policies for Scientific Workflows Using Software-Defined Storage Resource EnclavesIEEE Transactions on Multi-Scale Computing Systems10.1109/TMSCS.2018.28790964:4(662-675)Online publication date: 1-Oct-2018
  • (2018)Dynamic Scheduling with Service Curve for QoS Guarantee of Large-Scale Cloud StorageIEEE Transactions on Computers10.1109/TC.2017.277351167:4(457-468)Online publication date: 1-Apr-2018
  • (2018)FLINProceedings of the 45th Annual International Symposium on Computer Architecture10.1109/ISCA.2018.00041(397-410)Online publication date: 2-Jun-2018
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media