article

Controllable fair queuing for meeting performance goals

Authors:

Magnus Karlsson,

Christos Karamanolis,

Jeff ChaseAuthors Info & Claims

Performance Evaluation, Volume 62, Issue 1-4

Pages 278 - 294

https://doi.org/10.1016/j.peva.2005.07.019

Published: 01 October 2005 Publication History

Abstract

Computing and storage utilities must control resource usage to meet contractual performance targets for hosted customers under dynamic conditions, including flash crowds and unexpected resource failures. This paper explores properties of proportional share resource schedulers that are necessary for stability and responsiveness under feedback control. It shows that the fairness properties commonly defined for proportional share schedulers using Weighted Fair Queuing (WFQ) are not preserved across changes to the relative weights of competing request flows. As a result, conventional WFQ schedulers are not controllable by a resource controller that adapts by adjusting the weights. The paper defines controllable fairness properties, presents an algorithm to adjust any WFQ scheduler when the weights change, and proves that the algorithm results in controllable-fair schedulers. The analytic results are confirmed by experimental evaluation using a three-tier Web service and a prototype controllable-fair scheduler called C-SFQ(D). C-SFQ(D) extends concurrency-controlled Start-time Fair Queuing (SFQ(D), which supports proportional sharing in multi-tasking computing resources. The prototype includes an adaptive control system that adjusts the flow weights in C-SFQ(D) to meet latency and throughput targets under a variety of conditions. The experimental results demonstrate the importance of controllable-fair scheduling for feedback control of computing utilities.

References

[1]

Kamra, A., Misra, V. and Nahum, E., Yaksha: a self-tuning controller for managing the performance of three-tiered web sites. In: Proceedings of the International Workshop on Quality of Service (IWQoS), pp. 47-56.

[2]

Karlsson, M., Karamanolis, C. and Zhu, X., Triage: performance isolation and differentiation for storage systems. In: Proceedings of the International Workshop on Quality of Service (IWQoS), pp. 67-74.

[3]

Goyal, P., Guo, X. and Vin, H.M., A hierarchical CPU scheduler for multimedia operating systems. In: Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI), pp. 107-121.

Digital Library

[4]

Jin, W., Chase, J. and Kaur, J., Interposed proportional sharing for a storage service utility. In: Proceedings of the International Conference on Measurement and Modelling of Computer Systems (SIGMETRICS), pp. 37-48.

Digital Library

[5]

Karlsson, M., Zhu, X. and Karamanolis, C., An adaptive optimal controller for non-intrusive performance differentiation in computing services. In: Proceedings of the IEEE Conference on Control and Automation (ICCA),

[6]

Shenoy, P. and Vin, H., Cello: a disk scheduling framework for next generation operating systems. In: Proceedings of the International Conference on Measurement and Modelling of Computer Systems (SIGMETRICS), pp. 44-55.

Digital Library

[7]

Urgaonkar, B., Shenoy, P. and Roscoe, T., Resource overbooking and application profiling in shared hosting platforms. In: Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI), pp. 239-254.

Digital Library

[8]

T. Abdelzaher, K.G. Shin, N. Bhatti, User-level QoS-adaptive resource management in server end-systems, IEEE Trans. Comput. 52 (5) (2003).

Digital Library

[9]

M. Aron, Differentiated and Predictable Quality of Service in Web Server Systems, Ph.D. Thesis, Computer Science Department, Rice University, 2000.

Digital Library

[10]

Sundaram, V. and Shenoy, P., A practical learning-based approach for dynamic storage bandwidth allocation. In: Proceedings of the International Workshop on Quality of Service (IWQoS), pp. 479-497.

Digital Library

[11]

Chambliss, D., Alvarez, G., Pandey, P., Jadav, D., Xu, J., Menon, R. and Lee, T., Performance virtualization for large-scale storage systems. In: Proceedings of the Symposium on Reliable Distributed Systems (SRDS), pp. 109-118.

[12]

Chase, J., Anderson, D., Thakar, P., Vahdat, A. and Doyle, R., Managing energy and server resources in hosting centres. In: Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), pp. 103-116.

Digital Library

[13]

Shen, K., Tang, H., Yang, T. and Chu, L., Integrated resource management for cluster-based internet services. In: Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI), pp. 225-238.

Digital Library

[14]

Lu, Y., Abdelzaher, T., Lu, C. and Tao, G., An adaptive control framework for QoS guarantees and its application to differentiated caching services. In: Proceedings of the International Workshop on Quality of Service (IWQoS), pp. 23-32.

[15]

í'ström, K.J. and Wittenmark, B., Adaptive control. 1995. 2nd ed. Addison-Wesley Publishing Company.

[16]

Karamanolis, C., Karlsson, M. and Zhu, X., Designing controllable computer systems. In: Proceedings of the Workshop on Hot Topics in Operating Systems (HotOS),

Digital Library

[17]

Davin, J. and Heybey, A., A simulation study of fair queuing and policy enforcement. Comput. Commun. Rev. v20 i5. 23-29.

Digital Library

[18]

Goyal, P., Vin, H.M. and Cheng, H., Start-time fair queueing: a scheduling algorithm for integrated services packet switching networks. IEEE/ACM Trans. Networks. v5 i5. 690-704.

Digital Library

[19]

Cohen, I., Goldszmidt, M., Kelly, T., Symons, J. and Chase, J., Correlating instrumentation data to systems states: a building block for automated diagnosis and control. In: Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI), pp. 231-244.

Digital Library

[20]

Demers, A., Keshav, S. and Shenker, S., Analysis and simulation of a fair queuing algorithm. In: Proceedings of the ACM Conference of the Special Interest Group on Data Communication (SIGCOMM), pp. 1-12.

Digital Library

[21]

Goyal, P., Guo, X. and Vin, H., A hierarchical cpu scheduler for multimedia operating systems. In: Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI), pp. 107-121.

Digital Library

Cited By

Skowron PBiskup MHeldt ŁDubnicki CKat RBaker MToledo S(2013)Fuzzy adaptive control for heterogeneous tasks in high-performance storage systemsProceedings of the 6th International Systems and Storage Conference10.1145/2485732.2485737(1-11)Online publication date: 30-Jun-2013
https://dl.acm.org/doi/10.1145/2485732.2485737
Pereira ADe Araújo Silva LMeira WFilho W(2008)Reactivity-based approaches to improve web systems' quality of serviceJournal of Web Engineering10.5555/2011267.20112687:2(93-132)Online publication date: 1-Jun-2008
https://dl.acm.org/doi/10.5555/2011267.2011268
Choffnes DAstley MWard M(2008)Migration policies for multi-core fair-share schedulingACM SIGOPS Operating Systems Review10.1145/1341312.134132842:1(92-93)Online publication date: 1-Jan-2008
https://dl.acm.org/doi/10.1145/1341312.1341328
Show More Cited By

Index Terms

Controllable fair queuing for meeting performance goals

Recommendations

Measurement Based Fair Queuing for Allocating Bandwidth to Virtual Machines
HotMIddlebox '16: Proceedings of the 2016 workshop on Hot topics in Middleboxes and Network Function Virtualization

We wish to allocate outgoing bandwidth at a server among customer VMs. The allocation for each VM is proportional to the bandwidth purchased for that VM by the customer, while allowing idle bandwidth to redistributed. Classical fair queuing in routers ...
Class-based weighted fair queueing: validation and comparison by trace-driven simulation: Research Articles

World-wide web as well as proxy servers rely for their scheduling on services provided by the underlying operating system. In practice, this means that some form of first-come-first-served (FCFS) scheduling is utilized. Although FCFS is a reasonable ...
Approximation for a two-class weighted fair queueing discipline

This paper presents an approximating model for a 2-class weighted fair queueing (or random polling) model. The approximating system can be analyzed analytically to obtain mean performance measures such as expected delay. We show through a formal ...

Comments

Information & Contributors

Information

Published In

cover image Performance Evaluation

Performance Evaluation Volume 62, Issue 1-4

Performance 2005

October 2005

501 pages

ISSN:0166-5316

Issue’s Table of Contents

Copyright © Elsevier B.V. © 2005.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 October 2005

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Skowron PBiskup MHeldt ŁDubnicki CKat RBaker MToledo S(2013)Fuzzy adaptive control for heterogeneous tasks in high-performance storage systemsProceedings of the 6th International Systems and Storage Conference10.1145/2485732.2485737(1-11)Online publication date: 30-Jun-2013
https://dl.acm.org/doi/10.1145/2485732.2485737
Pereira ADe Araújo Silva LMeira WFilho W(2008)Reactivity-based approaches to improve web systems' quality of serviceJournal of Web Engineering10.5555/2011267.20112687:2(93-132)Online publication date: 1-Jun-2008
https://dl.acm.org/doi/10.5555/2011267.2011268
Choffnes DAstley MWard M(2008)Migration policies for multi-core fair-share schedulingACM SIGOPS Operating Systems Review10.1145/1341312.134132842:1(92-93)Online publication date: 1-Jan-2008
https://dl.acm.org/doi/10.1145/1341312.1341328
Rafique NLim WThottethodi M(2007)Effective Management of DRAM Bandwidth in Multicore ProcessorsProceedings of the 16th International Conference on Parallel Architecture and Compilation Techniques10.5555/1299042.1299052(245-258)Online publication date: 15-Sep-2007
https://dl.acm.org/doi/10.5555/1299042.1299052
Karlsson MKaramanolis C(2006)Non-intrusive performance management for computer servicesProceedings of the 7th ACM/IFIP/USENIX international conference on Middleware10.1007/11925071_2(22-41)Online publication date: 27-Nov-2006
https://dl.acm.org/doi/10.1007/11925071_2

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents