Article

Efficient network and I/O throttling for fine-grain cycle stealing

Authors:

Jeffrey K. Hollingsworth,

Peter J. KeleherAuthors Info & Claims

SC '01: Proceedings of the 2001 ACM/IEEE conference on Supercomputing

Page 3

https://doi.org/10.1145/582034.582037

Published: 10 November 2001 Publication History

Abstract

This paper proposes and evaluates a new mechanism, rate windows, for I/O and network rate policing. The goal of the proposed system is to provide a simple, yet effective way to enforce resource limits on target classes of jobs in a system. This work was motivated by our Linger Longer infrastructure, which harvests idle cycles in networks of workstations. Network and I/O throttling is crucial because Linger Longer can leave guest jobs on non-idle nodes and machine owners should not be adversely affected. Our approach is quite simple. We use a sliding window of recent events to compute the average rate for a target resource. The assigned limit is enforced by the simple expedient of putting application processes to sleep when they issue requests that would bring their resource utilization out of the allowable profile. Our I/O system call intercept model makes the rate windows mechanism light-weight and highly portable. Our experimental results show that we are able to limit resource usage to within a few percent of target usages.

References

[1]

M. Aron and P. Durschel, "Soft Timers: efficient microsecond software timer support for network processing," SOSP. Dec. 1999, Kiawah Island, SC, pp. 232-246.

Digital Library

[2]

R. H. Arpaci, A. C. Dusseau, A. M. Vahdat, L. T. Liu, T. E. Anderson, and D. A. Patterson, "The Interaction of Parallel and Sequential Workloads on a Network of Workstations," SIGMETRICS. May 1995, Ottawa, pp. 267-278.

Digital Library

[3]

A. Atlas and A. Bestavros, "Design and implementation of statistical rate monotonic scheduling in KURT Linux," Proceedings 20th IEEE Real-Time Systems Symposium. Dec. 1999, Phoenix, AZ, pp. 272-6.

Digital Library

[4]

G. Banga, P. Druschel, and J. Mogul, "Resource containers: A new facility for resource management in server systems," USENIX 3rd Symposium on Operating System Design and Implementation. October 1999, New Orleans, LA.

Digital Library

[5]

J. Bruno, E. Gabber, B. Ozden, and A. Silberschatz, "The Eclipse operating system: Providing Quality of Service via Reservation Domains," USENIX 1998 Annual Technical Conference. June 1998, New Orleans, Louisiana.

Digital Library

[6]

E. Bugnion, S. Devine, and M. Rosenblum, "Disco: Running Commodity Operating Systems on Scalabe Multiprocessors," SOSP. Oct 1997, pp. 143-156.

Digital Library

[7]

T. Faber, L. H. Landweber, and A. Mukherjee, "Dynamic Time Windows: packet admission control with feedback," SIGCOMM. Sept 1992, pp. 124-135.

Digital Library

[8]

W. C. Feng, D. D. Kandlur, D. Saha, and K. G. Shin, "Understanding and improving TCP performance over networks with minimum rate guarntees," IEEE/ACM Transactions on Networking,7(2), 1999, pp. 173-187.

Digital Library

[9]

R. P. Goldberg, "Survey of Virtual Machine Research," IEEE Computer Magazine,7(6), 1974, pp. 34-45.

Digital Library

[10]

J. S. Heidemann and G. J. Popek, "File-system development with stackable layers," ACM Trans. Computer Systems,12(1), 1994, pp. 58-89.

Digital Library

[11]

P. Krueger and R. Chawla, "The Stealth Distributed Scheduler," International Conference on Distributed Computing Systems (ICDCS). May 1991, Arlington, TX, pp. 336-343.

[12]

M. Litzkow, M. Livny, and M. Mutka, "Condor --- A Hunter of Idle Workstations," International Conference on Distributed Computing Systems. June 1988, pp. 104-111.

[13]

M. W. Mutka and M. Livny, "The available capacity of a privately owned workstation environment," Performance Evaluation,12, 1991, pp. 269-284.

Digital Library

[14]

V. N. Padmanabhan and R. H. Katz, "TCP Fast Start: A Techniques for Speeding Up Web Transfers," IEEE GLOBECOMM. Nov. 1998, Sydney, Australia, pp. 41-46.

[15]

D. Reed and R. Fairbairns, The Nemesis KernelOverview, http://citeseer.nj.nec.com/reed97nemesis.html, May 20, 1997.

[16]

K. D. Ryu and J. K. Hollingsworth, "Exploiting Fine Grained Idle Periods in Networks of Workstations," IEEE Transactions on Parallel and Distributed Computing,11(7), 2000.

Digital Library

[17]

K. D. Ryu, J. K. Hollingsworth, and P. J. Keleher, "Mechanisms and Policies for Supporting Fine-Grained Cycle Stealing," ICS. June 1999, Rhodes, Greece, pp. 93-100.

Digital Library

[18]

SiliconGraphics, IRIX 6.4 Technical Brief, http://www.sgi.com/software/irix6.5/techbrief.pdf, 1998.

[19]

J. S. Turner, "New Directions in Communications (or Which Way to the Information Age?)," IEEE Communications Magazine,24(10), 1986, pp. 8-15.

Digital Library

[20]

B. Verghese, A. Gupta, and M. Rosenblum, "Performance Isolation: Sharing and Isolation in Shared-Memory Multiprocessors," ASPLOS. Oct. 1998, San Jose, CA, pp. 181-192.

Digital Library

[21]

L. Zhang, "Virtual Clock: A New Traffic Control Algorithm for Packet Switching Networks," SIGCOMM. Sept. 1990, pp. 19-29.

Digital Library

[22]

S. Zhou, X. Zheng, J. Wang, and P. Delisle, "Utopia: a Load Sharing Facility for Large, Heterogeneous Distributed Computer Systems," SPE,23(12), 1993, pp. 1305-1336.

Digital Library

Cited By

Lv FLiu LCui HWang LLiu YFeng XYew P(2015)WiseThrottlingThe Journal of Supercomputing10.1007/s11227-015-1427-771:8(3054-3093)Online publication date: 1-Aug-2015
https://dl.acm.org/doi/10.1007/s11227-015-1427-7
Lv FCui HWang LLiu LWu CFeng XYew P(2014)Dynamic I/O-Aware Scheduling for Batch-Mode Applications on Chip Multiprocessor Systems of Cluster PlatformsJournal of Computer Science and Technology10.1007/s11390-013-1409-229:1(21-37)Online publication date: 10-Jan-2014
https://doi.org/10.1007/s11390-013-1409-2
Yigitbasi NSonmez OIosup AEpema D(2011)Performance Evaluation of Overload Control in Multi-cluster GridsProceedings of the 2011 IEEE/ACM 12th International Conference on Grid Computing10.1109/Grid.2011.30(173-180)Online publication date: 21-Sep-2011
https://dl.acm.org/doi/10.1109/Grid.2011.30
Show More Cited By

Index Terms

Efficient network and I/O throttling for fine-grain cycle stealing

Recommendations

Resource Policing to Support Fine-Grain Cycle Stealing in Networks of Workstations

This paper presents the design, implementation, and performance evaluation of a suite of resource policing mechanisms that allow guest processes to efficiently and unobtrusively exploit otherwise idle workstation resources. Unlike traditional policies ...
Cluster Load Balancing for Fine-Grain Network Services
IPDPS '02: Proceedings of the 16th International Symposium on Parallel and Distributed Processing

This paper studies cluster load balancing policies and system support for fine-grain network services. Load balancing on a cluster of machines has been studied extensively in the literature, mainly focusing on coarse-grain distributed computation. Fine-...
Resource stealing: a resource multiplexing method for mix workloads in cloud system

The cloud computing paradigm enables providing resources on demand. However, most of them focus on a single type of application requiring separate quality of service. In the context that mix heterogeneous workloads are co-scheduled in the cloud, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '01: Proceedings of the 2001 ACM/IEEE conference on Supercomputing

November 2001

756 pages

ISBN:158113293X

DOI:10.1145/582034

Conference Chair:
Charles Slocomb
Los Alamos National Laboratory

Copyright © 2001 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 November 2001

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SC '01

Sponsor:

SIGARCH
IEEE-CS

SC '01: International Conference for High Performance Computing, Networking, Storage and Analysis

November 10 - 16, 2001

Colorado, Denver

Acceptance Rates

SC '01 Paper Acceptance Rate 60 of 240 submissions, 25%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
168
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lv FLiu LCui HWang LLiu YFeng XYew P(2015)WiseThrottlingThe Journal of Supercomputing10.1007/s11227-015-1427-771:8(3054-3093)Online publication date: 1-Aug-2015
https://dl.acm.org/doi/10.1007/s11227-015-1427-7
Lv FCui HWang LLiu LWu CFeng XYew P(2014)Dynamic I/O-Aware Scheduling for Batch-Mode Applications on Chip Multiprocessor Systems of Cluster PlatformsJournal of Computer Science and Technology10.1007/s11390-013-1409-229:1(21-37)Online publication date: 10-Jan-2014
https://doi.org/10.1007/s11390-013-1409-2
Yigitbasi NSonmez OIosup AEpema D(2011)Performance Evaluation of Overload Control in Multi-cluster GridsProceedings of the 2011 IEEE/ACM 12th International Conference on Grid Computing10.1109/Grid.2011.30(173-180)Online publication date: 21-Sep-2011
https://dl.acm.org/doi/10.1109/Grid.2011.30
Yamada HKono K(2007)DiscNice: User-level Regulation of Disk BandwidthIPSJ Digital Courier10.2197/ipsjdc.3.8003(800-815)Online publication date: 2007
https://doi.org/10.2197/ipsjdc.3.800
Stiehr GChamberlain R(2006)Improving cluster utilization through intelligent processor sharingProceedings of the 20th international conference on Parallel and distributed processing10.5555/1898699.1898923(364-364)Online publication date: 25-Apr-2006
https://dl.acm.org/doi/10.5555/1898699.1898923
Stiehr GChamberlain R(2006)Improving cluster utilization through intelligent processor sharingProceedings 20th IEEE International Parallel & Distributed Processing Symposium10.1109/IPDPS.2006.1639696(8 pp.)Online publication date: 2006
https://doi.org/10.1109/IPDPS.2006.1639696
W. Strickland JW. Freeh VS. Vazhkudai S(2005)GovernorProceedings of the Second International Conference on Automatic Computing10.1109/ICAC.2005.31(64-75)Online publication date: 13-Jun-2005
https://dl.acm.org/doi/10.1109/ICAC.2005.31
Ryu KHollingsworth J(2004)Resource Policing to Support Fine-Grain Cycle Stealing in Networks of WorkstationsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2004.5815:10(878-892)Online publication date: 1-Oct-2004
https://dl.acm.org/doi/10.1109/TPDS.2004.58
Gupta ABin Lin Dinda P(2004)Measuring and understanding user comfort with resource borrowingProceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004.10.1109/HPDC.2004.1323536(214-224)Online publication date: 2004
https://doi.org/10.1109/HPDC.2004.1323536

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents