research-article

Adaptive Optimal Load Balancing in a Nonhomogeneous Multiserver System with a Central Job Scheduler

Authors:

A. KumarAuthors Info & Claims

IEEE Transactions on Computers, Volume 39, Issue 10

Pages 1232 - 1250

https://doi.org/10.1109/12.59854

Published: 01 October 1990 Publication History

Abstract

A model comprising several servers, each equipped with its own queue and with possibly different service speeds, is considered. Each server receives a dedicated arrival stream of jobs; there is also a stream of generic jobs that arrive to a job scheduler and can be individually allocated to any of the servers. It is shown that if the arrival streams are all Poisson and all jobs have the same exponentially distributed service requirements, the probabilistic splitting of the generic stream that minimizes the average job response time is such that it balances the server idle times in a weighted least-squares sense, where the weighting coefficients are related to the service speeds of the servers. The corresponding result holds for nonexponentially distributed service times if the service speeds are all equal. This result is used to develop adaptive quasi-static algorithms for allocating jobs in the generic arrival stream when the load parameters are unknown. The algorithms utilize server idle-time measurements which are sent periodically to the central job scheduler. A model is developed for these measurements, and the result mentioned is used to cast the problem into one of finding a projection of the root of an affine function, when only noisy values of the function can be observed.

References

[1]

{1} A. K. Agrawala and S. K. Tripathi, "On the optimality of semidynamic routing schemes," Inform. Processing Lett., vol. 13, Oct. 1981.

[2]

{2} M. Bazaraa and C. M. Shetty, Nonlinear Programming, Theory and Algorithms. New York: Wiley, 1979.

[3]

{3} D. P. Bertsekas and R. G. Gallager, "Second derivative algorithms for minimum delay distributed routing in networks," IEEE Trans. Commun., vol. COM-32, no. 8, pp. 911-919, Aug. 1984.

[4]

{4} C. G. Cassandras, M. V. Abidi, and D. Towsley, "Distributed routing with on-line marginal delay estimation," in Proc. IEEE INFOCOM '88, 1988, pp. 603-612.

[5]

{5} F. Chang and L. Wu, "An optimal adaptive routing algorithm," IEEE Trans. Automat. Contr., vol. AC-31, no. 8, pp. 690-700, Aug. 1986.

[6]

{6} H.-F. Chen, Recursive Estimation and Control of Stochastic Systems . New York: Wiley, 1985.

[7]

{7} Y. C. Chow and W. Kohler, "Models of dynamic load balancing in a heterogeneous multiple processor system," IEEE Trans. Comput., vol. C-28, no. 5, pp. 354-361, May 1979.

[8]

{8} E. de Souza e Silva and M. Gerla, "Load balancing in distributed systems with multiple classes and site constraints," Performance '84, 1984, pp. 17-33.

[9]

{9} D. Eager, E. Lazowska, and J. Zahorjan, "Adaptive load sharing in homogeneous distributed systems," IEEE Trans. Software Eng., vol. SE-12, no. 5, pp. 662-675, May 1986.

Digital Library

[10]

{10} R. G. Gallager, "A minimum delay routing algorithm using distributed computation," IEEE Trans. Commun., vol. COM-25, no. 1, pp. 73-85, Jan. 1977.

[11]

{11} D. L. Jagerman, "An inversion technique for the Laplace transform," Bell Syst. Tech. J., vol. 61, no. 8, pp. 1995-2002, Oct. 1982.

[12]

{12} L. Kleinrock, Queueing Systems, Vols. I & II. New York: Wiley, 1975, 1976.

[13]

{13} A. Kumar, "Adaptive load control of the central processor in a distributed system with a star topology," in Proc. IEEE Conf. Decision Contr., Athens, Greece, Dec. 1986, pp. 1697-1699.

[14]

{14} A. Kumar, "Adaptive load control of the central processor in a distributed system with a star topology," IEEE Trans. Comput., vol. 38, no. 11, pp. 1502-1512, Nov. 1989.

Digital Library

[15]

{15} A. Kumar, to be published.

[16]

{16} A. Kumar and F. Bonomi, "Adaptive load balancing in a multiprocessor system with a central job scheduler," in Proc. 2nd Int. Workshop Appl. Math. Perform/Reliability Models of Comput. Commun. Syst., Univ. of Rome II, 1987, pp. 173-188.

[17]

{17} P. R. Kumar and P. Varaiya, Stochastic Systems. Englewood Cliffs, NJ: Prentice-Hall, 1986.

[18]

{18} H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. New York: Springer-Verlag, 1978.

[19]

{19} L. M. Ni and K. Hwang, "Optimal load balancing strategies for a multiprocessor system, " in Proc. 1981 Int. Conf. Parallel Processing , Columbus, OH, Aug. 1981, pp. 352-357.

[20]

{20} L. M. Ni and K. Hwang, "Optimal load balancing in a multiple processor system with many job classes," IEEE Trans. Software Eng., vol. SE-11, no. 5, pp. 491-496, May 1985.

Digital Library

[21]

{21} H. S. Stone, "Multiprocessor scheduling with the aid of network flow algorithms," IEEE Trans. Software Eng., vol. SE-3, pp. 85-93, Jan. 1977.

Digital Library

[22]

{22} A. N. Tantawi and D. Towsley, "Optimal load balancing in distributed computer systems," Tech. Rep. RC-10346, IBM T. J. Watson Research Center, Jan. 1984.

[23]

{23} R. W. Weber, "On optimal assignment of customers to parallel servers," J. Appl. Prob., vol. 15, pp. 406-413, 1978.

[24]

{24} W. Winston, "Optimality of the shortest line discipline," J. Appl. Prob., pp. 181-189, 1977.

[25]

{25} T. P. Yum, "The design and analysis of semidynamic deterministic routing rule," IEEE Trans. Commun., vol. COM-29, no. 4, pp. 498-504, Apr. 1981.

Cited By

Lan Y(2023)A dynamic load balancing mechanism for distributed systemsJournal of Computer Science and Technology10.1007/BF0294312911:3(195-207)Online publication date: 22-Mar-2023
https://dl.acm.org/doi/10.1007/BF02943129
(2018)Image optimisation using dynamic load balancingInternational Journal of Knowledge Engineering and Data Mining10.5555/3272143.32721475:1-2(68-89)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.5555/3272143.3272147
Xiuli WXiajing L(2018)An Improved Differential Evolution Algorithm for Solving a Distributed Flexible Job Shop Scheduling Problem2018 IEEE 14th International Conference on Automation Science and Engineering (CASE)10.1109/COASE.2018.8560396(968-973)Online publication date: 20-Aug-2018
https://dl.acm.org/doi/10.1109/COASE.2018.8560396
Show More Cited By

Index Terms

Recommendations

Multiserver Queueing Models of Multiprocessing Systems

Conventional time sharing and multiprogramming systems have been extensively modeled as single-server queues. In contrast, multiprocessing systems must be modeled as multiserver queueing systems. This paper investigates the effect of the scheduling ...
A Dynamic Load-Balancing Policy with a Central Job Dispatcher (LBC)

A dynamic load-balancing policy is proposed with a central job dispatcher called the LBC policy for distributed systems. The design of this policy is motivated by the operation of a single-queue multiserver queueing system, and the average job response ...
Efficient job scheduling in a mesh multicomputer without discrimination against large jobs
SPDP '95: Proceedings of the 7th IEEE Symposium on Parallel and Distributeed Processing

Many innovative schemes for allocating jobs to parallel computing systems have been proposed in order to achieve highly utilized parallel computing systems. The schemes have tried to achieve good job response times with little system fragmentation of ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Computers

IEEE Transactions on Computers Volume 39, Issue 10

October 1990

99 pages

ISSN:0018-9340

Editor:
Ming T. (Mike) Liu
The Ohio State Univ., Columbus, OH

Issue’s Table of Contents

Copyright © Copyright © 1990 IEEE. All Rights Reserved.

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 October 1990

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lan Y(2023)A dynamic load balancing mechanism for distributed systemsJournal of Computer Science and Technology10.1007/BF0294312911:3(195-207)Online publication date: 22-Mar-2023
https://dl.acm.org/doi/10.1007/BF02943129
(2018)Image optimisation using dynamic load balancingInternational Journal of Knowledge Engineering and Data Mining10.5555/3272143.32721475:1-2(68-89)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.5555/3272143.3272147
Xiuli WXiajing L(2018)An Improved Differential Evolution Algorithm for Solving a Distributed Flexible Job Shop Scheduling Problem2018 IEEE 14th International Conference on Automation Science and Engineering (CASE)10.1109/COASE.2018.8560396(968-973)Online publication date: 20-Aug-2018
https://dl.acm.org/doi/10.1109/COASE.2018.8560396
(2017)A queuing approach to model power and performance trade-off with maintenance overhead of an infrastructure-as-a-service cloudInternational Journal of Communication Networks and Distributed Systems10.5555/3086592.308659718:3-4(287-311)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.5555/3086592.3086597
Huang JLi RAn JNtalasha DYang FLi K(2017)Energy-Efficient Resource Utilization for Heterogeneous Embedded Computing SystemsIEEE Transactions on Computers10.1109/TC.2017.269318666:9(1518-1531)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1109/TC.2017.2693186
Alam MVarshney A(2016)A New Approach of Dynamic Load Balancing Scheduling Algorithm for Homogeneous Multiprocessor SystemInternational Journal of Applied Evolutionary Computation10.4018/IJAEC.20160401047:2(61-75)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.4018/IJAEC.2016040104
Liu LFortnow LLi JWang YXu J(2016)Randomized Algorithms for Dynamic Storage Load-BalancingProceedings of the Seventh ACM Symposium on Cloud Computing10.1145/2987550.2987572(210-222)Online publication date: 5-Oct-2016
https://dl.acm.org/doi/10.1145/2987550.2987572
Behnamian JFatemi Ghomi S(2016)A survey of multi-factory schedulingJournal of Intelligent Manufacturing10.1007/s10845-014-0890-y27:1(231-249)Online publication date: 1-Feb-2016
https://dl.acm.org/doi/10.1007/s10845-014-0890-y
Espadas JMolina AJiménez GMolina MRamírez RConcha D(2013)A tenant-based resource allocation model for scaling Software-as-a-Service applications over cloud computing infrastructuresFuture Generation Computer Systems10.1016/j.future.2011.10.01329:1(273-286)Online publication date: 1-Jan-2013
https://dl.acm.org/doi/10.1016/j.future.2011.10.013
Li K(2013)Optimal Load Distribution for Multiple Heterogeneous Blade Servers in a Cloud Computing EnvironmentJournal of Grid Computing10.1007/s10723-012-9239-y11:1(27-46)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1007/s10723-012-9239-y
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents