research-article

The Probability of Load Balancing Success in a Homogeneous Network

Author:

C. Gary RommelAuthors Info & Claims

IEEE Transactions on Software Engineering, Volume 17, Issue 9

Pages 922 - 933

https://doi.org/10.1109/32.92912

Published: 01 September 1991 Publication History

Abstract

The problem of load balancing in distributed systems composed of several homogeneous sites connected by a subnet is examined. The author determines a general formula for the probability that any one site in the system is underloaded while some other site in the system is overloaded. This probability can be used to define the likelihood of load balancing success in a distributed operating system. This probability gives insight into the utilization of the system and is an aid in determining a measure of effectiveness of the system. From this formula one can determine this probability when the workload is composed of processes typical to distributed systems. The influence of variants in the load balancing algorithm on this probability is demonstrated.

References

[1]

{1} R. Byrant and R. Finkel, "A stable distributed scheduling algorithm," in Proc. IEEE Int. Conf. Distributed Comput. Syst., 1981, pp. 314-324.

[2]

{2} G. Burns and R. Daoud, "The performance / functionality dilemma of multicomputer message passing," in Proc. IEEE DMCC5 Conf. (Charleston, SC), 1990, to be published.

[3]

{3} D. R. Cheriton, "The V kernel distributed operating system," Commun. ACM, vol. 1, pp. 105-115, Feb. 1985.

Digital Library

[4]

{4} D. R. Cheriton and W. Zwaenepoel, "Distributed V kernel and its performance for diskless workstations," in Proc. 9th ACM Symp. Oper. Sys. Principles, 1983, vol. 5, pp. 128-140.

Digital Library

[5]

{5} D. L. Eager, E. Lazowska, and J. Zahorjan, "Adaptive load sharing in homogeneous distributed systems," IEEE Trans. Software Eng., vol. SE-12, pp. 662-675, May 1986.

Digital Library

[6]

{6} D. L. Eager, E. Lazowska, and J. Zahorjan, "A comparison of receiver-initiated and sender-initiated adaptive loading," Perform. Eval., vol. 6, 1986.

Digital Library

[7]

{7} K. Efe, "Heuristic models of task assignment scheduling in distributed systems," IEEE Computers, vol. C-15, pp. 50-56, June 1982.

[8]

{8} A. Ezzat, "Load balancing in nest: a network of workstations," in Proc. IEEE Fall Joint Computer Conf., 1986, pp. 1138-1148.

Digital Library

[9]

{9} D. Farber et al., "The distributed computer system," in Proc. 7th Ann. IEEE Computer Soc. Int., 1973, pp. 31-34.

[10]

{10} D. Grunwald, B. Nazief, and D. Reed, "Empirical comparison of heuristic load distributions in point-to-point multicomputer networks," in IEEE DMCC5 Conf. (Charleston, SC), Apr. 8-12, 1990, pp. 984-993.

[11]

{11} M. Gross and C. Harris, Introduction to Queueing Theory. New York: Wiley, 1976.

[12]

{12} D. Hinz, "A run-time load balancing strategy for highly parallel systems," IEEE DMCC5 Conf. (Charleston, SC), Apr. 8-12, 1990, pp. 951-961.

[13]

{13} L. Kleinrock, Queueing Systems, vol. 1. New York: Wiley, 1976.

[14]

{14} B. A. Kingsbury, "The network queueing system," NASA Ames, Moffett Field, CA, Rep. 11786, 1986.

[15]

{15} W. Leland and T. Ott, "Load balancing heuristics and process behavior," ACM Perform. Eval. Rev., vol. 14, pp. 54-69, 1986.

Digital Library

[16]

{16} M. Livny and M. Melmen, "Load balancing in homogeneous broadcast distributed systems," in Proc. Computer Network Perform. Symp., 1982, pp. 47-55.

Digital Library

[17]

{17} D. May, "Occam," ACM SIGPLAN Notices, vol. 18, 1983.

Digital Library

[18]

{18} R. Mirchandaney, D. Towsley, and J. Stankovic, "Analysis of the effects of delays on load sharing," Univ. Massachusetts, Amherst, COINS Tech. Rep. 87-100, 1987.

Digital Library

[19]

{19} K. Ramamritham and J. Stankovic, "Dynamic task scheduling in hard real-time distributed systems," IEEE Computers, vol. C-1, pp. 96-107, Jan. 1984.

[20]

{20} C. G. Rommel, "Scheduling parallel programs in distributed systems," Ph.D. thesis, Univ. Massachusetts, Amherst, Sept. 1988.

Digital Library

[21]

{21} C. G. Rommel, "The probability of load balancing success," in Proc. ISMM Conf. (Fort Lauderdale, FL), Dec. 13-15, 1989, pp. 18-22.

[22]

{22} C. G. Rommel and R. Rossow, XNOS Users Reference Manual. Hartford, CT: United Technol. Res. Ctr., 1989.

[23]

{23} T. Saaty, Elements to Queueing Theory. New York: McGraw-Hill, 1961.

[24]

{24} C. Seitz, "The cosmic cube," Commun. ACM, vol. 28, 1985.

Digital Library

[25]

{25} J. Stankovic, "An application of Bayesian decision theory to decentral control of scheduling," IEEE Trans. Computers, vol. C-3, pp. 117-130, Feb. 1985.

[26]

{26} D. Sweetman and J Munoz, "Measures of effectiveness and the performance of parallel architectures," presented at the Systems, Man, Cybern. Conf., 1989.

[27]

{27} Parallel Systems user's Guide., Topologix, Inc., Denver, CO, 1989.

Cited By

(2017)A queuing approach to model power and performance trade-off with maintenance overhead of an infrastructure-as-a-service cloudInternational Journal of Communication Networks and Distributed Systems10.5555/3086592.308659718:3-4(287-311)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.5555/3086592.3086597
Liu YLee MZheng Y(2016)Adaptive Multi-Resource Allocation for Cloudlet-Based Mobile Cloud Computing SystemIEEE Transactions on Mobile Computing10.1109/TMC.2015.250409115:10(2398-2410)Online publication date: 30-Aug-2016
https://dl.acm.org/doi/10.1109/TMC.2015.2504091
Li K(2013)Optimal Load Distribution for Multiple Heterogeneous Blade Servers in a Cloud Computing EnvironmentJournal of Grid Computing10.1007/s10723-012-9239-y11:1(27-46)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1007/s10723-012-9239-y
Show More Cited By

Index Terms

The Probability of Load Balancing Success in a Homogeneous Network

Recommendations

A dynamic load balancing mechanism for distributed systems
Abstract
It is desirable in a distributed system to have the system load balanced evenly among the nodes so that the mean job response time is minimized. In this paper, we present a dynamic load balancing mechanism (DLB). It adopts a centralized approach ...
Analysis and Development of Load Balancing Algorithms in Cloud Computing

This article describes how cloud computing utilizes the benefits of web engineering and its applications by improving the performance and reducing the load on cloud providers. As the cloud is one of the emerging technology in the field of computing, it ...
An experimental study of load balancing on Amoeba
PAS '95: Proceedings of the First Aizu International Symposium on Parallel Algorithms/Architecture Synthesis

The paper presents the results of an experimental study of load balancing using job initiation and process migration, carried out on Amoeba (A.S. Tanenbaum et al., 1990). The results indicate the need for a load balancing facility in a distributed ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Software Engineering

IEEE Transactions on Software Engineering Volume 17, Issue 9

September 1991

130 pages

ISSN:0098-5589

Editor:
Victor R. Basili
Univ. of Maryland, College Park

Issue’s Table of Contents

Copyright © Copyright © 1991 IEEE. All Rights Reserved.

Publisher

IEEE Press

Publication History

Published: 01 September 1991

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

(2017)A queuing approach to model power and performance trade-off with maintenance overhead of an infrastructure-as-a-service cloudInternational Journal of Communication Networks and Distributed Systems10.5555/3086592.308659718:3-4(287-311)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.5555/3086592.3086597
Liu YLee MZheng Y(2016)Adaptive Multi-Resource Allocation for Cloudlet-Based Mobile Cloud Computing SystemIEEE Transactions on Mobile Computing10.1109/TMC.2015.250409115:10(2398-2410)Online publication date: 30-Aug-2016
https://dl.acm.org/doi/10.1109/TMC.2015.2504091
Li K(2013)Optimal Load Distribution for Multiple Heterogeneous Blade Servers in a Cloud Computing EnvironmentJournal of Grid Computing10.1007/s10723-012-9239-y11:1(27-46)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1007/s10723-012-9239-y
Li K(2008)Optimal load distribution in nondedicated heterogeneous cluster and grid computing environmentsJournal of Systems Architecture: the EUROMICRO Journal10.1016/j.sysarc.2007.04.00354:1-2(111-123)Online publication date: 1-Jan-2008
https://dl.acm.org/doi/10.1016/j.sysarc.2007.04.003
Sriram Iyengar MSinghal M(2006)Effect of network latency on load sharing in distributed systemsJournal of Parallel and Distributed Computing10.1016/j.jpdc.2005.09.00566:6(839-853)Online publication date: 1-Jun-2006
https://dl.acm.org/doi/10.1016/j.jpdc.2005.09.005
Anglano CEgan GBrent RGannon D(1998)Predicting parallel applications performance on non-dedicated cluster platformsProceedings of the 12th international conference on Supercomputing10.1145/277830.277866(172-179)Online publication date: 13-Jul-1998
https://dl.acm.org/doi/10.1145/277830.277866
Das SHarvey DBiswas R(1997)Adaptive load-balancing algorithms using symmetric broadcast networksProceedings of the international Conference on Parallel Processing10.5555/645533.656498Online publication date: 11-Aug-1997
https://dl.acm.org/doi/10.5555/645533.656498
Harchol-Balter MDowney A(1997)Exploiting process lifetime distributions for dynamic load balancingACM Transactions on Computer Systems10.1145/263326.26334415:3(253-285)Online publication date: 1-Aug-1997
https://dl.acm.org/doi/10.1145/263326.263344
Harchol-Balter MDowney AReed D(1996)Exploiting process lifetime distributions for dynamic load balancingProceedings of the 1996 ACM SIGMETRICS international conference on Measurement and modeling of computer systems10.1145/233013.233019(13-24)Online publication date: 15-May-1996
https://dl.acm.org/doi/10.1145/233013.233019
Harchol-Balter MDowney A(1996)Exploiting process lifetime distributions for dynamic load balancingACM SIGMETRICS Performance Evaluation Review10.1145/233008.23301924:1(13-24)Online publication date: 15-May-1996
https://dl.acm.org/doi/10.1145/233008.233019
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents