Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing

Published: 01 March 2002 Publication History

Abstract

Efficient application scheduling is critical for achieving high performance in heterogeneous computing environments. The application scheduling problem has been shown to be NP-complete in general cases as well as in several restricted cases. Because of its key importance, this problem has been extensively studied and various algorithms have been proposed in the literature which are mainly for systems with homogeneous processors. Although there are a few algorithms in the literature for heterogeneous processors, they usually require significantly high scheduling costs and they may not deliver good quality schedules with lower costs. In this paper, we present two novel scheduling algorithms for a bounded number of heterogeneous processors with an objective to simultaneously meet high performance and fast scheduling time, which are called the Heterogeneous Earliest-Finish-Time (HEFT) algorithm and the Critical-Path-on-a-Processor (CPOP) algorithm. The HEFT algorithm selects the task with the highest upward rank value at each step and assigns the selected task to the processor, which minimizes its earliest finish time with an insertion-based approach. On the other hand, the CPOP algorithm uses the summation of upward and downward rank values for prioritizing tasks. Another difference is in the processor selection phase, which schedules the critical tasks onto the processor that minimizes the total execution time of the critical tasks. In order to provide a robust and unbiased comparison with the related work, a parametric graph generator was designed to generate weighted directed acyclic graphs with various characteristics. The comparison study, based on both randomly generated graphs and the graphs of some real applications, shows that our scheduling algorithms significantly surpass previous approaches in terms of both quality and cost of schedules, which are mainly presented with schedule length ratio, speedup, frequency of best results, and average scheduling time metrics.

References

[1]
M. R. Gary and D. S. Johnson, Computers and Intractability: A Guide to the Theory of NPCompleteness W. H. Freeman and Co., 1979.]]
[2]
J.D. Ullman, "NP-Complete Scheduling Problems," 1 Computer and Systems Sciences, vol. 10, PP. 384-393, 1975.]]
[3]
M. Wu and D. Gajski, "F-lypertnol: A Programming Aid for Message Passing Systems," IEEE Trans. Parallel and Distributed Systems, vol. 1, pp. 330-343, July 1990.]]
[4]
Y. Kwok and I. Ahmad, "Dynamic Critical-Path Scheduling: An Effective Technique for Allocating Task Graphs to Multiprocessors," IEEE Trans Parallel and Distributed Systems, vol. 7, no. 3, pp. 506-521, May 1996.]]
[5]
E.S.H. Hou, N. Ansari, and H. Ren, "A Genetic Algorithm for Multiprocessor Scheduling," IEEE Trans. Parallel and Distributed Systems vol. 5, no. 2, pp. 113-120, Feb. 1994.]]
[6]
G.C. Sih and E.A. Lee, "A Compile-Time Scheduling Heuristic for Interconnection Constrained Heterogeneous Processor Architectures," IEEE Trans. Parallel and Distributed Systems, vol. 4, no. 2, pp. 175-186, Feb. 1993.]]
[7]
H. El-Rewini and T.G. Lewis, "Scheduling Parallel Program Tasksonto Arbitrary Target Machines," I. Parallel and Distributed Computing, vol. 9, pp. 138-153,1990.]]
[8]
H. Singh and A. Youssef, "Mapping and Scheduling Heterogeneous Task Graphs Using Genetic Algorithms," Proc. Heterogeneous Computing Workshop, pp. 86-97,1996.]]
[9]
I. Ahmad and Y. Kwok "A New Approach to Scheduling Parallel Programs Using Task Duplication," Proc. Int'l Conf Parallel Processing, vol. 2, pp. 47-51, 1994.]]
[10]
M. Iverson, F. Ozguner, and G. Follen, "Parallelizing Existing Applications in a Distributed Heterogeneous Environment," Proc. Heterogeneous Computing Workshop, pp. 93-100,1995.]]
[11]
P. Shroff, D.W. Watson, N.S. Flann, and K. Freund, "Genetic Simulated Annealing for Scheduling Data-Dependent Tasks in Heterogeneous Environments," Proc. Heterogeneous Computing Workshop, pp. 98-104, 1996.]]
[12]
T. Yang and A. Gerasoulis, "DSC: Scheduling Parallel Tasks on an Unbounded Number of Processors," IEEE Trans. Parallel and Distributed Systems, vol. 5, no. 9, pp. 951-967, Sept. 1994.]]
[13]
L. Wang, H.J. Siegel, and V.P. Roychowdhury, "A Geneti c -Algorithm-Based Approach for Task Matching and Scheduling in Heterogeneous Computing Environments," Proc. Heterogeneous Computing Workshop, 1996.]]
[14]
M. Maheswaran and H.J. Siegel, "A Dynamic Matching and Scheduling Algorithm for Heterogeneous Computing Systems," Proc. Heterogeneous Computing Workshop, pp. 57-69,1998.]]
[15]
L. Tao, B. Narahari, and Y.C. Zhao, "Heuristics for Mapping Parallel Computations to Heterogeneous Parallel Architectures," Proc. Heterogeneous Computing Workshop, 1993.]]
[16]
M. Wu, W. Shu, and J. Gu, "Local Search for flAG Scheduling and Task Assignment," Proc. 1997 Int'l Conf. Parallel Processing, pp. 174-180, 1997,]]
[17]
R.C. Correa, A. Ferreria, and P. Rebreyend, "Integrating List Heuristics into Genetic Algorithms for Multiprocessor Scheduling," Proc. Eighth IEEE Symp. Parallel and Distributed Processing (SPDP '96), Oct. 1996.]]
[18]
B. Kruatrachue and T.G. Lewis, "Grain Size Determination for Parallel Processing," IEEE Software, pp. 23-32, Jan. 1988.]]
[19]
S.J. Kim and J.C. Browne, "A General Approach to Mapping of Parallel Computation upon Multiprocessor Architectures," Proc. Int'l Conf. Parallel Processing, vol. 2, pp. 1-8,1988.]]
[20]
Y. Kwok, I. Ahmad, and J. Gu, "FAST: A Low-Complexity Algorithm for Efficient Scheduling of DAGs on Parallel Processors," Proc. Int'l Conf. Parallel Processing, vol. 2, pp. 150-157,1996.]]
[21]
Y. Kwok and I. Ahmad, "Benchmarking the Task Graph Scheduling Algorithms," Proc. First Merged Int'l Parallel Pocessiu Symp./Symp. Parallel and Distributed Processing Conf, pp. 531,537, 1998.]]
[22]
J.J. Hwang, Y.C. Chow, P.D. Anger, and C.Y. Lee, "Scheduling Precedence Graphs in Systems with Interprocessor Communication Costs," SIAM I. Computing, vol. 18, no. 2, pp. 244-257, 1989.]]
[23]
H. El-Rewini, H.H. Ali, and T. Lewis, "Task Scheduling in Multiprocessor Systems," Computer, pp. 27-37, Dec. 1995.]]
[24]
J. Liou and M.A. Palis, "A Comparison of General Approaches to Multiprocessor Scheduling," Proc. Int'l Parallel Processing Syrup., pp. 152-156,1997.]]
[25]
J. Liou and M.A. Falls, "An Efficient Clustering Heuristic for Scheduling DAGs on Multiprocessors," Proc. Symp. Parallel and Distributed Processing, 1996.]]
[26]
A. Radulescu, A.J.C. van Gemund, and H. Lin, "LLB: A .Fast and Effective Scheduling Algorithm for Distributed-Memory Syste Proc. Second Merged Int'l Parallel Processing Symp/Symp. Parallel and Distributed Processing Conf., 1999.]]
[27]
G. Park, B. Shirazi, and J. Marquis, "DFRN: A New Approach for Duplication Based Scheduling for Distributed Memory Multiprocessor Systems," Proc. Int'l Conf. Parallel Processing, pp. 157-166,1997.]]
[28]
M. Cosnard, M. Marrakchi, Y. Robert, and D. Trystram, "Parallel Gaussian Elimination on an MTMD Computer," Parallel Computing, vol. 6, pp. 275-295,1988.]]
[29]
T.H. Cormen, C.E. Leiserson, and R.L. Rivest, Introduction to Algorithms. MIT Press, 1990.]]
[30]
Y. Chung and S. Ranka, "Applications and Performance Analysis of a Compile-Time Optimization Approach for List Scheduling Algorithms on Distributed Memory Multiprocessors," Proc. Supercomputing, pp. 512-521, Nov. 1992.]]
[31]
T. Braun, H.J. Siegel, N. Beck, L.L. Boloni, M. Maheswaran, A.l. Reuther, J.P. Robertson, M.D. Theys, B. Yao, U. Hengsen, and R.E. Freund, "A Comparison Study of Static Mapping Heuristics for a Class of Meta-Tasks on Heterogeneous Computing Systems," Proc. Heterogeneous Computing Workshop, pp. 15-29, 1999.]]

Cited By

View all
  • (2024)Efficient Workflow Scheduling in Edge Cloud-Enabled Space-Air-Ground-Integrated Information SystemsInternational Journal on Semantic Web & Information Systems10.4018/IJSWIS.34593520:1(1-29)Online publication date: 30-Jul-2024
  • (2024)Cloud-native Workflow Scheduling using a Hybrid Priority Rule, Dynamic Resource Allocation, and Dynamic Task PartitionProceedings of the ACM Symposium on Cloud Computing10.1145/3698038.3698551(830-846)Online publication date: 20-Nov-2024
  • (2024)Task replication scheduling algorithm under resource constraintsProceedings of the 2024 4th International Conference on Artificial Intelligence, Big Data and Algorithms10.1145/3690407.3690457(293-299)Online publication date: 21-Jun-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Parallel and Distributed Systems
IEEE Transactions on Parallel and Distributed Systems  Volume 13, Issue 3
March 2002
144 pages

Publisher

IEEE Press

Publication History

Published: 01 March 2002

Author Tags

  1. DAG scheduling
  2. heterogeneous systems
  3. list scheduling
  4. mapping
  5. task graphs

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Efficient Workflow Scheduling in Edge Cloud-Enabled Space-Air-Ground-Integrated Information SystemsInternational Journal on Semantic Web & Information Systems10.4018/IJSWIS.34593520:1(1-29)Online publication date: 30-Jul-2024
  • (2024)Cloud-native Workflow Scheduling using a Hybrid Priority Rule, Dynamic Resource Allocation, and Dynamic Task PartitionProceedings of the ACM Symposium on Cloud Computing10.1145/3698038.3698551(830-846)Online publication date: 20-Nov-2024
  • (2024)Task replication scheduling algorithm under resource constraintsProceedings of the 2024 4th International Conference on Artificial Intelligence, Big Data and Algorithms10.1145/3690407.3690457(293-299)Online publication date: 21-Jun-2024
  • (2024)SPHINX: Search Space-Pruning Heterogeneous Task Scheduling for Deep Neural NetworksProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673155(524-533)Online publication date: 12-Aug-2024
  • (2024)Reducing carbon emissions of distributed systems: a multi-objective approachProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658321.3658364(1-10)Online publication date: 20-May-2024
  • (2024)CoActo: CoActive Neural Network Inference Offloading with Fine-grained and Concurrent ExecutionProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661885(412-424)Online publication date: 3-Jun-2024
  • (2024)Optimizing VLIW Instruction Scheduling via a Two-Dimensional Constrained Dynamic ProgrammingACM Transactions on Design Automation of Electronic Systems10.1145/364313529:5(1-20)Online publication date: 25-Jan-2024
  • (2024)The Cost of Simplicity: Understanding Datacenter Scheduler Programming AbstractionsProceedings of the 15th ACM/SPEC International Conference on Performance Engineering10.1145/3629526.3645038(166-177)Online publication date: 7-May-2024
  • (2024)Efficient Multi-Processor Scheduling in Increasingly Realistic ModelsProceedings of the 36th ACM Symposium on Parallelism in Algorithms and Architectures10.1145/3626183.3659972(463-474)Online publication date: 17-Jun-2024
  • (2024)Reinforcement Learning-Based Online Scheduling of Multiple Workflows in Edge EnvironmentIEEE Transactions on Network and Service Management10.1109/TNSM.2024.342849621:5(5691-5706)Online publication date: 1-Oct-2024
  • Show More Cited By

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media