Article

Dynamic structured partitioning for parallel scientific applications with pointwise varying workloads

Authors:

Manish Parashar,

Jaideep RayAuthors Info & Claims

IPDPS'06: Proceedings of the 20th international conference on Parallel and distributed processing

Page 57

Published: 25 April 2006 Publication History

Abstract

Parallel implementations of scientific applications involving the simulation of reactive flow on structured grids are challenging, since the underlying phenomena include transport processes with uniform computational loads as well as reactive processes having pointwise varying workloads. As a result, traditional parallelization approaches that assume homogeneous loads are not suitable for these simulations. This paper presents "Dispatch", a dynamic structured partitioning strategy that has been applied to parallel uniform and adaptive formulations of simulations with computational heterogeneity. Dispatch maintains the computational weights associated with pointwise processes in a distributed manner, computes the local workloads and partitioning thresholds, and performs in-situ localitypreserving load balancing. The experimental evaluation of Dispatch using an illustrative 2-D reactive-diffusion kernel demonstrates improvement in load distribution and overall application performance.

References

[1]

M. Berger and J. Oliger. Adaptive mesh refinement for hyperbolic partial differential equations. Journal of Computational Physics, vol. 53. pp. 484-512, 1984.

[2]

S. Chandra, X. Li, and M. Parashar. Engineering an autonomic partitioning framework for Grid-based SAMR applications. In High Performance Scientific and Engineering Computing: Hardware/Software Support, L. T. Yang and Y. Pan (eds.), Kluwer Academic Publishers, pp. 169-187, March 2004.

Digital Library

[3]

S. D. Cohen and A. C. Hindmarch. CVODE, a stiff/- nonstiff ODE solver in C. Computers in Physics, vol. 10(2), pp. 138-143, 1996.

Digital Library

[4]

P. Colella et al. Chombo infrastructure for adaptive mesh refinement. http://seesar.lbl.gov/ANAG/- chombo/, 2005.

[5]

J. C. Hewson and F. A. Williams. Rate-ratio asymptotic analysis of methane-air diffusion flame structure for predicting production of oxides of nitrogen. Combustion and Flame, vol. 117, pp. 441-476, 1999.

[6]

C. Huang, O. Lawlor, and L. V.Kale. Adaptive MPI. In 16th International Workshop on Languages and Compilers for Parallel Computing, Lecture Notes in Computer Science, vol. 2958, pp. 306-322, 2003.

[7]

S. Kohn. SAMRAI: Structured adaptive mesh refinement applications infrastructure. http://- www.llnl.gov/CASC/SAMRAI/, 2005.

[8]

P. MacNeice, K. M. Olson, C. Mobarry, R. de-Fainchtein, and C. Packer. PARAMESH: A parallel adaptive mesh refinement community toolkit. Computer Physics Communications, vol. 126, pp. 330-354, 2000.

[9]

G. Marchuk. Splitting and alternating direction methods. In Handbook of Numerical Analysis, Volume I, P. Ciarlet and J. Lions (eds.), Elsevier Science Publishers B.V., North-Holland, Amsterdam, pp. 197-462, 1990.

[10]

S. McCormick and J. Ruge. Unigrid for multigrid simulation. Mathematics of Computation, vol. 41(163), pp. 43-62, 1986.

[11]

B. Moon, G. Patnaik, R. Bennett, D. Fyfe, A. Sussman, C. Douglas, J. Saltz, and K. Kailasanath. Runtime support and dynamic load balancing strategies for structured adaptive applications. In 7th SIAM Conference on Parallel Processing for Scientific Computing, San Francisco, CA, February 1995.

[12]

M. Parashar, J. C. Browne, C. Edwards, and K. Klimkowski. A common data management infrastructure for adaptive algorithms for PDE solutions. In ACM/IEEE Conference on Supercomputing, San Jose, CA, pp. 1-22, 1997.

Digital Library

[13]

J. Ray, H. N. Najm, R. B. Milne, K. D. Devine, and S. Kempka. Triple flame structure and dynamics at the stabilization point of an unsteady lifted jet diffusion flame. Proceedings of the Combustion Institute, vol. 25(1), pp. 219-226, 2000.

[14]

H. Sagan. Space filling curves. Springer-Verlag, 1994.

[15]

San Diego Supercomputer Center. DataStar user guide. http://www.sdsc.edu/user_services/datastar/, 2005.

Cited By

Monteiro PMonteiro MPingali KHvatum L(2011)Parallelizing irregular algorithmsProceedings of the 18th Conference on Pattern Languages of Programs10.1145/2578903.2579141(1-18)Online publication date: 21-Oct-2011
https://dl.acm.org/doi/10.1145/2578903.2579141
Chandra SParashar MRay JAdes M(2007)Analyzing the impact of computational heterogeneity on runtime performance of parallel scientific componentsProceedings of the 2007 spring simulation multiconference - Volume 210.5555/1404680.1404742(395-402)Online publication date: 25-Mar-2007
https://dl.acm.org/doi/10.5555/1404680.1404742

Dynamic structured partitioning for parallel scientific applications with pointwise varying workloads
1. Theory of computation
  1. Models of computation
    1. Concurrency

Recommendations

Dynamic load balancing for parallel program execution on a message-passing multicomputer
SPDP '90: Proceedings of the 1990 IEEE Second Symposium on Parallel and Distributed Processing

Dynamic load balancing solves the remapping problem in a multicomputer system at run time, where many processes need to be allocated evenly to multiple processor nodes. The mean is to migrate processes from busy to idle nodes in order to achieve higher ...
Dynamic workload balancing of parallel applications with user-level scheduling on the Grid

This paper suggests a hybrid resource management approach for efficient parallel distributed computing on the Grid. It operates on both application and system levels, combining user-level job scheduling with dynamic workload balancing algorithm that ...
Dynamic load balancing of SAMR applications on distributed systems
SC '01: Proceedings of the 2001 ACM/IEEE conference on Supercomputing

Dynamic load balancing(DLB) for parallel systems has been studied extensively; however, DLB for distributed systems is relatively new. To efficiently utilize computing resources provided by distributed systems, an underlying DLB scheme must address both ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

IPDPS'06: Proceedings of the 20th international conference on Parallel and distributed processing

April 2006

399 pages

ISBN:1424400546

Sponsors

IEEE CS TCPP: IEEE Computer Society Technical Committee on Parallel Processing

In-Cooperation

IEEE TCCA: IEEE Computer Society Technical Committee on Computer Architecture
SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE Computer Society Technical Committee on Distributed Processing

Publisher

IEEE Computer Society

United States

Publication History

Published: 25 April 2006

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Monteiro PMonteiro MPingali KHvatum L(2011)Parallelizing irregular algorithmsProceedings of the 18th Conference on Pattern Languages of Programs10.1145/2578903.2579141(1-18)Online publication date: 21-Oct-2011
https://dl.acm.org/doi/10.1145/2578903.2579141
Chandra SParashar MRay JAdes M(2007)Analyzing the impact of computational heterogeneity on runtime performance of parallel scientific componentsProceedings of the 2007 spring simulation multiconference - Volume 210.5555/1404680.1404742(395-402)Online publication date: 25-Mar-2007
https://dl.acm.org/doi/10.5555/1404680.1404742

View Options

View options

Media

Figures

Other

Tables

View Table of Contents