Detection and global optimization of reduction operations for distributed parallel machines

T Suganuma, H Komatsu, T Nakatani - Proceedings of the 10th …, 1996 - dl.acm.org
T Suganuma, H Komatsu, T Nakatani
Proceedings of the 10th international conference on Supercomputing, 1996dl.acm.org
This paper presents a new technique for detecting and optimizing reduction operations for
parallelizhtg compilers. The technique presented here can detect reduction constructs in
general complex loops, parallelize the loops containing reduction constructs, and optimize
communications for multiple reduction operations. The optimization proposed here can be
applied not only to individual reduction loops, but also to multiple loop nests throughout a
program. The techniques have been implemented in our HPF compiler, and their …
Abstract
This paper presents a new technique for detecting and optimizing reduction operations for parallelizhtg compilers. The technique presented here can detect reduction constructs in general complex loops, parallelize the loops containing reduction constructs, and optimize communications for multiple reduction operations. The optimization proposed here can be applied not only to individual reduction loops, but also to multiple loop nests throughout a program. The techniques have been implemented in our HPF compiler, and their effectiveness is evaluated on an IBM Scalable PowerParallel System SP2 using a set of standard benchmarking programs. Although the aperimental results are still preliminary, it is shown that our techniques for detecting and optimizing reductions are eflective on practical application programs.
ACM Digital Library