Cited By
View all- Hudak DAbraham S(1991)Beyond loop partitioningProceedings of the 5th international conference on Supercomputing10.1145/109025.109074(172-182)Online publication date: 1-Jun-1991
Designing algorithms on hierarchical memory multiprocessors
Pages 414 - 427
Abstract
We study here the behavior of two numerical algorithms (matrix multiplications and finite difference methods) on a three-level memory hierarchy multiprocessor RP3. Using different versions of these algorithms which differ on data placement (global, local, global and cacheable, local and cacheable) and on data access (blocked on non-blocked), we study the impact of these parameters on the performance of the program. This performance analysis is done using a very accurate monitoring system (VPMC) which records instructions, memory requests, cache requests and misses. We perform also a theoretical performance analysis of these programs using a model of computation and communication. Good agreements are found between theoretical and experimental results. As a conclusion we discuss the use of local memory on such a machine and show it is not worth with the RP3 ratio of communication between local and global memories. We also discuss optimal use of cache, show the optima can only be met under some cache properties (private store-in cache with user control of write-back) and show blocked optimal algorithms are to be used to meet it.
References
[1]
W. C. Brantley and H. Y. Chang, "Support Environment for RP3 Performance Monitor," in M. Simmons, R. Koskela, and !. Bucher, Ed. Performance Instrumentation and Visualization for Parallel Computer Systems, Addison-Wesley, (I 990).
[2]
W. C. Brantley, K. P. McAuliffe, and T. A. Ngo, "RP3 Performance Monitoring Hardware," in M. Simmons, R. Koskela, and I. Bucher, Ed. Instrumentation for Parallel Computer Systems, 35-47, Addison-Wesley, (1989).
[3]
W. C. Brantley, K. P. McAuliffe, and J. Weiss, "RP3 Processor-Memory Element," Proceedings of the 1985 International Conference on Parallel Processing, 782-789, (1985).
[4]
L. Brochard, "Efficiency of some numerical algorithms on distributed systems," Parallel Computing, 12, 21-44, (1989),
[5]
L. Brochard, "Scalability, granularity and parallelism of numerical algorithms," RC 14786, IBM Research Report, 1989.
[6]
L. Brochard and A. Freau, "Computation and data movement on RP3.," RC 15231, IBM Research Report, 1989.
[7]
L. Brochard and A. Freau, "Designing Algorithms on Hierarchical Memory Multiprocessors.," RC 15271, IBM Research Report, 1989.
[8]
W.L. Brochard, K. J. P. Prost, and F. Faurie, "Synchronization and load unbalance effects of parallel iterative algorithms," Proceedings of the 1989 International Conference on Parallel Processing, ili, 153-160, (1989).
[9]
G.C. Fox, "Domain decomposition in distributed and shared memory environments," in E. Housds, T.S. Papatheodorou, and C.D. Polychronopoulos, Ed. Proceedings of Supercomputing 87, 1042-1073., Lecture Notes in Computer Science 297, Springer-Verlag, (1988).
[10]
G. Fox, M. Johnson, G. Lyzenga, S. Otto, J. Salmon, and D. Walker, Solving problems on concurrent processors. Vol t, Prentice Hall, 1988.
[11]
K. Gallivan, W. Jalby, U. Meier, and A. Sameh, "The impact of hierarchical memory systems on linear algebra algorithm design," Int. J. of Super. Appl., 2, No. I, 12-48, (1988).
[12]
D. Marinescu and J. Rice, "On the effects of synchronization in parallel computing," CSD-TR-750, Purdue Univ., 1988.
[13]
G.F. Pfister, W. C. Brantley, D. A. George, S. L. Harvey, W. J. Kleinfelder, K. P. McAuliffe, E. A. Melton, V. A. Norton, and J. Weiss, "The IBM Research Parallel Processor Prototype (RP3): Introduction and Architecture," Proceedings of the 1985 International Conference on Parallel Processing, 764-771, (1985).
[14]
K. Solchenbach, "Grid applications on distributed memory architectures: Implementation and evaluation," Parallel Computing, 7, No. 3, 341-356, (1988).
Index Terms
- Designing algorithms on hierarchical memory multiprocessors
Recommendations
Designing algorithms on hierarchical memory multiprocessors
Special Issue: Proceedings of the 4th international conference on SupercomputingWe study here the behavior of two numerical algorithms (matrix multiplications and finite difference methods) on a three-level memory hierarchy multiprocessor RP3. Using different versions of these algorithms which differ on data placement (global, ...
Scalable directory architecture for distributed shared memory chip multiprocessors
Traditional Directory-based cache coherence protocol is far from optimal for large-scale cache coherent shared memory multiprocessors due to the increasing latency to access directories stored in DRAM memory. Instead of keeping directories in main ...
Comments
Information & Contributors
Information
Published In
Sept. 1990489 pages
Copyright © 1990 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 June 1990
Check for updates
Qualifiers
- Article
Conference
IC'90
Sponsor:
IC'90: ACM SIGARCH International Conference on Supercomputing
June 11 - 15, 1990
Amsterdam, The Netherlands
Acceptance Rates
Overall Acceptance Rate 629 of 2,180 submissions, 29%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 344Total Downloads
- Downloads (Last 12 months)55
- Downloads (Last 6 weeks)10
Reflects downloads up to 16 Oct 2024
Other Metrics
Citations
Cited By
View all- Hudak DAbraham S(1991)Beyond loop partitioningProceedings of the 5th international conference on Supercomputing10.1145/109025.109074(172-182)Online publication date: 1-Jun-1991
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in