Article

Free access

Analysis of the impact of memory in distributed parallel processing systems

Authors:

Vinod G. J. Peris,

Mark S. Squillante,

Vijay K. NaikAuthors Info & Claims

SIGMETRICS '94: Proceedings of the 1994 ACM SIGMETRICS conference on Measurement and modeling of computer systems

Pages 5 - 18

https://doi.org/10.1145/183018.183021

Published: 01 May 1994 Publication History

Abstract

We consider an important tradeoff between processor and memory allocation in distributed parallel processing systems. To study this tradeoff, we formulate stochastic models of parallel program behavior, distributed parallel processing environments and memory overheads incurred by parallel programs as a function of their processor allocation. A mathematical analysis of the models is developed, which includes the effects of contention for shared resources caused by paging activity. We conduct a detailed analysis of real large-scale scientific applications and use these results to parameterize our models. Our results show that memory overhead resulting from processor allocation decisions can have a significant effect on system performance in distributed parallel environments, strongly suggesting that memory considerations must be incorporated in the resource allocation policies for parallel systems. We also demonstrate the importance of the inter-locality miss ratio, which is introduced in this paper and analyzed for the first time.

References

[1]

O. I. Aven, Jr. E. G. Coffman, and Y. A. Kogan. Stochastic Analysis of Computer Storage. D. Reidel, 1987.

Digital Library

[2]

D. Bailey, J. Barton, T. Lasinski, and H. Simon. The NAS parallel benchmarks. Technical Report RNR-91-002 Revision 2, NASA Ames Research Center, August 1991.

[3]

D. H. Bailey, E. Barszcz, L. Dagum, and H. Simon. NAS parallel benchmark results. IEEE Parallel and Distributed Technology, 1:43-51, February 1993.

Digital Library

[4]

S. L. Brumelle. Some inequalities for parallel-server queues. Opera~ions Research, 19:402-413, 1971.

Digital Library

[5]

K. L. Chung. Markov Chains with S~a~ionary Transition Probabilities. Springer-Verlag, 1960.

[6]

P. J. Gourtois. Decomposability. Academic Press, 1977.

[7]

P. J. Courtois and H. Van~ilborgh. A decomposable model of program paging behavior. A cta Infovmatica, 6:251-275, 1976.

[8]

P. J. Denning. Working sets past and present. IEEE Transaction8 on Software Engineering, SE- 6(1):64-84, January 1980.

Digital Library

[9]

S. Leutenegger and M. Vernon. The performance of multiprogrammed multiprocessor scheduling policies. In Proceedings of the A CM SIGMETRICS Conference, pages 226-236, May 1990.

Digital Library

[10]

A. W. Madison and A. P. Batson. Characteristics of program locality. Communications of the A CM, 19:285-294, 1976.

Digital Library

[11]

S. Majumdar, D. L. Eager, and R. B. Bunt. Scheduling in multiprogrammed parallel systems. In Proceedings of the A CM SIGMETRIC$ Conference, pages 104-113, May 1988.

Digital Library

[12]

A. M. Makowski and R. D. Nelson. Distributed parallelism considered harmful. Technical Report RC 17448, IBM Research Division, December 1991.

[13]

A. M. Makowski and R. D. Nelson. Optimal scheduling for a distributed parallel processing model. Technical Report RC 17449, IBM Research Division, February 1992.

[14]

C. McCann, R. Vaswani, and J. Zahorjan. A dynamic processor allocation policy for multiprogrammed shared-memory multiprocessors. ACM Transactions on Computer Systems, 11(2):146- 178, May 1993.

Digital Library

[15]

3. M. Murphy and R. B. Bunt. Characterising program behaviour with phases and transitions. In Proceedings of the A CM SIGMETRICS Conference, pages 226-234, May 1988.

Digital Library

[16]

V. K. Naik, S. K. Setia, and M. S. Squillante. Performance analysis of job scheduling policies in parallel supercomputing environments. In Proceedings of Supercomputin9 '93, November 1993.

Digital Library

[17]

V. K. Naik, S. K. Setia, and M. S. Squillante. Scheduling of large scientific applications on distributed memory multiprocessor systems. In Proceedings 6th SIAM Conference on Parallel Processing for Scientific Computing, pages 913-922, March 1993.

[18]

V. G. Peris, M. S. Squillante, and V. K. Naik. Analysis of the impact of memory in distributed parallel processing systems. Technical Report RC 19336, IBM Research Division, October 1993.

[19]

E. Rosti, E. Smirni, G. Serazzi, L. Dowdy, and B. Carlson. Robust partitioning policies of multiprocessor systems. Technical report, Department of Computer Science, Vanderbilt University, 1992.

[20]

R. Schreiber and H. D. Simon. Towards the teraflops capability for CFD. In Parallel CFD - Implementations and Results Using Parallel Computers, 1992.

Digital Library

[21]

K. C. Sevcik. Characterizations of parallelism in applications and their use in scheduling. In Proceedings of the A CM SIGMETRICS Conference, pages 171-180, May 1989.

Digital Library

[22]

J. R. Spirn. Program Behavior: Models and Measurements. Elsevier, 1977.

Digital Library

[23]

J. R. Spirn and P. J. Denning. Experiments with program locality. In Proceedings of the AFIPS FJCC, volume 41, pages 611-621, 1972.

Digital Library

[24]

G. W. Stewart. Computable error bounds for aggregated Markov chains. Journal of the A CM, 30:271-285, t983.

Digital Library

[25]

A. Tucker and A. Gupta. Process control and scheduling issues for multiprogrammed sharedmemory multiprocessors. In Proceedings of the 12th A CM Symposium on Operating Systems Principles, pages 159-166, December 1989.

Digital Library

[26]

D. D. Yao. Refining the diffusion approximation for the M/G/m queue. Opera~ions Research, 33(6):1266-1277, 1985.

Digital Library

[27]

J. Zahorjan and C. McCann. Processor scheduling in shared memory muItiprocessors. In Proceedings of the A CM SIGMETRICS Conference, pages 214- 225, May 1990.

Digital Library

Cited By

Marijan DSen S(2020)Good Practices in Aligning Software Engineering Research and Industry PracticeACM SIGSOFT Software Engineering Notes10.1145/3356773.335681244:3(65-67)Online publication date: 22-Oct-2020
https://dl.acm.org/doi/10.1145/3356773.3356812
Ghoting AGunnels JKambadur PPednault ESquillante M(2013)Trends and outlook for the massive-scale analytics stackIBM Journal of Research and Development10.1147/JRD.2013.224267357:3-4(2-2)Online publication date: 1-May-2013
https://dl.acm.org/doi/10.1147/JRD.2013.2242673
Cui HHu GWu JYang J(2013)Verifying systems rules using rule-directed symbolic executionACM SIGARCH Computer Architecture News10.1145/2490301.245115241:1(329-342)Online publication date: 16-Mar-2013
https://dl.acm.org/doi/10.1145/2490301.2451152
Show More Cited By

Index Terms

Recommendations

Analysis of the impact of memory in distributed parallel processing systems

We consider an important tradeoff between processor and memory allocation in distributed parallel processing systems. To study this tradeoff, we formulate stochastic models of parallel program behavior, distributed parallel processing environments and ...
Analysis of Processor Allocation in Multiprogrammed, Distributed-Memory Parallel Processing Systems

A main objective of scheduling independent jobs composed of multiple sequential tasks in shared-memory and distributed-memory multiprocessor computer systems is theassignment of these tasks to processors in a manner that ensures efficient operation ...
Compiling shared-memory applications for distributed-memory systems

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMETRICS '94: Proceedings of the 1994 ACM SIGMETRICS conference on Measurement and modeling of computer systems

May 1994

294 pages

ISBN:089791659X

DOI:10.1145/183018

Chairmen:
Larry Dowdy
Vanderbilt Univ., Nashville, TN
,
Rick Bunt
Univ. of Saskatchewan, Saskatoon, Saskatchewan, Canada
,
Editor:
Blaine D. Gaither
Hewlett-Packard, NSA, Fort Collins, CO

ACM SIGMETRICS Performance Evaluation Review Volume 22, Issue 1
May 1994
289 pages
ISSN:0163-5999
DOI:10.1145/183019
Editor:
Blaine D. Gaither
Hewlett-Packard, NSA, Fort Collins, CO
Issue’s Table of Contents

Copyright © 1994 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 May 1994

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SIGMETRICS94

Sponsor:

SIGMETRICS

SIGMETRICS94: ACM SIGMETRICS Conference on Measurement & Modeling of Computer Systems

May 16 - 20, 1994

Tennessee, Nashville, USA

Acceptance Rates

Overall Acceptance Rate 459 of 2,691 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

50
Total Citations
View Citations
513
Total Downloads

Downloads (Last 12 months)58
Downloads (Last 6 weeks)11

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Marijan DSen S(2020)Good Practices in Aligning Software Engineering Research and Industry PracticeACM SIGSOFT Software Engineering Notes10.1145/3356773.335681244:3(65-67)Online publication date: 22-Oct-2020
https://dl.acm.org/doi/10.1145/3356773.3356812
Ghoting AGunnels JKambadur PPednault ESquillante M(2013)Trends and outlook for the massive-scale analytics stackIBM Journal of Research and Development10.1147/JRD.2013.224267357:3-4(2-2)Online publication date: 1-May-2013
https://dl.acm.org/doi/10.1147/JRD.2013.2242673
Cui HHu GWu JYang J(2013)Verifying systems rules using rule-directed symbolic executionACM SIGARCH Computer Architecture News10.1145/2490301.245115241:1(329-342)Online publication date: 16-Mar-2013
https://dl.acm.org/doi/10.1145/2490301.2451152
Mai HPek EXue HKing SMadhusudan P(2013)Verifying security invariants in ExpressOSACM SIGARCH Computer Architecture News10.1145/2490301.245114841:1(293-304)Online publication date: 16-Mar-2013
https://dl.acm.org/doi/10.1145/2490301.2451148
Tang LMars JZhang XHagmann RHundt RTune E(2013)Optimizing Google's warehouse scale computersProceedings of the 2013 IEEE 19th International Symposium on High Performance Computer Architecture (HPCA)10.1109/HPCA.2013.6522318(188-197)Online publication date: 23-Feb-2013
https://dl.acm.org/doi/10.1109/HPCA.2013.6522318
Squillante M(2010)Stochastic Analysis and Optimization of Multiserver SystemsRun-time Models for Self-managing Systems and Applications10.1007/978-3-0346-0433-8_1(1-24)Online publication date: 2010
https://doi.org/10.1007/978-3-0346-0433-8_1
Tournois JWormser CAlliez PDesbrun M(2009)Interleaving Delaunay refinement and optimization for practical isotropic tetrahedron mesh generationACM Transactions on Graphics10.1145/1531326.153138128:3(1-9)Online publication date: 27-Jul-2009
https://dl.acm.org/doi/10.1145/1531326.1531381
Baran IVlasic DGrinspun EPopović J(2009)Semantic deformation transferACM Transactions on Graphics10.1145/1531326.153134228:3(1-6)Online publication date: 27-Jul-2009
https://dl.acm.org/doi/10.1145/1531326.1531342
Xu WWang JYin KZhou Kvan de Panne MChen FGuo B(2009)Joint-aware manipulation of deformable modelsACM Transactions on Graphics10.1145/1531326.153134128:3(1-9)Online publication date: 27-Jul-2009
https://dl.acm.org/doi/10.1145/1531326.1531341
Weinberg JSnavely A(2007)Symbiotic Space-Sharing on SDSC’s DataStar SystemJob Scheduling Strategies for Parallel Processing10.1007/978-3-540-71035-6_10(192-209)Online publication date: 2007
https://doi.org/10.1007/978-3-540-71035-6_10
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents