Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Continuous Models for Communication Density Constraints on Multiprocessor Performance

Published: 01 June 1988 Publication History

Abstract

Fundamental limits on the communication capabilities of massively parallel multiprocessors are investigated. It is shown that in the limit of machines of infinite extent in which the number of processors per unit volume is constant and in which the communication bandwidth from each processor to its neighbors depends only on their separation distance, interprocessor communication must fall off faster than the fourth power of distance. For machines of finite size, communication energy density is used as a metric to compare various machine sizes and packaging densities. For instance, for machines with spherical symmetry and uniform communication requirements, the peak density depends on the number of processors to the 4/3 power and the number of processors per unit volume to the 2/3 power.

References

[1]
{1} W. D. Hillis, The Connection Machine. Cambridge, MA: MIT Press, 1985.
[2]
{2} S. E. Fahlman, G. E. Hinton, and T. J. Sejnowki, "Massively parallel architectures for AI: Netl, Thistle, and Boltzmann machines," in Proc. Nat. Conf. Artif. Intell., Washington DC, 1983, pp. 109-113.
[3]
{3} R. W. Keyes, "Fundamental limits in digital information processing," Proc. IEEE, vol. 69, pp. 267-278, 1981.
[4]
{4} C. E. Shannon and W. Weaver, The Mathematical Theory of Communication. Urbana, IL: Univ. Illinois Press, 1949.
[5]
{5} R. P. Feynman, R. B. Leighton, and M. Sands, The Feynman Lectures on Physics. Reading, MA: Addison-Wesley, 1975.
[6]
{6} J. J. O'Dwyer, The Theory of Electrical Conduction and Breakdown in Solid Dielectrics. Oxford, England: Clarendon, 1973, also C. Cooke, private communication.
[7]
{7} W. Crowther, J. Goodhue, E. Starr, R. Thomas, W. Milliken, and T. Blackadar, "Performance measurements on a 128-node butterfly parallel processor," in Proc. 1985 Int. Conf. Parallel Processing, IEEE Comput. Soc. Press, Aug. 20-23, 1985.
[8]
{8} R. M. Russell, "The CRAY-1 computer system," Commun. ACM, vol. 21, pp. 63-72, 1978.

Cited By

View all
  • (1992)Hardware combining and scalabilityProceedings of the fourth annual ACM symposium on Parallel algorithms and architectures10.1145/140901.141893(296-305)Online publication date: 1-Jun-1992

Recommendations

Reviews

Borivoje Djokic

This well-written paper presents a continuous model for communication density in large multiprocessor arrays. The authors use the criterion of information density to measure the difficulty and cost of building a machine's interconnect technology; they justify this choice by pointing out that information density does have a physical maximum based on material properties and information theory. The paper discusses the implications of identifying communication density as a fundamental quantity. After reading the section that quantifies the degree by which communication density must increase as the number of processors grows (for finite machines) one can much better understand the constraints involved in building a machine. The authors have achieved the main goal of their research: to provide the computer designer with the necessary theoretical background and a model for reasoning about machine tradeoffs when only general requirements are known and before a network topology has been chosen. The authors' statements are very general, as they are concerned with the functionality of the network rather than its design. I consider this to be a strength of their approach. The reader should have some knowledge of multiprocessor architecture, interprocessor communication, and information theory. The authors present their material effectively and in a logical and understandable way.

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Computers
IEEE Transactions on Computers  Volume 37, Issue 6
June 1988
136 pages

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 June 1988

Author Tags

  1. communication bandwidth
  2. communication density constraints
  3. communication energy density
  4. continuous models
  5. interprocessor communication
  6. multiprocessing systems
  7. multiprocessor performance
  8. performance evaluation.

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 06 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (1992)Hardware combining and scalabilityProceedings of the fourth annual ACM symposium on Parallel algorithms and architectures10.1145/140901.141893(296-305)Online publication date: 1-Jun-1992

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media