Article

Free access

Design challenges of virtual networks: fast, general-purpose communication

Authors:

Alan M. Mainwaring,

David E. CullerAuthors Info & Claims

PPoPP '99: Proceedings of the seventh ACM SIGPLAN symposium on Principles and practice of parallel programming

Pages 119 - 130

https://doi.org/10.1145/301104.301115

Published: 01 May 1999 Publication History

Abstract

Virtual networks provide applications with the illusion of having their own dedicated, high-performance networks, although network interfaces posses limited, shared resources. We present the design of a large-scale virtual network system and examine the integration of communication programming interface, system resource management, and network interface operation. Our implementation on a cluster of 100 workstations quantifies the impact of virtualization on small message latencies and throughputs, shows full hardware performance is delivered to dedicated applications and time-shared workloads, and shows robust performance under demanding workloads that overcommit interface resources.

References

[1]

N. Boden, D. Cohen, R. Felderman, A.Kulawik. C. Seitz, J. Seizovic, and W. Su. Myrinet: A Gigabit per Second Local Area Network. In IEEE Micro Magazine, February 1995.

Digital Library

[2]

E.A. Brewer, E T. Chong, Lok T. Liu, S. D. Sharma, and J. D. Kubiatowicz. Remote Queues. Exposing Network Queues for Atomicity and Optimization. In Proceedings of the 7th Symposium on Parallel Algorithms, and Architectures, pages 42-53, Santa Barbara, CA, July 1995.

Digital Library

[3]

A. Bilas and E. W. Felten. Fast RPC on the SHRIMP Virtual Memory Mapped Network Interface. Department of Computer Science, Princeton University Technical Report TR-512-96, February 1996.

[4]

G. Buzzard, D. Jacobson, M. Mackey, S. Marovich, and J. Wilkes. An implementation of the Hamlyn sender managed interface architecture. In Proceedings of the 2nd Symposium on Operating System Design and Implementation, pages 245-259, Seattle, WA, October 1996.

Digital Library

[5]

M.A. B lumrich, K. Li, R. Alpert, C. Dubnicki, E. W. Felten, and J. Sandberg. Virtual Memory Mapped Network Interface for the SHRIMP Multicomputer. In Proceedings of the 21rst International Symposium on Computer Architecture, pages 142-153, April 1994.

Digital Library

[6]

A. Basu, M. Welsh, and T. von Eicken. Incorporating Memory Management into User-Level Network Interfaces. In Proceedings of Hot Interconnects V, Stanford, CA, August 1997.

[7]

C. Chang, G. Czajkowski, C. Hawblitzel, and T. von Eicken, "Low-Latency Communication on the IBM RISC System/6000 SP," Department of Computer Science, Cornell University, September 1996.

[8]

Compaq Computer Corporation, Intel Corporation, and Microsoft Corporation. Virtual Interface Architecture Specification Version 1.0. On-line at http:// www.viarch.org, December, 1997.

[9]

D. Culler, L. Liu, R. Martin, and C. Yoshikawa. LogP Performance Assessment of Fast Network Interfaces. In IEEE Micro Magazine, February 19951

Digital Library

[10]

B. Chun, A. Mainwaring, and D. Culler. Virtual Network Transport Protocols for Myrinet. In IEEE Micro Magazine, January 1998.

Digital Library

[11]

R. Arpaci-Dusseau, E. Anderson, N. Treuhaft, D. Culler, J. Hellerstain, D. Patterson, K. Yelick. Cluster I/O with River: Making the Fast Case Common. IOPADS '99. May, 1999, Atlanta, Georgia.

Digital Library

[12]

A.C. Arpaci-Dusseau, D. E. Culler, A. M. Mainwaring. Scheduling with Implicit Information in Distributed Systems. In 1998 SIGMETRICS Conference on the Measurement and Modeling of Computer Systems, Madison, Wisconsin, June 24-26, 1998.

Digital Library

[13]

S. Damianakis, C. Dubnicki, and E. W. Felten. Stream Sockets on SHRIMP. Department of Computer Science, Princeton University Technical Report TR-513- 96, October 1996.

[14]

J.J. Dongarra, H. W. Meuer, and E. Strohmaier. TOP500 Supercomputer Sites. Technical Report UT- CS-97-365, University of Tennessee, June 1997.

Digital Library

[15]

P. Druschel, L. Peterson, and B. Davie. Experiences with a High-speed Network Adaptor: A Software Perspective. In Proceedings of ACM SIGCOMM '94 Symposium, August, 1994.

Digital Library

[16]

B. Goodheart and J. Cox. The Magic Garden Explained: The Internals of UNIX System V Release 4: An Open Systems Design. New York : Prentice Hall, 1994.

Digital Library

[17]

R.B. Gillett. Memory Channel Network for PCI. IEEE Micro, 16:12-18, February 1996.

Digital Library

[18]

R. Horst. TNet: A Reliable System Area Network. IEEE Micro, February 1995, vol.15, (no.1):37-45.

Digital Library

[19]

C.E. Leiserson, Z. S. Abuhamdeh, D. C. Douglas, C. R. Feynman, M. N. Ganmukhi, J. V. Hill, W. D. Hillis, B.C. Kuszmaul, M. A. St. Pierre, D. S. Wells, M. C. Wong, S. W.Yang, and R. Zak. The Network Architecture of the Connection Machine CM-5. In Symposium on Parallel and Distributed Algorithms, pages 272-285, San Diego, California, 1992.

Digital Library

[20]

L. Lamport. Time, Clocks, and Ordering of Events in a Distributed System. Communications of the ACM, 21 (7):558-565, July 1978.

Digital Library

[21]

L.T. Liu. An Evaluation of the Intel Paragon Communication Architecture. Master's report, University of California at Berkeley, Computer Science Department, Berkeley, CA, July 1995.

[22]

S. Lumetta, A. Mainwaring, D. Culler. Multi-Protocol Active Messages on a Cluster of SMP's. In Proceedings ofSC'97, November 1997.

Digital Library

[23]

R.P. Martin. HPAM. An Active Message Layer for a Network of Workstations. In Proceedings of Hot Interconnects II, Stanford, CA, August 1994.

[24]

S. Pakin, V. Karacheti, and A. Chien. Fast Messages (FM): Efficient, Portable Communication for Workstation Clusters and Massively-Parallel Processors. In IEEE Parallel and Distributed Technology, 1997.

Digital Library

[25]

S. Pakin, M. Lauria, and A. Chien. High Performance Messaging on Workstations. Illinois Fast Messages (FM) for Myrinet. In Proceedings of Supercomputing '95, San Diego, CA, 1995.

Digital Library

[26]

A. Mainwaring and D. Culler. Active Message Application Programming Interface and Communication Subsystem Organization. Technical Report CSD-96- 918, University of California at Berkeley, October 1996.

Digital Library

[27]

H.Tezuka, A. Hori, Y. Ishikawa and M. Sato. PM: A Operating System Coordinated High Performance Communication Library. in High-Performance Computing and Networking '97, April 1997

Digital Library

[28]

L. Tucker and A. Mainwaring. CMMD: Active Messages on the CM-5. Parallel Computing. 20 (1994) 481-496.

Digital Library

[29]

K.E. Schauser and C. J. Scheiman. Experience with Active Messages on the Meiko CS-2. In Proceedings of the 9th International Parallel Processing Symposium, Santa Barbara, CA, April 1995.

Digital Library

[30]

T. von Eicken, A. Basu, V. Buch, and W. Vogels. U- Net: A User-level Network Interface for Parallel and Distributed Computing. In Proceedings of the 15th ACM Symposium on Operating System Principles, December 1995.

Digital Library

[31]

T. von Eicken, D. E. Culler, S. C.Goldstein, and K. E. Schauser. Active Messages. a Mechanism for Integrated Communication and Computation. In Proceedings of the 19th International Symposium on Computer Architecture, pages 256-266, Gold Coast, Australia, May 1992.

Digital Library

[32]

R. Martin, A. Vahdat, D. Culler, T. Anderson. Effects of Communication Latency, Overhead, and Bandwidth in a Cluster Architecture. In Proceedings of the International Symposium on Computer Architecture, Denver, CO. June 1997.

Digital Library

Cited By

Marazakis MXinidis KPapaefstathiou VBilas AEgan GMuraoka Y(2006)Efficient remote block-level I/O over an RDMA-capable NICProceedings of the 20th annual international conference on Supercomputing10.1145/1183401.1183417(97-106)Online publication date: 28-Jun-2006
https://dl.acm.org/doi/10.1145/1183401.1183417
Schaelicke LDavis A(2006)Design Trade-Offs for User-Level I/O ArchitecturesIEEE Transactions on Computers10.1109/TC.2006.12255:8(962-973)Online publication date: 1-Aug-2006
https://dl.acm.org/doi/10.1109/TC.2006.122
Azimi RBilas ABanerjee UGallivan KGonzalez A(2003)miNIProceedings of the 17th annual international conference on Supercomputing10.1145/782814.782851(261-272)Online publication date: 23-Jun-2003
https://dl.acm.org/doi/10.1145/782814.782851
Show More Cited By

Index Terms

Design challenges of virtual networks: fast, general-purpose communication
1. Computing methodologies
  1. Concurrent computing methodologies
    1. Concurrent programming languages
2. Software and its engineering
  1. Software notations and tools
    1. General programming languages
      1. Language types
        Concurrent programming languages
  2. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Communications management

Recommendations

Design challenges of virtual networks: fast, general-purpose communication

Virtual networks provide applications with the illusion of having their own dedicated, high-performance networks, although network interfaces posses limited, shared resources. We present the design of a large-scale virtual network system and examine the ...
Towards efficiently migrating virtual networks in cloud-based data centers

With the expansion of cloud computing, virtual network (VN) migration becomes the very perspective technology for saving energy, ensuring Service Level Agreements or improving the survivability of virtual networks in cloud networks. At present, the ...
Towards automated security policy enforcement in multi-tenant virtual data centers
EU-Funded ICT Research on Trust and Security

Virtual data centers allow the hosting of virtualized infrastructures (networks, storage, machines) that belong to several customers on the same physical infrastructure. Virtualization theoretically provides the capability for sharing the infrastructure ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

PPoPP '99: Proceedings of the seventh ACM SIGPLAN symposium on Principles and practice of parallel programming

May 1999

192 pages

ISBN:1581131003

DOI:10.1145/301104

Chairmen:
Marc Snir
IBM T. J. Watson Research Center, Yorktown Heights, NY
,
Andrew A. Chien
Univ. of California, San Diego, San Diego

ACM SIGPLAN Notices Volume 34, Issue 8
Aug. 1999
192 pages
ISSN:0362-1340
EISSN:1558-1160
DOI:10.1145/329366
Editor:
A. Michael Burman
Rowan Univ., Glassboro, NJ
Issue’s Table of Contents

Copyright © 1999 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGPLAN: ACM Special Interest Group on Programming Languages

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 May 1999

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

PPoPP99

Sponsor:

SIGPLAN

PPoPP99: Symposium on Principles & Practice of Parallel Programming

May 4 - 6, 1999

Georgia, Atlanta, USA

Acceptance Rates

PPoPP '99 Paper Acceptance Rate 17 of 79 submissions, 22%;

Overall Acceptance Rate 230 of 1,014 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
720
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)9

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Marazakis MXinidis KPapaefstathiou VBilas AEgan GMuraoka Y(2006)Efficient remote block-level I/O over an RDMA-capable NICProceedings of the 20th annual international conference on Supercomputing10.1145/1183401.1183417(97-106)Online publication date: 28-Jun-2006
https://dl.acm.org/doi/10.1145/1183401.1183417
Schaelicke LDavis A(2006)Design Trade-Offs for User-Level I/O ArchitecturesIEEE Transactions on Computers10.1109/TC.2006.12255:8(962-973)Online publication date: 1-Aug-2006
https://dl.acm.org/doi/10.1109/TC.2006.122
Azimi RBilas ABanerjee UGallivan KGonzalez A(2003)miNIProceedings of the 17th annual international conference on Supercomputing10.1145/782814.782851(261-272)Online publication date: 23-Jun-2003
https://dl.acm.org/doi/10.1145/782814.782851
Eberle HGura NGiles RReed DKelley K(2002)Separated high-bandwidth and low-latency communication in the cluster interconnect ClintProceedings of the 2002 ACM/IEEE conference on Supercomputing10.5555/762761.762804(1-12)Online publication date: 16-Nov-2002
https://dl.acm.org/doi/10.5555/762761.762804
Buonadonna PCuller DPatt YGrunwald DSkadron K(2002)Queue pair IPProceedings of the 29th annual international symposium on Computer architecture10.5555/545215.545243(247-256)Online publication date: 25-May-2002
https://dl.acm.org/doi/10.5555/545215.545243
Buonadonna PCuller D(2002)Queue pair IPACM SIGARCH Computer Architecture News10.1145/545214.54524330:2(247-256)Online publication date: 1-May-2002
https://dl.acm.org/doi/10.1145/545214.545243
Buonadonna PCuller D(2002)Queue pair IP: a hybrid architecture for system area networksProceedings 29th Annual International Symposium on Computer Architecture10.1109/ISCA.2002.1003583(247-256)Online publication date: 2002
https://doi.org/10.1109/ISCA.2002.1003583
Begel ABuonadonna PCuller DGay D(2002)An analysis of VI Architecture primitives in support of parallel and distributed communicationConcurrency and Computation: Practice and Experience10.1002/cpe.61614:1(55-76)Online publication date: 12-Mar-2002
https://doi.org/10.1002/cpe.616
Culler DHill JBuonadonna PSzewczyk RWoo A(2001)A Network-Centric Approach to Embedded Software for Tiny DevicesEmbedded Software10.1007/3-540-45449-7_9(114-130)Online publication date: 27-Sep-2001
https://doi.org/10.1007/3-540-45449-7_9
McKee SWulf WAylor JSalinas MKlenke RHong SWeikle D(2000)Dynamic Access Ordering for Streamed ComputationsIEEE Transactions on Computers10.1109/12.89594149:11(1255-1271)Online publication date: 1-Nov-2000
https://dl.acm.org/doi/10.1109/12.895941

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents