Article

An integrated experimental environment for distributed systems and networks

Authors:

Shashi Guruprasad,

Abhijeet JoglekarAuthors Info & Claims

OSDI '02: Proceedings of the 5th symposium on Operating systems design and implementation (Copyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading)

Pages 255 - 270

Published: 09 December 2002 Publication History

Abstract

Three experimental environments traditionally support network and distributed systems research: network emulators, network simulators, and live networks. The continued use of multiple approaches highlights both the value and inadequacy of each. Netbed, a descendant of Emulab, provides an experimentation facility that integrates these approaches, allowing researchers to configure and access networks composed of emulated, simulated, and wide-area nodes and links. Netbed's primary goals are ease of use, control, and realism, achieved through consistent use of virtualization and abstraction.By providing operating system-like services, such as resource allocation and scheduling, and by virtualizing heterogeneous resources, Netbed acts as a virtual machine for network experimentation. This paper presents Netbed's overall design and implementation and demonstrates its ability to improve experimental automation and efficiency. These, in turn, lead to new methods of experimentation, including automated parameter-space studies within emulation and straightforward comparisons of simulated, emulated, and wide-area scenarios.

References

[1]

J. S. Ahn et al. Evaluation of TCP Vegas: Emulation and Experiment. In Proc. of SIGCOMM '95, pages 185--195, Aug. 1995.

Digital Library

[2]

M. Allman, A. Caldwell, and S. Ostermann. ONE: The Ohio Network Emulator. Technical Report TR-19972, Ohio University Computer Science, Aug. 1997.

[3]

Y. Amir, C. Danilov, M. Miskin-Amir, J. Stanton, and C. Tutu. Practical Wide-Area Database Replication. Technical report, Johns Hopkins University, 2002.

[4]

D. Andersen, H. Balakrishnan, F. Kaashock, and R. Morris. Resilient Overlay Networks. In Proc. 18th SOSP, Oct. 2001.

Digital Library

[5]

T. Anderson. A Case for Access: A High Performance Communication and Computation Environment for Wide Area Distributed Systems, Networking, and Applications Research. http://www.cs.washington.edu/homes/tom/access/.

[6]

L. S. Brakmo and L. L. Peterson. Experiences with Network Simulation. In Proc. of ACM SIGMETRICS'96, May 1996.

Digital Library

[7]

CAIRN: Collaborative Advanced Internet Research Network. http://www.isi.edu/CAIRN/.

[8]

S. Dawson et al. Testing of Fault-Tolerant and Real-Time Distributed Systems via Protocol Fault Injection. In Proc. FTCS '96.

Digital Library

[9]

D. Engler, D. Y. Chen, S. Hallem, A. Chou, and B. Chelf. Bugs as Deviant Behavior: A General Approach to Inferring Errors in Systems Code. In Proc. 18th SOSP, Oct. 2001.

Digital Library

[10]

K. Fall. Network Emulation in the Vint/NS Simulator. In Proc. IEEE ISCC '99, 1999.

Digital Library

[11]

S. Floyd and V. Paxson. Difficulties in simulating the Internet. IEEE/ACM Transactions on Networking, 9(4), August 2001.

Digital Library

[12]

B. Ford, G. Back, G. Benson, J. Lepreau, A. Lin, and O. Shivers. The Flux OSKit: A Substrate for OS and Language Research. In Proc. 16th SOSP, pages 38--51, Oct. 1997.

Digital Library

[13]

M. R. Garey and D. S. Johnson. Computers and Intractability: A guide to the theory of NP-completeness. W. H. Freeman, 1979.

Digital Library

[14]

Symantec Ghost. http://www.symantec.com/sabu/ghost/.

[15]

J. Heidemann et al. Effects of Detail in Wireless Network Simulation. http://www.isi.edu/~johnh/PAPERS/Heidemann00d.html.

[16]

L. Ingber. Very Fast Simulated Re-Annealing. Journal of Mathematical Computer Modelling, 12:967--973, 1989. http://www.ingber.com/asa89_vfsr.ps.gz.

Digital Library

[17]

IXP1200. http://www.intel.com/design/network/products/-npfamily/ixp1200.htm.

[18]

P.-H. Kamp and R. N. M. Watson. Jails: Confining the omnipotent root. In Proc. 2nd Intl. SANE Conference, May 2000.

[19]

A. M. Lapone. N. F. Maxemchuk, and H. Schulzrinne. The Bell Laboratories Network Emulator. Technical Report BL0113820930913--64TM, AT&T Bell Labs, Sept. 1993.

[20]

D. Mazières, M. Kaminsky, M. F. Kaashoek, and E. Witchel. Separating key management from file system security. In Proc. of SOSP '99, December 1999.

Digital Library

[21]

P. E. McKenney, D. Y. Lee, and B. A. Denny. Traffic Generator Software Release Notes. SRI International and USC/ISI Postel Center for Experimental Networking. http://www.postel.org/tg/.

[22]

J. Moore and J. Chase. Cluster On Demand. Technical Report CS-2002-07, Duke University, Dept. of Computer Science, May 2002.

[23]

A. Muthitacharoen, B. Chen, and D. Mazières. A Low-bandwidth Network File System. In Proc. 18th SOSP, Oct. 2001.

Digital Library

[24]

The Network Simulator ns-2: Validation Tests. http://www.isi.edu/nsnam/ns/ns-tests.html.

[25]

M. Neufeld, A. Jain, and D. Grunwald. Nsclick: Bridging Network Simulation and Deployment. In Proc. MSWiM 2002.

Digital Library

[26]

NIST Internetworking Technology Group. NIST Net home page. http://www.antd.nist.gov/itg/nistnet/.

[27]

B. D. Noble et al. Trace-Based Mobile Network Emulation. In Proc. of SIGCOMM '97, Sept. 1997.

Digital Library

[28]

Océano Project. http://www.research.ibm.com/oceanoproject/.

[29]

R. Oldfield and D. Kotz. Armada: A parallel file system for computational grids. In Proc. of IEEE/ACM International Symposium on Cluster Computing and the Grid, May 2001.

Digital Library

[30]

R. Oldfield and D. Kotz. Using the Emulab network testbed to evaluate the Armada I/O framework for computational grids. Technical report, Dartmouth, May 2002. ftp://ftp.cs.dartmouth.edu/pub/raoldfi/armada/oldfield:armada-emulab-tr.pdf.

[31]

V. S. Pai, P. Druschel, and W. Zwaenepoel. IO-Lite: A Unified I/O Buffering and Caching System. In Proc. 3rd OSDI, Feb. 1999.

Digital Library

[32]

Partition Image. http://www.partimage.org/.

[33]

L. Peterson, T. Anderson, D. Culler, and T. Roscoe. A Blueprint for Introducing Disruptive Technology into the Internet. In Proc. HotNets-I, Princeton, NJ, Oct. 2002.

[34]

PXE Preboot Execution Environment Specification Version 2.1. ftp://download.intel.com/ial/wfm/pxespec.pdf.

[35]

Rembo Technology. BpBatch. http://www.bpbatch.org/.

[36]

L. Rizzo. Dummynet and Forward Error Correction. In Proc. of the 1998 USENIX Annual Technical Conf., June 1998.

Digital Library

[37]

rsync. http://rsync.samba.org/.

[38]

B. Segall, D. Arnold, J. Boot, M. Henderson, and T. Phelps. Content Based Routing with Elvin4. In Proc. AUUG '00, June 2000.

[39]

R. Tanese. The Distributed Genetic Algorithm. In Proc. ICGA '89. Morgan Kaufmann, 1989.

Digital Library

[40]

The VINT Project. The ns Manual, Apr. 2002. http://www.isi.-edu/nsnam/ns/ns-documentation.html.

[41]

Unison. http://www.cis.upenn.edu/~bcpierce/unison/.

[42]

A. Vahdat, K. Yocum, K. Walsh, P. Mahadevan, D. Kostic, J. Chase, and D. Becker. Scalability and Accuracy in a Large-Scale Network Emulator. In Proc. 5th OSDI, Dec. 2002.

Digital Library

Cited By

Muthuraj NEghbal NLu PVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Replication: "Taking a long look at QUIC"Proceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688453(375-388)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3688453
Liu S(2022)All in One: Design, Verification, and Implementation of SNOW-optimal Read Atomic TransactionsACM Transactions on Software Engineering and Methodology10.1145/349451731:3(1-44)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.1145/3494517
Burke MCheng ALloyd WBhagwan RPorter G(2020)GryffProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388286(591-618)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388286
Show More Cited By

An integrated experimental environment for distributed systems and networks
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures

Recommendations

An integrated experimental environment for distributed systems and networks
OSDI '02: Proceedings of the 5th Symposium on Operating Systems Design and Implementation

Three experimental environments traditionally support network and distributed systems research: network emulators, network simulators, and live networks. The continued use of multiple approaches highlights both the value and inadequacy of each. Netbed, ...
A Large-Scale Network Worm Emulation Experimental Environment
IMCCC '11: Proceedings of the 2011 First International Conference on Instrumentation, Measurement, Computer, Communication and Control

The worm experimental environment is the pivotal foundation for the worm research. Existing methods to build the environment, such as mathematical modeling, simulation and emulation, almost all of the existing methods inherently face a rigid fidelity-...
Design and Evaluation of a Virtual Experimental Environment for Distributed Systems
PDP '13: Proceedings of the 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing

Between simulation and experiments on real-scale testbeds, the combined use of emulation and virtualization provide a useful alternative for performing experiments on distributed systems such as clusters, grids, cloud computing or P2P systems. In this ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

OSDI '02: Proceedings of the 5th symposium on Operating systems design and implementation (Copyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading)

December 2002

413 pages

ISBN:9781450301114

Program Chairs:
David Culler
University of California, Berkeley
,
Peter Druschel
Rice University

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

USENIX Association

United States

Publication History

Published: 09 December 2002

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

350
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Muthuraj NEghbal NLu PVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Replication: "Taking a long look at QUIC"Proceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688453(375-388)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3688453
Liu S(2022)All in One: Design, Verification, and Implementation of SNOW-optimal Read Atomic TransactionsACM Transactions on Software Engineering and Methodology10.1145/349451731:3(1-44)Online publication date: 7-Mar-2022
https://dl.acm.org/doi/10.1145/3494517
Burke MCheng ALloyd WBhagwan RPorter G(2020)GryffProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388286(591-618)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388286
Crow SFarinholt BJohannesmeyer BKoscher KCheckoway SSavage SSchulman ASnoeren ALevchenko KJansen RPeterson P(2019)TritonProceedings of the 12th USENIX Conference on Cyber Security Experimentation and Test10.5555/3359012.3359015(3-3)Online publication date: 12-Aug-2019
https://dl.acm.org/doi/10.5555/3359012.3359015
Duplyakin DRicci RMaricq AWong GDuerig JEide EStoller LHibler MJohnson DWebb KAkella AWang KRicart GLandweber LElliott CZink MCecchet EKar SMishra PDan TDahlia M(2019)The design and operation of cloudlabProceedings of the 2019 USENIX Conference on Usenix Annual Technical Conference10.5555/3358807.3358809(1-14)Online publication date: 10-Jul-2019
https://dl.acm.org/doi/10.5555/3358807.3358809
Kalia AKaminsky MAndersen DLorch JYu M(2019)Datacenter RPCs can be general and fastProceedings of the 16th USENIX Conference on Networked Systems Design and Implementation10.5555/3323234.3323236(1-16)Online publication date: 26-Feb-2019
https://dl.acm.org/doi/10.5555/3323234.3323236
Ghandeharizadeh SNguyen H(2019)Design, implementation, and evaluation of write-back policy with cache augmented data storesProceedings of the VLDB Endowment10.14778/3324301.332430212:8(836-849)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.14778/3324301.3324302
Zarchy DMittal RSchapira MShenker S(2019)Axiomatizing Congestion ControlProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/3341617.33261483:2(1-33)Online publication date: 19-Jun-2019
https://dl.acm.org/doi/10.1145/3341617.3326148
Zhu TZhao ZLi FQian WZhou AXie DStutsman RLi HHu H(2019)SolarDBACM Transactions on Storage10.1145/331815815:2(1-26)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3318158
Lukman JKe HStuardo CSuminto RKurniawan DSimon DPriambada STian CYe FLeesatapornwongsa TGupta ALu SGunawi H(2019)FlyMCProceedings of the Fourteenth EuroSys Conference 201910.1145/3302424.3303986(1-16)Online publication date: 25-Mar-2019
https://dl.acm.org/doi/10.1145/3302424.3303986
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents