research-article

TPy: A Lightweight Framework for Agile Distributed Network Experiments

Authors:

Daniel Steinmetzer,

Matthias HollickAuthors Info & Claims

WiNTECH '18: Proceedings of the 12th International Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization

Pages 38 - 45

https://doi.org/10.1145/3267204.3267214

Published: 01 October 2018 Publication History

Abstract

Experimental validation of novel network solutions, protocols, and applications gains increasing importance. The complexity of today's network systems makes evaluations in physical testbeds mandatory to capture real-world effects. However, this causes methodological and technical issues and challenges researchers in handling their agile testbed deployments. In contrast to Internet-scale testbeds, most agile experiments require specific topologies, specialized hardware, or a custom environment. They typically run only a few times and demand live user interaction. Existing management systems for Internet-scale testbeds do not accommodate these needs due to their complexity and maintenance overhead. In this paper, we present TPy, a lightweight and flexible framework to conduct distributed network experiments. TPy is written in Python and extendable via modules. To demonstrate its versatility and ease-of-use, we use TPy to perform experiments in the domains of millimeter-wave and secure multi-hop communications. We share TPy as open source software to support the community of experimental evaluation.

References

[1]

ACM Conference on Security and Privacy in Wireless and Mobile Networks. 2017. Reproducibility Label. http://wisec2017.ccs.neu.edu/reproducibility.html Retrieved July 4, 2018 from

[2]

ACM MobiCom. 2017. Call for Papers. https://www.sigmobile.org/mobicom/2017/cfp.php Retrieved July 4, 2018 from

[3]

Alessio Botta, Alberto Dainotti, and Antonio Pescapè. 2012. A tool for the generation of realistic network workload for emerging networking scenarios. Computer Networks, Vol. 56, 15 (2012), 3531--3547.

Digital Library

[4]

Ioannis Chatzigiannakis, Stefan Fischer, Christos Koninis, Georgios Mylonas, and Dennis Pfisterer. 2010. WISEBED: An Open Large-Scale Wireless Sensor Network Testbed. In Sensor Applications, Experimentation, and Logistics. Springer Berlin Heidelberg, 68--87.

[5]

Irmen de Jong. 2018. Pyro 4.x - Python Remote Objects. https://github.com/irmen/Pyro4

[6]

PC Engines. 2018. APU platform. http://www.pcengines.ch/apu.htm Retrieved June 27, 2018 from

[7]

Future Internet Testing Facility (FIT). 2018. IoT-LAB: a very large scale open testbed. https://www.iot-lab.info Retrieved June 27, 2018 from

[8]

GENI (Global Environment for Network Innovations). 2018. Federated Testbeds. http://www.geni.net/geni-partners/federated-testbeds/ Retrieved June 27, 2018 from

[9]

John D. Hunter. 2007. Matplotlib: A 2D Graphics Environment. Computing in Science Engineering, Vol. 9, 3 (2007), 90--95.

Digital Library

[10]

imec. 2018. jFed is a Java-based framework for testbed federation. https://jfed.ilabt.imec.be Retrieved June 27, 2018 from

[11]

IMEC iLab.t. 2018. w-iLab.t. https://doc.ilabt.imec.be/ilabt-documentation/wilabfacility.html Retrieved June 27, 2018 from

[12]

Institute of Telematics, University of Lübeck. 2018. Testbed Runtime. https://github.com/itm/testbed-runtime Retrieved June 27, 2018 from

[13]

Eddie Kohler, Robert Morris, Benjie Chen, John Jannotti, and M Frans Kaashoek. 2000. The Click Modular Router. ACM Transactions on Computer Systems, Vol. 18, 3 (Aug. 2000), 263--297.

Digital Library

[14]

Wes McKinney. 2010. Data Structures for Statistical Computing in Python. In Python in Science Conference. 51 -- 56.

[15]

ORBIT Project. 2018. Open-Access Research Testbed for Next-Generation Wireless Networks (ORBIT). http://www.orbit-lab.org Retrieved June 27, 2018 from

[16]

Thierry Rakotoarivelo, Maximilian Ott, Guillaume Jourjon, and Ivan Seskar. 2010. OMF: A Control and Management Framework for Networking Testbeds. SIGOPS Oper. Syst. Rev., Vol. 43, 4 (Jan. 2010), 54--59.

Digital Library

[17]

Milan Schmittner, Arash Asadi, and Matthias Hollick. 2017. SEMUD: Secure Multi-hop Device-to-Device Communication for 5G Public Safety Networks. In IFIP Networking Conference and Workshops. IEEE.

[18]

Daniel Steinmetzer and Milan Stute. 2018. TPy Implementation. https://seemoo.de/tpy

[19]

Daniel Steinmetzer, Daniel Wegemer, and Matthias Hollick. 2017. Talon Tools: The Framework for Practical IEEE 802.11ad Research. https://seemoo.de/talon-tools

[20]

Brian White, Jay Lepreau, Leigh Stoller, Robert Ricci, Shashi Guruprasad, Mac Newbold, Mike Hibler, Chad Barb, and Abhijeet Joglekar. 2002. An Integrated Experimental Environment for Distributed Systems and Networks. In Proceedings of the Fifth Symposium on Operating Systems Design and Implementation (OSDI). USENIX, 255--270.

Digital Library

[21]

Wraith Wireless. 2018. PyRIC: Python Radio Interface Controller. https://github.com/wraith-wireless/PyRIC

[22]

Tatu Ylonen and Chris Lonvick. 2006. The Secure Shell (SSH) Connection Protocol. RFC 4254 (Jan. 2006).

Cited By

Hessel FAlmon LÁlvarez FMayrhofer RRoland M(2020)ChirpOTLEProceedings of the 13th ACM Conference on Security and Privacy in Wireless and Mobile Networks10.1145/3395351.3399423(306-316)Online publication date: 8-Jul-2020
https://dl.acm.org/doi/10.1145/3395351.3399423
Stute MAgarwal PKumar AAsadi AHollick M(2020)LIDOR: A Lightweight DoS-Resilient Communication Protocol for Safety-Critical IoT SystemsIEEE Internet of Things Journal10.1109/JIOT.2020.29850447:8(6802-6816)Online publication date: Aug-2020
https://doi.org/10.1109/JIOT.2020.2985044
Klingler FHauptmeier FSommer CDressler F(2020)Poster Abstract: An Open Source Approach to Field Testing of WLAN up to IEEE 802.11ad at 60 GHz Using Commodity HardwareIEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)10.1109/INFOCOMWKSHPS50562.2020.9162717(1312-1313)Online publication date: Jul-2020
https://doi.org/10.1109/INFOCOMWKSHPS50562.2020.9162717
Show More Cited By

Index Terms

TPy: A Lightweight Framework for Agile Distributed Network Experiments
1. Networks
  1. Network performance evaluation
    1. Network experimentation
  2. Network types
    1. Ad hoc networks
    2. Wireless access networks
      1. Wireless local area networks

Recommendations

Experiment Replication Using ProtoGENI nodes
GREE '13: Proceedings of the 2013 Second GENI Research and Educational Experiment Workshop

Repeatability of network experiments has long been a goal for networking researchers but the lack of a scientific process of experimentation has made this exercise difficult to achieve. In this paper, we demonstrate that, if conducted in a scientific ...
Virtual Time Machine for Reproducible Network Emulation
SIGSIM-PADS '19: Proceedings of the 2019 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation

Reproducing network emulation experiments on diverse physical platforms with varying computation and communication resources is non-trivial. Many state-of-the-art network emulation testbeds do not guarantee timing fidelity. Consequently, results ...
Introduction to network experiments using the GENI cyberinfrastructure
SIGMETRICS '12: Proceedings of the 12th ACM SIGMETRICS/PERFORMANCE joint international conference on Measurement and Modeling of Computer Systems

In this tutorial, we will introduce the SIGMETRICS/Performance community to the vast testbeds, tools and resources openly available through the GENI (Global Environment for Network Innovations) project. We will present details about the distributed ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WiNTECH '18: Proceedings of the 12th International Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization

October 2018

106 pages

ISBN:9781450359306

DOI:10.1145/3267204

General Chairs:
Swarun Kumar
Carnegie Mellon University
,
Andres Garcia-Saavedra
NEC Laboratories Europe

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobiCom '18

Sponsor:

SIGMOBILE

MobiCom '18: The 24th Annual International Conference on Mobile Computing and Networking

November 2, 2018

New Delhi, India

Acceptance Rates

WiNTECH '18 Paper Acceptance Rate 10 of 16 submissions, 63%;

Overall Acceptance Rate 63 of 100 submissions, 63%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
162
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to

Other Metrics

View Author Metrics

Citations

Cited By

Hessel FAlmon LÁlvarez FMayrhofer RRoland M(2020)ChirpOTLEProceedings of the 13th ACM Conference on Security and Privacy in Wireless and Mobile Networks10.1145/3395351.3399423(306-316)Online publication date: 8-Jul-2020
https://dl.acm.org/doi/10.1145/3395351.3399423
Stute MAgarwal PKumar AAsadi AHollick M(2020)LIDOR: A Lightweight DoS-Resilient Communication Protocol for Safety-Critical IoT SystemsIEEE Internet of Things Journal10.1109/JIOT.2020.29850447:8(6802-6816)Online publication date: Aug-2020
https://doi.org/10.1109/JIOT.2020.2985044
Klingler FHauptmeier FSommer CDressler F(2020)Poster Abstract: An Open Source Approach to Field Testing of WLAN up to IEEE 802.11ad at 60 GHz Using Commodity HardwareIEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)10.1109/INFOCOMWKSHPS50562.2020.9162717(1312-1313)Online publication date: Jul-2020
https://doi.org/10.1109/INFOCOMWKSHPS50562.2020.9162717
Almon LAlvarez FKamp LHollick M(2019)The King is Dead Long Live the King! Towards Systematic Performance Evaluation of Heterogeneous Bluetooth Mesh Networks in Real World Environments2019 IEEE 44th Conference on Local Computer Networks (LCN)10.1109/LCN44214.2019.8990765(389-397)Online publication date: Oct-2019
https://doi.org/10.1109/LCN44214.2019.8990765

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents