Significant efforts have been devoted to creating large scale compute and network testbeds for st... more Significant efforts have been devoted to creating large scale compute and network testbeds for studying future Internet challenges. Besides large geographic span, the common emphasis is programmability, allowing researchers to reserve or create, via software, flexible sets of compute and network resources over specified topologies to execute research prototypes of new protocols, processes, and applications. Also emphasized are virtualization, instrumentation, and software defined networking (SDN) capabilities of the infrastructure. SDN in particular stimulated significant interests in academia, industry, and public sectors to re-imagine the future computing and networking infrastructure landscape and roadmap while it becomes increasingly utilized in production environments. Amidst these interests, one can start to capture desirable characteristics to glimpse the potential architecture of the future Internet. In this paper, we discuss the significance of compute-network interaction across complex, highly customized federated architecture in the future Internet. Infrastructure federation has been happening across multiple dimensions. Federation expands the scope of infrastructure, geographically and administratively, for use by members of different organizations. For example, federation initiatives are underway among: 1) US Global Environment for Network Innovations (GENI), Europe Future Internet Research and Experimentation (FIRE), and future Internet testbeds in Asia, South America, and Canada, 2) university production infrastructure, 3) US cities, 4) US public research institutes, and 5) commercial infrastructure. While requirements and objectives differ, they must all address a common set of issues. Such federation suggests the fundamental needs of applications to interact with compute and network resources across a generic, federated, future Internet environment.
A complete system for distributing quantum entangled signals over fiber based on commercially ava... more A complete system for distributing quantum entangled signals over fiber based on commercially available equipment will be demonstrated. Measurements are collected and controlled from a single location using an embedded optical data link.
Communication services, architecture, and technologies are rapidly evolving in response to applic... more Communication services, architecture, and technologies are rapidly evolving in response to application demand and research innovation. These changes are motivating a fundamentally new approach to the design and provisioning of services, facilities, and infrastructure. Traditionally, such resources have been designed and implemented as centralized fixed utility services, with almost no options for specialization and customization, especially by processes at the
To realize P4 language benefits: “Protocol Independent, Target Independent, Field Reconfigurable”... more To realize P4 language benefits: “Protocol Independent, Target Independent, Field Reconfigurable” [1] in a network research and development environment, a few P4 research institutions around the world formed a partnership to design and implement the international P4 Experimental Networks (Figure 1). The participating institutions can share distributed P4 resources over international research and education networks, as well as initiate international P4 research collaboration projects. Initial network scenarios in this research testbed are Software-Defined Network Exchanges (SDXs), Network and Cloud Testbed Networks, Science Networks, and Campus Research Networks. These four network scenarios require multi-tenant support. Current P4Runtime specifications include a Multi-Controller design for twofold: Control Plane Partition and Redundancy [2]. However, the current P4Runtime does not implement Control Plane partition to support multi-tenant service on a switch. This project modified the current design to support a provider and multiple tenant model for the four international P4 Experimental Networks (i-P4EN)scenarios and other applications.
2017 20th Conference on Innovations in Clouds, Internet and Networks (ICIN), 2017
This paper describes a Bioinformatics Software Defined Network Exchange (SDX) or BioSDX, which ha... more This paper describes a Bioinformatics Software Defined Network Exchange (SDX) or BioSDX, which has been designed, deployed, and demonstrated by a multi-organizational research consortium to enable bioinformatics knowledge discovery supported by dynamic networking services. This BioSDX uses precision networking to support precision medicine. The BioSDX is based on recent technical developments in infrastructure abstraction that enables new types of tools and services utilizing programmable network infrastructure through high levels of resource virtualization. Combined with close integration of programmable cloud computing facilities, the BioSDX is an important advance in supporting the new paradigm of data intensive bioinformatics across multiple disciplines, including computational genomics and precision medicine.
In part because of the limitations of the TCP/IP protocols used by the current Internet, the Futu... more In part because of the limitations of the TCP/IP protocols used by the current Internet, the Future Internet has become an attractive network research topic. Recently, several projects focused on the Future Internet have been launched around the globe based on the OpenFlow platform, such as those that are part of the GENI project in the U.S., the OFELIA project of FP7 in the E.U., and the FIRST project in Korea. Because OpenFlow allows researchers to design and develop innovative protocols, it could be applied in different situations for constructing desired network environments. OpenFlow is not limited to single controller environment within a single network domain. It allows network engineers to construct a multi-controller environment across various network domains. In this paper, we design and implement an automatic network topology discovery mechanism based on a multi-controller OpenFlow network. The result has been applied to a large-scale OpenFlow testbed implemented across r...
2019 IEEE/ACM Innovating the Network for Data-Intensive Science (INDIS), 2019
Transferring big data over Wide Area Networks (WANs) is challenging because optimization is depen... more Transferring big data over Wide Area Networks (WANs) is challenging because optimization is dependent on the specifics of multiple parameters. Network services, paths, and technologies have different characteristics, including loss rate, latency, and available capacity. Yet, frameworks currently used to configure and orchestrate transfer systems, measure performance, and analyze results have limited capabilities. We propose a framework, DTN-as-a-Service (DaaS), for high-performance network data transfers using and integration of techniques, including virtualization, network provisioning, and performance data analysis. This framework has a modular design for supporting multiple transfer tools, optimizers and orchestrators for the data transfer environment, including \textit{Docker} and \textit{Kubernetes}. We present a \textit{Jupyter} based workflow for high-speed network data transfer in data-intensive science and evaluate the performance of the transfer with a simple programmable visualizer implemented in the framework. This framework has been implemented as a prototype at two recent SC supercomputing conferences. With the increase in the number and the capacity of WAN links at the conferences (multiple 100 Gbps WAN circuits), the challenges involved in setting up, testing, debugging, verifying and running applications on high-performance systems connecting to the conference SCinet WAN circuits also increase. The SCinet implementation of the DaaS framework for the conference community allowed users to control hardware, software, and network infrastructure for high-speed network data transfer, primarily for large scale applications. Through the evaluation of the framework in our test setup, we demonstrated that NVMe over Fabrics with TCP is twice as efficient compared to using conventional TCP in high-speed NVMe-to-NVMe transfers. We also implemented a 400 Gbps LAN experiment to evaluate the DaaS framework.
Significant efforts have been devoted to creating large scale compute and network testbeds for st... more Significant efforts have been devoted to creating large scale compute and network testbeds for studying future Internet challenges. Besides large geographic span, the common emphasis is programmability, allowing researchers to reserve or create, via software, flexible sets of compute and network resources over specified topologies to execute research prototypes of new protocols, processes, and applications. Also emphasized are virtualization, instrumentation, and software defined networking (SDN) capabilities of the infrastructure. SDN in particular stimulated significant interests in academia, industry, and public sectors to re-imagine the future computing and networking infrastructure landscape and roadmap while it becomes increasingly utilized in production environments. Amidst these interests, one can start to capture desirable characteristics to glimpse the potential architecture of the future Internet. In this paper, we discuss the significance of compute-network interaction across complex, highly customized federated architecture in the future Internet. Infrastructure federation has been happening across multiple dimensions. Federation expands the scope of infrastructure, geographically and administratively, for use by members of different organizations. For example, federation initiatives are underway among: 1) US Global Environment for Network Innovations (GENI), Europe Future Internet Research and Experimentation (FIRE), and future Internet testbeds in Asia, South America, and Canada, 2) university production infrastructure, 3) US cities, 4) US public research institutes, and 5) commercial infrastructure. While requirements and objectives differ, they must all address a common set of issues. Such federation suggests the fundamental needs of applications to interact with compute and network resources across a generic, federated, future Internet environment.
A complete system for distributing quantum entangled signals over fiber based on commercially ava... more A complete system for distributing quantum entangled signals over fiber based on commercially available equipment will be demonstrated. Measurements are collected and controlled from a single location using an embedded optical data link.
Communication services, architecture, and technologies are rapidly evolving in response to applic... more Communication services, architecture, and technologies are rapidly evolving in response to application demand and research innovation. These changes are motivating a fundamentally new approach to the design and provisioning of services, facilities, and infrastructure. Traditionally, such resources have been designed and implemented as centralized fixed utility services, with almost no options for specialization and customization, especially by processes at the
To realize P4 language benefits: “Protocol Independent, Target Independent, Field Reconfigurable”... more To realize P4 language benefits: “Protocol Independent, Target Independent, Field Reconfigurable” [1] in a network research and development environment, a few P4 research institutions around the world formed a partnership to design and implement the international P4 Experimental Networks (Figure 1). The participating institutions can share distributed P4 resources over international research and education networks, as well as initiate international P4 research collaboration projects. Initial network scenarios in this research testbed are Software-Defined Network Exchanges (SDXs), Network and Cloud Testbed Networks, Science Networks, and Campus Research Networks. These four network scenarios require multi-tenant support. Current P4Runtime specifications include a Multi-Controller design for twofold: Control Plane Partition and Redundancy [2]. However, the current P4Runtime does not implement Control Plane partition to support multi-tenant service on a switch. This project modified the current design to support a provider and multiple tenant model for the four international P4 Experimental Networks (i-P4EN)scenarios and other applications.
2017 20th Conference on Innovations in Clouds, Internet and Networks (ICIN), 2017
This paper describes a Bioinformatics Software Defined Network Exchange (SDX) or BioSDX, which ha... more This paper describes a Bioinformatics Software Defined Network Exchange (SDX) or BioSDX, which has been designed, deployed, and demonstrated by a multi-organizational research consortium to enable bioinformatics knowledge discovery supported by dynamic networking services. This BioSDX uses precision networking to support precision medicine. The BioSDX is based on recent technical developments in infrastructure abstraction that enables new types of tools and services utilizing programmable network infrastructure through high levels of resource virtualization. Combined with close integration of programmable cloud computing facilities, the BioSDX is an important advance in supporting the new paradigm of data intensive bioinformatics across multiple disciplines, including computational genomics and precision medicine.
In part because of the limitations of the TCP/IP protocols used by the current Internet, the Futu... more In part because of the limitations of the TCP/IP protocols used by the current Internet, the Future Internet has become an attractive network research topic. Recently, several projects focused on the Future Internet have been launched around the globe based on the OpenFlow platform, such as those that are part of the GENI project in the U.S., the OFELIA project of FP7 in the E.U., and the FIRST project in Korea. Because OpenFlow allows researchers to design and develop innovative protocols, it could be applied in different situations for constructing desired network environments. OpenFlow is not limited to single controller environment within a single network domain. It allows network engineers to construct a multi-controller environment across various network domains. In this paper, we design and implement an automatic network topology discovery mechanism based on a multi-controller OpenFlow network. The result has been applied to a large-scale OpenFlow testbed implemented across r...
2019 IEEE/ACM Innovating the Network for Data-Intensive Science (INDIS), 2019
Transferring big data over Wide Area Networks (WANs) is challenging because optimization is depen... more Transferring big data over Wide Area Networks (WANs) is challenging because optimization is dependent on the specifics of multiple parameters. Network services, paths, and technologies have different characteristics, including loss rate, latency, and available capacity. Yet, frameworks currently used to configure and orchestrate transfer systems, measure performance, and analyze results have limited capabilities. We propose a framework, DTN-as-a-Service (DaaS), for high-performance network data transfers using and integration of techniques, including virtualization, network provisioning, and performance data analysis. This framework has a modular design for supporting multiple transfer tools, optimizers and orchestrators for the data transfer environment, including \textit{Docker} and \textit{Kubernetes}. We present a \textit{Jupyter} based workflow for high-speed network data transfer in data-intensive science and evaluate the performance of the transfer with a simple programmable visualizer implemented in the framework. This framework has been implemented as a prototype at two recent SC supercomputing conferences. With the increase in the number and the capacity of WAN links at the conferences (multiple 100 Gbps WAN circuits), the challenges involved in setting up, testing, debugging, verifying and running applications on high-performance systems connecting to the conference SCinet WAN circuits also increase. The SCinet implementation of the DaaS framework for the conference community allowed users to control hardware, software, and network infrastructure for high-speed network data transfer, primarily for large scale applications. Through the evaluation of the framework in our test setup, we demonstrated that NVMe over Fabrics with TCP is twice as efficient compared to using conventional TCP in high-speed NVMe-to-NVMe transfers. We also implemented a 400 Gbps LAN experiment to evaluate the DaaS framework.
Uploads
Papers by Joe Mambretti