A Model Driven Intelligent Orchestration Approach to Service Automation in Large Distributed Infrastructures
Article No.: 5, Pages 1 - 8
Abstract
Today's scientific computing applications and workflows operate on heterogeneous and vastly distributed infrastructures. Traditional human-in-the-loop service engineering approach met its insurmountable challenge in dealing with these very complex and diverse networked systems, including conventional and software defined networks, compute, storage, clouds and instruments. Orchestration is the key to integrate and coordinate the networked multi-services and automate end-to-end workflows. In this work, we present a model driven intelligent orchestration approach to this end-to-end automation, which is built upon a semantic modeling solution that supports the full stack of service integration, orchestration, abstraction, and intent and policy representation. We also present the design of a real-world orchestrator called StackV that is able to accommodate highly complex application scenarios such as Software Defined ScienceDMZ (SD-SDMZ) and Hybrid Cloud Inter-Networking (HCIN) by implementing this approach.
References
[1]
StackV Open Source Orchestration Software Suite, http://github.com/MAX-UMD/StackV.community
[2]
World Wide Web Consortium, "Resource Description Framework (RDF)", W3C Recommendation. Available at: http://www.w3.org/RDF/.
[3]
World Wide Web Consortium, "Web Ontology Language (OWL)", W3C Recommendation. Available at: www.w3.org/2004/OWL/.
[4]
RAINS Project, "The Multi-Resource Markup Language (MRML) Ontology - Extension of NML", Available at: https://github.com/RAINS-Project/nml-mrs-model/blob/master/schema/rdf-owl/nml-mrs-ext-v2.owl
[5]
J. van der Ham, F. Dijkstra, R. Lapacz, J. Zurawski, "Network Markup Language Base Schema version 1", OGF GFD-R-P.206, May 2013.
[6]
T. Lehman, X. Yang, N. Ghani, et al., "Multilayer Networks: An Architecture Framework," IEEE Communications Magazine, 49-5, May 2011.
[7]
Internet Engineering Task Force, "YANG - A Data Modeling Language for the Network Configuration Protocol (NETCONF)", IETF RFC 6241, October 2010.
[8]
Internet Engineering Task Force, "Network Configuration Protocol (NETCONF)", IETF RFC 6020, June 2011.
[9]
RAINS Project, "The Multi-Resource Service (MRS) Simple Policy Annotation (SPA) Ontology", Available at: https://github.com/RAINS-Project/nml-mrs-model/blob/master/schema/rdf-owl/mrs-spa-v1.owl.
[10]
Apache Software Foundation, "Apache Jena: A free and open source Java framework for building Semantic Web and Linked Data applications", Available at https://jena.apache.org.
[11]
OpenStack, "OpenStack Open Source Cloud Computing Software," Available at: http://www.openstack.org/software/
[12]
SPARQL Query Language for RDF, https://www.w3.org/TR/rdf-sparql-query/
[13]
JSONPath - XPath for JSON, http://goessner.net/articles/JsonPath/
[14]
S. Weil, S. Brandt, E. Miller et al., "Ceph: A Scalable, High-Performance Distributed File System", in OSDI, pp. 307--320, 2006.
[15]
Intel Corp. whitepaper, "PCI-SIG SR-IOV Primer: An Introduction to SR-IOV Technology," http://www.intel.com/content/www/us/en/pci-express/pci-sig-sr-iov-primer-sr-iov-technology-paper.html
[16]
Quagga Routing Software Suite, Available at: http://www.quagga.net.
[17]
Globus, Research Data Management Services, http://www.globus.org
Index Terms
- A Model Driven Intelligent Orchestration Approach to Service Automation in Large Distributed Infrastructures
Recommendations
Towards Federated Service Discovery and Identity Management in Collaborative Data and Compute Cloud Infrastructures
This paper compares three multi-national research infrastructures, one that provides data services, one that provides compute services, and one that supports linguistics research. The aim is to jointly provide services to the user communities, and, ...
A Model-Driven Approach to Service Orchestration
SCC '08: Proceedings of the 2008 IEEE International Conference on Services Computing - Volume 2Software systems based on Service-Oriented Architectures (SOAs) promise high flexibility, improved maintainability, and simple re-use of functionality. A variety of languages and standards have emerged for working with SOA artifacts; however, service ...
Performance Driven WS Orchestration and Deployment in Service Oriented Infrastructure
Composite Web services (WS) can be seen as software systems designed according to workflow-based orchestration of building blocks or simpler WS. Each block has its own specifications concerning both functional and non-functional properties. While the ...
Comments
Information & Contributors
Information
Published In
June 2018
53 pages
ISBN:9781450358620
DOI:10.1145/3217197
Copyright © 2018 ACM.
© 2018 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the United States Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.
Sponsors
- University of Arizona: University of Arizona
- SIGARCH: ACM Special Interest Group on Computer Architecture
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 June 2018
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
HPDC '18
Sponsor:
- University of Arizona
- SIGARCH
HPDC '18: The 27th International Symposium on High-Performance Parallel and Distributed Computing
June 11, 2018
AZ, Tempe, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 157Total Downloads
- Downloads (Last 12 months)10
- Downloads (Last 6 weeks)1
Reflects downloads up to 13 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in