Meta-learning Generalized AIOps Models for Multi-cloud Computer using Digital Twins
Authors: 
Xi Yang, Saurabh Jha, Paulito Palmes, Bekir Turkkan, Gerard Vanloo, 
Chandra Narayanaswami, Larisa ShwartzAuthors Info & Claims
Xi Yang, Saurabh Jha, Paulito Palmes, Bekir Turkkan, Gerard Vanloo, Chandra Narayanaswami, Larisa ShwartzAuthors Info & ClaimsPages 206 - 210
Abstract
Multi-cloud computing is a vitally important topic from both busi-ness and technical perspectives since it guarantees resiliency, avail-ability, and security. Due to the vast number of configurations among cloud providers, it is quite challenging to migrate AIOps models across different clouds. Although it is possible to train these models from scratch on the target cloud, this process can be time-consuming and prone to delays. Consequently, the objective of this paper is to create a generalized AIOps model from the original cloud that can be seamlessly applied to target cloud with minimal to zero-shot observations. To achieve this goal, we present a novel framework in this position paper, which harnesses the potential of digital twins to enhance data generalization. Additionally, our proposed framework employs meta-learning techniques to ensure effective model generalization across different cloud environments.
References
[1]
Sandesh Achar. 2021. Enterprise SaaS Workloads on New-Generation Infrastructure-as-Code (IaC) on Multi-Cloud Platforms. Global Disclosure of Economics and Business 10, 2 (2021), 55–74.
[2]
Mohsen Attaran and Bilge Gokhan Celik. 2023. Digital Twin: Benefits, use cases, challenges, and opportunities. Decision Analytics Journal (2023), 100165.
[3]
Frank Bagehorn, Jesus Rios, Saurabh Jha, Robert Filepp, Larisa Shwartz, Naoki Abe, and Xi Yang. 2023. A Fault Injection Platform for Learning AIOps Mod-els. In Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering (Rochester, MI, USA) (ASE ’22). Association for Computing Machinery, New York, NY, USA, Article 130, 5 pages. https://doi.org/10.1145/ 3551349.3559503
[4]
Efe C Balta, Dawn M Tilbury, and Kira Barton. 2019. A digital twin framework for performance monitoring and anomaly detection in fused deposition modeling. In 2019 IEEE 15th International Conference on Automation Science and Engineering.
[5]
Ayush Bhardwaj and Theophilus A Benson. 2022. KubeKlone: A Digital Twin for Simulating Edge and Cloud Microservices. In Asia-Pacific Workshop on Networking (APNet 2022). 7.
[6]
Li Bu, Cesare Alippi, and Dongbin Zhao. 2016. A pdf-free change detection test based on density difference estimation. IEEE transactions on neural networks and learning systems 29, 2 (2016), 324–334.
[7]
Tri Cao, Jiawen Zhu, and Guansong Pang. 2023. Anomaly Detection under Distribution Shift. arXiv preprint arXiv:2303.13845 (2023).
[8]
Andrea Castellani, Sebastian Schmitt, and Stefano Squartini. 2020. Real-world anomaly detection by using digital twin systems and weakly supervised learning. IEEE Transactions on Industrial Informatics 17, 7 (2020), 4733–4742.
[9]
ChaosToolkit. [n. d.]. ChaosToolkit. https://chaostoolkit.org/.
[10]
Elisabetta Di Nitto, Marcos Aurélio Almeida da Silva, Danilo Ardagna, Giuliano Casale, Ciprian Dorin Craciun, Nicolas Ferry, Victor Muntes, and Arnor Solberg. 2013. Supporting the development and operation of multi-cloud applications: The modaclouds approach. In 2013 15th international symposium on symbolic and numeric algorithms for scientific computing. IEEE, 417–423.
[11]
Denis Moreira Dos Reis, Peter Flach, Stan Matwin, and Gustavo Batista. 2016. Fast unsupervised online drift detection using incremental kolmogorov-smirnov test. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. 1545–1554.
[12]
Anton Dries and Ulrich Rückert. 2009. Adaptive concept drift detection. Statistical Analysis and Data Mining: The ASA Data Science Journal 2, 5-6 (2009), 311–327.
[13]
Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In International conference on machine learning. PMLR, 1126–1135.
[14]
Michael Grieves. 2014. Digital twin: manufacturing excellence through virtual factory replication. White paper 1, 2014 (2014), 1–7.
[15]
Jinkang Guo and Zhihan Lv. 2022. Application of Digital Twins in multiple fields. Multimedia tools and applications 81, 19 (2022), 26941–26967.
[16]
Xiao Han and Shuhan Yuan. 2021. Unsupervised cross-system log anomaly detection via domain adaptation. In Proceedings of the 30th ACM international conference on information & knowledge management. 3068–3072.
[17]
Timothy Hospedales, Antreas Antoniou, Paul Micaelli, and Amos Storkey. 2021. Meta-learning in neural networks: A survey. IEEE transactions on pattern analysis and machine intelligence 44, 9 (2021), 5149–5169.
[18]
IBM. 2020. What is a digital twin? https://www.ibm.com/topics/what-is-a-digital-twin#footnote.
[19]
Roger Jennings. 2010. Cloud computing with the Windows Azure platform. John Wiley & Sons.
[20]
David Jones, Chris Snider, Aydin Nassehi, Jason Yon, and Ben Hicks. 2020. Char-acterising the Digital Twin: A systematic literature review. CIRP journal of manufacturing science and technology 29 (2020), 36–52.
[21]
Da Li, Yongxin Yang, Yi-Zhe Song, and Timothy Hospedales. 2018. Learning to generalize: Meta-learning for domain generalization. In Proceedings of the AAAI conference on artificial intelligence, Vol. 32.
[22]
LitmusChaos. [n. d.]. LitmusChaos. https://litmuschaos.io/.
[23]
Hausi A Müller, Luis F Rivera, Miguel Jiménez, Norha M Villegas, Gabriel Tamura, Rama Akkiraju, Ian Watts, and Eric Erpenbach. 2021. Proactive AIOps through digital twins. In Proceedings of the 31st Annual International Conference on Com-puter Science and Software Engineering. 275–276.
[24]
Ricardo Silva Peres, Magno Guedes, Fabio Miranda, and Jose Barata. 2021. Simulation-based data augmentation for the quality inspection of structural adhesive with deep learning. IEEE Access 9 (2021), 76532–76541.
[25]
Luis F Rivera, Norha M Villegas, Gabriel Tamura, Hausi A Muller, Rama Akkiraju, Ian Watts, and Eric Erpenbach. 2022. Using Dynamic Knowledge Hypergraphs Toward Proactive AlOps through Digital Twins. In Proceedings of the 32nd Annual International Conference on Computer Science and Software Engineering. 163–168.
[26]
Siyu Shao, Stephen McAleer, Ruqiang Yan, and Pierre Baldi. 2018. Highly accurate machine fault diagnosis using deep transfer learning. IEEE Transactions on Industrial Informatics 15, 4 (2018), 2446–2455.
[27]
Zheyan Shen, Jiashuo Liu, Yue He, Xingxuan Zhang, Renzhe Xu, Han Yu, and Peng Cui. 2021. Towards out-of-distribution generalization: A survey. arXiv preprint arXiv:2108.13624 (2021).
[28]
Gayathri Sugumar and Aditya Mathur. 2019. Assessment of a method for detecting process anomalies using digital-twinning. In 2019 15th European Dependable Computing Conference (EDCC). IEEE, 119–126.
[29]
Fei Tao, He Zhang, Ang Liu, and Andrew YC Nee. 2018. Digital twin in industry: State-of-the-art. IEEE Transactions on industrial informatics (2018).
[30]
Thomas H-J Uhlemann, Christian Lehmann, and Rolf Steinhilper. 2017. The digital twin: Realizing the cyber-physical production system for industry 4.0. Procedia Cirp 61 (2017), 335–340.
[31]
Riccardo Volpi, Hongseok Namkoong, Ozan Sener, John C Duchi, Vittorio Murino, and Silvio Savarese. 2018. Generalizing to unseen domains via adversarial data augmentation. Advances in neural information processing systems 31 (2018).
[32]
Homer Rich Walke, Jonathan Heewon Yang, Albert Yu, Aviral Kumar, Jędrzej Orbik, Avi Singh, and Sergey Levine. 2023. Don’t start from scratch: Leveraging prior data to automate robotic reinforcement learning. In Conference on Robot Learning. PMLR, 1652–1662.
[33]
Qing Wang, Jesus Rios, Saurabh Jha, Karthikeyan Shanmugam, Frank Bagehorn, Xi Yang, Robert Filepp, Naoki Abe, and Larisa Shwartz. 2023. Fault Injection Based Interventional Causal Learning for Distributed Applications. Proceedings of the AAAI Conference on Artificial Intelligence 37, 13 (Jun. 2023), 15738–15744. https://doi.org/10.1609/aaai.v37i13.26868
[34]
Qingsong Wen, Liang Sun, Fan Yang, Xiaomin Song, Jingkun Gao, Xue Wang, and Huan Xu. 2020. Time series data augmentation for deep learning: A survey. arXiv preprint arXiv:2002.12478 (2020).
[35]
Ziyi Yang, Iman Soltani, and Eric Darve. 2023. Anomaly detection with domain adaptation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2957–2966.
[36]
Sinong Zhao, Zhaoyang Yu, Trent G Marbach, Gang Wang, Airu Yin, Yatao Zhou, and Xiaoguang Liu. 2023. MDGAD: Meta Domain Generalization for Distribution Drift in Anomaly Detection. Neurocomputing (2023), 126483.
[37]
Kaiyang Zhou, Ziwei Liu, Yu Qiao, Tao Xiang, and Chen Change Loy. 2022. Domain generalization: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022).
Index Terms
- Meta-learning Generalized AIOps Models for Multi-cloud Computer using Digital Twins
Index terms have been assigned to the content through auto-classification.
Recommendations
Cloud Multi-Tenancy: Issues and Developments
UCC '17 Companion: Companion Proceedings of the10th International Conference on Utility and Cloud ComputingCloud Computing (CC) is a computational paradigm that provides pay-per use services to customers from a pool of networked computing resources that are provided on demand. Customers therefore does not need to worry about infrastructure or storage. Cloud ...
An AIOps Approach to Data Cloud Based on Large Language Models
CAIBDA '24: Proceedings of the 2024 4th International Conference on Artificial Intelligence, Big Data and AlgorithmsIn order to overcome the challenges of inefficiency, high error rate and poor scalability in the traditional operations model, and to ensure that the data cloud can provide efficient and stable quality of service, this study explores AIOps strategies for ...
Comments
Information & Contributors
Information
Published In
September 2023
251 pages
- Conference Chair:
- Iosif-Viorel (Vio) Onut,
- Editors:
- Paria Shirani,
- Iosif-Viorel (Vio) Onut,
- Program Co-chairs:
- Iosif-Viorel (Vio) Onut,
- Paula Branco
Publisher
IBM Corp.
United States
Publication History
Published: 11 September 2023
Author Tags
Qualifiers
- Research-article
Acceptance Rates
Overall Acceptance Rate 24 of 90 submissions, 27%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 67Total Downloads
- Downloads (Last 12 months)54
- Downloads (Last 6 weeks)5
Reflects downloads up to 13 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in