Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Fault and performance management in multi-cloud based NFV using shallow and deep predictive structures

  • Original Article
  • Published:
Journal of Reliable Intelligent Environments Aims and scope Submit manuscript

Abstract

Deployment of network function virtualization (NFV) over multiple clouds accentuates its advantages such as flexibility of virtualization, proximity to customers and lower total cost of operation. However, NFV over multiple clouds has not yet attained the level of performance to be a viable replacement for traditional networks. One of the reasons is the absence of a standard based fault, configuration, accounting, performance and security (FCAPS) framework for the virtual network services. In NFV, faults and performance issues can have complex geneses within virtual resources as well as virtual networks and cannot be effectively handled by traditional rule-based systems. To tackle the above problem, we propose a fault detection and localization model based on a combination of shallow and deep learning structures. Relatively simpler detection has been effectively shown to be handled by shallow machine learning structures such as support vector machine (SVM). Deeper structure, i.e., the stacked autoencoder has been found to be useful for a more complex localization function where a large amount of information needs to be worked through to get to the root cause of the problem. We provide evaluation results using a dataset adapted from fault datasets available on Kaggle and another based on multivariate kernel density estimation and Markov sampling.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Find the latest articles, discoveries, and news in related topics.

References

  1. Network functions virtualisation: an introduction, benefits, enablers, challenges & call for action (2012). ETSI Whitepaper published at the SDN and OpenFlow World Congress, Darmstadt-Germany

  2. ETSI ISG Network Functions Virtualization (ISG NFV) (2016) http://www.etsi.org/technologies-clusters/technologies/nfv. Accessed Dec 2016

  3. ETSI GR NFV-IFA 015 V2.1.1 (2017) Network functions virtualisation (NFV) release 2; management and orchestration; Report on NFV Information Model

  4. Bhamare D, Jain R, Samaka M, Erbad A (2016) A survey on service function chaining. J Netw Comput Appl 75:138–155

    Article  Google Scholar 

  5. (2000) Recommendations M.3010 Series M: TMN and network maintenance: international transmission systems, telephone circuits, telegraphy, facsimile, and leased circuits TMN management functions

  6. Bhamare D, Jain R, Samaka M, Erbad A, Gupta L, Chan HA (2017) Optimal virtual network function placement and resource allocation in multi-cloud service function chaining architecture. Comput Communications

  7. (2002) ITU-T Recommendation M.3400 Series M: TMN AND network maintenance: international transmission systems, telephone circuits, telegraphy, facsimile and leased circuits TMN management functions

  8. (1992) ITU-T Recommendation X.733, information technology-open system interconnection-systems management-alarm reporting function

  9. (2013) ETSI GS NEV 002, Network functional virtualization; architectureal framework

  10. Gupta L, Samaka M, Jain R, Erbad A, Bhamare D, Metz C (2017) COLAP: a predictive framework for service function chain placement in a multi-cloud environment. IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas

  11. Lopez D (2014) Network functions virtualization: beyond carrier-grade clouds. In: Optical fiber communications conference and exhibition (OFC), pp 1–18, IEEE

  12. Han B, Gopalakrishnan V, Ji L, Lee S (2015) Network function virtualization: challenges and opportunities for innovations. IEEE Commun Mag 53(2):90–97

    Article  Google Scholar 

  13. (2015) IETF RFC: 7665, J. Halpern, C. Pignataro, Service function chaining (SFC) architecture

  14. (2014) ETSI GS NFVMAN001 V1.1.1, Network Functions Virtualization (NFV); Management and Orchestration

  15. (2008) ITU-T Recommendations E.800 [i.10]: Definitions of terms related to quality of service (2008)

  16. Priyadarsini RJ, Arockiam L (2013) Failure Management In Cloud: An Overview. Int J Adv Res Comput Commun Eng

  17. Gap analysis on network virtualization activities draft-bernardos-nfvrg-gaps-network-virtualization-00, (2016)

  18. Leahy K, Hu RL, Konstantakopoulos IC, Spanos CJ, Agogino AM (2016) Diagnosing wind turbine faults using machine learning techniques applied to operational data. In: International conference on prognostics and health management (ICPHM)

  19. Nicchiotti G, Fromaigeat L, Etienne L (2016) Machine learning strategy for fault classification using only nominal data. In: European conference of the prognostics and health management society

  20. Kompella RR, Yates J, Greenberg AG, Snoeren AC (2010) Fault localization via risk modeling. IEEE Trans Dependable Sec Comput 7(4):396–409

    Article  Google Scholar 

  21. (2015) ETSI GS NFV-REL 001 V1.1.1 Network functions virtualisation (NFV); resiliency requirements

  22. (2014) ETSI GS NFV-INF 010 V1.1.1 Network Functions virtualisation (NFV): service quality metrics

  23. Mijumbi R, Serrat J, Gorricho J-L, Latre S, Charalambides M, Lopez D (2016) Management and orchestration challenges in network function virtualization. IEEE Commun Mag 54(1):98–105

    Article  Google Scholar 

  24. Boucadair M, Jaquenet C (2015) Handbook of research on redesigning the future of Internet architectures. IGI Global

  25. Kunzmann G, Goncalves C, Mibu R (2015) OPNFV–doctor fault management. OPNFV Summit, Linux Foundation

    Google Scholar 

  26. de Souza DL, Granzotto MH, de Almeida GM, Oliveira-Lopes LC (2014) Fault detection and diagnosis using support vector machines — A SVC and SVR Comparison, J Saf Eng 3:(1):18–29. http://doi.org/10.5923/j.safety.20140301.03

  27. Santos P, Villa LF, Reñones A, Bustillo A, Maudes J (2015) An SVM-based solution for fault detection in wind turbines. Sensors 15(3):5627–5648

    Article  Google Scholar 

  28. Jamil M, Sharma SK, Singh R (2015) Fault detection and classification in electrical power transmission system using artificial neural network. SpringerPlus 4(1):334

    Article  Google Scholar 

  29. Lv F, Wen C, Bao Z, Liu Meiqin (2016) Fault diagnosis based on deep learning. In: American Control Conference (ACC)

  30. Zhang L, Lei Y, Chang Q (2017) Intermittent connection fault diagnosis for CAN using data link layer information. IEEE Trans Indus Electronics

  31. Yilmaz A (2017) Comparative study for identification of multiple alarms in telecommunication networks. Turk J Electr Eng Comput Sci 25(2):677–688

    Article  Google Scholar 

  32. Rozaki E (2015) Network fault diagnosis using data mining classifiers. Int J Data Min Knowl Manag Process

  33. Jaudet M, Iqbal N, Hussain A, Sharif K (2005) Temporal classification for fault-prediction in a real-world telecommunications network. In: Proceeding of the International conference on emerging technologies

  34. Lee BY, Lee BC (2016) Fault localization in NFV framework. In: 18th International Conference on Advanced Communication Technology (ICACT), PyeongChang, Korea

  35. Lichman M (2017) UCI machine learning repository, Irvine, CA: University of California, School of Information and Computer Science. https://archive.ics.uci.edu/ml/datasets.html Accessed Dec 2013

  36. Stanford SNAP: large network dataset collection. https://snap.stanford.edu/data/. Accessed Jan 2017

  37. DMOZ open directory project (ODP). http://www.dmoz.org/docs/en/about.html. Accessed Jan 2017

  38. Kaggle datasets, https://www.kaggle.com/datasets

  39. Botev Z (2016) Fast multivariate kernel density estimation for high dimensions. https://ch.mathworks.com/matlabcentral/fileexchange/58312-kernel-density-estimator-for-high-dimensions. Accessed Jan 2017

  40. Mhaskar HN, Poggio T (2016) Deep vs. shallow networks: an approximation theory perspective. Anal Appl 14(06):829–848

    Article  MathSciNet  MATH  Google Scholar 

  41. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural networks 61:85–117

    Article  Google Scholar 

  42. Smola AJ, Scholkopf B (2004) A tutorial on support vector regression. Stat Comput 14(3):199–222

    Article  MathSciNet  Google Scholar 

  43. Jabber MA, Deekshatulu BL, Chandra P (2014) Alternating decision trees for early diagnosis of heart disease. In: Proceedings of international conference on circuits, communication, control and computing, pp 322–328

  44. Louppe G (2014) Understanding random forests—from theory to practice. PhD Dissertation, University of Liege, France

  45. Stacked autoencoder (Unsupervised Feature Learning and Deep Learning). http://ufldl.stanford.edu/wiki/index.php/Stacked_Autoencoders. Accessed Jan 2017

  46. Lee D, Lee B, Shin J. W (2015) Fault detection and diagnosis with modelica language using deep belief network. In: Proceedings of the 11th international modelica conference

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lav Gupta.

Additional information

This work has been supported under the grant ID NPRP 6 - 901 - 2 - 370 for the project entitled “Middleware Architecture for cloud based services using software defined networking (SDN),” which is funded by the Qatar national research fund (QNRF) and by Huawei Technologies. The statements made herein are solely the responsibility of the authors.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gupta, L., Samaka, M., Jain, R. et al. Fault and performance management in multi-cloud based NFV using shallow and deep predictive structures. J Reliable Intell Environ 3, 221–231 (2017). https://doi.org/10.1007/s40860-017-0053-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40860-017-0053-y

Keywords