Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3460824.3460825acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmsieConference Proceedingsconference-collections
research-article

Variational Autoencoder based Novelty Detection for Real-World Time Series

Published: 20 July 2021 Publication History

Abstract

There are numerous applications that deal with data captured over time making them potential subject to time series analysis. Detecting unknown events and anomalies in time series data is challenging due to the presence of noise, seasonalities and long-term trends. Data-driven methods applied to identify such patterns are called anomaly detection. Typically, the amount of available abnormal data, e.g. failure states in manufacturing plants, is not sufficient to construct an explicit model. Novelty detection is a special form of anomaly detection which detects when a data point differs from the majority of data. In this work, a novel approach to detect anomalous patterns and events in real-world time series data is proposed. The novelty detection approach is based on deep generative learning and utilizes natural properties of the variational autoencoder to create a novelty indicator. Therefore, a wide range of deterministic and stochastic novelty scores calculated in the latent and original data space are combined. The combination of these novelty scores leads to a novelty indicator that accurately detects novel events in real-world time series data. An experimental study evaluates the method on data collected at an electrocoating plant which was affected by internal and external disturbances. The proposed method is benchmarked against other state of the art methods and achieves highly competitive results.

References

[1]
A. Amini, W. Schwarting, G. Rosman, B. Araki, S. Karaman, and D. Rus. 2018. Variational Autoencoder for End-to-End Control of Autonomous Driving with Novelty Detection and Training De-biasing. In2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 568–575.
[2]
J. An and S. Cho. 2015. Variational Autoencoder based Anomaly Detection using Reconstruction Probability. Special Lecture on IE2, 1
[3]
Ane Blázquez-García, Angel Conde, Usue Mori, and Jose A. Lozano. 2020. A review on outlier/anomaly detection in time series data. arXiv:arXiv:2002.04236
[4]
Juan Wen and Hongli Gao. 2018. Degradation assessment for the ball screw with variational autoencoder and kernel density estimation. Advances in Mechanical Engineering10, 9 (2018), 12.
[5]
Raghavendra Chalapathy and Sanjay Chawla. 2019. Deep Learning for Anomaly Detection: A Survey. arXiv:arXiv:1901.03407
[6]
Davide Chicco and Giuseppe Jurman. 2020. The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genomics21, 1 (2020).
[7]
Tal Daniel, Thanard Kurutach, and Aviv Tamar. 2019. Deep Variational Semi-Supervised Novelty Detection. arXiv:arXiv:1911.04971
[8]
Xuhong Wang, Ying Du, Shijie Lin, Ping Cui, Yuntian Shen, and Yupu Yang. 2019. adVAE: A self-adversarial variational autoencoder with Gaussian anomaly prior knowledge for anomaly detection. arXiv:arXiv:1903.00904
[9]
R. Domingues, P. Michiardi, J. Barlet, and M. Filippone. 2019. A comparative evaluation of novelty detection algorithms for discrete sequences.Artificial Intelligence Review(2019).
[10]
B. Eiteneuer, N. Hranisavljevic, and O. Niggemann. 2019. Dimensionality Reduction and Anomaly Detection for CPPS Data using Autoencoder. In2019 IEEE International Conference on Industrial Technology (ICIT). 1286–1292.
[11]
Harshvardhan GM, Mahendra Kumar Gourisaria, Manjusha Pandey, and Siddharth Swarup Rautaray. 2020. A comprehensive survey and analysis of generative models in machine learning. Computer Science Review38 (2020).
[12]
Ian Goodfellow, Joshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT Press Ltd, Cambridge, MA, USA.
[13]
Myeongjun Jang, Seungwan Seo, and Pilsung Kang. 2019. Recurrent neural network-based semantic variational autoencoder for Sequence-to-sequence learning. Information Sciences 490 (2019), 59 – 73.
[14]
Daisuke Kaji, Kazuho Watanabe, and Masahiro Kobayashi. 2020. Multi-Decoder RNN Autoencoder Based on Variational Bayes Method. arXiv:arXiv:2004.14016
[15]
Y. Kawachi, Yuma Koizumi, and N. Harada. 2018. Complementary Set Variational Autoencoder for Supervised Anomaly Detection.2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)(2018), 2366–2370.
[16]
Diederik P Kingma and Max Welling. 2013. Auto-Encoding Variational Bayes. arXiv:arXiv:1312.6114
[17]
Diederik P. Kingma and Max Welling. 2019. An Introduction to Variational Autoencoders. Foundations and Trends® in Machine Learning12, 4 (2019), 307–392.
[18]
Chieh-Hsin Lai, Dongmian Zou, and Gilad Lerman. 2020. Novelty Detection via Robust Variational Autoencoding. arXiv:arXiv:2006.05534
[19]
Aleksei Vasilev, Vladimir Golkov, Marc Meissner, Ilona Lipp, Eleonora Sgarlata, Valentina Tomassini, Derek K. Jones, and Daniel Cremers. 2018.q-Space Novelty Detection with Variational Autoencoders. arXiv:arXiv:1806.02997
[20]
David Zimmerer, Simon A. A. Kohl, Jens Petersen, Fabian Isensee, and Klaus H. Maier-Hein. 2018. Context-encoding Variational Autoencoder for Unsupervised Anomaly Detection. arXiv:arXiv:1812.05941
[21]
Achraf Oussidi and Azeddine Elhassouny. 2018. Deep generative models: Survey.2018 International Conference on Intelligent Systems and Computer Vision (ISCV)(2018), 1–8.
[22]
Marco A.F. Pimentel, David A. Clifton, Lei Clifton, and Lionel Tarassenko. 2014. A review of novelty detection. Signal Processing 99 (2014), 215–249.

Cited By

View all
  • (2022)Inlier Modeling-Based Good Fishing Ground Detection for Efficient Bullet Tuna Trolling Using Meteorological and Oceanographic InformationOCEANS 2022 - Chennai10.1109/OCEANSChennai45887.2022.9775305(1-6)Online publication date: 21-Feb-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MSIE '21: Proceedings of the 2021 3rd International Conference on Management Science and Industrial Engineering
April 2021
227 pages
ISBN:9781450388887
DOI:10.1145/3460824
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Additional Key Words and Phrases: Generative models
  2. Manufacturing systems
  3. Novelty detection
  4. Variational autoencoder

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

MSIE 2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)26
  • Downloads (Last 6 weeks)7
Reflects downloads up to 22 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2022)Inlier Modeling-Based Good Fishing Ground Detection for Efficient Bullet Tuna Trolling Using Meteorological and Oceanographic InformationOCEANS 2022 - Chennai10.1109/OCEANSChennai45887.2022.9775305(1-6)Online publication date: 21-Feb-2022

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media