A Fine Grained Quality Assessment of Video Anomaly Detection
Pages 29 - 35
Abstract
In this paper we propose a new approach to assess the performance of video anomaly detection algorithms. Inspired by the COCO metrics we propose a quartile based quality assessment of video anomaly detection to have a detailed breakdown of algorithm performance. The proposed assessment divides the detection into five categories based on the measurement quartiles of the position, scale and motion magnitude of anomalies. A weighted precision is introduced in the average precision calculation such that the frame-level average precision reported in categories can be compared to each other regardless of the baseline of the precision-recall curve in every category.
We evaluated three video anomaly detection approaches, including supervised and unsupervised approaches, on five public datasets using the proposed approach. Our evaluation shows that the anomaly scale introduces performance difference in detection. For both supervised and unsupervised methods evaluated, the detection achieve higher average precision for the large anomalies in scale. Our assessment also shows that the supervised multiple instance learning method is robust to the motion magnitude differences in anomalies, while the unsupervised one-class neural network method performs better than the unsupervised autoencoder reconstruction method when the motion magnitudes are small. Our experiments, however, also show that the positions of the anomalies have impact on the performance of the multiple instance learning method and the one-class neural network method but the impact on the autoencoder-based approach is negligible.
References
[1]
Shuai Bai, Zhiqun He, Yu Lei, Wei Wu, Chengkai Zhu, Ming Sun, and Junjie Yan. 2019. Traffic Anomaly Detection via Perspective Map based on Spatial-temporal Information Matrix. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.
[2]
Raghavendra Chalapathy, Aditya Krishna Menon, and Sanjay Chawla. 2018. Anomaly Detection using One-Class Neural Networks. arXiv preprint arXiv:1802.06360(2018).
[3]
Y. Cong, J. Yuan, and J. Liu. 2011. Sparse reconstruction cost for abnormal event detection. In Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. 3449–3456. https://doi.org/10.1109/CVPR.2011.5995434
[4]
Keval Doshi and Yasin Yilmaz. 2020. Any-Shot Sequential Anomaly Detection in Surveillance Videos. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition CVPR Workshops. IEEE, 4037–4042. https://doi.org/10.1109/CVPRW50498.2020.00475
[5]
Shikha Dubey, Abhijeet Boragule, and Moongu Jeon. 2019. 3D ResNet with Ranking Loss Function for Abnormal Activity Detection in Videos. 2019 International Conference on Control, Automation and Information Sciences (ICCAIS) (2019), 1–6.
[6]
M. Hasan, J. Choi, J. Neumann, A. K. Roy-Chowdhury, and L. S. Davis. 2016. Learning Temporal Regularity in Video Sequences. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 733–742. https://doi.org/10.1109/CVPR.2016.86
[7]
Ammar Mansoor Kamoona, Amirali Khodadadian Gostar, Alireza Bab-Hadiashar, and Reza Hoseinnezhad. 2020. Multiple Instance-Based Video Anomaly Detection using Deep Temporal Encoding-Decoding. CoRR abs/2007.01548(2020). arxiv:2007.01548https://arxiv.org/abs/2007.01548
[8]
Andrej Karpathy, George Toderici, Sanketh Shetty, Thomas Leung, Rahul Sukthankar, and Li Fei-Fei. 2014. Large-Scale Video Classification with Convolutional Neural Networks. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. 1725–1732. https://doi.org/10.1109/CVPR.2014.223
[9]
Roberto Leyva, Victor Sanchez, and Chang Tsun Li. 2017. The LV dataset: A realistic surveillance video dataset for abnormal event detection. In Proceedings of the 2017 5th International Workshop on Biometrics and Forensics (IWBF 2017). 1–6. https://doi.org/10.1109/IWBF.2017.7935096
[10]
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common Objects in Context. In European Conference on Computer Vision (ECCV) (2014-01-01). Zürich. /se3/wp-content/uploads/2014/09/coco_eccv.pdf, http://mscoco.org
[11]
Kun Liu and Huadong Ma. 2019. Exploring Background-Bias for Anomaly Detection in Surveillance Videos. In Proceedings of the 27th ACM International Conference on Multimedia. 1490–1499.
[12]
Wen Liu, Weixin Luo, Dongze Lian, and Shenghua Gao. 2018. Future Frame Prediction for Anomaly Detection - A New Baseline. In 2018 IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, 6536–6545. https://doi.org/10.1109/CVPR.2018.00684
[13]
Cewu Lu, Jianping Shi, and Jiaya Jia. 2013. Abnormal Event Detection at 150 FPS in MATLAB. In Proceedings of the 2013 IEEE International Conference on Computer Vision(ICCV ’13). 2720–2727. https://doi.org/10.1109/ICCV.2013.338
[14]
Vijay Mahadevan, Wei-Xin LI, Viral Bhalodia, and Nuno Vasconcelos. 2010. Anomaly Detection in Crowded Scenes. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 1975–1981.
[15]
B. Ramachandra, M. Jones, and R. Vatsavai. 5555. A Survey of Single-Scene Video Anomaly Detection. IEEE Transactions on Pattern Analysis & Machine Intelligence01 (5555), 1–1. https://doi.org/10.1109/TPAMI.2020.3040591
[16]
Bharathkumar Ramachandra and Michael J. Jones. 2020. Street Scene: A new dataset and evaluation protocol for video anomaly detection. In IEEE Winter Conference on Applications of Computer Vision (WACV). 2569–2578. https://doi.org/10.1109/WACV45572.2020.9093457
[17]
Mahdyar Ravanbakhsh, Moin Nabi, Enver Sangineto, Lucio Marcenaro, Carlo S. Regazzoni, and Nicu Sebe. 2017. Abnormal event detection in videos using generative adversarial nets. In 2017 IEEE International Conference on Image Processing, ICIP. 1577–1581. https://doi.org/10.1109/ICIP.2017.8296547
[18]
Lukas Ruff, Robert A. Vandermeulen, Nico Görnitz, Lucas Deecke, Shoaib A. Siddiqui, Alexander Binder, Emmanuel Müller, and Marius Kloft. 2018. Deep One-Class Classification. In Proceedings of the 35th International Conference on Machine Learning, Vol. 80. 4393–4402.
[19]
W. Sultani, C. Chen, and M. Shah. 2018. Real-World Anomaly Detection in Surveillance Videos. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6479–6488. https://doi.org/10.1109/CVPR.2018.00678
[20]
Du Tran, Lubomir Bourdev, Rob Fergus, Lorenzo Torresani, and Manohar Paluri. 2015. Learning Spatiotemporal Features with 3D Convolutional Networks. In Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV). 4489–4497. https://doi.org/10.1109/ICCV.2015.510
[21]
Hanh Tran and David C. Hogg. 2017. Anomaly Detection using a Convolutional Winner-Take-All Autoencoder. In BMVC.
[22]
Gaoang Wang, Xinyu Yuan, Aotian Zheng, Hung-Min Hsu, and Jenq-Neng Hwang. 2019. Anomaly Candidate Identification and Starting Time Estimation of Vehicles from Traffic Videos. In IEEE Conference on Computer Vision and Pattern Recognition Workshops. 382–390. http://openaccess.thecvf.com/content_CVPRW_2019/html/AI_City/Wang_Anomaly_Candidate_Identification_and_Starting_Time_Estimation_of_Vehicles_from_CVPRW_2019_paper.html
Index Terms
- A Fine Grained Quality Assessment of Video Anomaly Detection
Recommendations
Towards Open Set Video Anomaly Detection
Computer Vision – ECCV 2022AbstractOpen Set Video Anomaly Detection (OpenVAD) aims to identify abnormal events from video data where both known anomalies and novel ones exist in testing. Unsupervised models learned solely from normal videos are applicable to any testing anomalies ...
CKNN: Cleansed k-Nearest Neighbor for Unsupervised Video Anomaly Detection
CIKM '24: Proceedings of the 33rd ACM International Conference on Information and Knowledge ManagementIn this paper, we address the problem of unsupervised video anomaly detection (UVAD). The task aims to detect abnormal events in test video using unlabeled videos as training data. The presence of anomalies in the training data poses a significant ...
Weakly Supervised Video Anomaly Detection with Temporal and Abnormal Information
Pattern Recognition and Computer VisionAbstractWeakly supervised video anomaly detection is to distinguish anomalies from normal scenes and events in videos, under the setting that we only know whether there are abnormal events in a video, but the specific occurrence time of abnormal events is ...
Comments
Information & Contributors
Information
Published In
September 2022
208 pages
Copyright © 2022 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 October 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
CBMI 2022
CBMI 2022: International Conference on Content-based Multimedia Indexing
September 14 - 16, 2022
Graz, Austria
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 416Total Downloads
- Downloads (Last 12 months)196
- Downloads (Last 6 weeks)61
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in