Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
29 November 2023 Abnormal event detection based on masked reconstruction and dual-channel adversarial prediction
Lunzheng Tan, Yu Weng, Limin Xia, Jiusheng Xiao
Author Affiliations +
Abstract

Abnormal event detection in computer vision addresses the task of identifying events that deviate from expected behavior in video scenes. Issues, such as occlusion in crowded scenes, the powerful generalization capabilities of deep neural networks, and the heavy reliance on contextual information, make this task particularly challenging. To address these issues, we propose a cascaded form of abnormal detection framework that combines the paradigms of reconstruction and prediction in this paper. First, stochastic masking techniques are employed for image reconstruction to alleviate the overgeneralization of neural networks under abnormal conditions. Second, an innovative motion characterization of frame-difference streak streams is introduced to better characterize the motion of video frames in crowded scenes. Finally, a dual-channel autoencoder-based prediction network is introduced to jointly learn appearance and motion features. This network captures contextual information to better generate predictive features. Meanwhile, adversarial learning is introduced for abnormal inference to improve the detection performance. Experimental results on several benchmark datasets validate the effectiveness of our approach.

© 2023 SPIE and IS&T
Lunzheng Tan, Yu Weng, Limin Xia, and Jiusheng Xiao "Abnormal event detection based on masked reconstruction and dual-channel adversarial prediction," Journal of Electronic Imaging 32(6), 063020 (29 November 2023). https://doi.org/10.1117/1.JEI.32.6.063020
Received: 6 July 2023; Accepted: 14 November 2023; Published: 29 November 2023
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image restoration

Video

Education and training

Optical flow

Video coding

Adversarial training

Video surveillance

RELATED CONTENT


Back to Top