Abstract
With increasing crime rates in today’s world, there is a corresponding awareness for the necessity of detecting abnormal activity. Automation of abnormal Human behavior analysis can play a significant role in security by decreasing the time taken to thwart unwanted events and picking them up during the suspicion stage itself. With advances in technology, surveillance systems can become more automated than manual. Human Behavior Analysis although crucial, is highly challenging. Tracking and recognizing objects and human motion from surveillance videos, followed by automatic summarization of its content has become a hot topic of research. Many researchers have contributed to the field of automated video surveillance through detection, classification and tracking algorithms. Earlier research work is insufficient for comprehensive analysis of human behavior. With the introduction of semantics, the context of a surveillance domain may be established. Such semantics may extend surveillance systems to perform event-based behavior analysis relevant to the domain. This paper presents a survey on research on human behavior analysis with a scope of analyzing the capabilities of the state-of-art methodologies with special focus on semantically enhanced analysis.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
BenAbdelkadert C, Cutler R, Davist L (2002) Person identification using automatic height and stride estimation. In: Proceedings of 16th international conference on pattern recognition, pp 377–380
Bremond F, Thonnat M, Zuniga M (2005) Video understanding framework for automatic behavior recognition. Behav Res Methods 38(3): 416–426
Brown JA, Capson DW (2011) A framework for 3D model-based visual tracking using a GPU-accelerated particle filter. IEEE Trans Vis Comput Graph 80(1): 60–80
Brox T, Rosenhahn B, Gall J, Cremers D (2010) Combined region and motion-based 3D tracking of rigid and articulated objects. IEEE Trans Pattern Anal Mach Intell 32(3): 402–415
Chang M-C, Krahnstoever N, Lim S, Yu T (2010) Group level activity recognition in crowded environments across multiple cameras. In: Seventh IEEE international conference on advanced video and signal based surveillance, pp 56–63
Chen M (2010) Long term activity analysis in surveillance video archives
Chen Y-K, Lin Y-T, Kung SY (1996) A feature tracking algorithm using neighborhood relaxation with multi-candidate pre-screening. In: IEEE international conference on image processing, pp 513–516
Denman S, Fookes C, Sridharan S(2009) Improved simultaneous computation of motion detection and optical flow for object tracking. In: Digital image computing: techniques and applications, pp 175–182
Feris R, Petterson J, Siddiquie B, Brown L, Pankanti S (2011) Large-scale vehicle detection in challenging Urban surveillance environments. In: IEEE workshop on applications of computer vision, pp 527–533
Foroughi H, Yazdi HS, Pourreza H, Javidi M (2008) An eigenspace-based approach for human fall detection using integrated time motion image and multi-class support vector machine. In: IEEE 4th international conference on intelligent computer communication and processing, pp 83–90
Gandhi T, Trivedi MM (2006) Panoramic appearance map (PAM) for multi-camera based person re-identification. In: Proceedings of the IEEE international conference on video and signal based surveillance, p 78
Huang K, Tao D, Yuan Y, Li X, Tan T (2011) Biologically inspired features for scene classification in video surveillance. IEEE Trans Syst Man Cybern B Cybern 41(1): 307–313
Huang S-C (2011) An advanced motion detection algorithm with video quality analysis for video surveillance systems. IEEE Trans Circuits Syst Video Technol 21(1): 1–14
Javed O, Shafique K, Shah M (2002) A hierarchical approach to robust background subtraction using color and gradient information. In: IEEE proceedings of workshop on motion and video computing
Kim T, Lee S, Paik J (2011) Combined shape and feature-based video analysis and its application to non-rigid object tracking. Inst Eng Technol Image Process 5(1): 87–100
Kiryati N, Riklin TR, Ivanchenko Y, Rochel S (2008) Real-time abnormal motion detection in surveillance video. In: IEEE 19th international conference on pattern recognition, pp 1–4
Ko T (2008) A survey on behaviour analysis in video surveillance applications. In: 37th IEEE applied imagery pattern recognition workshop ’08, pp 1–8
Lao W, Han J, deWith PHN (2010) Flexible human behavior analysis framework for video surveillance applications. Int J Digit Multimed Broadcast, Article ID 920121, 1–9
Lee BH, Choi I, Jeon GJ (2006) Motion-based moving object tracking using an active contour. In: International conference on acoustics, speech, and signal processing, pp 649–652
Leykin A, Tuceryan M (2007) Detecting shopper groups in video sequences. In: IEEE conference on advanced video and signal based surveillance, pp 417–422
Li W, Zhang Z, Liu Z (2010) Action recognition based on a bag of 3D points. In: IEEE computer society conference on computer vision and pattern recognition workshops, pp 9–14
Lin W, Sun M-T, Poovendran R, Zhang Z (2010) Group event detection with a varying number of group members for video surveillance. IEEE Trans Circuits Syst Video Technol 20(8): 1057–1067
Liang Y-M, Shih S-W, Shih AC-C, Mark Liao H-Y, Lin C-C (2009) Unsupervised analysis of human behavior based on manifold learning. In: IEEE international symposium on circuits and systems, pp 2605–2608
Liao S-K, Liu B-Y (2010) An edge-based approach to improve optical flow algorithm. In: Third international conference on advanced computer theory and engineering, vol 6, pp 45–61
Mahadevan V, Vasconcelos N (2009) Segmentation of motion objects from surveillance video sequences using temporal differencing combined with multiple correlation. In: Advanced video and signal-based surveillance, pp 472–477
McIvor AM (1999) Background subtraction techniques. Reveal Ltd, New Zealand
Ogale NA (2006) A survey of techniques for human detection from video
Park J-S, Yoon J-H, Kim C (2005) STable 2D feature tracking for long video sequences. Int J Signal Process Image Process Pattern Recogn 1(1): 39–46
Park S, Aggarwal JK (2004) Semantic-level understanding of human actions and interactions using event hierarchy. In: IEEE computer society conference on computer vision and pattern recognition workshops
Peursum P, Bui HH, Venkatesh S, West G (2005) Robust recognition and segmentation of human actions using HMMs with missing observations. Eur Assoc Signal Process J Appl Signal Process 2005: 2110–2126
Rahimt HA, Sheikh UU, Ahmad RB, Zaint ASM, Ariffin WNFW (2010) Vehicle speed detection using frame differencing for smart surveillance system. In: International conference on information science, signal processing and their applications, pp 630–633
Roach M, Mason JS, Pawlewski M (2001) Motion-based classification of cartoons. In: Proceedings of 2001 international symposium on intelligent multimedia, video and speech processing, pp 146–149
Robertson security submission (2006) Automatic human behaviour recognition and explanation for CCTV video surveillance
Rougier C, Meunier J, St-Arnaud A, Rousseau J (2011) Robust video surveillance for fall detection based on human shape deformation. IEEE Trans Circuits Syst Video Technol 21(5): 611–622
Seki M, Fujiwara H, Sumi K (2000) A robust background subtraction method for changing background. In: Fifth IEEE workshop on applications of computer vision 2000, pp 207–213
Shafie AA, Hafiz F, Ali MH (2009) Motion detection techniques using optical flow. In: World Academy of Science, Engineering and Technology, vol 56
Tabb K, Davey N, Adams R, George S (2004) Detecting, tracking & classifying human movement using active contour models and neural networks. In: Innovations in intelligent systems, Physica (Springer) Verlag, pp 343–360
Techmer A (2001) Contour-based motion estimation and object tracking for real-time applications. IEEE, Infineon Technologies AG, Corporate Research
Xiaofeng L, Tao Z, Zaiwen L (2010) A novel method on moving-objects detection based on background subtraction and three frames differencing. In: International conference on measuring technology and mechatronics automation, pp 252–256
Yoshimitsu Y, Naito T, Fujimura K, Kamijo S (2010) Behavior understanding at railway station by association of locational semantics and postures. In: IEEE international conference on systems man and cybernetics, pp 3033–3038
Yunus RM (2009) Development of algorithm for human non-human object classification. Scholarly paper, University of Teknikal
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gowsikhaa, D., Abirami, S. & Baskaran, R. Automated human behavior analysis from surveillance videos: a survey. Artif Intell Rev 42, 747–765 (2014). https://doi.org/10.1007/s10462-012-9341-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-012-9341-3