Categorizing bi-object video activities using bag of segments and causality features
Pages 55 - 60
Abstract
We address the recognition problem of video activities involving two interacting moving objects under a surveillance camera. We develop a novel video activity representation scheme --'bag of segments'. In this scheme, the video sessions are represented as a collection of independent segments, with memberships to each pre-learned visual patterns that we call codewords. To better represent the video segments with object interaction, we design a set of new features based on the prediction filter responses and the Granger Causality Test (GCT). These features capture the inter-relationship between moving objects and are combined with conventional features such as position and velocity. We validate the proposed method for the task of video activities classification with extensive experiments on a surveillance database with 867 video sessions.
References
[1]
D.M. Blei, A.Y. Ng, and M.I. Jordan. Latent dirichlet allocation. Journal of Machine Learning Research 3:993--1022, 2003.
[2]
O. Boiman and M. Irani. Detecting irregularities in images and in video. Proceedings of the International Conference on Computer Vision 01:462, 2005.
[3]
M. Brand, N. Oliver, and A. Pentland. Coupled hidden markov models for complex action recognition. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition 00:994, 1997.
[4]
D. Comaniciu, V. Ramesh, and P. Meer. Kernel-based object tracking. IEEE Transaction on Pattern Analysis and Machine Intelligence 25(5):564--575, 2003.
[5]
P. Domingos and M. Pazzani. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning 29(2-3):103--130, 1997.
[6]
C.W.J. Granger. Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37(3):424--438, 1969.
[7]
T. Hofmann. Probabilistic latent semantic indexing. In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval pages 50--57, 1999.
[8]
Y.A. Ivanov and A.F. Bobick. Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(8):852--872, 2000.
[9]
K.-C. Lee, J. Ho, M.-H. Yang, and D. Kriegman. Visual tracking and recognition using probabilistic appearance manifolds. Computer Vision and Image Understanding 99(3):303--331, 2005.
[10]
D.D. Lewis. Naive Bayes at forty: The independence assumption in information retrieval. In Proceedings of the 10th European Conference on Machine Learning pages 4--15, 1998.
[11]
F.-F. Li and P. Perona. A bayesian hierarchical model for learning natural scene categories. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition 2:524--531, 2005.
[12]
G. Medioni, I. Cohen, F. Bremond, S. Hongeng, and R. Nevatia. Event detection and analysis from video streams. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(8):873--889, 2001.
[13]
A.Y. Ng, M.I. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. Proceedings of the Neural Information Processing Systems Conference pages 849--856, 2001.
[14]
C.A. Sims. Money, income, and causality. American Economic Review 62(4):540--52, September 1972.
[15]
J. Sivic, B.C. Russell, A.A. Efros, A. Zisserman, and W.T. Freeman. Discovering objects and their localization in images. Proceedings of the International Conference on Computer Vision 1:370--377, 2005.
[16]
C. Stauffer and W. Grimson. Adaptive background mixture models for real-time tracking. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition 02:252, 1999.
[17]
H. Zhong, J. Shi, and M. Visontai. Detecting unusual activity in video. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition 02:819--826, 2004.
[18]
Y. Zhou, S. Yan,and T. Huang. Pair-activity classification by bi-trajectory analysis. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition 2008.
Index Terms
- Categorizing bi-object video activities using bag of segments and causality features
Recommendations
Granger Causality Driven AHP for Feature Weighted kNN
The kNN algorithm remains a popular choice for pattern classification till date due to its non-parametric nature, easy implementation and the fact that its classification error is bounded by twice the Bayes error. In this paper, we show that the ...
Scalable and Flexible Two-Phase Ensemble Algorithms for Causality Discovery
AbstractCausality study investigates cause-effect relationships among different variables of a system and has been widely used in many disciplines including climatology and neuroscience. To discover causal relationships, many data-driven ...
A Wiener Causality Defined by Divergence
AbstractDiscovering causal relationships is a fundamental task in investigating the dynamics of complex systems (Pearl in Stat Surv 3:96–146, 2009). Traditional approaches like Granger causality or transfer entropy fail to capture all the interdependence ...
Comments
Information & Contributors
Information
Published In
October 2008
116 pages
Copyright © 2008 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 31 October 2008
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 145Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 31 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in