Article

Analysis and query of person-vehicle interactions in homography domain

Authors:

Mohan M. TrivediAuthors Info & Claims

VSSN '06: Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks

Pages 101 - 110

https://doi.org/10.1145/1178782.1178798

Published: 27 October 2006 Publication History

Abstract

This paper presents an efficient and robust paradigm for analysis and query of moving-object interactions in planar homography domain.People and vehicle activities/interactions are analyzed for situational awareness by using a multi-perspective approach.Planar homography constraints are exploited to extract view-invariant object features including footage area and velocity of objects on the ground plane. Spatio-temporal relationships between person-and vehicle-tracks are represented by a semantic event grammar. Semantic-level information of the situation is achieved with the anticipation of possible directions of near-future tracks using piecewise velocity history. An efficient query paradigm is proposed by histogram-based approximation of probability density functions of objects and by quad-tree indexing. Experimental data show promising results.Our framework can be applied to applications for enhanced situational awareness such as disaster prevention,human interactions in structured environments,and crowd movement analysis in wide-view areas.

References

[1]

J.K.Aggarwal and Q.Cai.Human motion analysis:a review. Computer Vision and Image Understanding 73(3): 295--304, 1999.

Digital Library

[2]

J. F. Allen and G. Ferguson. Actions and events in interval temporal logic.Journal of Logic and Computation 4(5):531--579, 1994.

[3]

I. Altman. The environment and social behavior: privacy, personal space, territory, crowding Irving Publishers, New York, N.Y., 1981.

[4]

Y. Bar-Shalom and W. Blair. Multitarget-multisensor tracking: applications and advances volume 3, pages 199--231. Norwood, MA, 2000.

[5]

R. Brooks, P. Ramanathan,and A. Sayeed. Distributed target classication and tracking in sensor networks.Proc. of the IEEE 91(8): 1163--1171, 2003.

[6]

A. Criminisi, I. Reid, and A. Zisserman. A plane measuring device.Image and Vision Computing 17(8):625--634, 1999.

[7]

D. Fidaleo, H. Nguyen, and M. Trivedi. The networked sensor tapestry:A privacy enhanced software architecture for interactive analysis and processing of data in video sensor networks. In ACM 2nd International Workshop on Video Surveillance and Sensor Networks 2004.

Digital Library

[8]

D. Gavrila. The visual analysis of human movement:a survey. Computer Vision and Image Understanding 73(1):82--98, 1999.

Digital Library

[9]

I. Haritaoglu, D. Harwood,and L.S. Davis. W4: Real-time surveillance of people and their activities. IEEE transactions on Pattern Analysis and Machine Intelligence 22(8): 797--808, August 2000.

Digital Library

[10]

D. V. Kalashnikov, Y. Ma, S. Mehrotra, R. Hariharan, N. Venkatasubramanian,and N. Ashish. SAT: Spatial awareness from textual input.In Proc. of International Conference on Extending Database Technology (EDBT 2006) Munich, Germany, March 26-30 2006.

Digital Library

[11]

S. J. McKenna, S. Jabri, Z. Duric, and H. Wechsler. Tracking interacting people.In 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2000)pages 348--353, 2000.

Digital Library

[12]

N. M. Oliver, B. Rosario,and A. P. Pentland. A Bayesian Computer Vision System for Modeling Human Interactions. IEEE Trans. Pattern Analysis and Machine Intelligence 22(8): 831--843, August 2000.

Digital Library

[13]

S. Park and J. Aggarwal. Semantic-level understanding of human actions and interactions using event hierarchy.In IEEE Workshop on Articulated and Nonrigid Motion 2004.

Digital Library

[14]

S. Park and M. M. Trivedi. Multi-perspective video analysis of persons and vehicles for enhanced situational awareness.In IEEE International Conference on Intelligence and Security Informatics (ISI2006), LNCS 3975 pages 440--451, San Diego, USA, 2006.

Digital Library

[15]

S. Park and M. M. Trivedi. Multi-person interaction and activity analysis:A synergistic track-and body-level analysis framework.Machine Vision and Applications Journal, Special Issue on Novel Concepts and Challenges for the Generation of Video Surveillance Systems toappear.

Digital Library

[16]

P. Remagnino, A. Shihab,and G. Jones. Distributed intelligence for multi-camera visual surveillance. Pattern Recognition: Special Issue on Agent-based Computer Vision 37(4):675--689, 2004.

[17]

R. Sommer. Personal Space: The Behavioral Basis of Design Prentice Hall, Englewood Cliffs, New Jersey, 1969.

[18]

M. M. Trivedi, T. Gandhi,and K. Huang. Distributed interactive video arrays for event capture and enhanced situational awareness.IEEE Intelligent Systems, Special Issue on Artificial Intelligence for Homeland Security September 2005.

Digital Library

[19]

M. M. Trivedi, K. S. Huang, T. Gandhi, B. Hall, and K. Harlow. Distributed omni-video arrays and digital tele-viewer for customized viewing, event detection and notification. In IEEE Int Conf on Information Technology: Coding and Computing (ITCC'04) pages 669--674, 2004.

Digital Library

[20]

M. Valera Espina and S. Velastin. Intelligent distributed surveillance systems: A review. IEE Proceedings - Vision, Image and Signal Processing 152(2):192--204, 2005.

[21]

S. Velastin, B. Boghossian, B. Lo, J. Sun,and M. Vicencio-Silva. Prismatica: Toward ambient intelligence in public transport environments.IEEE Transactions on Systems, Man, and Cybernetics -Part A 35(1):164--182, 2005.

Digital Library

Cited By

Kosmopoulos D(2011)Behavior monitoring for assistive environments using multiple viewsUniversal Access in the Information Society10.1007/s10209-010-0193-910:2(115-123)Online publication date: 1-Jun-2011
https://dl.acm.org/doi/10.1007/s10209-010-0193-9
Park STrivedi M(2010)Multi-Level Human Interaction RecognitionIntelligent Video Surveillance10.1201/9781439813300-c10(273-302)Online publication date: 16-Jun-2010
https://doi.org/10.1201/9781439813300-c10
Ryoo MLee JAggarwal JLi SGao XSebe N(2010)Video scene analysis of interactions between humans and vehicles using event contextProceedings of the ACM International Conference on Image and Video Retrieval10.1145/1816041.1816109(462-469)Online publication date: 5-Jul-2010
https://dl.acm.org/doi/10.1145/1816041.1816109
Show More Cited By

Index Terms

Analysis and query of person-vehicle interactions in homography domain
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Animation
      1. Motion capture
      2. Motion processing

Recommendations

Recognition of two-person interactions using a hierarchical Bayesian network
IWVS '03: First ACM SIGMM international workshop on Video surveillance

Recognizing human interactions is a challenging task due to the multiple body parts of interacting persons and the concomitant occlusions. This paper presents a method for the recognition of two-person interactions using a hierarchical Bayesian network (...
Self-Calibration of Turntable Sequences from Silhouettes

This paper addresses the problem of recovering both the intrinsic and extrinsic parameters of a camera from the silhouettes of an object in a turntable sequence. Previous silhouette-based approaches have exploited correspondences induced by epipolar ...
A hierarchical Bayesian network for event recognition of human actions and interactions

Recognizing human interactions is a challenging task due to the multiple body parts of interacting persons and the concomitant occlusions. This paper presents a method for the recognition of two-person interactions using a hierarchical Bayesian network (...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VSSN '06: Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks

October 2006

230 pages

ISBN:1595934960

DOI:10.1145/1178782

General Chairs:
Jake K. Aggarwal
University of Texas
,
Rita Cucchiara
University of Modena and Reggio Emilia, Italy
,
Program Chair:
Andrea Prati
University of Modena and Reggio Emilia, Italy

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM06

Sponsor:

MM06: The 14th ACM International Conference on Multimedia 2006

October 27, 2006

California, Santa Barbara, USA

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
408
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kosmopoulos D(2011)Behavior monitoring for assistive environments using multiple viewsUniversal Access in the Information Society10.1007/s10209-010-0193-910:2(115-123)Online publication date: 1-Jun-2011
https://dl.acm.org/doi/10.1007/s10209-010-0193-9
Park STrivedi M(2010)Multi-Level Human Interaction RecognitionIntelligent Video Surveillance10.1201/9781439813300-c10(273-302)Online publication date: 16-Jun-2010
https://doi.org/10.1201/9781439813300-c10
Ryoo MLee JAggarwal JLi SGao XSebe N(2010)Video scene analysis of interactions between humans and vehicles using event contextProceedings of the ACM International Conference on Image and Video Retrieval10.1145/1816041.1816109(462-469)Online publication date: 5-Jul-2010
https://dl.acm.org/doi/10.1145/1816041.1816109
Khan SShah M(2009)Tracking Multiple Occluding People by Localizing on Multiple Scene PlanesIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2008.10231:3(505-519)Online publication date: 1-Mar-2009
https://dl.acm.org/doi/10.1109/TPAMI.2008.102
Kosmopoulos DAntonakaki PValasoulis KKatsoulas D(2008)Monitoring human behavior in an assistive environment using multiple viewsProceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments10.1145/1389586.1389624(1-6)Online publication date: 16-Jul-2008
https://dl.acm.org/doi/10.1145/1389586.1389624
Gandhi TTrivedi M(2008)Image based estimation of pedestrian orientation for improving path prediction2008 IEEE Intelligent Vehicles Symposium10.1109/IVS.2008.4621257(506-511)Online publication date: Jun-2008
https://doi.org/10.1109/IVS.2008.4621257
Park STrivedi M(2008)Understanding human interactions with track and body synergies (TBS) captured from multiple viewsComputer Vision and Image Understanding10.1016/j.cviu.2007.10.005111:1(2-20)Online publication date: 1-Jul-2008
https://dl.acm.org/doi/10.1016/j.cviu.2007.10.005
Hansen DDuizer PPark SMoeslund TTrivedi M(2008)Multi-view Video Analysis of Humans and Vehicles in an Unconstrained EnvironmentProceedings of the 4th International Symposium on Advances in Visual Computing10.1007/978-3-540-89639-5_41(428-439)Online publication date: 1-Dec-2008
https://dl.acm.org/doi/10.1007/978-3-540-89639-5_41
Kosmopoulos DAntonakaki PValasoulis KKesidis APerantonis S(2008)Human Behavior Classification Using Multiple ViewsProceedings of the 5th Hellenic conference on Artificial Intelligence: Theories, Models and Applications10.1007/978-3-540-87881-0_12(123-134)Online publication date: 2-Oct-2008
https://dl.acm.org/doi/10.1007/978-3-540-87881-0_12
Park STrivedi M(2008)Video Analysis of Vehicles and Persons for SurveillanceIntelligence and Security Informatics10.1007/978-3-540-69209-6_21(407-424)Online publication date: 2008
https://doi.org/10.1007/978-3-540-69209-6_21
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents