Article

Multi-views tracking within and across uncalibrated camera streams

Authors:

Gérard MedioniAuthors Info & Claims

IWVS '03: First ACM SIGMM international workshop on Video surveillance

Pages 21 - 33

https://doi.org/10.1145/982452.982456

Published: 02 November 2003 Publication History

Abstract

This paper presents novel approaches for continuous detection and tracking of moving objects observed by multiple, stationary or moving cameras. Stationary video streams are registered using a ground plane homography and the trajectories derived by Tensor Voting formalism are integrated across cameras by a spatio-temporal homography. Tensor Voting based tracking approach provides smooth and continuous trajectories and bounding boxes, ensuring minimum registration error. In the more general case of moving cameras, we present an approach for integrating objects trajectories across cameras by simultaneous processing of video streams. The detection of moving objects from moving camera is performed by defining an adaptive background model that uses an affine-based camera motion approximation. Relative motion between cameras is approximated by a combination of affine and perspective transform while objects' dynamics are modeled by a Kalman Filter. Shape and appearance of moving objects are also taken into account using a probabilistic framework. The maximization of the joint probability model allows tracking moving objects across the cameras. We demonstrate the performances of the proposed approaches on several video surveillance sequences.

References

[1]

A. Elgammal and L. S. Davis, "Probabilistic Framework for Segmenting People Under Occlusion", IEEE Proc. International Conference on Computer Vision, 2001.

[2]

A. Mittal and L. S. Davis, "M2Tracker: A Multi-View Approach to Segmenting and Tracking People in a Cluttered Scene Using Region-Based Stereo", In Proc. European Conference Computer Vision, 2002.

Digital Library

[3]

A. Utsumi, H. Mori, J. Ohya and M. Yachida, "Multiple-Human Tracking using Multiple Cameras", Proc. of the Int. Conf. on Automatic Face and Gesture Recognition, pp. 498--503, Nara, Japan, 14--16 April, 1998.

Digital Library

[4]

B. Stenger, P. R. S. Mendonca, and R. Cipolla, "Model-Based Hand Tracking Using an Unscented Kalman Filter", In Proc. British Machine Vision Conference, Vol. 1, pp. 63--72, Manchester, UK, September 2001.

[5]

B. Stenger, P. R. S. Mendonca, and R. Cipolla, "Model-Based Hand Tracking of an Articulated Hand", IEEE Proc. CVPR, Vol. II, pp. 310--315, Kauai, USA, December 2001.

[6]

G. Stein, "Tracking from Multiple View Points: Self-calibration of Space and Time", IEEE Proc. CVPR, pp. 521--527, 1999.

[7]

G. Welch and G. Bishop, "SCAAT: Incremental Tracking with Incomplete Information", In. Proc. of SIGGRAPH 97, pp. 333--344, 1997.

Digital Library

[8]

H. Zhang and J. Malik, "Learning a discriminative classifier using shape context distance", Proc. of the IEEE CVPR, Vol. 1, pp. 242--247, Madison, Wisconsin, 18--20 June, 2003.

Digital Library

[9]

J. Kang, I. Cohen and G. Medioni, "Continuous Multi-Views Tracking using Tensor Voting", proc. of the IEEE Workshop on Motion and Video Computing, pp. 181--186, Orlando, Florida, 5--6 December, 2002.

Digital Library

[10]

J. Kang, I. Cohen and G. Medioni, "Continuous Tracking Within and Across Camera Streams", Proc. of the IEEE CVPR, Vol. 1, pp. 267--272, Madison, Wisconsin, 18--20 June, 2003.

Digital Library

[11]

J. Krumm, S. Harris, B. Meyers, B. Brumitt, M. Hale and S. Shafer, "Multi-camera Multi-person Tracking for EasyLiving", proc. of the 3rd IEEE Workshop on Visual Surveillance, 2000.

Digital Library

[12]

J. Orwell, P. Remagnino, and G. A. Jones, "Multi-Camera Color Tracking", proc. of the 2nd IEEE Workshop on Visual Surveillance, 1999.

Digital Library

[13]

K. Bradshaw, I. Reid, and D. Murray, "The active recovery of 3d motion trajectories and their use in prediction", IEEE Trans. PAMI, Vol. 19, no. 3, 1997.

Digital Library

[14]

K. Toyama, J. Krumm, B. Brumitt and B. Meyers, "Wallflower: Principles and Practice of Background Maintenance", IEEE Proc. Int'l Conf. Computer Vision, pp. 255--261, 1999.

[15]

M. J. Black and A. D. Jepson, "A Probabilistic framework for matching temporal trajectories: Condensation-based recognition of gestures and expressions", In Proc. European Conference Computer Vision, Vol. 1, pp. 909--924, 1998.

Digital Library

[16]

M. Black and P. Anandan, "The robust estimation of multiple motions: Affine and piecewise-smooth flow fields", Tech. Report TR, Xerox PARC, Dec. 1993.

[17]

M. Irani et al., "Efficient Representations of Video Sequences and Their Applications", Signal Processing, Vol. 8, No. 4, May, 1996.

[18]

P. Kornprobst and G. Medioni, "Tracking Segmented Objects using Tensor Voting", IEEE CVPR, Vol. 2, pp. 118--125, 2000.

[19]

Q. Cai and J. K. Aggarwal, "Automatic Tracking of Human Motion in Indoor Scenes Across Multiple Synchronized video Streams", IEEE Proc. International Conference on Computer Vision, 1998.

Digital Library

[20]

Q. Cai and J. K. Aggarwal, "Tracking Human Motion in Structured Environments Using a Distributed-Camera System", IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 21, No. 11, pp. 1241--1247, November, 1999.

Digital Library

[21]

R. Rosales and S. Sclaroff, "Improved Tracking of Multiple Humans with Trajectory Prediction and Occlusion Modeling", IEEE Proc. CVPR, Santa Barbara, CA, 1998.

Digital Library

[22]

R. T. Collins, A. J. Lipton, Ho Fujiyoshi and T. Kanade, "Algorithms for Cooperative Multisensor Surveillance", Proc. of the IEEE, Vol 89(10), pp. 1456--1477, Oct, 2001.

[23]

S. Ayer, P. Schroeter, and J. Bigun, "Segmentation of moving objects by robust motion parameter estimation over multiple frames", In Proc. European Conference Computer Vision, May, 1994.

Digital Library

[24]

S. Stillman, R. Tanawongsuwan and I. Essa, "A system for tracking and recognizing multiple people with multiple cameras", Proc. of the Int. Conf. on Audio and Video-Based Biometric Person Authentication, pp. 96--101, Washington, DC, 22--23 March 1999.

[25]

T.-J. Cham and J. M. Rehg, "A Multiple Hypothesis Approach to Figure Tracking", IEEE Proc. Computer Vision and Pattern Recognition, Vol. 2, pp. 239--245, Ft. Collins, CO, June 1999.

[26]

Y. Chen, Y. Rui, and T. S. Huang, "JPDAF Based HMM for Real-Time Contour Tracking", IEEE Proc. CVPR, Vol 1. pp. 543--550, Kauai, Hawaii, December 11--13, 2001

Cited By

Achard CAmbellouis SMeden BLefebvre STruong Cong D(2013)Tracking Objects of Interest Through a Camera NetworkIntelligent Video Surveillance Systems10.1002/9781118577851.ch9(147-164)Online publication date: 5-Feb-2013
https://doi.org/10.1002/9781118577851.ch9
Jiang MWang H(2012)A Robust Tracking Algorithm in Crowded EnvironmentApplied Mechanics and Materials10.4028/www.scientific.net/AMM.157-158.1336157-158(1336-1339)Online publication date: Feb-2012
https://doi.org/10.4028/www.scientific.net/AMM.157-158.1336
Jiang MWang HLin C(2011)A Multi-Object Tracking Algorithm Based on Multi-CameraApplied Mechanics and Materials10.4028/www.scientific.net/AMM.135-136.70135-136(70-75)Online publication date: Oct-2011
https://doi.org/10.4028/www.scientific.net/AMM.135-136.70
Show More Cited By

Index Terms

Multi-views tracking within and across uncalibrated camera streams
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
        Scene understanding

Recommendations

Object Inter-camera Tracking with Non-overlapping Views: A New Dynamic Approach
CRV '10: Proceedings of the 2010 Canadian Conference on Computer and Robot Vision

Disjoint inter-camera object tracking is the task of tracking objects across video-surveillance cameras that have non-overlapping views. Unlike the closely related task of single-camera tracking, disjoint inter-camera tracking is difficult due to the ...
The invariant features-based target tracking across multiple cameras

Target tracking across lenses is a popular research topic for video surveillance recently. This paper presents a method of target tracking across lenses with overlap regions. First, the target detection and tracking are completed with a single camera. ...
Hand-Eye Camera Calibration with an Optical Tracking System
ICDSC '18: Proceedings of the 12th International Conference on Distributed Smart Cameras

This paper presents a method for hand-eye camera calibration via an optical tracking system (OTS) faciltating robotic applications. The camera pose cannot be directly tracked via the OTS. Because of this, a transformation matrix between a marker-plate ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IWVS '03: First ACM SIGMM international workshop on Video surveillance

November 2003

130 pages

ISBN:158113780X

DOI:10.1145/982452

Program Chairs:
Edward Y. Chang
University of California, Santa Barbara
,
Yuan-Fang Wang
University of California, Santa Barbara

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
1,442
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 31 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Achard CAmbellouis SMeden BLefebvre STruong Cong D(2013)Tracking Objects of Interest Through a Camera NetworkIntelligent Video Surveillance Systems10.1002/9781118577851.ch9(147-164)Online publication date: 5-Feb-2013
https://doi.org/10.1002/9781118577851.ch9
Jiang MWang H(2012)A Robust Tracking Algorithm in Crowded EnvironmentApplied Mechanics and Materials10.4028/www.scientific.net/AMM.157-158.1336157-158(1336-1339)Online publication date: Feb-2012
https://doi.org/10.4028/www.scientific.net/AMM.157-158.1336
Jiang MWang HLin C(2011)A Multi-Object Tracking Algorithm Based on Multi-CameraApplied Mechanics and Materials10.4028/www.scientific.net/AMM.135-136.70135-136(70-75)Online publication date: Oct-2011
https://doi.org/10.4028/www.scientific.net/AMM.135-136.70
Tang SLi XZhang HHan JDai GWang CShen X(2011)TelosCAMProceedings of the 2011 IEEE 32nd Real-Time Systems Symposium10.1109/RTSS.2011.37(327-336)Online publication date: 29-Nov-2011
https://dl.acm.org/doi/10.1109/RTSS.2011.37
Hofmann MKiechle MRigoll G(2011)Late fusion for person detection in camera networksCVPR 2011 WORKSHOPS10.1109/CVPRW.2011.5981737(41-46)Online publication date: Jun-2011
https://doi.org/10.1109/CVPRW.2011.5981737
Kim KDavis L(2011)Object Detection and Tracking for Intelligent Video SurveillanceMultimedia Analysis, Processing and Communications10.1007/978-3-642-19551-8_9(265-288)Online publication date: 2011
https://doi.org/10.1007/978-3-642-19551-8_9
Snidaro LVisentini IForesti G(2011)Data Fusion in Modern SurveillanceInnovations in Defence Support Systems – 310.1007/978-3-642-18278-5_1(1-21)Online publication date: 2011
https://doi.org/10.1007/978-3-642-18278-5_1
Mörzinger RThaler MWolf MForesti GBischof H(2010)Establishing correspondence in distributed cameras by observing humansProceedings of the Fourth ACM/IEEE International Conference on Distributed Smart Cameras10.1145/1865987.1865989(2-7)Online publication date: 31-Aug-2010
https://dl.acm.org/doi/10.1145/1865987.1865989
Thaler MMorzinger R(2010)Automatic Inter-image Homography Estimation from Person DetectionsProceedings of the 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance10.1109/AVSS.2010.35(456-461)Online publication date: 29-Aug-2010
https://dl.acm.org/doi/10.1109/AVSS.2010.35
Snidaro LVisentini IForesti G(2010)Sensor managementProceedings of the 5th international conference on Hybrid Artificial Intelligence Systems - Volume Part II10.1007/978-3-642-13803-4_56(452-459)Online publication date: 23-Jun-2010
https://dl.acm.org/doi/10.1007/978-3-642-13803-4_56
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten