Article

A hybrid system for affine-invariant trajectory retrieval

Authors:

Faisal Bashir,

Ashfaq Khokhar,

Dan SchonfeldAuthors Info & Claims

MIR '04: Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval

Pages 235 - 242

https://doi.org/10.1145/1026711.1026750

Published: 15 October 2004 Publication History

Get Access

Abstract

This paper studies efficient feature spaces for content based indexing and retrieval of object motion trajectories. Taking object trajectory data as input, we first investigate highly compact affine invariant feature spaces based on Fourier Descriptors (FD) and Principal Component Analysis (PCA) techniques. Based on these feature spaces, we then develop a hybrid content based indexing and retrieval system that employs a two-stage matching scheme. The first stage uses affine-invariant Fourier Descriptor (FD) for indexing and retrieval. Top few results from this stage along with the original query are then posed to the second stage of the matching system that employs Principal Component Analysis (PCA) for fast retrieval. We compare our system's performance with two other approaches borrowed from 2-D shape representation in image analysis. For quantitative analysis of the system performance, we report query results in terms of precision-recall metrics

References

[1]

Arbter K., Snyder W.E., Burkhardt H., Hirzinger G., "Applications of affine-invariant fourier descriptors to recognition of 3-D objects", IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 12, July 1990. Pages 640--646.]]

Digital Library

Google Scholar

[2]

Bashir F., Khanvilkar S., Schonfeld D., Khokhar A., "Multimedia systems: content-based indexing and retrieval", Sec. 4, Chap. 6, in "Electrical Engineer's Handbook" (In press).]]

Google Scholar

[3]

Bashir F., Schonfeld D., Khokhar A., "Segmented trajectory based indexing and retrieval of video data", IEEE International Conference on Image Processing, ICIP 2003, Barcelona, Spain.]]

Crossref

Google Scholar

[4]

Chen W., Chang S. F., "Motion trajectory matching of video objects", IS&T/SPIE. San Jose, CA, Jan. 2000.]]

Google Scholar

[5]

Hu M. K., "Visual pattern recognition by moment invariants, computer methods in image analysis", IEEE transactions on Information Theory. Vol. 8. No. 2, Feb. 1962. Pages 179--187.]]

Crossref

Google Scholar

[6]

Jolliffe I.T., "Principal Component Analysis", Springer-Verlag, New York, 1986.]]

Google Scholar

[7]

Mokhtarian F., Mackworth A., "A theory of multiscale, curvature-based shape representation for planar curves", IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 14, No. 8, August 1992. Pages 789--805.]]

Digital Library

Google Scholar

[8]

Mokhtarian F., Abbasi S., "Retrieval of similar shapes under affine transformation", Proc. International Conference on Visual Information Systems. Amsterdam, The Netherlands, 1999. Pages 566--574.]]

Digital Library

Google Scholar

[9]

Mokhtarian F., Bober M., "Curvature scale space representation: theory, applications, and MPEG-7 standardization", Kluwer Academic Publishers, Netherlands, 2003.]]

Digital Library

Google Scholar

[10]

Pentland A., Sclaroff S., "Modal matching for correspondence and recognition", IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol. 17, No. 6, June 1995. Pages 545--561.]]

Digital Library

Google Scholar

[11]

Raghavan V. V., Bollman P."A critical investigation of Recall and Precision as a measure of retrieval system performance", ACM transactions on Information Systems. Vol. 7, No. 3, 1989. Pages 205--229.]]

Digital Library

Google Scholar

[12]

Rangarajan K., Allen W., Shah M., "Matching motion trajectories using scale-space", Pattern Recognition, Vol. 26, No. 4, 1993. Pages 595--610.]]

Crossref

Google Scholar

[13]

Zhang D.S., "Image retrieval based on shape", Ph.D Thesis, Monash University, Australia, March 2003.]]

Google Scholar

[14]

Zhang D.S., Lu G., "A comparative study of curvature scale space and Fourier descriptors for shape-based image retrieval", Journal of Visual Communication and Image Representation. Vol. 14, 2003. Pages 41--60.]]

Crossref

Google Scholar

Cited By

View all

Wu XMao XChen LXue Y(2015)Trajectory‐based view‐invariant hand gesture recognition by fusing shape and orientationIET Computer Vision10.1049/iet-cvi.2014.03689:6(797-805)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1049/iet-cvi.2014.0368
Vincs KBarbour K(2013)Snapshots of complexity: using motion capture and principal component analysis to reconceptualise danceDigital Creativity10.1080/14626268.2013.78673225:1(62-78)Online publication date: 3-Jun-2013
https://doi.org/10.1080/14626268.2013.786732
Hu WTian GLi XMaybank S(2013)An Improved Hierarchical Dirichlet Process-Hidden Markov Model and Its Application to Trajectory Modeling and RetrievalInternational Journal of Computer Vision10.1007/s11263-013-0638-8105:3(246-268)Online publication date: 1-Dec-2013
https://dl.acm.org/doi/10.1007/s11263-013-0638-8
Show More Cited By

Index Terms

A hybrid system for affine-invariant trajectory retrieval
1. Information systems
  1. Information retrieval
    1. Information retrieval query processing
    2. Retrieval models and ranking

Recommendations

Real-Time Motion Trajectory-Based Indexing and Retrieval of Video Sequences

This paper presents a novel motion trajectory-based compact indexing and efficient retrieval mechanism for video sequences. Assuming trajectory information is already available, we represent trajectories as temporal ordering of subtrajectories. This ...
Evaluation of MPEG-7 shape descriptors against other shape descriptors

Shape is an important image feature-it is one of the primary low level image features exploited in content-based image retrieval (CBIR). There are generally two types of shape descriptors in the literature: contour-based and region-based. In MPEG-7, the ...
Performance analysis of various local and global shape descriptors for image retrieval

In this paper, various prominent local and global descriptors are evaluated against each other for analyzing their performance on shape-based image retrieval. Local descriptors include Fourier descriptors, Weber's local descriptor, local binary patterns,...

Comments

Information & Contributors

Information

Published In

MIR '04: Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval

October 2004

334 pages

ISBN:1581139403

DOI:10.1145/1026711

General Chairs:
Michael S. Lew
LIACS Media Lab, The Netherlands
,
Nicu Sebe
University of Amsterdam, The Netherlands
,
Chabane Djeraba
LIFL, France

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM04

Sponsor:

MM04: 2004 12th Annual ACM International Conference on Multimedia

October 15 - 16, 2004

NY, New York, USA

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
600
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wu XMao XChen LXue Y(2015)Trajectory‐based view‐invariant hand gesture recognition by fusing shape and orientationIET Computer Vision10.1049/iet-cvi.2014.03689:6(797-805)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1049/iet-cvi.2014.0368
Vincs KBarbour K(2013)Snapshots of complexity: using motion capture and principal component analysis to reconceptualise danceDigital Creativity10.1080/14626268.2013.78673225:1(62-78)Online publication date: 3-Jun-2013
https://doi.org/10.1080/14626268.2013.786732
Hu WTian GLi XMaybank S(2013)An Improved Hierarchical Dirichlet Process-Hidden Markov Model and Its Application to Trajectory Modeling and RetrievalInternational Journal of Computer Vision10.1007/s11263-013-0638-8105:3(246-268)Online publication date: 1-Dec-2013
https://dl.acm.org/doi/10.1007/s11263-013-0638-8
Cheng HHwang J(2011)Integrated video object tracking with applications in trajectory-based event detectionJournal of Visual Communication and Image Representation10.1016/j.jvcir.2011.07.00122:7(673-685)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1016/j.jvcir.2011.07.001
Nunziati WSclaroff SBimbo A(2010)Matching Trajectories between Video Sequences by Exploiting a Sparse Projective Invariant RepresentationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2009.3532:3(517-529)Online publication date: 1-Mar-2010
https://dl.acm.org/doi/10.1109/TPAMI.2009.35
Dyana ADas S(2010)MST-CSS (Multi-Spectro-Temporal Curvature Scale Space), a Novel Spatio-Temporal Representation for Content-Based Video RetrievalIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2010.205136720:8(1080-1094)Online publication date: 1-Aug-2010
https://dl.acm.org/doi/10.1109/TCSVT.2010.2051367
Calderara SCucchiara R(2010)People trajectory mining with statistical pattern recognition2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops10.1109/CVPRW.2010.5543158(1-8)Online publication date: Jun-2010
https://doi.org/10.1109/CVPRW.2010.5543158
Ma XChen XKhokhar ASchonfeld D(2010)Motion Trajectory-Based Video Retrieval, Classification, and SummarizationVideo Search and Mining10.1007/978-3-642-12900-1_3(53-82)Online publication date: 2010
https://doi.org/10.1007/978-3-642-12900-1_3
Ren WSingh SSingh MZhu Y(2009)State-of-the-art on spatio-temporal information-based video retrievalPattern Recognition10.1016/j.patcog.2008.08.03342:2(267-282)Online publication date: 1-Feb-2009
https://dl.acm.org/doi/10.1016/j.patcog.2008.08.033
Cuntoor NYegnanarayana BChellappa R(2008)Activity Modeling Using Event Probability SequencesIEEE Transactions on Image Processing10.1109/TIP.2008.91699117:4(594-607)Online publication date: Apr-2008
https://doi.org/10.1109/TIP.2008.916991
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Real-Time Motion Trajectory-Based Indexing and Retrieval of Video Sequences

Evaluation of MPEG-7 shape descriptors against other shape descriptors

Performance analysis of various local and global shape descriptors for image retrieval

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Upcoming Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Real-Time Motion Trajectory-Based Indexing and Retrieval of Video Sequences

Evaluation of MPEG-7 shape descriptors against other shape descriptors

Performance analysis of various local and global shape descriptors for image retrieval

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations