Interactive similarity search for video browsing and retrieval
Abstract
We present an interactive system that allows a user to locate regions of video that are similar to a video query. Thus segments of video can be found by simply providing an example of the video of interest. The user selects a video segment for the query from either a static frame-based interface or a video player. A statistical model of the query is calculated on-the-fly, and is used to find similar regions of video. The similarity measure is based on a Gaussian model of reduced frame image transform coefficients. Similarity in a single video is displayed in the Metadata Media Player. The player can be used to navigate through the video by jumping between regions of similarity. Similarity can be rapidly calculated for multiple video files as well. These results are displayed in MBase, a Web-based video browser that allows similarity in multiple video files to be visualized simultaneously.
References
[1]
Chiu, P., Kapuskar, A., Reitmeier, S., and Wilcox, L. (1999). Meeting Capture in a Media Enriched Conference Room. In Proceedings of the Second International Workshop on Cooperative Buildings (CoBuild'99) Lecture Notes in Computer Science, Vol. 1670 (pp. 79--88) Springer-Verlag.
[2]
Dimitrova, N. and Abdel-Mottaled, M. (1997). Content-based Video Retrieval by Example Video Clip. SPIE Vol. 3022 (pp. 59--71).
[3]
Flickner, M. et al. (1997) Query by Image and Video Content: the QBIC System. In Maybury, M. (Ed.) Intelligent Multimedia Information Retrieval, (pp. 7--22) AAAI Press/MIT Press.
[4]
Girgensohn, A., Boreczky, J., Wilcox, L., and Foote, J. (1999). Facilitating Video Access by Visualizing Automatic Analysis. In Human-Computer Interaction INTERACT '99, (pp. 205--212). IOS Press.
[5]
Girgensohn, A. and Foote, J. (1999). Video Classification Using Transform Coefficients. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing '99, Vol. 6 (pp. 3045--3048) Phoenix, AZ, IEEE.
[6]
Günsel, B., Fu, Y., and Tekalp, A. M. (1997). Hierarchical Temporal Video Segmentation and Content Characterization. Multimedia Storage and Archiving Systems II, SPIE, Vol. 3229, (pp. 46--55) Dallas, TX.
[7]
Jacobs, C., Finkelstein, A., and Salesin, D. (1995) Fast Multiresolution Image Querying. In Proceedings SIGGRAPH 95, Los Angeles.
[8]
Kobla, V., Doermann, D. S., Lin, K-I., and Faloutsos, C. (1997). Compressed Domain Video Indexing Techniques Using DCT and Motion Vector Information in MPEG Video. In Proceedings SPIE Conference on Storage and Retrieval for Image and Video databases, Vol. 3022 (pp. 200--211).
[9]
Mohan, R. (1998). Video Sequence Matching. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing '98, Seattle, WA, IEEE.
[10]
Rabiner, L. R. and Juang, B. (1993). Fundamentals of Speech Recognition Prentice Hall.
[11]
Ravela, S. and Manmatha, R. (1998). On Computing Global Similarity in Images. In Proceedings IEEE Workshop on Applications of Computer Vision (WACV '98) (pp. 82--87).
[12]
Rosenfield, A. and Kak, A. (1982) Digital Picture Processing. Academic Press.
[13]
Swain, M. (1993). Interactive Indexing into Image Databases. In Proceedings SPIE Storage and Retrieval for Image and Video Databases Vol. 1908, (pp. 95--103).
[14]
Zhang, H-J., Low, C-Y., Smoliar, S., and JWu, J-H. (1997). Video Parsing, Retrieval, and Browsing: an Integrated and Content-Based Solution. In Maybury, M. (Ed.), Intelligent Multimedia Information Retrieva, (pp. 139--158) AAAI Press/MIT Press.
Index Terms
- Interactive similarity search for video browsing and retrieval
Recommendations
Strong similarity measures for ordered sets of documents in information retrieval
A general method is presented to construct ordered similarity measures (OS-measures), i.e., similarity measures for ordered sets of documents (as, e.g., being the result of an IR-process), based on classical, well-known similarity measures for ordinary ...
Learning similarity with cosine similarity ensemble
This paper proposes a cosine similarity ensemble (CSE) method to learn similarity.CSE is a selective ensemble and combines multiple cosine similarity learners.A learner redefines the pattern vectors and determines its threshold adaptively.Experimental ...
Effective Similarity Search on Indoor Moving-Object Trajectories
DASFAA 2016: Proceedings, Part II, of the 21st International Conference on Database Systems for Advanced Applications - Volume 9643In this paper, we propose a new approach to measuring the similarity among indoor moving-object trajectories. Particularly, we propose to measure indoor trajectory similarity based on spatial similarity and semantic pattern similarity. For spatial ...
Comments
Information & Contributors
Information
Published In
Publisher
LE CENTRE DE HAUTES ETUDES INTERNATIONALES D'INFORMATIQUE DOCUMENTAIRE
Paris, France
Publication History
Published: 12 April 2000
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 54Total Downloads
- Downloads (Last 12 months)25
- Downloads (Last 6 weeks)3
Reflects downloads up to 01 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in