short-paper

Known-item video search via query-to-modality mapping

Authors:

Lekha ChaisornAuthors Info & Claims

MM '11: Proceedings of the 19th ACM international conference on Multimedia

Pages 1133 - 1136

https://doi.org/10.1145/2072298.2071957

Published: 28 November 2011 Publication History

Abstract

We introduce a novel query-to-modality mapping approach to the TRECVid 2010 known-Item video search (KIS) task. To search for a specific target video, a KIS query is verbose with many multi-modal attributes. Issuing all search terms to a retrieval engine will confuse the search criteria in different modalities and result in "topic drift". We propose decomposing a KIS query into a set of short uni-modal subqueries and issue them to the search index of the corresponding modality features, such as text-based metadata, visualbased high-level features. To do so, we introduce novel syntactic query features and cast the query-to-modality mapping as a classification problem. Retrieval results on the TRECVid 2010 KIS dataset shows that our approach outperforms existing methods by a significant margin.

References

[1]

TRECVID 2010 Known-Item Search. http://www-nlpir.nist.gov/projects/tv2010/tv2010.html\#kis.

[2]

M. Bendersky and W. B. Croft. Discovering key concepts in verbose queries. In Proc of SIGIR, pages 491--498, 2008.

Digital Library

[3]

S. Bergsma and Q. I. Wang. Learning noun phrase query segmentation. In Proc of EMNLP-CoNLL, pages 819--826, 2007.

[4]

W. Daelemans, J. Zavrel, K. van der Sloot, and A. van den Bosch. Timbl: Tilburg memory based learner version 6.3, reference guide. ILK Technical Report ILK-1001, 2010.

[5]

J. Feng, Y. Zheng, and S. Yan. Towards a universal detector by mining concepts with small semantic gaps. In Proc of ACM Multimedia, pages 1707--1710, 2010.

Digital Library

[6]

X. Guo, Y. Chen, W. Liu, Y. Mao, H. Zhang, K. Zhou, L. Wang, Y. Hua, Z. Zhao, Y. Zhao, and A. Cai. Bupt-mcprl at trecvid 2010. In Proc of TRECVID Workshop, 2010.

[7]

Y.-G. Jiang, J. Yang, C.-W. Ngo, and A. G. Hauptmann. Representations of keypoint-based semantic concept detection: A comprehensive study. IEEE Transactions on Multimedia, 12:42--53, 2010.

Digital Library

[8]

C. Lampert, H. Nickisch, and S. Harmeling. Learning to detect unseen object classes by between-class attribute transfer. Proc CVPR, 2009.

[9]

M. Marneffe, B. MacCartney, and C. Manning. Generating typed dependency parses from phrase structure parses. In Proc of LREC, 2006.

[10]

C.-W. Ngo, S.-A. Zhu, H.-K. Tan, W.-L. Zhao, and X.-Y. Wei. Vireo at trecvid 2010: Semantic indexing, known-item search, and content-based copy detection. In Proc of TRECVID Workshop, Nov 2010.

[11]

P. Ogilvie and J. Callan. Combining document representations for known-item search. In Proc of SIGIR, SIGIR'03, pages 143--150, 2003.

Digital Library

[12]

K. Risvik, T. Mikolajewski, and P. Boros. Query segmentation for web search. In Proc of WWW, 2003.

[13]

H. Samuel and W. Bruce. Evaluating verbose query processing techniques. In Proc of SIGIR, pages 291--298, 2010.

Digital Library

[14]

C. Snoek, K. Sande, O. Rooij, B. Huurnink, E. Gavves, D. odijk, M. Rijke, T. Gevers, M. Worring, D. Koelma, and A. Smeulders. The mediamill trecvid 2010 semantic video search engine. In Proc of TRECVID Workshop, 2010.

[15]

M. Soubbotin and S. Soubbotin. Use of patterns for detection of likely answer strings: A systematic approach. In Proc of TREC, 2020.

Cited By

Etter DDomeniconi C(2015)Multi2RankProceedings of the 2015 IEEE International Conference on Multimedia Big Data10.1109/BigMM.2015.47(80-87)Online publication date: 20-Apr-2015
https://dl.acm.org/doi/10.1109/BigMM.2015.47
Chaisorn LYan-Tao Zheng Sim K(2011)Known-item Search (KIS) in video: Survey, experience and trend2011 8th International Conference on Information, Communications & Signal Processing10.1109/ICICS.2011.6173547(1-4)Online publication date: Dec-2011
https://doi.org/10.1109/ICICS.2011.6173547

Index Terms

Known-item video search via query-to-modality mapping
1. Information systems
  1. Information retrieval
    1. Information retrieval query processing

Recommendations

Modeling reformulation using query distributions

Query reformulation modifies the original query with the aim of better matching the vocabulary of the relevant documents, and consequently improving ranking effectiveness. Previous models typically generate words and phrases related to the original ...
A new approach to query segmentation for relevance ranking in web search
Abstract
In this paper, we try to determine how best to improve state-of-the-art methods for relevance ranking in web searching by query segmentation. Query segmentation is meant to separate the input query into segments, typically natural language ...
How Many Neighbours for Known-Item Search?
Similarity Search and Applications
Abstract
In the ongoing multimedia age, search needs become more variable and challenging to aid. In the area of content-based similarity search, asking search engines for one or just a few nearest neighbours to a query does not have to be sufficient to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

944 pages

ISBN:9781450306164

DOI:10.1145/2072298

General Chairs:
K. Selçuk Candan
Arizona State University, USA
,
Sethuraman Panchanathan
Arizona State University, USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Hari Sundaram
Arizona State University, USA
,
Wu-Chi Feng
Portland State University, USA
,
Nicu Sebe
University of Trento, Italy

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM '11

Sponsor:

SIGMM

MM '11: ACM Multimedia Conference

November 28 - December 1, 2011

Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
148
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Etter DDomeniconi C(2015)Multi2RankProceedings of the 2015 IEEE International Conference on Multimedia Big Data10.1109/BigMM.2015.47(80-87)Online publication date: 20-Apr-2015
https://dl.acm.org/doi/10.1109/BigMM.2015.47
Chaisorn LYan-Tao Zheng Sim K(2011)Known-item Search (KIS) in video: Survey, experience and trend2011 8th International Conference on Information, Communications & Signal Processing10.1109/ICICS.2011.6173547(1-4)Online publication date: Dec-2011
https://doi.org/10.1109/ICICS.2011.6173547

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents