Article

Similarity space projection for web image search and annotation

Authors:

Wei-Ying MaAuthors Info & Claims

MIR '05: Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval

Pages 49 - 56

https://doi.org/10.1145/1101826.1101837

Published: 10 November 2005 Publication History

Abstract

Web image search has been explored and developed in academic as well as commercial areas for over a decade. To measure the similarity between Web images and user queries, most of the existing Web image search systems try to convert an image to textual keywords by analyzing the textual information available (such as surrounding text and image filename) with or without leveraging image visual features (such as color, texture, shape). In this way, the existing systems transform "Web images" to the "query (text)" space so as to compare the relevance of images to the query. In this paper, we present a novel solution to Web image search - similarity space projection (SSP). This algorithm takes images and queries as two heterogeneous object peers, and projects them into a third Euclidean "similarity space" in which their similarity can be directly measured. The rule of projection guarantees that in the new space the relevant images are kept close to the corresponding query and those irrelevant ones are away from it. Experiments on real-world Web image collections showed that the proposed algorithm significantly outperformed traditional information retrieval models (such as vector space model) in the application of image search. Besides Web image search, we demonstrate that this algorithm can also be applied to image annotation scenario, and has promising performance. Thus, this algorithm unifies Web image search and image annotation into same framework.

References

[1]

Baeza-Yates, R., Ribeiro-Neto,B. Modern Information Retrieval. Addison Wesley, 1999.

Digital Library

[2]

Boyd, S., and Vandenberghe, L. Convex Optimization, Cambridge Univ. Press, Cambridge, U.K., available at http://www.stanford.edu/~boyd/cvxbook.html, 2003.

Digital Library

[3]

Cai, D., He, X.F., Li, Z.W., Ma, W.Y., and Wen, J.R. Hierarchical clustering of WWW image search results using visual, textual and link analysis. ACM Multimedia, Oct 10-16, 2004.

Digital Library

[4]

Charles Frankel, Michael J Swain, Vassilis Athitsos. WebSeer: an image search engine for the World Wide Web. Technical Report: TR-96-14, 1996.

Digital Library

[5]

Cheng Thao, Ethan V.Munson. A relevance model for Web image search. WDA2003, UK, August 3, 2003.

[6]

David Forsyth, David Blei, and Michael I. Jordan, Matching words and pictures. Journal of Machine Learning Research, Vol 3, pp 1107--1135, 2003.

Digital Library

[7]

Feng, H.M., Shi, R., Chua, T.S. A bootstrapping framework for annotating and retrieving WWW images. ACM Multimedia, 2004.

Digital Library

[8]

Huang J., Kumar S. R., Mitra M., Zhu W. J. and Zabih R. Image indexing using color correlograms. IEEE Conf. on Computer Vision and Pattern Recognition, pp762--765, 1997.

Digital Library

[9]

Kearns, M., and Ron, D. Algorithmic stability and sanity-check bounds for leave-one-out cross-validation. Neural Computation, 11(6):1427--1453, 1999.

Digital Library

[10]

Lin, W.H., Jin, R., and Hauptmann, A. Web image retrieval re-ranking with relevance model. WI'03, pp242--248, 2003.

Digital Library

[11]

Lu, Y., Hu, C.H., Zhu, X.Q., Zhang, H-J., and Yang, Q. A unified framework for semantics and feature based relevance feedback in image retrieval systems. ACM Multimedia 2000.

Digital Library

[12]

Sclaroff, S., Cascia, M.L., and Sethi, S. Unifying textual and visual cues for content-based image retrieval on the World Wide Web. Computer Vision and Image Understanding, 75(1/2), pp86--98, 1999.

Digital Library

[13]

Singhal, A. Modern information retrieval: A brief overview. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering, 24(4):35--43, 2001.

[14]

Smith, J.R., and Chang, S.F. WebSeek: visually searching the Web for content, IEEE Multimedia, 4(3):12--20, 1997.

Digital Library

[15]

Steven M. Beitzel, Eric C. Jensen, Abdur Chowdhury, David Grossman, Ophir Frieder, Hourly analysis of a very large topically categorized Web query log. SIGIR, pp321--328, 2004.

Digital Library

[16]

Tsymbalenko, Y., and Munson, E.V. Using HTML metadata to find relevant images on the Web. Proc. of Internet Computing 2001, Vol.II, pp.842--848, June 2001.

[17]

Yanai, K. Image collector II: an over-one-thousand-image-gathering system. WWW2003, Budapest Hungary, 2003.

[18]

Yanai, K. Web image mining toward generic image recognition. WWW, May 2003.

[19]

Yu H., Li M., Zhang H. and Feng J. Color texture moment for content-based image retrieval. ICIP, September, 2002.

[20]

Zhang L., Lin F. and Zhang B. A CBIR method based on color-spatial feature. TENCON'99, pp166--169, 1999.

[21]

Altavista image: http://www.altavista.com/images

[22]

Ditto: http://ditto.com/

[23]

Google image search: http://images.google.com

[24]

http://www.google.com/press/zeitgeist.html

[25]

Yahoo image search: http://images.yahoo.com

[26]

PicSearch: http://www.picsearch.com

Cited By

Li RXu WLu JZhang YLu Z(2009)Technique of Large-scale Image Set Construction Based on Web Image Searching EngineProceedings of the 2009 Eigth IEEE/ACIS International Conference on Computer and Information Science10.1109/ICIS.2009.13(622-626)Online publication date: 1-Jun-2009
https://dl.acm.org/doi/10.1109/ICIS.2009.13
André PCutrell ETan DSmith G(2009)Designing Novel Image Search Interfaces by Understanding Unique Characteristics and UsageProceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II10.1007/978-3-642-03658-3_40(340-353)Online publication date: 20-Aug-2009
https://dl.acm.org/doi/10.1007/978-3-642-03658-3_40

Index Terms

Similarity space projection for web image search and annotation
1. Information systems
  1. Information retrieval
    1. Information retrieval query processing
    2. Retrieval models and ranking

Recommendations

Correlated multi-label refinement for semantic noise removal
ICIC'10: Proceedings of the Advanced intelligent computing theories and applications, and 6th international conference on Intelligent computing

Images are major source of Web content. Image annotation is an important issue which is adopted to retrieve images from large image collections based on the keyword annotations of images, which access a large image data-base with textual queries. With ...
Web image retrieval systems with automatic web image annotating techniques

Due to the popularity of digital cameras and web authors'enriching the visual aesthetics, the number of web images is growing in an uncontrolled speed. The images in the World Wide Web are becoming a large image library for browsing. It is an important ...
A graph-based image annotation framework

Automatic image annotation is crucial for keyword-based image retrieval because it can be used to improve the textual description of images. In this paper, we propose a unified framework for image annotation, which contains two kinds of learning ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MIR '05: Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval

November 2005

274 pages

ISBN:1595932445

DOI:10.1145/1101826

General Chairs:
Hongjiang Zhang
Microsoft Research Advanced Technology Center, China
,
John Smith
IBM T. J. Watson Research Center, Hawthorne, NY, USA
,
Qi Tian
University of Texas at San Antonio, San Antonio, TX, USA

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 November 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM&Sec '05

Sponsor:

MM&Sec '05: Multimedia and Security Workshop 2005

November 10 - 11, 2005

Hilton, Singapore

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
471
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li RXu WLu JZhang YLu Z(2009)Technique of Large-scale Image Set Construction Based on Web Image Searching EngineProceedings of the 2009 Eigth IEEE/ACIS International Conference on Computer and Information Science10.1109/ICIS.2009.13(622-626)Online publication date: 1-Jun-2009
https://dl.acm.org/doi/10.1109/ICIS.2009.13
André PCutrell ETan DSmith G(2009)Designing Novel Image Search Interfaces by Understanding Unique Characteristics and UsageProceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II10.1007/978-3-642-03658-3_40(340-353)Online publication date: 20-Aug-2009
https://dl.acm.org/doi/10.1007/978-3-642-03658-3_40

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten