research-article

The MIR flickr retrieval evaluation

Authors:

Mark J. Huiskes,

Michael S. LewAuthors Info & Claims

MIR '08: Proceedings of the 1st ACM international conference on Multimedia information retrieval

Pages 39 - 43

https://doi.org/10.1145/1460096.1460104

Published: 30 October 2008 Publication History

Get Access

Abstract

In most well known image retrieval test sets, the imagery typically cannot be freely distributed or is not representative of a large community of users. In this paper we present a collection for the MIR community comprising 25000 images from the Flickr website which are redistributable for research purposes and represent a real community of users both in the image content and image tags. We have extracted the tags and EXIF image metadata, and also make all of these publicly available. In addition we discuss several challenges for benchmarking retrieval and classification methods.

References

[1]

P. CLOUGH, H. MUELLER, AND M. SANDERSON. 2004. The CLEF cross-language image retrieval track (imageCLEF) 2004. In Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004), LNCS, New York, NY, USA, ACM Press.

Crossref

Google Scholar

[2]

M. S. LEW, N. SEBE, C. DJERABA, AND R. JAIN. 2006. Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl., 2(1):1---19.

Digital Library

Google Scholar

[3]

S. MARCHAND-MAILLET. 2005. The Benchathlon Network. http://www.benchathlon.net.

Google Scholar

[4]

S. MARCHAND-MAILLET AND M. WORRING. 2006. Benchmarking image and video retrieval: an overview. In MIR '06: Proceedings of the 8th ACM international workshop on Multimedia information retrieval, pages 297--300, New York, NY, USA. ACM Press.

Digital Library

Google Scholar

[5]

H. MÜLLER, S. MARCHAND-MAILLET, AND T. PUN. 2002. The truth about Corel - evaluation in image retrieval. In: CIVR '02: Proceedings of the International Conference on Image and Video Retrieval, pages 38--49, London, UK. Springer-Verlag.

Digital Library

Google Scholar

[6]

X. ZHOU AND T. HUANG. 2003. Relevance feedback in image retrieval: a comprehensive review. ACM Multimedia Systems Journal, 8(6):536--544, April.

Crossref

Google Scholar

[7]

A. F. SMEATON, P. OVER, AND W. KRAAIJ. 2006. Evaluation campaigns and TRECVid. In MIR '06: Proceedings of the 8th ACM international workshop on Multimedia information retrieval, pages 321--330, New York, NY, USA. ACM Press.

Digital Library

Google Scholar

[8]

C. H. C. LEUNG AND H. H.-S. IP. 2000. Benchmarking for content-based visual information search. In VISUAL'00: Proceedings of the 4th International Conference on Advances in Visual Information Systems, pages 442--456, London, UK. Springer-Verlag.

Digital Library

Google Scholar

[9]

C. FLUHR, P.-A. MOELLIC, AND P. HEDE. 2006. Usage oriented multimedia information retrieval technological evaluation. In MIR '06: Proceedings of the 8th ACM international workshop on Multimedia information retrieval, pages 301--306, New York, NY, USA. ACM Press.

Digital Library

Google Scholar

[10]

M. J. HUISKES AND M. S. LEW (2008). "Performance Evaluation of Relevance Feedback Methods", ACM International Conference on Content-Based Image and Video Retrieval (CIVR'08), pages 239--248, Niagara Falls, Canada.

Digital Library

Google Scholar

[11]

K. SPARCK JONES AND C. VAN RIJSBERGEN (1975). Report on the need for and provision of an ideal information retrieval test collection. British Library Research and Development Report 5266, Computer Laboratory, University of Cambridge.

Google Scholar

[12]

P. SINHA AND R. JAIN (2008). Classification and annotation of digital photos using optical context data. ACM International Conference on Content-Based Image and Video Retrieval (CIVR '08), pages 309--318, Niagara Falls, Canada.

Digital Library

Google Scholar

[13]

J. YEN, P. WU, AND D. TRETTER (2007) Knowledge discovery for better photographs, Proc. SPIE 6506, 65060B.

Crossref

Google Scholar

Cited By

View all

Connor RDearle AClaydon BVadicamo L(2024)Correlations of Cross-Entropy Loss in Machine LearningEntropy10.3390/e2606049126:6(491)Online publication date: 3-Jun-2024
https://doi.org/10.3390/e26060491
Wu RZhu XYi ZZou ZLiu YZhu L(2024)Multi-Grained Similarity Preserving and Updating for Unsupervised Cross-Modal HashingApplied Sciences10.3390/app1402087014:2(870)Online publication date: 19-Jan-2024
https://doi.org/10.3390/app14020870
Ren DXu W(2024)Cross-modal retrieval based on multi-dimensional feature fusion hashingFrontiers in Physics10.3389/fphy.2024.137987312Online publication date: 19-Jun-2024
https://doi.org/10.3389/fphy.2024.1379873
Show More Cited By

Index Terms

The MIR flickr retrieval evaluation

Recommendations

New trends and ideas in visual concept detection: the MIR flickr retrieval evaluation initiative
MIR '10: Proceedings of the international conference on Multimedia information retrieval

The MIR Flickr collection consists of 25000 high-quality photographic images of thousands of Flickr users, made available under the Creative Commons license. The database includes all the original user tags and EXIF metadata. Additionally, detailed and ...
Assessment of the utility of tag clouds for faster image retrieval
MIR '10: Proceedings of the international conference on Multimedia information retrieval

Flickr™, a web-based system for online photo management, has experienced rapid growth in popularity over the past several years, due to an increase in photo sharing as a social networking tool. Part of the excitement about Flickr is due to its use of ...
Interactive content-based image retrieval using relevance feedback

Database search engines are generally used in a one-shot fashion in which a user provides query information to the system and, in return, the system provides a number of database instances to the user. A relevance feedback system allows the user to ...

Comments

Information & Contributors

Information

Published In

MIR '08: Proceedings of the 1st ACM international conference on Multimedia information retrieval

October 2008

506 pages

ISBN:9781605583129

DOI:10.1145/1460096

General Chair:
Michael S. Lew
Leiden University, The Netherlands
,
Program Chairs:
Alberto del Bimbo
University of Florence, Italy
,
Erwin M. Bakker
Leiden University, The Netherlands

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 30 - 31, 2008

British Columbia, Vancouver, Canada

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,168
Total Citations
View Citations
1,845
Total Downloads

Downloads (Last 12 months)98
Downloads (Last 6 weeks)6

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Connor RDearle AClaydon BVadicamo L(2024)Correlations of Cross-Entropy Loss in Machine LearningEntropy10.3390/e2606049126:6(491)Online publication date: 3-Jun-2024
https://doi.org/10.3390/e26060491
Wu RZhu XYi ZZou ZLiu YZhu L(2024)Multi-Grained Similarity Preserving and Updating for Unsupervised Cross-Modal HashingApplied Sciences10.3390/app1402087014:2(870)Online publication date: 19-Jan-2024
https://doi.org/10.3390/app14020870
Ren DXu W(2024)Cross-modal retrieval based on multi-dimensional feature fusion hashingFrontiers in Physics10.3389/fphy.2024.137987312Online publication date: 19-Jun-2024
https://doi.org/10.3389/fphy.2024.1379873
Liang XYang EDeng CYang Y(2024)CrossFormer: Cross-modal Representation Learning via Heterogeneous Graph TransformerACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3688801Online publication date: 20-Sep-2024
https://doi.org/10.1145/3688801
Schubhan MAltmeyer MRogers KDegraen DLessel PKrüger A(2024)Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging TaskProceedings of the ACM on Human-Computer Interaction10.1145/36770598:CHI PLAY(1-28)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3677059
Kang XLiu XXue WNie XYin Y(2024)Online Cross-modal Hashing With Dynamic PrototypeACM Transactions on Multimedia Computing, Communications, and Applications10.1145/366524920:8(1-18)Online publication date: 13-Jun-2024
https://dl.acm.org/doi/10.1145/3665249
Kawai VValem LBaldassin ABorin EPedronette DLatecki L(2024)Rank-based Hashing for Effective and Efficient Nearest Neighbor Search for Image RetrievalACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365958020:10(1-19)Online publication date: 12-Sep-2024
https://dl.acm.org/doi/10.1145/3659580
Yang HHe HZhang WWang YJing L(2024)Multi-Source and Multi-modal Deep Network Embedding for Cross-Network Node ClassificationACM Transactions on Knowledge Discovery from Data10.1145/365330418:6(1-26)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653304
Meng FChen XCao YGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)Targeted Universal Adversarial Attack on Deep Hash NetworksProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3658062(165-174)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3658062
Pegia MGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)Multimodality in Media RetrievalProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3657583(1219-1223)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3657583
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

New trends and ideas in visual concept detection: the MIR flickr retrieval evaluation initiative

Assessment of the utility of tag clouds for faster image retrieval

Interactive content-based image retrieval using relevance feedback