short-paper

Smart batch tagging of photo albums

Authors:

Xian-Sheng Hua,

Hong-Jiang ZhangAuthors Info & Claims

MM '09: Proceedings of the 17th ACM international conference on Multimedia

Pages 809 - 812

https://doi.org/10.1145/1631272.1631420

Published: 19 October 2009 Publication History

Abstract

As one of the emerging Web 2.0 activities, tagging becomes a popular approach to manage personal media data, such as photo albums. However, exhaustively tagging all photos in an album is a labor-intensive and time-consuming task, and simply entering tags for the whole album will significantly degrade the tagging accuracy. In this paper, we propose a smart batch tagging scheme that aims at facilitating users in album tagging. For a given album, it selects a set of representative exemplars for manual tagging, where the number of exemplars is dependent on the content of the photos.Then the tags of the rest photos are automatically inferred.In this way, the number of tagged photos is significantly reduced and we will show that high tagging accuracy can still be maintained. Therefore, a good trade-off between manual efforts and tagging performance can be achieved. Experimental results have demonstrated the effectiveness and usefulness of the proposed approach.

References

[1]

Flickr. http://www.flickr.com.

[2]

J. Li and J. Z. Wang. Real-Time Computerized Annotation of Pictures. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol, 30, no. 6, 2008.

Digital Library

[3]

J. Jeon, V. Lavrenko and R. Manmatha. Automatic Image Annotation and Retrieval using Cross--media Relevance Models. In Proceedings of SIGIR, 2003.

Digital Library

[4]

J. M. Jia, N. H. Yu and X. S. Hua. Annotating Personal Albums via Web Mining. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.

Digital Library

[5]

R. Yan, A. Natsev and M. Campbell. A Learning-based Hybrid Tagging and Browsing Approach for Efficient Manual Image Annotation. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2008.

[6]

M. Ames and M. Naaman. Why We Tag: Motivations for Annotation in Mobile and Online Media. In Proceedings of the SIGCHI Conference on Human Factors in Computing System, 2007.

Digital Library

[7]

L. S. Kennedy, S. F. Chang and I. V. Kozintsev. To Search or To Label? Precdicting the Performance of Search-Based Automatic Image Classifiers. In Proceedings of the 8th ACM International Workshop on Multimedia information retrieval, 2006.

Digital Library

[8]

D. Liu, X. S. Hua, L. J. Yang, M. Wang and H. J. Zhang. Tag Ranking. In Proceedings of ACM International World Wide Web Conference, 2009.

Digital Library

[9]

B. Sigurbjornsson and R. V. Zwol. Flickr Tag Recommendation based on Collective Knowledge. In Proceedings of ACM International World Wide Web Conference, 2008.

Digital Library

[10]

H. M. Chen, M. H. Chang, P. C. Chang, M. C. Tien, W. H. Hsu and J. L. Wu. SheepDog-Group and Tag Recommendation for Flickr Photos by Automatic Search-based Learning. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.

Digital Library

[11]

B. J. Frey and D. Dueck. Clustering by Passing Messages between Data Points. In Science, vol. 315, 2007.

[12]

Y. Jia, J. D. Wang, C. S. Zhang and X. S. Hua. Finding Image Exemplars using Fast Sparse Affinity Propagation. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.

Digital Library

[13]

W. T. Chu and C. H. Lin. Automatic Selection of Representative Photo and Smart Thumbnailing Using Near-duplicate Detection. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.

Digital Library

[14]

L. L. Cao, J. B. Luo and T. S. Huang. Annotating Photo Collections by Label Propagation according to Multiple Similarity Cues. In Proceedings of the 15th ACM International Conference on Multimedia, 2008.

Digital Library

[15]

X. J. Zhu, Z. Ghahramani and J. Lafferty. Semi-supervised Learning using Gaussian Fields and Harmonic Functions. In Proceedings of the International Conference on Machine Learning, 2003.

[16]

J. B. Shi and J. Malik. Normalized Cuts and Image Segmentation. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.22, no.8, 2000.

Digital Library

Cited By

Zhang YWang YZhang HZhu BChen SZhang D(2022)OneLabeler: A Flexible System for Building Data Labeling ToolsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517612(1-22)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517612
Zhang YCoecke BChen M(2021)MI3: Machine-initiated Intelligent Interaction for Interactive Classification and Data ReconstructionACM Transactions on Interactive Intelligent Systems10.1145/341284811:3-4(1-34)Online publication date: 3-Sep-2021
https://dl.acm.org/doi/10.1145/3412848
Liang JJiang LCao LKalantidis YLi LHauptmann A(2019)Focal Visual-Text Attention for Memex Question AnsweringIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2018.289062841:8(1893-1908)Online publication date: 1-Aug-2019
https://doi.org/10.1109/TPAMI.2018.2890628
Show More Cited By

Index Terms

Smart batch tagging of photo albums
1. Information systems
  1. Information retrieval
    1. Document representation

Recommendations

Tagging photos using users' vocabularies

Online social image share websites such as Flickr and Panoramio allow users to manually annotate their images with their own words, which can be used to facilitating image retrieval and other image applications. The smart-phones have made it possible ...
Semi-Automatic Tagging of Photo Albums via Exemplar Selection and Tag Inference

As one of the emerging Web 2.0 activities, tagging becomes a popular approach to manage personal media data, such as photo albums. A dilemma in tagging behavior is the users' manual efforts and the tagging accuracy: exhaustively tagging all photos in an ...
Automatic tag expansion using visual similarity for photo sharing websites

In this paper we present an automatic photo tag expansion method designed for photo sharing websites. The purpose of the method is to suggest tags that are relevant to the visual content of a given photo at upload time. Both textual and visual cues are ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '09: Proceedings of the 17th ACM international conference on Multimedia

October 2009

1202 pages

ISBN:9781605586083

DOI:10.1145/1631272

General Chairs:
Wen Gao
Peking University, China
,
Yong Rui
Microsoft, China
,
Alan Hanjalic
Delft University of Technology, The Netherlands
,
Program Chairs:
Changsheng Xu
Institute of Automation, Chinese Academy of Sciences, China
,
Eckehard Steinbach
Technical University of Munich, Germany
,
Abdulmotaleb El Saddik
University of Ottawa, Canada
,
Michelle Zhou
IBM T. J. Watson Research Center, USA

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM09

Sponsor:

SIGMM

MM09: ACM Multimedia Conference

October 19 - 24, 2009

Beijing, China

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
327
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang YWang YZhang HZhu BChen SZhang D(2022)OneLabeler: A Flexible System for Building Data Labeling ToolsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517612(1-22)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517612
Zhang YCoecke BChen M(2021)MI3: Machine-initiated Intelligent Interaction for Interactive Classification and Data ReconstructionACM Transactions on Interactive Intelligent Systems10.1145/341284811:3-4(1-34)Online publication date: 3-Sep-2021
https://dl.acm.org/doi/10.1145/3412848
Liang JJiang LCao LKalantidis YLi LHauptmann A(2019)Focal Visual-Text Attention for Memex Question AnsweringIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2018.289062841:8(1893-1908)Online publication date: 1-Aug-2019
https://doi.org/10.1109/TPAMI.2018.2890628
Tang JChen QWang MYan SChua TJain R(2013)Towards optimizing human labeling for interactive image taggingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/2501643.25016519:4(1-18)Online publication date: 19-Aug-2013
https://dl.acm.org/doi/10.1145/2501643.2501651
Zha ZTian QCai JWang Z(2013)Interactive social group recommendation for Flickr photosNeurocomputing10.1016/j.neucom.2012.06.039105(30-37)Online publication date: 1-Apr-2013
https://dl.acm.org/doi/10.1016/j.neucom.2012.06.039
Wang MJi DTian QHua X(2012)Intelligent photo clustering with user interaction and distance metric learningPattern Recognition Letters10.1016/j.patrec.2011.02.01233:4(462-470)Online publication date: 1-Mar-2012
https://dl.acm.org/doi/10.1016/j.patrec.2011.02.012
Wang MYang K(2012)Constructing visual tag dictionary by mining community-contributed media corpusNeurocomputing10.1016/j.neucom.2011.03.05995(3-10)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.1016/j.neucom.2011.03.059
Cai JZha ZTian QWang Z(2011)Semi-automatic flickr group suggestionProceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II10.5555/1950054.1950065(77-87)Online publication date: 5-Jan-2011
https://dl.acm.org/doi/10.5555/1950054.1950065
Sawant NLi JWang J(2011)Automatic image semantic interpretation using social action and tagging dataMultimedia Tools and Applications10.1007/s11042-010-0650-851:1(213-246)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1007/s11042-010-0650-8
Cai JZha ZTian QWang Z(2011)Semi-automatic Flickr Group SuggestionAdvances in Multimedia Modeling10.1007/978-3-642-17829-0_8(77-87)Online publication date: 2011
https://doi.org/10.1007/978-3-642-17829-0_8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents