Cited By
View all- Qian XLiu XMa XLu DXu C(2016)What Is Happening in the Video? —Annotate Video by SentenceIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2015.247581526:9(1746-1757)Online publication date: 1-Sep-2016
What is happening: annotating images with verbs
Pages 1077 - 1080
Abstract
Image annotation has been widely investigated to discover the semantics of an image. However, most of the existing algorithms focus on noun tags (e.g. concepts and objects). Since an image is a snapshot of the real world event, annotating images with verbs will enable richer understanding of an image. In this paper, we propose a data-driven approach to verb oriented image annotation. At first, we obtain verb candidates by generating search queries for a given image with initial noun tags and establishing a sentence corpus from those queries. We utilize visualness to filter tags which are not visually presentable (e.g. pain) and differentiate tags into two categories (i.e. scene based and object based) to impose linguistic rules in verb extraction. Then we further re-rank the candidate verbs with the tag context discovered from the images which are both semantically and visually similar to the given image in the MIRFlickr dataset. Our experimental results from user study demonstrate that our proposed approach is promising.
References
[1]
J. K. Aggarwal and M. S. Ryoo. Human activity analysis. ACM Computing Surveys, 43(3), 2011.
[2]
K. Deschacht and M.-F. Moens. Text analysis for automatic image annotation. In the 45th Annual Meeting of the Association of Computational Linguistics, 2007.
[3]
J. J. Jiang and D. W. Conrath. Semantic similarity based on corpus statistics and lexical taxonomy. In the International Conference Research on Computational Linguistics, 1997.
[4]
L. S. Kennedy, S.-F. Chang, and I. V. Kozintsev. To search or to label? predicting the performance of search-based automatic image classifiers. In the 8th ACM international workshop on Multimedia information retrieval, 2006.
[5]
D. Lin. An information-theoretic definition of similarity. In the 15th International Conference on Machine Learning, 1998.
[6]
Y. Ushiku, T. Harada, and Y. Kuniyoshi. Automatic sentence generation from images. In the 19th ACM international conference on Multimedia, 2011.
[7]
X.-J. Wang, L. Zhang, X. Li, and W.-Y. Ma. Annotating images by mining image search results. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(11):1919--1932, November 2008.
[8]
Z. Wang and D. Feng. Discovering semantics from visual information. In Machine Learning: Concepts, Methodologies, Tools and Applications, chapter 8.8, pages 1981--2009. 2012.
[9]
D. Zhang, M. M. Islam, and G. Lu. A review on automatic image annotation techniques. Pattern Recognition, 45(1):346--362, 2012.
Index Terms
- What is happening: annotating images with verbs
Recommendations
A method for enhancing image retrieval based on annotation using modified WUP similarity in WordNet
AIKED'12: Proceedings of the 11th WSEAS international conference on Artificial Intelligence, Knowledge Engineering and Data BasesImages are the most common contents on the Internet for a long time. Lots of researchers have been studied to satisfy user demands for semantic visual recognition using low-level feature (such as color or texture) or keywords which were textual ...
Image distance metric learning based on neighborhood sets for automatic image annotation
Display Omitted Knowledge of the samples with and without caption is sufficiently considered.The number of labels is completely determined by the image content.The proposed AIA approach can automatically implemented. Since there is semantic gap between ...
Methods for extracting and classifying pairs of cognates and false friends
The identification of cognates has attracted the attention of researchers working in the area of Natural Language Processing, but the identification of false friends is still an under-researched area. This paper proposes novel methods for the automatic ...
Comments
Information & Contributors
Information
Published In
October 2012
1584 pages
ISBN:9781450310895
DOI:10.1145/2393347
- General Chairs:
- Noboru Babaguchi,
- Kiyoharu Aizawa,
- John Smith,
- Program Chairs:
- Shin'ichi Satoh,
- Thomas Plagemann,
- Xian-Sheng Hua,
- Rong Yan
Copyright © 2012 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 October 2012
Check for updates
Author Tags
Qualifiers
- Poster
Conference
MM '12
Sponsor:
Acceptance Rates
Overall Acceptance Rate 995 of 4,171 submissions, 24%
Upcoming Conference
MM '24
- Sponsor:
- sigmm
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 197Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 26 Sep 2024
Other Metrics
Citations
Cited By
View all- Qian XLiu XMa XLu DXu C(2016)What Is Happening in the Video? —Annotate Video by SentenceIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2015.247581526:9(1746-1757)Online publication date: 1-Sep-2016
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in