Multimedia information retrieval on the social web
Pages 349 - 354
Abstract
Efforts have been made to obtain more accurate results for multimedia searches on the Web. Nevertheless, not all multimedia objects have related text descriptions available. This makes bridging the semantic gap more difficult. Approaches that combine context and content information of multimedia objects are the most popular for indexing and later retrieving these objects. However, scaling these techniques to Web environments is still an open problem. In this thesis, we propose the use of user-generated content (UGC) from the Web and social platforms as well as multimedia content information to describe the context of multimedia objects. We aim to design tag-oriented algorithms to automatically tag multimedia objects, filter irrelevant tags, and cluster tags in semantically-related groups. The novelty of our proposal is centered on the design of Web-scalable algorithms that enrich multimedia context using the social information provided by users as a result of their interaction with multimedia objects. We validate the results of our proposal with a large-scale evaluation in crowdsourcing platforms.
References
[1]
T. Bracamonte and B. Poblete. Automatic image tagging through information propagation in a query log based graph structure. In Proceedings of the 19th ACM international conference on Multimedia, MM '11, pages 1201--1204. ACM, 2011.
[2]
X. Chen, Y. Mu, S. Yan, and T.-S. Chua. Efficient large-scale image annotation by probabilistic collaborative multi-label propagation. In Proceedings of the international conference on Multimedia, MM '10, pages 35--44, New York, NY, USA, 2010. ACM.
[3]
J. Cui, H. Liu, J. He, P. Li, X. Du, and P. Wang. Tagclus: a random walk-based method for tag clustering. Knowledge and Information Systems, 27:193--225, 2011.
[4]
J. Cui, F. Wen, and X. Tang. Real time google and live image search re-ranking. In Proceedings of the 16th ACM international conference on Multimedia, MM '08, pages 729--732, New York, NY, USA, 2008. ACM.
[5]
V. Hollink, T. Tsikrika, and A. P. de Vries. Semantic search log analysis: A method and a study on professional image search. Journal of the American Society for Information Science and Technology, 62(4):691--713, 2011.
[6]
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Information retrieval in folksonomies: Search and ranking. In The Semantic Web: Research and Applications, volume 4011 of Lecture Notes in Computer Science, pages 411--426. Springer Berlin / Heidelberg, 2006.
[7]
G. Koutrika, F. A. Effendi, Z. Gyöngyi, P. Heymann, and H. Garcia-Molina. Combating spam in tagging systems. In Proceedings of the 3rd international workshop on Adversarial information retrieval on the web, AIRWeb '07, pages 57--64, New York, NY, USA, 2007. ACM.
[8]
X. Li, C. Snoek, and M. Worring. Learning social tag relevance by neighbor voting. Multimedia, IEEE Transactions on, 11(7):1310--1322, nov. 2009.
[9]
D. Liu and T. Chen. Video retrieval based on object discovery. Computer Vision and Image Understanding, 113(3):397--404, 2009.
[10]
D. Liu, X.-S. Hua, M. Wang, and H.-J. Zhang. Image retagging. In Proceedings of the international conference on Multimedia, MM '10, pages 491--500, New York, NY, USA, 2010. ACM.
[11]
J. a. Magalhães and S. Rüger. An information-theoretic framework for semantic-multimedia retrieval. ACM Trans. Inf. Syst., 28(4):19:1--19:32, Nov. 2010.
[12]
B. Markines, C. Cattuto, and F. Menczer. Social spam detection. In Proceedings of the 5th International Workshop on Adversarial Information Retrieval on the Web, AIRWeb '09, pages 41--48, New York, NY, USA, 2009. ACM.
[13]
M. E. J. Newman and M. Girvan. Finding and evaluating community structure in networks. Phys. Rev. E, 69:026113, Feb 2004.
[14]
S. Papadopoulos, Y. Kompatsiaris, and A. Vakali. A graph-based clustering scheme for identifying related tags in folksonomies. In Data Warehousing and Knowledge Discovery, volume 6263 of Lecture Notes in Computer Science, pages 65--76. Springer Berlin / Heidelberg, 2010.
[15]
B. Poblete, B. Bustos, M. Mendoza, and J. M. Barrios. Visual-semantic graphs: using queries to reduce the semantic gap in web image retrieval. In Proceedings of the 19th ACM international conference on Information and knowledge management, CIKM '10, pages 1553--1556, New York, NY, USA, 2010. ACM.
[16]
Y. Shen and J. Fan. Leveraging loosely-tagged images and inter-object correlations for tag recommendation. In Proceedings of the international conference on Multimedia, MM '10, pages 5--14, New York, NY, USA, 2010. ACM.
[17]
A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12):1349--1380, 2000.
[18]
J. Surowiecki. The wisdom of crowds. Anchor Books, 2005.
[19]
T. Tsikrika, C. Diou, A. de Vries, and A. Delopoulos. Reliability and effectiveness of clickthrough data for automatic image annotation. Multimedia Tools and Applications, 55:27--52, 2011.
[20]
D. Vandic, J.-W. van Dam, F. Hogenboom, and F. Frasincar. A semantic clustering-based approach for searching and browsing tag spaces. In Proceedings of the 2011 ACM Symposium on Applied Computing, SAC '11, pages 1693--1699, New York, NY, USA, 2011. ACM.
[21]
X.-J. Wang, L. Zhang, X. Li, and W.-Y. Ma. Annotating images by mining image search results. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 30(11):1919--1932, nov. 2008.
[22]
H. Xu, J. Wang, X.-S. Hua, and S. Li. Tag refinement by regularized lda. In Proceedings of the 17th ACM international conference on Multimedia, MM '09, pages 573--576, New York, NY, USA, 2009. ACM.
[23]
X. Xu, N. Yuruk, Z. Feng, and T. A. J. Schweiger. Scan: a structural clustering algorithm for networks. In Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '07, pages 824--833, New York, NY, USA, 2007. ACM.
[24]
M. Zaveršnik and V. Batagelj. Islands. Slides from Sunbelt XXIV, Portoroz, Slovenia, 12:16, 2004.
[25]
G. Zhu, S. Yan, and Y. Ma. Image tag refinement towards low-rank, content-tag prior and error sparsity. In Proceedings of the international conference on Multimedia, MM '10, pages 461--470, New York, NY, USA, 2010. ACM.
Index Terms
- Multimedia information retrieval on the social web
Recommendations
Heterogeneous multimedia data semantics mining using content and location context
MM '08: Proceedings of the 16th ACM international conference on MultimediaBecause it is very common that the heterogeneous multimedia data of the same semantics always exist jointly in many domain and application specific databases, it is very helpful to consider the location information when analyzing multimedia data. In ...
Content-based multimedia information retrieval: State of the art and challenges
Extending beyond the boundaries of science, art, and culture, content-based multimedia information retrieval provides new paradigms and methods for searching through the myriad variety of media all over the world. This survey reviews 100+ recent ...
Multimedia information retrieval: what is it, and why isn't anyone using it?
MIR '05: Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrievalIn this paper, the participants of the panel at the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval answer questions about what multimedia is, how MIR is different from other kinds of retrieval, the most important technical ...
Comments
Information & Contributors
Information
Published In
May 2013
1636 pages
ISBN:9781450320382
DOI:10.1145/2487788
- General Chairs:
- Daniel Schwabe,
- Virgílio Almeida,
- Hartmut Glaser,
- Program Chairs:
- Ricardo Baeza-Yates,
- Sue Moon
Copyright © 2013 Copyright is held by the International World Wide Web Conference Committee (IW3C2).
Sponsors
- NICBR: Nucleo de Informatcao e Coordenacao do Ponto BR
- CGIBR: Comite Gestor da Internet no Brazil
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 May 2013
Check for updates
Author Tags
Qualifiers
- Abstract
Conference
WWW '13
Sponsor:
- NICBR
- CGIBR
Acceptance Rates
WWW '13 Companion Paper Acceptance Rate 831 of 1,250 submissions, 66%;
Overall Acceptance Rate 1,899 of 8,196 submissions, 23%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 148Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 11 Aug 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in