research-article

Cross media hyperlinking for search topic browsing

Authors:

Hung-Khoon Tan, and

Lei PangAuthors Info & Claims

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

Pages 243 - 252

https://doi.org/10.1145/2072298.2072331

Published: 28 November 2011 Publication History

Abstract

With the rapid growth of social media, there are plenty of information sources freely available online for use. Nevertheless, how to synchronize and leverage these diverse forms of information for multimedia applications remains a problem yet to be seriously studied. This paper investigates the synchronization of multiple media content in the physical form of hyperlinking them. The ultimate goal is to develop browsing systems that author search results with rich media information mined from various knowledge sources. The authoring enables the vivid visualization and exploration of different information landscapes inherent in search results. Several key techniques are studied in this paper for developing these browsing features. These techniques include content mining and selection from web videos, space-time alignment of multiple media, and augmenting of search result with when and what information. We conduct both quantitative and user studies on a large video dataset for performance evaluation. Comparison with traditional techniques including storyboard summarization and video skimming are also presented.

References

[1]

Google wonder wheel. http://www.googlewonderwheel.com/.

[2]

Wikipedia. en.wikipedia.org/.

[3]

R. K. Ahuja, T. L. Magnanti, and J. B. Orlin. Network Flows: Theory, Algorithms, and Applications. Prentice Hall, Reading, Massachusetts, 1993.

Digital Library

[4]

S. Baluja, R. Seth, D. Sivakumar, Y. Jing, J. Yagnik, S. Kumar, D. Ravichandran, and M. Aly. Video suggestion and discovery for YouTube: Taking random walks through the view graph. In WWW, 2008.

Digital Library

[5]

O. de Rooij, C. G. M. Snoek, and M. Worring. Query on demand video browsing. In ACM Multimedia, 2007.

Digital Library

[6]

O. de Rooij and M. Worring. Browsing video along multiple threads. IEEE Trans. on Multimedia, 12(2):121--130, Feb 2010.

Digital Library

[7]

P. Duygulu, J. Y. Pan, and D. A. Forsyth. Towards auto-documentary: Tracking the evolution of news stories. In ACM Multimedia, 2005.

Digital Library

[8]

A. G. Hauptmann, W. H. Lin, R. Yan, J. Yang, and M. Y. Chen. Extreme video retrieval: Joint maximization of human and computer performance. In ACM Multimedia, 2006.

Digital Library

[9]

R. Hong, J. Tang, H. K. Tan, C. W. Ngo, S. Yan, and T. S. Chua. Beyond search: Event driven summarization for web videos. ACM TOMCCAP, 2011.

Digital Library

[10]

I. Ide, T. Kinoshita, T. Takahashi, S. Satoh, and H. Murase. mediawalker: A video archive explorer based on time-series semantic structure. In ACM Multimedia, 2007.

Digital Library

[11]

I. Ide, H. Mo, N. Katayama, and S. Satoh. Topic threading for structuring a large-scale news video archive. In CIVR, 2004.

[12]

H. Jegou, M. Douze, and C. Schmid. Hamming embedding and weak geometric consistency for large scale image search. In ECCV, 2008.

Digital Library

[13]

J. R. Kender, M. L. Hill, A. Natsev, J. R. Smith, and L. Xie. Video genetics: A case study from YouTube. In ACM Multimedia, 2010.

Digital Library

[14]

Y. Li and B. Merialdo. Multi-video summarization based on AV-MMR. In CBMI, 2010.

[15]

L. Liu, L. Sun, Y. Rui, Y. Shi, and S. Yang. Web video topic discovery and tracking via bipartite graph reinforcement model. In WWW, 2008.

Digital Library

[16]

D. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60(2), Nov 2004.

Digital Library

[17]

H. B. Luan, S. Y. Neo, H. K. Goh, Y. D. Zhang, S. X. Lin, and T. S. Chua. Segregated feedback with performance-based adaptive sampling for interactive news video retrieval. In ACM Multimedia, 2007.

Digital Library

[18]

S. Y. Neo, T. Ran, and et. al. The use of topic evaluation to help users browse and find answer in news video corpus. In ACM Multimedia, 2007.

Digital Library

[19]

D. Nistĺęr and H. Stewénius. Scalable recognition with a vocabulary tree. In CVPR, 2006.

Digital Library

[20]

H. K. Tan, C. W. Ngo, R. C. Hong, and T. S. Chua. Scalable detection of partial near-duplicate videos by visual-temporal consistency. In ACM Multimedia, 2009.

Digital Library

[21]

S. Tan, H. K. Tan, and C. W. Ngo. Topical summarization of web videos by visual-text time-depedent alignment. In ACM Multimedia, 2010.

Digital Library

[22]

B. T. Truong and S. Venkatesh. Video abstraction: A systematic review and classification. ACM TOMCCAP, 3(1), 2007.

Digital Library

[23]

F. Wang and B. Merialdo. Multi-document video summarization. In ICME, 2009.

Digital Library

[24]

X. Wu, Y. Lu, Q. Peng, and C. W. Ngo. Mining event structure from web videos. IEEE Multimedia Maganize, 18(1), Jan 2011.

Digital Library

[25]

X. Wu, C. W. Ngo, A. G. Hauptmann, and H. K. Tan. Real-time near duplicate elimination for web video search with content and context. IEEE Trans. on Multimedia, 11(2):196--207, Feb 2009.

Digital Library

[26]

X. Wu, C. W. Ngo, and Q. Li. Threading and autodocumenting in news videos. IEEE Signal Processing Magazine, 23(2):59--68, Mar 2006.

[27]

C. Zhai, W. Cohen, and J. Lafferty. Beyond independent relevance: Methods and evaluation metrics for subtopic retrieval. In ACM SIGIR, 2003.

Digital Library

[28]

Y. Zhai and M. Shah. Tracking news stories across different sources. In ACM Multimedia, 2005.

Digital Library

[29]

B. Zhang, H. Li, Y. Liu, L. Ji, W. Xi, W. Fan, Z. Chen, and W.-Y. Ma. Improving web search results using affinity graph. In ACM SIGIR, 2005.

Digital Library

[30]

W. L. Zhao and C. W. Ngo. Scale-rotation invariant pattern entropy for keypoint-based near-duplicate detection. IEEE Trans. on Image Processing, 19(2), Feb 2009.

Digital Library

[31]

W. L. Zhao, X. Wu, and C. W. Ngo. On the annotation of web videos by efficient near-duplicate search. IEEE Trans. on Multimedia, 12(5), July 2010.

Digital Library

Cited By

Kavoosifar MApiletti DBaralis EGarza PHuet B(2019)Effective video hyperlinking by means of enriched feature sets and monomodal query combinationsInternational Journal of Multimedia Information Retrieval10.1007/s13735-019-00173-y9:3(215-227)Online publication date: 10-Jun-2019
https://doi.org/10.1007/s13735-019-00173-y
Bracamonte TBustos BPoblete BSchreck T(2018)Extracting semantic knowledge from web context for multimedia IRMultimedia Tools and Applications10.1007/s11042-017-4997-y77:11(13853-13889)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s11042-017-4997-y
Zhou HYu HHu RHu J(2017)A survey on trends of cross-media topic evolution mapKnowledge-Based Systems10.1016/j.knosys.2017.03.009124:C(164-175)Online publication date: 15-May-2017
https://dl.acm.org/doi/10.1016/j.knosys.2017.03.009
Show More Cited By

Index Terms

Cross media hyperlinking for search topic browsing
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

Beyond video searching: summarization and exploration
MM '11: Proceedings of the 19th ACM international conference on Multimedia
Read More
What fresh media are you looking for?: retrieving media items from multiple social networks
SAM '12: Proceedings of the 2012 international workshop on Socially-aware multimedia

Social networks play an increasingly important role for sharing media items related to daily life moments or for the live coverage of events. One of the problems is that media are spread over multiple social networks. In this paper, we propose a social ...
Read More
Folksonomy-boosted social media search and ranking
ICMR '11: Proceedings of the 1st ACM International Conference on Multimedia Retrieval

With the rapid proliferation of social media services, users on the social Web are overwhelmed by the huge amount of social media available. In this paper, we look into the potential of social tagging in social media services to help users in retrieving ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

944 pages

ISBN:9781450306164

DOI:10.1145/2072298

General Chairs:
K. Selçuk Candan
Arizona State University, USA
,
Sethuraman Panchanathan
Arizona State University, USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Hari Sundaram
Arizona State University, USA
,
Wu-Chi Feng
Portland State University, USA
,
Nicu Sebe
University of Trento, Italy

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '11

Sponsor:

SIGMM

MM '11: ACM Multimedia Conference

November 28 - December 1, 2011

Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 995 of 4,171 submissions, 24%

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
383
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Kavoosifar MApiletti DBaralis EGarza PHuet B(2019)Effective video hyperlinking by means of enriched feature sets and monomodal query combinationsInternational Journal of Multimedia Information Retrieval10.1007/s13735-019-00173-y9:3(215-227)Online publication date: 10-Jun-2019
https://doi.org/10.1007/s13735-019-00173-y
Bracamonte TBustos BPoblete BSchreck T(2018)Extracting semantic knowledge from web context for multimedia IRMultimedia Tools and Applications10.1007/s11042-017-4997-y77:11(13853-13889)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s11042-017-4997-y
Zhou HYu HHu RHu J(2017)A survey on trends of cross-media topic evolution mapKnowledge-Based Systems10.1016/j.knosys.2017.03.009124:C(164-175)Online publication date: 15-May-2017
https://dl.acm.org/doi/10.1016/j.knosys.2017.03.009
de Oliveira Barra GLux MGiro-i-Nieto X(2016)Large scale content-based video retrieval with LIvRE2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI)10.1109/CBMI.2016.7500266(1-4)Online publication date: Jun-2016
https://doi.org/10.1109/CBMI.2016.7500266
Ordelman REskevich MAly RHuet BJones GGangemi ALeonardi SPanconesi A(2015)Defining and Evaluating Video Hyperlinking for Navigating Multimedia ArchivesProceedings of the 24th International Conference on World Wide Web10.1145/2740908.2742915(727-732)Online publication date: 18-May-2015
https://dl.acm.org/doi/10.1145/2740908.2742915
Bao BXu CMin WHossain M(2015)Cross-Platform Emerging Topic Detection and Elaboration from Multimedia StreamsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/273088911:4(1-21)Online publication date: 2-Jun-2015
https://dl.acm.org/doi/10.1145/2730889
Moeller M(2015)Pushing boundaries of normalcyCommunication Design Quarterly10.1145/2721874.27218772:4(52-80)Online publication date: 13-Jan-2015
https://dl.acm.org/doi/10.1145/2721874.2721877
Frechtling MLeong P(2015)MCALIBACM Transactions on Programming Languages and Systems10.1145/266507337:2(1-25)Online publication date: 16-Apr-2015
https://dl.acm.org/doi/10.1145/2665073
Stansifer PWand M(2014)RomeoACM SIGPLAN Notices10.1145/2692915.262816249:9(53-65)Online publication date: 19-Aug-2014
https://dl.acm.org/doi/10.1145/2692915.2628162
Petricek TOrchard DMycroft A(2014)CoeffectsACM SIGPLAN Notices10.1145/2692915.262816049:9(123-135)Online publication date: 19-Aug-2014
https://dl.acm.org/doi/10.1145/2692915.2628160
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents