Article

The use of topic evolution to help users browse and find answers in news video corpus

Authors:

Jintao LiAuthors Info & Claims

MM '07: Proceedings of the 15th ACM international conference on Multimedia

Pages 198 - 207

https://doi.org/10.1145/1291233.1291278

Published: 29 September 2007 Publication History

Abstract

Earlier research in news video has been focusing mainly on improving retrieval accuracies given the limited amount of extractable video semantics. In this paper, we propose an enhancement to news video searching by leveraging extractable video semantics coupled with relevant external information resources to support event-based analysis; leading to discovery of topic hierarchy for browsing key events and supporting question answering (QA). We introduce topic browsing based on news structures obtained through hierarchical clustering and threading, with emphasis on interesting events determined by measuring the amount of "web activities" on these events on Blog sites. For QA, we employ extensive query analysis to obtain various query features in addition to the topic hierarchical structures to answer both context-oriented and visual-oriented questions. Our main contributions includes: (a) combining multimodal event information extracted from news video, web news articles and news blogs to support event analysis, (b) introducing topic evolution browsing based on users' interest and (c) extending QA on top of topic hierarchy to handle various types of specialized video queries. Experiments performed on 70 hours of multilingual news from TRECVID 2005 dataset shows that the proposed approach is effective and appealing to users.

References

[1]

J. Adcock, M. Cooper, A. Girgensohn, and L. Wilox. "Interactive Video Search Using Multilevel Indexing" CIVR 2005, Singapore, 205--214, July 2005.

[2]

J. Allan, R. Papka and V. Lavrenko, "On-Line New Event Detection and Tracking" SIGIR 1998, Melbourne, Australia, 37--45, 1998.

Digital Library

[3]

A. Amir, G. Iyengar, J. Argillander, M. Campbell, A. Haubold, S. Ebadollahi, F. Kang, M. R. Naphade, A. P. Natsev, J. R Smith, J. Tesic, T. Volkmer, "IBM research TRECVID - 2005 video retrieval system" TRECVID 2005 Workshop, NIST, USA Nov 2005.

[4]

AQUAINT, http://www.ldc.upenn.edu/Catalog/docs/

[5]

A. Bocker, S. Derksen, E. Schmidt, A. Teckentrup, G. Schneider, "A Hierarchical clustering Approach for Large Compound Libraries," Journal of CIM, 807--815, 2005.

[6]

H. Bruce, "Perceptions of the Internet: What People Think When They Search the Internet for Information" Internet Research: Electronic Networking Applications & Policy, Vol 9, 187--199. 1999.

[7]

L. Chaisorn, T. S. Chua and C. H. Lee, "The segmentation of news video into story units" ICME 2002, Ischia, Italy, Jul 2002.

[8]

M. G. Christel, A. G. Hauptmann, H. D. Wactlar and T. D. Ng, "Collages as Dynamic Summaries for News Video" ACM Multimedia 2002, 561--569, Juan-les-Pins, France, Dec 2002.

Digital Library

[9]

T. S. Chua, S. Y. Neo, H. K. Goh, M. Zhao, Y. Xiao, G. Wang, "TRECVID 2005 by NUS PRIS" TRECVID 2005 Workshop, NIST, USA Nov 2005.

[10]

W. B Croft, H. R. Turtle, D. D. Lewis, "The use of phrases and structured queries in information retrieval" ACM SIGIR 1991, Chicago, USA, 32--45, 1991.

Digital Library

[11]

A. Davis, P. Pennert, R. Rubinoff, T. Sibley, E. Tzoukemann, "Retrieving what is relevant in audio and video: statistics and linguistics in combination". RIAO'2004.

[12]

C. Fellbaum. WordNet: An Electronic Lexical Database. MIT Press 98.

[13]

Flickr, http://www.flickr.com

[14]

S. Har-Peled, B. Sadri, "How Fast Is the k-Means Method?" Algorithmica 41, Vol.3, 185--202, Jan. 2005.

Digital Library

[15]

W. H. Hsu, L. Kennedy, S. F. Chang, M. Franz, and J. Smith, "Columbia-IBM News Video Story Segmentation in TRECVID 2004", Columbia ADVENT Technical Report, New York 2005

[16]

C. Kenneth and P. Hanks, "Word Association Norms, Mutual Information, and Lexicography," ACL, 1989

[17]

LSCOM Lexicon http://www.ee.columbia.edu/dvmm/lscom

[18]

J. McCarley, M. Franz. "Influence of speech recognition errors on topic detection". SIGIR 2000, 342--344, New York, NY, USA, 2000.

Digital Library

[19]

S. Y. Neo, Y. Zheng, T. S. Chua, Q. Tian, "News Video Search with Fuzzy Event Clustering using High-level Features" ACM Multimedia 2006, Santa Barbara, USA, 23--27 Oct 2006.

Digital Library

[20]

S. Y. Neo, J. Zhao, M. Y. Kan, T. S. Chua, "Video Retrieval Using High-level features, "Exploiting Query-matching and Confidence-based Weighting", CIVR 2006, Arizona, USA, 143--152, July 2006.

Digital Library

[21]

C. Petersohn. "Fraunhofer HHI at TRECVID 2004: Shot Boundary Detection System" TRECVID 2004 Workshop, NIST, US, Nov 2005

[22]

P. Resnik, "Semantic similarity in a taxonomy: An information-based measure and its applications to problems of ambiguity in natural language" Journal of Artificial Intelligence Research, 95--130, Nov 1999.

[23]

Technorati, http://www.technorati.com

[24]

TREC, Text Retrieval Conference, http://trec.nist.gov

[25]

TRECVID, TREC Video Retrieval Evaluation, http://www-nlpir.nist.gov/projects/trecvid

[26]

Vivisimo, http://www.vivisimo.com

[27]

H. D. Wactlar, A. G. Hauptman, M. G. Christel, R. A. Houghton, and A. M. Olligschlaeger, "Complementary video and audio analysis from Broadcast News Archives" Comm. of ACM, Vol 43. No. 2, 42--47, Feb 2000.

Digital Library

[28]

Wikipedia News, http://en.wikipedia.org/wiki/Nov_04

[29]

R. Yan, J. Yang, and A. G. Hauptmann, "Learning Query-Class Dependent Weights for Automatic Video Retrieval" ACM Multimedia 2004, New York, Oct 2004.

Digital Library

[30]

H. Yang, L.Chaisorn, Y. Zhao, S.-Y. Neo, T. S. Chua, "VideoQA: question answering on news video" ACM Multimedia 2003, Berkeley, USA, 632--641, Nov 2003.

Digital Library

[31]

H. Yang, T. Chua, S. Wang and C. Koh. "Structured use of external knowledge for event-based open-domain question-answering" SIGIR 2003, Canada, Jul 2003.

Digital Library

[32]

M. Zhao, S. Y. Neo, H. K. Goh, T. S. Chua, "Multi-Faceted Contextual Model for Person Identification in News Video" MMM 2006, Beijing, China, 2006.

Cited By

Li BWeng YGuo HSun BLi SLuo YQi MLiu XHan YLiang HGao SChen C(2023)Overview of the NLPCC 2023 Shared Task: Chinese Medical Instructional Video Question AnsweringNatural Language Processing and Chinese Computing10.1007/978-3-031-44699-3_21(233-242)Online publication date: 12-Oct-2023
https://dl.acm.org/doi/10.1007/978-3-031-44699-3_21
Geller MVasconcelos VPinheiro F(2023)Toxicity in Evolving Twitter TopicsComputational Science – ICCS 202310.1007/978-3-031-36027-5_4(40-54)Online publication date: 26-Jun-2023
https://doi.org/10.1007/978-3-031-36027-5_4
Xiao KQian ZQin B(2022)A Survey of Data Representation for Multi-Modality Event Detection and EvolutionApplied Sciences10.3390/app1204220412:4(2204)Online publication date: 20-Feb-2022
https://doi.org/10.3390/app12042204
Show More Cited By

Index Terms

The use of topic evolution to help users browse and find answers in news video corpus
1. Information systems
  1. Information retrieval
    1. Information retrieval query processing
    2. Retrieval models and ranking

Recommendations

Discovering Event Evolution Graphs Based on News Articles Relationships
ICEBE '14: Proceedings of the 2014 IEEE 11th International Conference on e-Business Engineering

There are many news articles reported online everyday. Within an ongoing topic, people can find a huge amount of news articles. A topic often consists of several events, and people are interested in the whole evolution of a topic along a timeline. This ...
Discovering event evolution graphs from news corpora

Given the advance of Internet technologies, we can now easily extract hundreds or thousands of news stories of any ongoing incidents from newswires such as CNN.com, but the volume of information is too large for us to capture the blueprint. Information ...
Topic chains for understanding a news corpus
CICLing'11: Proceedings of the 12th international conference on Computational linguistics and intelligent text processing - Volume Part II

The Web is a great resource and archive of news articles for the world. We present a framework, based on probabilistic topic modeling, for uncovering the meaningful structure and trends of important topics and issues hidden within the news archives on ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '07: Proceedings of the 15th ACM international conference on Multimedia

September 2007

1115 pages

ISBN:9781595937025

DOI:10.1145/1291233

General Chairs:
Rainer Lienhart
University of Augsburg, Germany
,
Anand R. Prasad
DoCoMo Euro-Labs,Germany
,
Program Chairs:
Alan Hanjalic
Delft University of Technology, The Netherlands
,
Sunghyun Choi
Seoul National University, South Korea
,
Brian Bailey
University of Illinois at Urbana-Champaign
,
Nicu Sebe
University of Amsterdam, The Netherlands

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 September 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM07

Sponsor:

MM07: The 15th ACM International Conference on Multimedia 2007

September 25 - 29, 2007

Augsburg, Germany

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
531
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li BWeng YGuo HSun BLi SLuo YQi MLiu XHan YLiang HGao SChen C(2023)Overview of the NLPCC 2023 Shared Task: Chinese Medical Instructional Video Question AnsweringNatural Language Processing and Chinese Computing10.1007/978-3-031-44699-3_21(233-242)Online publication date: 12-Oct-2023
https://dl.acm.org/doi/10.1007/978-3-031-44699-3_21
Geller MVasconcelos VPinheiro F(2023)Toxicity in Evolving Twitter TopicsComputational Science – ICCS 202310.1007/978-3-031-36027-5_4(40-54)Online publication date: 26-Jun-2023
https://doi.org/10.1007/978-3-031-36027-5_4
Xiao KQian ZQin B(2022)A Survey of Data Representation for Multi-Modality Event Detection and EvolutionApplied Sciences10.3390/app1204220412:4(2204)Online publication date: 20-Feb-2022
https://doi.org/10.3390/app12042204
Pal RSekh ADogra DKar SRoy PPrasad D(2021)Topic-based Video AnalysisACM Computing Surveys10.1145/345908954:6(1-34)Online publication date: 13-Jul-2021
https://dl.acm.org/doi/10.1145/3459089
Ren HRenoust BMelançon GViaud MSatoh SBoll SMu Lee KLuo JZhu WByun HWen Chen CLienhart RMei T(2018)Exploring Temporal Communities in Mass Media ArchivesProceedings of the 26th ACM international conference on Multimedia10.1145/3240508.3241392(1247-1249)Online publication date: 15-Oct-2018
https://dl.acm.org/doi/10.1145/3240508.3241392
Zhou HYu HHu RHu J(2017)A survey on trends of cross-media topic evolution mapKnowledge-Based Systems10.1016/j.knosys.2017.03.009124:C(164-175)Online publication date: 15-May-2017
https://dl.acm.org/doi/10.1016/j.knosys.2017.03.009
Cao JZhang YJi RXie FSu Y(2016)Web video topics discovery and structuralization with social networkNeurocomputing10.1016/j.neucom.2014.10.103172(53-63)Online publication date: Jan-2016
https://doi.org/10.1016/j.neucom.2014.10.103
Wang MHong RLi GZha ZYan SChua T(2012)Event Driven Web Video Summarization by Tag Localization and Key-Shot IdentificationIEEE Transactions on Multimedia10.1109/TMM.2012.218504114:4(975-985)Online publication date: 1-Aug-2012
https://dl.acm.org/doi/10.1109/TMM.2012.2185041
Nack FIde ICandan KPanchanathan SPrabhakaran BSundaram HFeng WSebe N(2011)Why did the prime minister resign?Proceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072340(313-322)Online publication date: 28-Nov-2011
https://dl.acm.org/doi/10.1145/2072298.2072340
Tan SNgo CTan HPang LCandan KPanchanathan SPrabhakaran BSundaram HFeng WSebe N(2011)Cross media hyperlinking for search topic browsingProceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072331(243-252)Online publication date: 28-Nov-2011
https://dl.acm.org/doi/10.1145/2072298.2072331
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents