research-article

An instant semantics acquisition system of live soccer video with application to live event alert and on-the-fly language selection

Authors:

Hon Wai LeongAuthors Info & Claims

CIVR '08: Proceedings of the 2008 international conference on Content-based image and video retrieval

Pages 495 - 504

https://doi.org/10.1145/1386352.1386416

Published: 07 July 2008 Publication History

Abstract

Automatic indexing of recorded sports video is a hard problem, even more so for live sports video, though a lot of advances have been achieved in the recent years. This paper presents a semi-automatic instant semantics generation system of live soccer video and its two applications: live event alert and instant semantics embedding. A key technical challenge of building the proposed system is how to acquire the desired semantics in a very short time lag. To confront this challenge, we develop a three-channel approach to accurately and quickly acquire semantics. The hree channels are (1) developing the tool for inputting gamelog, (2) signal communication for getting commands of referee and director, and (3) video analysis for finding event boundary. The proposed system requires only a very small amount of manual work to operate gamelog acquisition tool using an icon-based interface for entering event log. Experimental results show that our system can quickly obtain the semantics of live soccer video, alert live events with a very small latency, and embed semantics into broadcasting video with a short time lag.

References

[1]

Assfalg J., Bertini M., Colombo C., del Bimbo D., and Nunziati W., Semantic annotation of soccer videos: automatic highlights identification, Comp. Vis. & Image U., vol. 92, pp. 285--305, 2003.

Digital Library

[2]

Babaguchi N., Kawai Y., and Kitashi T., Event based semantics of broadcasted sports video by intermodal collaboration, IEEE Trans. on Multimedia, vol. 4, pp. 68--75, March, 2002.

Digital Library

[3]

Bolle R.M., Yeo B.-L., and Yeung M.M., Video query: research directions, IBM J. of R & D, vol. 42, pp.233--252, 1998.

Digital Library

[4]

Brunelli R., Mich O., and Modena C.M., A survey of the automatic semantics of video data, J. of Vis. Com. & Image Representation 10(2), 78--112, 1999.

Digital Library

[5]

Chang S. F. The Holy Grail of content-based media analysis, IEEE Multimedia, vol. 9:2(2002), 6--10.

Digital Library

[6]

Chen S.-C, Shyu M.-L., Chen M, and Zhang C., A decision tree-based multimodal data mining framework for soccer goal detection, ICME 2004, pp. 265--268, Taibei, Taiwan, June, 2004.

[7]

Duan L., Xu M., Chua T. S., Tian Q., and Xu C., A mid-level representation framework for semantic sports video analysis, ACM Multimedia 2003, pp. 33--44, 2003.

Digital Library

[8]

Ekin A., Tekalp A. M., and Mehrotra R., Automatic soccer video analysis and summarization, IEEE Trans. Image Processing, vol. 12, no. 7, pp. 796--807, 2003.

Digital Library

[9]

Gong Y., Lim T. S., Chua H. C., Zhang H. J., and Sakauchi M., Automatic parsing of TV soccer programs, 2nd Int'l C. on Multimedia Comp. and Sys., pp. 167--174, 1995.

[10]

Leonardi R., Migliorati P., and Prandini M., Semantics acquisition of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains, CVST, vol. 14, 2004, pp: 634 -- 643.

Digital Library

[11]

Li B., Errico J., Pan H., and Sezan M. I., Bridging the semantic gap in sports video retrieval and summarization, J. of Vis. Commun. & Image Representation, vol 15, 2004, pp. 393--424.

Digital Library

[12]

Ngo C. W., Zhang H. J., and Pong T. C., Recent advances in content-based video analysis, J. of Image and Graphics, vol. 3, no. 1, pp.445--468, 2001.

[13]

Pan H., Li B., and Sezan M. I., Automatic detection of replay segments in broadcast sports programs by detection of logos in scene transitions, ICASSP 2002.

[14]

Pan H., van Beek P., and Sezan M. I., Detection of slowmotion segments in sports video for highlights generation, ICASSP 2001., vol 3, pp. 1649--1652.

Digital Library

[15]

Pingali G. S., Opalach A., Jean Y. D., and Carlbom I. B., Instantly indexed multimedia databases of real world events, IEEE Trans. Multimedia, vol. 4, pp. 269--282, June 2002.

Digital Library

[16]

Snoek C.G.M. and Worring M., Multimodal video semantics: a review of the state-of-the-art, MM Tools & App, vol. 25, pp: 5--35.

Digital Library

[17]

Tovinkere V. and Qian R. J., Detecting semantic events in soccer games: Towards a complete solution, ICME 2001, 1040--1043.

[18]

Wan K., Yan X., and Xu C., Automatic mobile sports highlights, ICME 2005.

[19]

Wang J., Xu C., Chng E.-S., Wan K.-W., and Tian Q., Automatic replay generation for soccer video broadcasting, ACM MM 2004.

Digital Library

[20]

Wang Y., Liu Z., and Huang J., Multimedia content analysis using both audio and visual cues, IEEE Signal Proc. Magazine, vol. 17, pp.12--36, 2000.

[21]

Xie L., Xu P., Chang S. F., Divakaran A., and Sun H, Structure analysis of soccer video with domain knowledge and hidden Markov models, Pattern Recognition Letters, vol. 25, 2004, pp. 767--775.

Digital Library

[22]

Xu C., Wang J., Wan K., Li Y. and Duan L., Live sports event detection based on broadcast video and web-casting text, ACM MM 2006, pp:221--230.

Digital Library

[23]

Xu H. and Chua T., The fusion of audiovisual features and external knowledge for event detection in team sports video, MIR 2004.

Digital Library

[24]

Xu H., Fong T.-H., and Chua T-S., Fusion of multiple asynchronous information sources for event detection in team sports video, ICME 2005.

Digital Library

[25]

Xu M., Duan L. Y., Xu C., and Tian Q., A fusion scheme of visual and auditory modalities for event detection in sports video, Proc. of ICASSP 2003, pp.189--192, 2003.

Digital Library

[26]

Xiong Z., Radhakrishnan R., and Divakaran A., Generation of sports highlights using motion activity in combination with a common audio feature extraction framework, ICIP 2003, vol. 1, pp. 5--8, 2003.

[27]

Yang Y.-Q., Lu Y-D, and Chen W., A framework for automatic detection of soccer goal event based on cinematic template, Int'l Conf. on Machine Learning and Cybernetics, vol 6, pp.3759--764, 2004.

[28]

Yow D., Yeo B. L., Yeung M., and Liu B., Analysis and presentation of soccer highlight from digital video, ACCV 1995, pp.499--503, 1995.

[29]

http://news.bbc.co.uk/sport1/hi/football/teams/m/man_utd/live_text/default.stm

[30]

http://live.espnstar.com.cn/tools/live/newlivelist.asp

[31]

http://www.microsoft.com/tv/IPTVEdition.mspx

Cited By

Siles FSaborio J(2015)Parallel spatial segmentation for the automated analysis of football2015 4th International Work Conference on Bioinspired Intelligence (IWOBI)10.1109/IWOBI.2015.7160140(33-38)Online publication date: Jun-2015
https://doi.org/10.1109/IWOBI.2015.7160140
Olsen DPartridge BLynn S(2010)Time warp sports for internet televisionACM Transactions on Computer-Human Interaction10.1145/1879831.187983417:4(1-37)Online publication date: 29-Dec-2010
https://dl.acm.org/doi/10.1145/1879831.1879834
D'Orazio TLeo M(2010)A review of vision-based systems for soccer video analysisPattern Recognition10.1016/j.patcog.2010.03.00943:8(2911-2926)Online publication date: 1-Aug-2010
https://dl.acm.org/doi/10.1016/j.patcog.2010.03.009
Show More Cited By

Index Terms

An instant semantics acquisition system of live soccer video with application to live event alert and on-the-fly language selection
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
  2. World Wide Web
    1. Web applications
    2. Web services

Recommendations

Interactive broadcast services for live soccer video based on instant semantics acquisition

This paper presents a system for providing interactive broadcast services for live soccer video that is based on instant semantics acquisition. Currently, we have implemented two such interactive services: live event alert and on-the-fly language ...
Multi-camera Live Video Streaming over Wireless Network
Advances in Mobile Computing and Multimedia Intelligence
Abstract
Due to the development of wireless communication technology, more and more streamers are using cameras mounted on mobile devices for live streaming in a wireless LAN environment. Conventional live streaming systems, which employ multiple images ...
Event detection over live and archived streams
WAIM'11: Proceedings of the 12th international conference on Web-age information management

It is becoming increasingly crucial to integrate pattern matching functionality over live and archived event streams with hybrid event queries for various complex event processing(CEP) applications. As existing Stream Processing Engine(SPE) and DBMS ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIVR '08: Proceedings of the 2008 international conference on Content-based image and video retrieval

July 2008

674 pages

ISBN:9781605580708

DOI:10.1145/1386352

General Chairs:
Jiebo Luo
Kodak Research Laboratories
,
Ling Guan
Ryerson University
,
Program Chairs:
Alan Hanjalic
Delft University of Technology
,
Mohan Kankanhalli
National University of Singapore
,
Ivan Lee
University of South Australia

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIVR08

Sponsor:

CIVR08: CIVR'08 - International Conference on Content-based Image and Video Retrieval

July 7 - 9, 2008

Niagara Falls, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
249
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Siles FSaborio J(2015)Parallel spatial segmentation for the automated analysis of football2015 4th International Work Conference on Bioinspired Intelligence (IWOBI)10.1109/IWOBI.2015.7160140(33-38)Online publication date: Jun-2015
https://doi.org/10.1109/IWOBI.2015.7160140
Olsen DPartridge BLynn S(2010)Time warp sports for internet televisionACM Transactions on Computer-Human Interaction10.1145/1879831.187983417:4(1-37)Online publication date: 29-Dec-2010
https://dl.acm.org/doi/10.1145/1879831.1879834
D'Orazio TLeo M(2010)A review of vision-based systems for soccer video analysisPattern Recognition10.1016/j.patcog.2010.03.00943:8(2911-2926)Online publication date: 1-Aug-2010
https://dl.acm.org/doi/10.1016/j.patcog.2010.03.009
Yu XLi LLeong H(2009)Interactive broadcast services for live soccer video based on instant semantics acquisitionJournal of Visual Communication and Image Representation10.1016/j.jvcir.2008.12.00420:2(117-130)Online publication date: 1-Feb-2009
https://dl.acm.org/doi/10.1016/j.jvcir.2008.12.004

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents