Article

Inserting 3D projected virtual content into broadcast tennis video

Authors:

Xinguo Yu,

Xin Yan,

Tran Thi Phuong Chi,

Loong Fah CheongAuthors Info & Claims

MM '06: Proceedings of the 14th ACM international conference on Multimedia

Pages 619 - 622

https://doi.org/10.1145/1180639.1180767

Published: 23 October 2006 Publication History

Get Access

Abstract

The ability to acquire the accurate camera matrix of each frame of a video clip is essential if virtual content is inserted into the images in a believable way. This paper presents our system for inserting projected virtual content into broadcast tennis video based on camera matrix acquired. To achieve the accurate camera matrix, we develop a new algorithm for the 3D camera calibration of broadcast tennis video, which improves the accuracy of camera matrices via the proposed techniques of clip-wise data analysis and Hough-like search. We divide all the camera parameters determining a camera matrix into two categories: clip-varying and frame-varying. For the clip-varying ones, we use a clip-wise data analysis procedure to achieve their accuracy. For the framevarying ones, we use a Hough-like search to tune them for each frame. Preliminary experiments results show that we can seamlessly insert projected virtual content into each frame.

References

[1]

D. Farin, S. Krabbe, P. H. N. de With, and W. Effelsberg. Robust camera calibration for sport videos using court models. SPIE Storage & Retr. M. & App. for MM, vol 5307, pp80--91, 2004.

Google Scholar

[2]

S. Gibson, J. Cook, T. Howard, R. Hubbold, and D. Oram. Accurate camera calibration for off-line, video-based augmented reality, ISMAR 2002, pp. 37--46.

Digital Library

Google Scholar

[3]

J. R. Gloundemans, et al. Blending a graphic, US paten: 6,229,550 (From Sportsvision Inc, US).

Google Scholar

[4]

R. Hartley and A. Zisserman, Multiple view geometry in computer vision, Cambridge U. Press 2003 (2rd edition), UK.

Digital Library

Google Scholar

[5]

I. D. Reid and A. Zisserman. Goal-directed video metrology, Proc. of 4th ECCV, vol. II, pp 647--658, 1996.

Digital Library

Google Scholar

[6]

R. Y. Tsai. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the shelf TV cameras and lenses, IEEE J. of Robotics and Automation, vol. RA-3, No. 4, Aug 1987, pp 323--344.

Crossref

Google Scholar

[7]

K. Wan, X. Yan, X. Yu, and C. Xu. Robust goal-mouth detection for virtual content insertion, ACM MM 2003, pp.468--469

Digital Library

Google Scholar

[8]

X. Yu, C. H. Sim, J. R. Wang, and F. C. Loong. A trajectory-based ball detection and tracking algorithm in broadcast tennis video. ICIP04, pp1049--1052, 2004.

Google Scholar

[9]

http://www.orad.co.il

Google Scholar

[10]

http://www.sportvision.com

Google Scholar

[11]

http://www.hawkeyeinnovations.co.uk.

Google Scholar

Cited By

View all

Haq MSethi MAhmad SELAffendi MAsim M(2024)Automatic Player Face Detection and Recognition for Players in Cricket GamesIEEE Access10.1109/ACCESS.2024.337756412(41219-41233)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3377564
Sha LLucey PYue YWei XHobbs JRohlf CSridharan S(2018)Interactive Sports AnalyticsACM Transactions on Computer-Human Interaction10.1145/318559625:2(1-32)Online publication date: 11-Apr-2018
https://dl.acm.org/doi/10.1145/3185596
Mahmood ZAli TKhattak SHasan LKhan S(2015)Automatic player detection and identification for sports entertainment applicationsPattern Analysis & Applications10.1007/s10044-014-0416-418:4(971-982)Online publication date: 1-Nov-2015
https://dl.acm.org/doi/10.1007/s10044-014-0416-4
Show More Cited By

Index Terms

Inserting 3D projected virtual content into broadcast tennis video
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Object recognition
        Shape inference
  2. Computer graphics
    1. Shape modeling

Recommendations

A system for 3D projected virtual content insertion into broadcast tennis video
MM '06: Proceedings of the 14th ACM international conference on Multimedia

This demonstration presents our system for inserting projected virtual content into broadcast tennis video based on camera matrix acquired. This system can automatically acquire the accurate camera matrix for each frame with the tennis court and insert ...
Automatic camera calibration of broadcast tennis video with applications to 3D virtual content insertion and ball detection and tracking

This paper presents an original algorithm to automatically acquire accurate camera calibration from broadcast tennis video (BTV) as well as demonstrates two of its many applications. Accurate camera calibration from BTV is challenging because the frame-...
Geometric and Color Calibration of Multiview Panoramic Cameras for Life-Size 3D Immersive Video
3DV '13: Proceedings of the 2013 International Conference on 3D Vision

In this paper we address calibration of camera arrays for life-size 3D video acquisition and display where mosaicking and multiviewpoint stereo are combined to provide an immersive experience which, by its size, resolution, and three-dimensionality, is ...

Comments

Information & Contributors

Information

Published In

MM '06: Proceedings of the 14th ACM international conference on Multimedia

October 2006

1072 pages

ISBN:1595934472

DOI:10.1145/1180639

General Chairs:
Klara Nahrstedt
UIUC
,
Matthew Turk
UCSB
,
Program Chairs:
Yong Rui
Microsoft Research
,
Wolfgang Klas
Universität Wien
,
Ketan Mayer-Patel
UNC

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM06

Sponsor:

MM06: The 14th ACM International Conference on Multimedia 2006

October 23 - 27, 2006

CA, Santa Barbara, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
361
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Haq MSethi MAhmad SELAffendi MAsim M(2024)Automatic Player Face Detection and Recognition for Players in Cricket GamesIEEE Access10.1109/ACCESS.2024.337756412(41219-41233)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3377564
Sha LLucey PYue YWei XHobbs JRohlf CSridharan S(2018)Interactive Sports AnalyticsACM Transactions on Computer-Human Interaction10.1145/318559625:2(1-32)Online publication date: 11-Apr-2018
https://dl.acm.org/doi/10.1145/3185596
Mahmood ZAli TKhattak SHasan LKhan S(2015)Automatic player detection and identification for sports entertainment applicationsPattern Analysis & Applications10.1007/s10044-014-0416-418:4(971-982)Online publication date: 1-Nov-2015
https://dl.acm.org/doi/10.1007/s10044-014-0416-4
Sajjad MLee JGu BMehmood IFahad Lee MJang YBaik S(2013)Synchronized and efficient communication system based on Agent-Mediator framework for adaptive mixed reality spaceInternational Conference on ICT for Smart Society10.1109/ICTSS.2013.6588085(1-4)Online publication date: Jun-2013
https://doi.org/10.1109/ICTSS.2013.6588085
Chang CWu J(2011)An Explorative Study of Virtual Product PlacementOnline Multimedia Advertising10.4018/978-1-60960-189-8.ch008(122-147)Online publication date: 2011
https://doi.org/10.4018/978-1-60960-189-8.ch008
Han JFarin Dde With P(2011)A Mixed-Reality System for Broadcasting Sports Video to Mobile DevicesIEEE MultiMedia10.1109/MMUL.2010.2418:2(72-84)Online publication date: 1-Apr-2011
https://dl.acm.org/doi/10.1109/MMUL.2010.24
Lai JChen CKao CChien S(2011)Tennis Video 2.0Journal of Visual Communication and Image Representation10.1016/j.jvcir.2011.01.00122:3(271-283)Online publication date: 1-Apr-2011
https://dl.acm.org/doi/10.1016/j.jvcir.2011.01.001
Liu HHuang QXu CJiang S(2011)@ICT: attention-based virtual content insertionMultimedia Systems10.1007/s00530-011-0234-018:3(201-214)Online publication date: 28-Apr-2011
https://doi.org/10.1007/s00530-011-0234-0
Chang CHsieh KChung MWu JEL Saddik AVuong SGriwodz CDel Bimbo ACandan KJaimes A(2008)ViSAProceedings of the 16th ACM international conference on Multimedia10.1145/1459359.1459500(837-840)Online publication date: 26-Oct-2008
https://dl.acm.org/doi/10.1145/1459359.1459500
Liu HJiang SHuang QXu CEL Saddik AVuong SGriwodz CDel Bimbo ACandan KJaimes A(2008)A generic virtual content insertion system based on visual attention analysisProceedings of the 16th ACM international conference on Multimedia10.1145/1459359.1459410(379-388)Online publication date: 26-Oct-2008
https://dl.acm.org/doi/10.1145/1459359.1459410
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A system for 3D projected virtual content insertion into broadcast tennis video

Automatic camera calibration of broadcast tennis video with applications to 3D virtual content insertion and ball detection and tracking

Geometric and Color Calibration of Multiview Panoramic Cameras for Life-Size 3D Immersive Video