Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

MultiCAMBA: a system for selecting camera views in live broadcasting of sport events using a dynamic 3D model

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

For a Technical Director (TD) in charge of a live broadcasting, selecting the best camera shots among the available video sources is a challenging task, even more now that the number of cameras (some of them mobile, or attached to moving objects) in the broadcasting of sport events is increasing. So, the TD needs to manage a great amount of continuously changing information to quickly select the camera whose view should be broadcasted. Besides, the better the decisions made by the TD, the more interesting the content for the audience. Therefore, the development of systems that could help the TD with the selection of camera views is demanded by broadcasting organizations.

In this paper, we present the system MultiCAMBA that helps TDs in the live broadcasting task by allowing them to indicate in run-time their interest in certain kind of shots, and the system will show the cameras that are able to provide them. To achieve this task, the system manages location-dependent queries generated according to the interests of the TD. Moreover, to avoid the use of costly on line real-image processing techniques over the camera views, such real camera views are recreated in a 3D engine by using the information contained in a 3D model of the scenario. This model is updated continuously with real-time data retrieved from the real objects and cameras in the scenario. In this way, the system extracts high-level semantic features of 2D projections of the 3D reconstruction of the camera views. We present a prototype of the system and experimental results that show the feasibility of our proposal.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Notes

  1. Notice that the Technical Director is the user of the system and we will use both terms to refer to him/her.

  2. In this work we do not deal with the possibility of zooming.

  3. http://jmonkeyengine.org/

  4. Some videos and interesting moments of the tests are available at http://sid.cps.unizar.es/MultiCAMBA/Experiments.

  5. https://developers.google.com/kml

References

  1. Aliaga DG, Xu Y, Popescu V (2006) Lag camera: a moving multi-camera array for scene-acquisition. J Virtual Reality Broadcast 3(10). http://www.jvrb.org/past-issues/3.2006/820/view?set_language=en

  2. Ansary T, Daoudi M, Vandeborre JP (2007) A bayesian 3-D search engine using adaptive views clustering. IEEE Trans Multimed 9(1):78–88

    Article  Google Scholar 

  3. Babaguchi N, Kawai Y, Ogura T, Kitahashi T (2004) Personalized abstraction of broadcasted American football video by highlight selection. IEEE Trans Multimed 6(4):575–586

    Article  Google Scholar 

  4. Bianchi MH (2004) Automatic video production of lectures using an intelligent and aware environment. In: Third international conference on mobile and ubiquitous multimedia (MUM’04), pp 117–123, ACM

  5. Cha J, Eid M, Saddik AE (2009) Touchable 3D video system. ACM Trans Multimed Comput Commun Appl 5(4):29:1–29:25

    Article  Google Scholar 

  6. Cheng CC, Hsu CT (2006) Fusion of audio and motion information on HMM-based highlight extraction for baseball games. IEEE Trans Multimed 8(3):585–599

    Article  Google Scholar 

  7. Chen F, Delannay D, Vleeschouwer CD (2011) An autonomous framework to produce and distribute personalized team-sport video summaries: a basket-ball case study. IEEE Trans Multimed 13(6):1381–1394

    Article  Google Scholar 

  8. Chen F, Vleeschouwer CD (2010) Personalized production of basketball videos from multi-sensored data under limited display resolution. Comp Vision Image Underst 114(6):667–680

    Article  Google Scholar 

  9. Chen Y, Sampathkumar H, Luo B, Chen X (2012) iLike: bridging the semantic gap in vertical image search by integrating text and visual features. IEEE Trans Knowl Data Eng PP 99(10):2257–2270

    Google Scholar 

  10. Choi K, Lee S, Y S (2009) Automatic broadcast video generation for ball sports from multiple view. In: International workshop on advanced image technology (IWAIT’09)

  11. D’Orazio T, Leo M (2010) A review of vision-based systems for soccer video analysis. Pattern Recog 43:2911–2926

    Article  Google Scholar 

  12. Ekin A, Tekalp AM, Mehrotra R (2003) Automatic soccer video analysis and summarization. IEEE Trans Image Process 12(7):796–807

    Article  Google Scholar 

  13. Gao Y, Wang M, Zha ZJ, Tian Q, Dai Q, Zhang N (2011) Less is more: efficient 3-D object retrieval with query view selection. IEEE Trans Multimed 13(5):1007–1018

    Article  Google Scholar 

  14. Heck R, Wallick M, Gleicher M (2007) Virtual videography. ACM Trans Multimed Comput Commun Appl 3(1): 28

    Article  Google Scholar 

  15. Hendawi AM, Mokbel MF (2012) Predictive spatio-temporal queries: a comprehensive survey and future directions. In: Proceedings of the first ACM Sigspatial international workshop on mobile geographic information systems. MobiGIS ’12 pp 97–104

  16. Ilarri S, Mena E, Illarramendi A (2010) Location-dependent query processing: where we are and where we are heading. ACM Comput Surv 42(3):1–73

    Article  Google Scholar 

  17. Ilarri S, Mena E, Illarramendi A, Yus R, Laka M, Marcos G (2012) A friendly location-aware system to facilitate the work of technical directors when broadcasting sport events. Mob Inf Syst 8(1):17–43

    Google Scholar 

  18. Kolekar MH (2011) Bayesian belief network based broadcast sports video indexing. Multimedia Tools Appl 54:27–54

    Article  Google Scholar 

  19. Liu Q, Kimber D, Foote J, Wilcox L, Boreczky J (2002) FlySPEC: a multi-user video camera system with hybrid human and automatic control. In: Tenth ACM international conference on multimedia (MULTIMEDIA’02), pp 484–492. ACM

  20. Nitta N, Takahashi Y, Babaguchi N (2009) Automatic personalized video abstraction for sports videos using metadata. Multimedia Tools Appl 41(1):1–25

    Article  Google Scholar 

  21. Park HS, Lim S, Min JK, Cho SB (2009) Optimal view selection and event retrieval in multi-camera office environment. Multisensor Fusion Integr Intell Syst 35:45–53

    Article  Google Scholar 

  22. Rui Y, He L, Gupta A, Liu Q (2001) Building an intelligent camera management system. In: Ninth ACM international conference on multimedia (MULTIMEDIA’01), pp. 2–11. ACM

  23. Serr K, Windholz T, Weber K (2006) Comparing GPS receivers: a field study. URISA J 18(2):19–24

    Google Scholar 

  24. Tao Y, Faloutsos C, Papadias D, Liu B (2004) Prediction and indexing of moving objects with unknown motion patterns. In: Proceedings of the 2004 ACM SIGMOD international conference on management of data, SIGMOD ’04, pp 611–622

  25. Terry D, Goldberg D, Nichols D, Oki B (1992) Continuous queries over append-only databases. ACM SIGMOD Rec 21(2):321–330

    Article  Google Scholar 

  26. Wang J, Xu C, Chng E, Lu H, Tian Q (2008) Automatic composition of broadcast sports video. Multimedia Systems 14(4):179–193

    Article  Google Scholar 

  27. Xu C, Wang J, Lu H, Zhang Y (2008) A novel framework for semantic annotation and personalized retrieval of sports video. IEEE Trans Multimed 10(3):421–436

    Article  Google Scholar 

  28. Xu C, Zhang YF, Zhu G, Rui Y, Lu H, Huang Q (2008) Using webcast text for semantic event detection in broadcast sports video. IEEE Trans Multimed 10(7):1342–1355

    Article  Google Scholar 

  29. Yildirim Y, Yazici A, Yilmaz T (2013) Automatic semantic content extraction in videos using a fuzzy ontology and rule-based model. IEEE Trans Knowl Data Eng 25(1):47–61. doi:10.1109/TKDE.2011.189

    Article  Google Scholar 

  30. Yus R, Anton D, Mena E, Ilarri S, Illarramendi A (2011) MultiCAMBA : a system to assist in the broadcasting of sport events. In: Eighth annual international conference on mobile and ubiquitous systems: computing, networking and services (MobiQuitous 2011). Springer, pp 238–242

  31. Yus R, Ilarri S, Mena E (2013) Real-time selection of video streams for live TV broadcasting based on query-by-example using a 3D model. Multimedia tools and applications. Published online: June 2013, 27 pages, doi:10.1007/s11042-013-1550-5

  32. Yus R, Mena E, Bernad J, Ilarri S, Illarramendi A (2011) Location-aware system based on a dynamic 3D model to help in live broadcasting of sport events. In: 19th ACM international conference on multimedia (MM 2011). ACM, pp1005–1008

  33. Zhang C, Rui Y, Crawford J, He LW (2008) An automated end-to-end lecture capture and broadcasting system. ACM Trans Multimed Comput Commun Appl 4(1):6:1–6:23

    Article  Google Scholar 

  34. Zhu G, Huang Q, Xu C, Xing L, Gao W, Yao H (2007) Human behavior analysis for highlight ranking in broadcast racket sports video. IEEE Trans Multimed 9(6):1167–1182

    Article  Google Scholar 

Download references

Acknowledgments

This work has been supported by the CICYT project TIN2010-21387-C02 and DGA-FSE. We thank David Antón and Francisco J. Serón for their help with the implementation of our prototype and technical support, respectively.

Author information

Authors and Affiliations

  1. IIS Department, University of Zaragoza, María de Luna, 1, 50018, Zaragoza, Spain

    Roberto Yus, Eduardo Mena, Sergio Ilarri & Jorge Bernad

  2. LSI Department, Basque Country University, Manuel de Lardizábal s/n, 20080, San Sebastían, Spain

    Arantza Illarramendi

Authors
  1. Roberto Yus
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eduardo Mena
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sergio Ilarri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arantza Illarramendi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jorge Bernad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Roberto Yus.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yus, R., Mena, E., Ilarri, S. et al. MultiCAMBA: a system for selecting camera views in live broadcasting of sport events using a dynamic 3D model. Multimed Tools Appl 74, 4059–4090 (2015). https://doi.org/10.1007/s11042-013-1810-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1810-4

Keywords

Search

Navigation