research-article

An approach to intelligently crop and scale video for broadcast applications

Authors:

Joerg Deigmoeller,

Takebumi Itagaki,

Norbert JustAuthors Info & Claims

SAC '10: Proceedings of the 2010 ACM Symposium on Applied Computing

Pages 1911 - 1918

https://doi.org/10.1145/1774088.1774493

Published: 22 March 2010 Publication History

Abstract

Within the scope of the EU-funded project porTiVity (portable interactivity), an application has been developed, that automatically modifies SDTV (Standard Definition Television) sports productions for viewing on mobile TV displays by means of intelligent cropping and scaling. It crops regions of interest of sports productions based on a smart combination of production metadata and systematic video analysis methods. This approach allows a context-based composition for cropped images. It provides a differentiation between the original SD-version of the production and the processed one adapted to the requirements for mobile TV. Envisaged is the integration of the tool in post-production and live workflows.

References

[1]

C. Arthur. (2009, September 5). Television is a turnoff for mobile users, http://www.guardian.co.uk/technology/2007/aug/02/guardianweeklytechnologysection.mobilephones

[2]

A. Treisman. Features and Objects in Visual Processing. Scientific American, vol. 255, pp. 106--115, 1986.

Digital Library

[3]

L. Itti, C. Koch, E. Niebur. A Model of Saliency-based Visual Attention for Rapid Scene Analysis. IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 20, pp. 1254--1259, 1998

Digital Library

[4]

W.-H. Cheng, W.-T. Chu, and J.-L. Wu. A Visual Attention Based Region-of-interest Determination Framework for Video Sequences. IEICE Transactions on Information and Systems Journal, vol. E-88D, no. 7, pp. 1578--1586, 2005

Digital Library

[5]

T. Deselaers, P. Dreuw, H. Ney. Pan, Zoom, Scan -- Time-coherent, Trained Automatic Video Cropping. IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, 2008

[6]

X. Hou. L. Zhang. Saliency Detection: A Spectral Residual Approach. Conference on Computer Vision and Pattern Recognition, Minneapolis, 2007

[7]

J. Zaller. (2009, September 5). Snell & Wilcox's Helios: Optimizes Video for Distribution to Mobile TV Devices. http://www.snellwilcox.com/news_events/press_coverage/

[8]

M. Knee, R. Piroddi. (2009, September 5). Aspect Processing: The Shape of Things to Come, http://www.snellwilcox.com/community/documents/support_documentation/white_papers/

[9]

O. Le Meur, P. Le Callet, D. Barba. Predicting visual fixations on video based on low-level visual features. Vision Research, vol. 47, pp. 2483--2498, 2007

[10]

A. Dearden, Y. Demiris, O. Grau, Tracking football player movement from a single moving camera using particle filters. Proceedings of the 3rd European Conference on Visual Media Production (CVMP), pp. 29--37, 2006

[11]

S. Frintrop, VOCUS: A Visual Attention System for Object Detection and Goal-Directed Search. Lecture Notes in Artificial Intelligence, vol. 3899, 2006

Digital Library

[12]

S. Mason, (2009, September 5). Mobile TV -- results from the DVB-H trial in Oxford. http://www.ebu.ch/en/technical/trev/trev_306-mason.pdf

[13]

BMF Documentation. "BMF -- Broadcast Metadata exchange Format", Institut fuer Rundfunktechnik, Version 01.00.00, Munich, 2007

[14]

(2009, September 5). Opencv library Documentation. http://opencv.willowgarage.com/wiki/

[15]

J. Y. Bouguet, Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the algorithm. Intel Corporation Microprocessor Research Labs, 1999

[16]

P. Rousseeuw. Least Median of Squares Regression. Journal of the American Statistics Association, vol. 79, pp. 871--880, 1984

[17]

R. Hartley, A. Zisserman. Multiple View Geometry in Computer Vision -- Second Edition. Cambridge University Press, 2003

Digital Library

[18]

Z. Zhang, R. Deriche, O. Faugeras, Q. T. Luong. A Robust Technique for Matching Two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry. Artificial Intelligence, vol. 78, pp. 87--119, 1995.

Digital Library

[19]

(2009, September 5). homest: A C/C++ Library for Robust, Non-linear Homography Estimation, http://www.ics.forth.gr/~lourakis/homest/

[20]

(2009, September 5). Saliency Tollbox, http://www.saliencytoolbox.net/index.html

[21]

(2009, September 5). Spectral Residual, http://www.its.caltech.edu/~xhou/

[22]

D. L. Ruderman, The statistics of natural images. Computation in Neural Systems, vol. 5, pp. 517--548, 1994.

[23]

D. A. Forsyth, J. Ponce. Computer Vision - A Modern Approach. Prentice Hall. New Jersey, 2003

Digital Library

[24]

B. Schölkpf, C. Burges, A. Smola. Advances in Kernel Methods: Support Vector Learning. Cambridge, 1999

[25]

(2009, October 20). ITU Gaze Tracker, http://www.gazegroup.org/downloads/23-gazetracker

Cited By

Soe TSlavkovik M(2022)A content-aware tool for converting videos to narrower aspect ratiosProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3529970(109-120)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3529970
Deigmoeller JItagaki TJust NStoll G(2012)Contextual cropping and scaling of TV productionsMultimedia Tools and Applications10.1007/s11042-011-0804-361:3(623-644)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1007/s11042-011-0804-3

Index Terms

An approach to intelligently crop and scale video for broadcast applications

Recommendations

Contextual cropping and scaling of TV productions

In this paper, an application is presented which automatically adapts SDTV (Standard Definition Television) sports productions to smaller displays through intelligent cropping and scaling. It crops regions of interest of sports productions based on a ...
Monitoring crop phenology with street-level imagery using computer vision
Highlights
- Method to automatically collect side looking imagery for agriculture parcels.
- Crop types and phenology obtained from computer vision.
- Demonstration over monthly surveyed totalling 400,000 pictures for 17 crop types.
- Deep ...
Abstract
Street-level imagery holds a significant potential to scale-up in-situ data collection. This is enabled by combining the use of cheap high-quality cameras with recent advances in deep learning compute solutions to derive relevant thematic ...
Extracting Regions of Interest in Biomedical Images
FBIE '08: Proceedings of the 2008 International Seminar on Future BioMedical Information Engineering

Regions of interest (ROI) usually means the meaningful and important regions in the images. The use of ROI can avoid the processing of irrevelent image points and accelerate the processing. Extraction of regions of interest from images is an important ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SAC '10: Proceedings of the 2010 ACM Symposium on Applied Computing

March 2010

2712 pages

ISBN:9781605586397

DOI:10.1145/1774088

Conference Chairs:
Sung Y. Shin
South Dakota State University
,
Sascha Ossowski
University Rey Juan Carlos, Spain
,
Michael Schumacher
University of Applied Sciences Western Switzerland, Switzerland
,
Program Chairs:
Mathew J. Palakal
Indiana University Purdue University
,
Chih-Cheng Hung
Southern Polytechnic State University

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 March 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SAC'10

Sponsor:

SIGAPP

SAC'10: The 2010 ACM Symposium on Applied Computing

March 22 - 26, 2010

Sierre, Switzerland

Acceptance Rates

SAC '10 Paper Acceptance Rate 364 of 1,353 submissions, 27%;

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25

Sponsor:
sigapp

The 40th ACM/SIGAPP Symposium on Applied Computing

March 31 - April 4, 2025

Catania , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
106
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Soe TSlavkovik M(2022)A content-aware tool for converting videos to narrower aspect ratiosProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3529970(109-120)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3505284.3529970
Deigmoeller JItagaki TJust NStoll G(2012)Contextual cropping and scaling of TV productionsMultimedia Tools and Applications10.1007/s11042-011-0804-361:3(623-644)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1007/s11042-011-0804-3

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten