research-article

Automatic retrieval of visual continuity errors in movies

Authors:

Lyndsey Pickup,

Andrew ZissermanAuthors Info & Claims

CIVR '09: Proceedings of the ACM International Conference on Image and Video Retrieval

Article No.: 7, Pages 1 - 8

https://doi.org/10.1145/1646396.1646406

Published: 08 July 2009 Publication History

Get Access

Abstract

Continuity errors occur in many movies and television series, in spite of careful checking by those employed to minimise them. In this work we develop a scheme for automatically detecting these errors and producing a ranked list of the most likely inconsistencies, working from a commercial DVD release. We use the editing structure of the movie to detect pairs of shots within a scene that might have arisen from different takes, and thus are possible candidates for continuity errors. These pairs are then registered and examined for differences that lack an obvious cause -- suppressing changes arising from humans and other moving objects by using upper body detectors and trackers. The result is a ranked list of possible continuity errors for the movie.

We show discovered errors for a number of feature length movies including relatively recent releases, such as 'Love Actually' (Curtis, 2003) and classics, such as 'Pretty Woman' (Marshall, 1990). We discover mistakes that have previously been missed in the listings for these movies on such websites as moviemistakes.com.

References

[1]

Internet Movie Database (IMDb). http://www.imdb.com/.

Google Scholar

[2]

N. E. Apostoloff and A. W. Fitzgibbon. Automatic video segmentation using spatiotemporal t-junctions. In Proc. BMVC., 2006.

Crossref

Google Scholar

[3]

T. Cour, C. Jordan, E. Miltsakaki, and B. Taskar. Movie/script: Alignment and parsing of video and text transcription. In Proc. ECCV, volume 4, pages 158--171, 2008.

Digital Library

Google Scholar

[4]

N. Dalal and B. Triggs. Histogram of Oriented Gradients for Human Detection. In Proc. CVPR, volume 2, pages 886--893, 2005.

Digital Library

Google Scholar

[5]

V. Ferrari, M. Marin-Jimenez, and A. Zisserman. Progressive search space reduction for human pose estimation. In Proc. CVPR, Jun 2008.

Crossref

Google Scholar

[6]

R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, ISBN: 0521540518, second edition, 2004.

Digital Library

Google Scholar

[7]

P. D. Kovesi. MATLAB and Octave functions for computer vision and image processing. The University of Western Australia. http://www.csse.uwa.edu.au/~pk/research/matlabfns/.

Google Scholar

[8]

B. Leibe, E. Seemann, and B. Schiele. Pedestrian detection in crowded scenes. In Proc. CVPR, 2005.

Digital Library

Google Scholar

[9]

R. Lienhart. Reliable transition detection in videos: A survey and practitioner's guide. International Journal of Image and Graphics, 1(3): 469--486, 2001.

Crossref

Google Scholar

[10]

J. Monaco. How to Read a Film: The World of Movies, Media, Multimedia -- Language, History, Theory. OUP USA, Apr 2000.

Google Scholar

[11]

MovieMistakes. http://www.moviemistakes.com/.

Google Scholar

[12]

D. Ramanan. Using segmentation to verify object hypotheses. In Proc. CVPR, 2007.

Crossref

Google Scholar

[13]

T. J. Smith. An Attentional Theory of Continuity Editing. PhD thesis, University of Edinburgh, 2006. Unpublished Doctoral Thesis.

Google Scholar

[14]

P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Proc. CVPR, pages 511--518, 2001.

Crossref

Google Scholar

Cited By

View all

Leake MLi W(2024)ChunkyEdit: Text-first video interview editing via chunkingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642667(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642667
Hwang JBose NMillar GBulger CNazareth G(2023)Bubble Plume Tracking Using a Backseat Driver on an Autonomous Underwater VehicleDrones10.3390/drones71006357:10(635)Online publication date: 16-Oct-2023
https://doi.org/10.3390/drones7100635
Hoai MZisserman A(2015)Thread-Safe: Towards Recognizing Human Actions Across Shot BoundariesComputer Vision -- ACCV 201410.1007/978-3-319-16817-3_15(222-237)Online publication date: 17-Apr-2015
https://doi.org/10.1007/978-3-319-16817-3_15
Show More Cited By

Index Terms

Automatic retrieval of visual continuity errors in movies
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
        Scene understanding

Recommendations

Interpolating splines with local tension, continuity, and bias control

This paper presents a new method for using cubic interpolating splines in a key frame animation system. Three control parameters allow the animator to change the tension, continuity, and bias of the splines. Each of these three parameters can be used ...
Interpolating splines with local tension, continuity, and bias control
SIGGRAPH '84: Proceedings of the 11th annual conference on Computer graphics and interactive techniques

This paper presents a new method for using cubic interpolating splines in a key frame animation system. Three control parameters allow the animator to change the tension, continuity, and bias of the splines. Each of these three parameters can be used ...
The influence of color during continuity cuts in edited movies: an eye-tracking study

Professionally edited videos entail frequent editorial cuts --- that is, abrupt image changes from one frame to another. The impact of these cuts on human eye movements is currently not well understood. In the present eye-tracking study, we ...

Comments

Information & Contributors

Information

Published In

CIVR '09: Proceedings of the ACM International Conference on Image and Video Retrieval

July 2009

383 pages

ISBN:9781605584805

DOI:10.1145/1646396

Conference Chairs:
Yiannis Kompatsiaris
CERTH-ITI, Greece
,
Stephane Marchand-Maillet
Univ. of Geneva, Switzerland
,
Program Chairs:
Yannis Avrithis
NTUA, Greece
,
Noel O Connor
DCU, Ireland
,
Daniel Gatica-Perez
Idiap Research Institute, Switzerland
,
Tat-Seng Chua
National University of Singapore, Singapore

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 July 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIVR '09

Sponsor:

SIGMM

CIVR '09: CIVR '09 - International Conference on Image and Video Retrieval

July 8 - 10, 2009

Santorini, Fira, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
298
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Leake MLi W(2024)ChunkyEdit: Text-first video interview editing via chunkingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642667(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642667
Hwang JBose NMillar GBulger CNazareth G(2023)Bubble Plume Tracking Using a Backseat Driver on an Autonomous Underwater VehicleDrones10.3390/drones71006357:10(635)Online publication date: 16-Oct-2023
https://doi.org/10.3390/drones7100635
Hoai MZisserman A(2015)Thread-Safe: Towards Recognizing Human Actions Across Shot BoundariesComputer Vision -- ACCV 201410.1007/978-3-319-16817-3_15(222-237)Online publication date: 17-Apr-2015
https://doi.org/10.1007/978-3-319-16817-3_15
Tapaswi MParkhi ORahtu ESommerlade EStiefelhagen RZisserman ARamakrishnan AMalik JEfros AJawahar CVarma M(2014)Total ClusterProceedings of the 2014 Indian Conference on Computer Vision Graphics and Image Processing10.1145/2683483.2683490(1-8)Online publication date: 14-Dec-2014
https://dl.acm.org/doi/10.1145/2683483.2683490
Schubert EZimek AKriegel H(2014)Local outlier detection reconsideredData Mining and Knowledge Discovery10.1007/s10618-012-0300-z28:1(190-237)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1007/s10618-012-0300-z
Kit DSullivan BBallard D(2011)Novelty detection using growing neural gas for visuo-spatial memory2011 IEEE/RSJ International Conference on Intelligent Robots and Systems10.1109/IROS.2011.6094794(1194-1200)Online publication date: Sep-2011
https://doi.org/10.1109/IROS.2011.6094794

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Interpolating splines with local tension, continuity, and bias control

Interpolating splines with local tension, continuity, and bias control

The influence of color during continuity cuts in edited movies: an eye-tracking study

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations