Abstract
Dialogue sequences constitute an important part of any movie or television program and their successful detection is an essential step in any movie summarisation/indexing system. The focus of this paper is to detect sequences of dialogue, rather than complete scenes. We argue that these shorter sequences are more desirable as retrieval units than temporally long scenes. This paper combines various audiovisual features that reflect accepted and well know film making conventions using a selection of machine learning techniques in order to detect such sequences. Three systems for detecting dialogue sequences are proposed: one based primarily on audio analysis, one based primarily on visual analysis and one that combines the results of both. The performance of the three systems are compared using a manually marked-up test corpus drawn from a variety of movies of different genres. Results show that high precision and recall can be obtained using low-level features that are automatically extracted.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bordwell, D., Thompson, K.: Film Art: An Introduction. McGraw-Hill, New York (1997)
Browne, P., Smeaton, A., Murphy, N., O’Connor, N., Marlow, S., Berrut, C.: Evaluating and combining digital video shot boundary detection algorithms. In: Irish Machine Vision and Image Processing Conference (2002)
Chan, H.-W., Kuo, J.-H., Chu, W.-T., Wu, J.-L.: Action movies segmentation and summarization based on tempo analysis. In: ACM SIGMM International Workshop on Multimedia Information Retrieval (2004)
Chen, L., Rizvi, S.J., Ötzu, M.T.: Incorporating audio cues into dialog and action scene detection. In: Proceedings of SPIE Conference on Storage and Retrieval for Media Databases, pp. 252–264 (2003)
Huang, J., Liu, Z., Wang, Y.: Integration of audio and visual information for content-based video segmentation. In: IEEE Int’l Conf. Image Processing (1998)
Kender, J.R., Yeo, B.-L.: Video scene segmentation vis continuous video coherence. In: Proceedings CVPR 1998, pp. 167–393 (1998)
Lehane, B., O’Connor, N., Murphy, N.: Action sequence detection in motion pictures. In: The international Workshop on Multidisciplinary Image, Video, and Audio Retrieval and Mining (2004)
Lehane, B., O’Connor, N., Murphy, N.: Dialogue scene detection in movies using low and mid-level visual features. In: International Workshop on Image, Video, and Audio Retrieval and Mining (2004)
Li, Y., Kou, C.-C.J.: Video Content Analysis using Multimodal Information. Kluwer Academic Publishers, Dordrecht (2003)
Rabiger, M.: Directing. Focal Press (1997)
Sundaram, H., Chan, S.-F.: Condensing computable scenes using visual complexity and film syntax analysis. In: IEEE Conference on Multimedia and Exhibition (2001)
Yeo, B.-L., Liu, B.: Rapid scene analysis on compressed videos. In: IEEE Transactions on Circuits and Systems for Video Technology, pp. 533–544 (1995)
Yeung, M., Yeo, B.-L.: Video visualisation for compact presentation and fast browsing of pictorial content. In: IEEE Transactions on Circuits and Systems for Video Technology, pp. 771–785 (1997)
Zhai, Y., Rasheed, Z., Shah, M.: A framework for semantic classification of scenes using finite state machines. In: International Converence on Image and Video Retrieval (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lehane, B., O’Connor, N., Murphy, N. (2005). Dialogue Sequence Detection in Movies. In: Leow, WK., Lew, M.S., Chua, TS., Ma, WY., Chaisorn, L., Bakker, E.M. (eds) Image and Video Retrieval. CIVR 2005. Lecture Notes in Computer Science, vol 3568. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11526346_32
Download citation
DOI: https://doi.org/10.1007/11526346_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27858-0
Online ISBN: 978-3-540-31678-7
eBook Packages: Computer ScienceComputer Science (R0)