Abstract
In this paper we present a new approach for automatic summarization of rushes video. Our approach is composed of three main steps. First, based on a temporal segmentation, we filter sub-shots with low information content not likely to be useful in a summary. Second, a method using maximal matching in a bipartite graph is adapted to measure similarity between the remaining shots and to minimize inter-shot redundancy by removing repetitive retake shots common in rushes content. Finally, the presence of faces and the motion in-tensity are characterised in each sub-shot. A measure of how representative the sub-shot is in the context of the overall video is then proposed. Video summaries composed of keyframe slideshows are then generated. In order to evaluate the effectiveness of this approach we re-run the evaluation carried out by the TREC, using the same dataset and evaluation metrics used in the TRECVID video summarization task in 2007 but with our own assessors. Results show that our approach leads to a significant improvement in terms of the fraction of the TRECVID summary ground truth included and is competitive with other approaches in TRECVID 2007.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Byrne, D., Kehoe, P., Lee, H., O Conaire, C., Smeaton, A.F., O’Connor, N., Jones, G.: A User-Centered Approach to Rushes Summarisation Via Highlight-Detected Keyframes. In: Proceedings of the TRECVID Workshop on Video Summarization (TVS 2007), Augsburg, Germany, September 28, pp. 35–39. ACM Press, New York (2007)
Ferman, A.M., Tekalp, A.M.: Two-stage hierarchical video summary extraction to match low-level user browsing preferences. IEEE Trans. Multimedia 5(2), 244–256 (2003)
Ma, Y.F., Lu, L., Zhang, H.J., Li, M.: A User Attention Model for Video Summarization. In: Proc. ACM Multimedia Conference (2002)
Taskiran, C.M., Pizlo, Z., Amir, A., Ponceleon, D., Delp, E.: Automated Video Program Summarization Using Speech Transcripts. IEEE Trans. on Multimedia 8(4), 775–791 (2006)
Over, P., Smeaton, A.F., Kelly, P.: The TRECVID 2007 BBC rushes summarization evaluation pilot. In: Proceedings of the TRECVID Workshop on Video Summarization (TVS 2007), Augsburg, Germany, September 28, 2007, pp. 1–15. ACM Press, New York (2007)
Ngo, C.W., Zhao, W.L., Jiang, Y.G.: Fast Tracking of Near-Duplicate Keyframes in Broadcast Domain with Transitivity Propagation. In: Proc. ACM Multimedia Conference (October 2006)
Dai, Y.Q., Hu, G.Z., Chen, W.: Graph Theory and Algebra Structure, pp. 89–91. Tsinghua University Press, Beijing (1995) (in Chinese)
O’Connor, N., Cooke, E., le Borgne, H., Blighe, M., Adamek, T.: The AceToolbox: Low-Level Audiovisual Feature Extraction for Retrieval and Classification. In: Proceedings 2nd IEE European Workshop on the Integration of Knowledge, Semantic and Digital Media Technologies, London, U.K (2005)
Liu, C.: A Bayesian discriminating features method for face detection. IEEE Tran. on PAMI 25, 725–740 (2003)
Cooray, S., O’Connor, N.: A Hybrid Technique for Face Detection in Color Images. In: IEEE Conf. on Advanced Video Surveillance (AVSS 2005), Italy, September 15-16 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bai, L., Lao, S., Smeaton, A.F., O’Connor, N.E. (2008). Automatic Summarization of Rushes Video Using Bipartite Graphs. In: Duke, D., Hardman, L., Hauptmann, A., Paulus, D., Staab, S. (eds) Semantic Multimedia. SAMT 2008. Lecture Notes in Computer Science, vol 5392. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92235-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-540-92235-3_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92234-6
Online ISBN: 978-3-540-92235-3
eBook Packages: Computer ScienceComputer Science (R0)