Abstract
In this paper, a novel shot boundary detection algorithm is introduced for H.264/AVC bitstreams. This algorithm relies on features present in a compressed video bitstream, i.e., macroblock types and reference directions. In contrast to existing algorithms, the proposed technique is able to analyze bitstreams with frames containing different types of slices. To deal with such frames, formulas are presented that work on inter- and intra-coded slices. The results obtained for the different types of slices are combined by calculating a linear combination, taking into account their size. This way, a metric is found that can be used for the automatic detection of shot boundaries. Results show that the proposed algorithm has a high accuracy in terms of recall and precision for video sequences with frames containing multiple slice types.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Hanjalic, A.: Shot-Boundary Detection: Unraveled and Resolved? IEEE Transactions on Circuits and Systems for Video Technology, 90–105 (2002)
Lienhart, R.: Comparison of automatic shot boundary detection algorithms. In: Proceedings of SPIE Storage and Retrieval for Image and Video Databases VII vol. 3656, pp. 290–301 (1999)
Gargi, U., Kasturi, R., Strayer, S.: Performance Characterization of Video-Shot-Change Detection Methods. IEEE Transactions on Circuits and Systems for Video Technology 10(1), 1–13 (2000)
Wiegard, T., Sullivan, G., Bjontegaard, G., Luthra, A.: Overview of the H.264/AVC Video Coding Standard. IEEE Transactions on Circuits and Systems for Video Technology 13(7), 560–576 (2003)
Kim, S.M., Byun, J., Won, C.: A scene change detection in H.264/AVC compression domain. In: Ho, Y.-S., Kim, H.J. (eds.) PCM 2005. LNCS, vol. 3768, pp. 1072–1082. Springer, Heidelberg (2005)
De Bruyne, S., De Neve, W., De Wolf, K., De Schrijver, D., Verhoeve, P., Van de Walle, R.: Temporal video segmentation on H.264/AVC compressed bitstreams. In: Cham, T.-J., Cai, J., Dorai, C., Rajan, D., Chua, T.-S., Chia, L.-T. (eds.) MMM 2007. LNCS, vol. 4351, pp. 1–12. Springer, Heidelberg (2006)
Liu, Y., Wang, W., Gao, W., Zeng, W.: A novel compressed domain shot segmentation algorithm on H.264/AVC. In: Proceedings of ICIP 2004, vol. 4, pp. 2235–2238 (2004)
Undheim, A., Lin, Y., Emstad, P.J.: Characterization of Slice-based H.264/AVC Encoded Video Traffic. In: Proceedings of the ECUMN 2007 (2007)
Lambert, P., De Neve, W., Dhondt, Y., Van de Walle, R.: Flexible macroblock ordering in H.264/AVC. Journal of Visual Communications & Image Representation 17, 358–375 (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
De Bruyne, S., De Neve, W., De Schrijver, D., Lambert, P., Verhoeve, P., Van de Walle, R. (2007). Shot Boundary Detection for H.264/AVC Bitstreams with Frames Containing Multiple Types of Slices. In: Ip, H.HS., Au, O.C., Leung, H., Sun, MT., Ma, WY., Hu, SM. (eds) Advances in Multimedia Information Processing – PCM 2007. PCM 2007. Lecture Notes in Computer Science, vol 4810. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77255-2_20
Download citation
DOI: https://doi.org/10.1007/978-3-540-77255-2_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77254-5
Online ISBN: 978-3-540-77255-2
eBook Packages: Computer ScienceComputer Science (R0)