Abstract
MPEG-21 BSDL offers a solution for exposing the structure of a binary media resource as an XML description, and for the generation of a tailored media resource using a transformed XML description. The main contribution of this paper is the introduction of a real-time work flow for the XML-driven adaptation of H.264/AVC bitstreams in the temporal domain. This real-time approach, which is in line with the vision of MPEG-21 BSDL, is made possible by two key technologies: BFlavor (BSDL + XFlavor) for the efficient generation of XML descriptions and Streaming Transformations for XML (STX) for the efficient transformation of these descriptions. Our work flow is validated in several applications, all using H.264/AVC bitstreams: the exploitation and emulation of temporal scalability, as well as the creation of video skims using key frame selection. Special attention is paid to the deployment of hierarchical B pictures and to the use of placeholder slices for synchronization purposes. Extensive performance data are also provided.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Chang, S.-F., Vetro, A.: Video Adaptation: Concepts, Technology, and Open Issues. Proc. the IEEE 93(1), 145–158 (2005)
Sullivan, G.J., Wiegand, T.: Video Compression - From Concepts to the H.264/AVC Standard. Proc. the IEEE 93(1), 18–31 (2005)
Tian, D., Hannuksela, M., Gabbouj, M.: Sub-sequence Video Coding for Improved Temporal Scalability. In: Proceedings 2005 IEEE International Symposium on Circuits and Systems (ISCAS 2005), Kobe, Japan, May 2005, pp. 6074–6077 (2005)
De Neve, W., Van Deursen, D., De Schrijver, D., De Wolf, K., Van de Walle, R.: Using Bitstream Structure Descriptions for the Exploitation of Multi-layered Temporal Scalability in H.264/AVC’s Base Specification. In: Ho, Y.-S., Kim, H.J. (eds.) PCM 2005. LNCS, vol. 3767, pp. 641–652. Springer, Heidelberg (2005)
Schwarz, H., Marpe, D., Wiegand, T.: Analysis of Hierarchical B Pictures and MCTF. In: Proceedings 2006 International Conference on Multimedia & Expo (ICME 2006), Toronto, Canada (July 2006)
Panis, G., Hutter, A., Heuer, J., Hellwagner, H., Kosch, H., Timmerer, T., Devillers, S., Amielh, M.: Bitstream Syntax Description: A Tool for Multimedia Resource Adaptation within MPEG-21. Signal Processing: Image Communication 18, 721–747 (2003)
De Schrijver, D., De Neve, W., De Wolf, K., Van de Walle, R.: Generating MPEG-21 BSDL Descriptions Using Context-Related Attributes. In: Proceedings of the 7th IEEE International Symposium on Multimedia (ISM 2005), USA, December 2005, pp. 79–86 (2005)
Van Deursen, D., De Neve, W., De Schrijver, D., Van de Walle, R.: BFlavor: an Optimized XML-based Framework for Multimedia Content Customization. In: Proceedings of the 25th Picture Coding Symposium (PCS 2006), CD-ROM, Beijing, China, April 2006, p. 6 (2006)
De Neve, W., Van Deursen, D., De Schrijver, D., De Wolf, K., Lerouge, S., Van de Walle, R.: BFlavor: a harmonized approach to media resource adaptation, inspired by MPEG-21 BSDL and XFlavor. In: EURASIP Signal Processing: Image Communication, Elsevier, Amsterdam (accepted for publication)
De Neve, W., De Schrijver, D., Van de Walle, D., Lambert, P., Van de Walle, R.: Description-Based Substitution Methods for Emulating Temporal Scalability in State-of-the-Art Video Coding Formats. In: Proceedings of the 7th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2006), Incheon, Korea, pp. 83–86 (2006)
Devillers, S., Timmerer, C., Heuer, J., Hellwagner, H.: Bitstream Syntax Description-Based Adaptation in Streaming and Constrained Environments. IEEE Trans. Multimedia 7(3), 463–470 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
De Neve, W., De Schrijver, D., Van Deursen, D., Lambert, P., Van de Walle, R. (2006). Real-Time BSD-Driven Adaptation Along the Temporal Axis of H.264/AVC Bitstreams. In: Zhuang, Y., Yang, SQ., Rui, Y., He, Q. (eds) Advances in Multimedia Information Processing - PCM 2006. PCM 2006. Lecture Notes in Computer Science, vol 4261. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11922162_16
Download citation
DOI: https://doi.org/10.1007/11922162_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-48766-1
Online ISBN: 978-3-540-48769-2
eBook Packages: Computer ScienceComputer Science (R0)