Abstract
The current heterogeneity in networks and devices demands for a high degree of flexibility in IPTV systems for digital television. A scalable video coding scheme (in this paper we focus on H.264/AVC’s scalable video coding extension SVC) accommodates this flexibility from the coding point of view. Because the IP-based network delivery chain in IPTV systems may suffer from packet loss (having a severe impact on the visual quality) it is necessary to provide means for error concealment. In this paper we propose a novel method that performs adaptation on impaired SVC bitstreams so that the resulting adapted bitstream is compliant to the SVC specification and that the reconstruction result at the decoder is equivalent compared to the approach where the error concealment is implemented in the decoder itself. The adapted bitstreams have a significantly higher visual quality while our approach does not require any modification to existing SVC-compliant decoders. The results of several experiments show that the proposed method is extremely fast (over 900 frames/s) and that it introduces a negligible overhead in terms of bit rate (ca. 0.02%).
Similar content being viewed by others
Notes
Note that H.264/AVC and SVC provide maximum flexibility concerning GOP structures, allowing for example the use of hierarchical P pictures for temporal scalability.
References
1080p test sequences. Obtained from ftp://ftp.ldv.e-technik.tu-muenchen.de/pub/test_sequences/1080p/
Agrafiotis, D., Bull, D.R., Canagarajah, C.N.: Enhanced error concealment with mode selection. IEEE Trans. Circuits Syst. Video Technol. 16(8), 960–973 (2006)
Begen, A.C.: Error control for IPTV over xDSL networks. In: Fifth IEEE Consumer Communications and Networking Conference, pp. 632–637, Las Vegas, NV, USA (2007)
Chen, M.-J., Chen, C.-S., Chi, M.-C.: Temporal error concealment algorithm by recursive block-matching principle. IEEE Trans. Circuits Syst. Video Technol. 15(11), 1385–1393 (2005)
Chen, Y., Xie, K., Zhang, F., Pandit, P., Boyce, J.: Frame loss error concealment for SVC. J. Zhejiang Univ. Sci. A 7, 677–683 (2006)
Chiao, H.-T., Chen, F.-C., Hsu, K.-S., Yuan, S.-M.: Video everywhere through a scalable IP-streaming service framework. In: Third International Symposium on Wireless Communication Systems, pp. 190–194, Valencia, Spain (2006)
Degrande, N., DeVleeschauwer, D., Laevens, K.: Protecting IPTV against packet loss: techniques and trade-offs. Bell Labs Tech. J. 13(1), 35–51 (2008)
Elephants dream. Available at http://www.elephantsdream.org/
ISO/IEC JTC 1. Information technology—coding of audio-visual objects—part 2: visual. ISO/IEC 14496-2 (MPEG-4 Visual version 1), April 1999; Amd. 1 (ver. 2), February 2000; Amd. 2, 2001; Amd. 3, 2001; Amd. 4 (Streaming Video Profile), 2001; Amd. 1 to 2nd edn. (Studio Profile), 2001; Amd. 2 to 2nd edn, 2003
ITU-T and ISO/IEC JTC 1. Generic coding of moving pictures and associated audio information—part 2: Video. ITU-T Rec. H.262–ISO/IEC 13818-2 (MPEG-2 Video), November 1994
JSVM v9_12 reference software. Available at http://garcon.ient.rwth-aachen.de/cvs/jvt
Joo, H., Lee, D.-B., Song, H.: Effective IPTV channel management method over heterogeneous environments. In: Conference on Multimedia Systems and Applications, Boston, MA, USA (2007)
Kerpez, K., Waring, D., Lapiotis, G., Lyles, J.B., Vaidyanathan, R.: IPTV service assurance. IEEE Commun. Mag. 4(9), 166–172 (2006)
Kung, W.-Y., Kim, C.-S., Kuo, C.-C.J.: Spatial and temporal error concealment techniques for video transmission over noisy channels. IEEE Trans. Circuits Syst. Video Technol. 16(7), 789–802 (2006)
Maes, J., Peeters, M., Guenach, M., Storry, C.: Maximizing digital subscriber line performance. Bell Labs Tech. J. 13(1), 105–115 (2008)
Schwarz, H., Marpe, D., Wiegand, T.: Analysis of hierarchical B pictures and MCTF. In: IEEE International Conference Multimedia Expo (ICME), July 2006
Schwarz, H., Marpe, D., Wiegand, T.: Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17(9), 1103–1120 (2007)
Segall, A., Sullivan, G.J.: Spatial scalability within the H.264/AVC scalable video coding extension. IEEE Trans. Circuits Syst. Video Technol. 17(9), 1121–1135 (2007)
Van Caenegem, T., Struyve, K., Laevens, K., De Vleeschauwer, D., Sharpe, R.: Maintaining video quality and optimizing video delivery over the bandwidth constrained DSL last mile through intelligent packet drop. Bell Labs Tech. J. 13(1), 53–68 (2008)
Winkler, S.: Digital video quality: vision models and metrics. Wiley, London (2005)
Acknowledgments
The research activities as described in this paper were funded by Ghent University, the Interdisciplinary Institute for Broadband Technology (IBBT), the Institute for the Promotion of Innovation by Science and Technology in Flanders (IWT), the Fund for Scientific Research-Flanders (FWO-Flanders), and the European Union.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lambert, P., Debevere, P., De Cock, J. et al. Real-time error concealing bitstream adaptation methods for SVC in IPTV systems. J Real-Time Image Proc 4, 79–90 (2009). https://doi.org/10.1007/s11554-008-0104-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-008-0104-y