Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Interactive Content-aware Video Streaming System with Fine Granularity Scalability

  • Published:
Journal of VLSI signal processing systems for signal, image and video technology Aims and scope Submit manuscript

Abstract

Video streaming with varying transmission bandwidth is becoming increasingly important. In this paper, an interactive video streaming system is proposed. Fine Granularity Scalability (FGS) is applied to be the streaming video format. The computational complexity of FGS coding is analyzed to explore an efficient FGS implementation. A new transmission model is proposed for the realization of a content-aware video streaming. At encoder side, the current MPEG-4 FGS coding flow is reordered such that the picture-level maximum can be acquired in advance and bit-plane data can be dynamically adapted. With these proposed hardware-oriented optimization approaches, a hardwired FGS block-level processing core is proposed to achieve a cost-effective solution to FGS implementation. The streaming server can adaptively decide quality-enhanced region by selective enhancement according to both object information from encoding side and user-defined region from receiver side. From the simulation results, it’s demonstrated that the proposed approach can provide better quality in users’ interest regions with no bit-rate or complexity overhead.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. http://www.microsoft.com/windows/windowsmedia/default.aspx

  2. http://www.realnetworks.com/index.html

  3. http://www.apple.com/quicktime/index.html

  4. G.J. Conklin, G.S. Greenbaum, K.O. Lillevold, A.F. Lippman, and Y.A. Reznik, ‘Video coding for streaming media delivery on the internet,’ IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, no. 3, 2001, pp. 269–281.

    Article  Google Scholar 

  5. D. Wu, Y.T. Hou, W. Zhu, Y.Q. Zhang, and J.M. Peha, ‘Streaming video over the internet: Approaches and directions,’ IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, no. 3, 2001, pp. 282–300.

    Article  Google Scholar 

  6. J.G. Apostolopoulos, W.T. Tan, and S.J. Wee, ‘Video streaming: Concepts, algorithms, and systems,’ HP, Tech. Rep. HPL-2002-260, 2002.

  7. W. Li, F. Ling, and X. Chen, ‘Fine granularity scalability in MPEG-4 for streaming video,’ in IEEE International Symposium on Circuits and Systems (ISCAS), vol. 1, 2000, pp. 299–302.

    Google Scholar 

  8. W. Li, ‘Overview of fine granularity scalability in MPEG-4 video standard,’ IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, no. 3, 2001, pp. 301–317.

    Article  Google Scholar 

  9. ISO/IEC, 13818-2, Information technology—Generic coding of moving pictures and associated audio information- Part 2: Visual, ISO/IEC Std., 1994.

  10. ISO/IEC 14496-2, Information technology—Generic coding of audio-visual objects—Part 2: Visual, ISO/IEC Std., 1999.

  11. R. Aravind, M.R. Civanlar, and A.R. Reibman, ‘Packet loss resilience of MPEG-2 scalable video coding algorithms,’ IEEE Transactions on Circuits and Systems for Video Technology, vol. 6, no. 5, 1996, pp. 426–435.

    Article  Google Scholar 

  12. U. Benzler, ‘Spatial scalable video coding using a combined subband-DCT approach,’ IEEE Transactions on Circuits and Systems for Video Technology, vol. 10, no. 7, 2000, pp. 1080–1087.

    Article  Google Scholar 

  13. G.J. Conklin and S.S. Hemami, ‘A comparison of temporal scalability techniques,’ IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, no. 6, 1999, pp. 909–919.

    Article  Google Scholar 

  14. ISO/IEC 14496-2:1999/FDAM4: Streaming video profile, ISO/IEC JTC1/SC29/WG11 Final Draft Amendment N3904, 2001.

  15. H. Radha, M. van der Schaar, and Y. Chen, ‘The MPEG-4 fine-grained scalable video coding method for multimedia streaming over IP,’ IEEE Transactions on Multimedia, vol. 3, no. 1, 2001, pp. 53–68.

    Article  Google Scholar 

  16. F. Wu, S.U, and Y.Q. Zhang, ‘A framework for efficient progressive fine granularity scalable video coding,’ IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, no, 3, 2001, pp. 332–344.

    Article  Google Scholar 

  17. X. Fan, G. Shen, S. Li, T.D. Tran, and Y.Q. Zhang, ‘Rate-distortion optimization of macroblock-based progressive fine granularity scalable video codec,’ in IEEE International Symposium on Circuits and Systems (ISCAS), vol. 4, 2002, pp. 540–543.

    Google Scholar 

  18. X. Sun, F. Wu, S. Li, W. Gao, and Y.Q. Zhang, ‘Seamless switching of scalable video bitstreams for efficient streaming,’ in IEEE International Symposium on Circuits and Systems (ISCAS), vol. 3, 2002, pp. 385–388.

    Google Scholar 

  19. H.C. Huang, C.N. Wang, and T. Chiang, ‘A robust fine granularity scalability using trellis-based predictive leak,’ IEEE Transactions on Circuits and Systems for Video Technology, vol. 12, no. 6, 2002, pp. 372–385.

    Article  Google Scholar 

  20. Y.S. Chen and Y.C. Chen, ‘Design of MPEG4 fine granularity scalability encoder for multimedia streaming,’ in Workshop on Consumer Electronics (WCE), vol. 2, 2001, pp. 45–48.

    Google Scholar 

  21. R.K. Rajendran, M. van der Schaar, and S.F. Chang, ‘FGS+: optimizing the joint SNR-temporal video quality in MPEG-4 fine grained scalable coding,’ in IEEE International Symposium on Circuits and Systems (ISCAS), vol. 1, 2002, pp. 445–448.

    Google Scholar 

  22. M. van der Schaar and H. Radha, ‘Adaptive motion-compensation fine-granular-scalability (AMC-FGS) for wireless video,’ IEEE Transactions on Circuits and Systems for Video Technology, vol. 12, no. 6, 2002, pp. 360–371.

    Article  Google Scholar 

  23. M. van der Schaar and Y.T. Lin, ‘Content-based selective enhancement for streaming video,’ in IEEE International Conference on Image Processing (ICIP), 2001, pp. 977–980.

  24. Y. He, S. Yang, and Y. Zhong, ‘Block-based fine granularity scalable video coding for content-aware streaming,’ in IEEE International Conference on Image Processing (ICIP), vol. 2, 2002, pp. 45–48.

    Google Scholar 

  25. S.F. Chang and P. Bocheck, ‘Principles and applications of content-aware video communication,’ in IEEE International Symposium on Circuits and Systems (ISCAS), vol. 4, 2000, pp. 33–36.

    Google Scholar 

  26. ‘MPEG-4 VM FPDAM1-FPDAM4,’ MoMuSys, 2000.

  27. H. Jiang and G.M. Thayer, ‘Using frequency weighting in FGS bit-plane coding for natural video,’ ISO/IEC JTC1/SC29/WG11 MPEG99/M5489, 1999.

  28. W. Li, ‘Frequency weighting for FGS,’ ISO/IEC JTC1/SC29/WG11 MPEG99/M5589, 1999.

  29. C.W. Hsu, W.M. Chao, Y.C. Chang, and L.G. Chen, ‘Texture coder design of MPEG-4 video by using interleaving schedule,’ in IEEE International Conference on Multimedia and Expo (ICME), vol. 2, 2002, pp. 157–160.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DSP/IC Design Lab Department of Electrical Engineering and Graduate Institute of Electronics Engineering, National Taiwan University, Taipei, Taiwan, R.O.C.

    Yung-Chi Chang, Chih-Wei Hsu, Wei-Min Chao & Liang-Gee Chen

Authors
  1. Yung-Chi Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chih-Wei Hsu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei-Min Chao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Liang-Gee Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Yung-Chi Chang was born in Kaohsiung, Taiwan, R.O.C., in 1975. He received the B.S., M.S., and Ph.D. degrees from the Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan, R.O.C., in 1998, 2000, and 2005, respectively. He serves as senior engineer in SoC Solutions Dept., Vivotek Inc. now. His research interests include video coding algorithms and VLSI architectures for image/video processing.

Chih-Wei Hsu was born in Taipei, Taiwan, in 1979. He received the B.S.E.E and M.S.E.E degrees from National Taiwan University (NTU), Taipei, in 2001 and 2003, respectively. He joined MediaTek, Inc., Hsinchu, Taiwan, in 2003, where he develops integrated circuits related to multimedia coding standard and digital consumer devices. His research interests include video coding, video processing and VLSI design.

Wei-Min Chao was born in Taoyuan, Taiwan, R.O.C., in 1977. He received the B.S. and M.S. degrees from the Department of Electronics Engineering, National Taiwan University in 2000 and 2002 separately. His research interests include video coding algorithms and VLSI architecture for image and video processing.

Liang-Gee Chen was born in Yun-Lin, Taiwan, in 1956. He received the B.S., M.S., and Ph.D. degrees in electrical engineering from National Cheng Kung University, Tainan, Taiwan, in 1979, 1981, and 1986, respectively. He was an Instructor (1981–1986), and an Associate Professor (1986–1988) in the Department of Electrical Engineering, National Cheng Kung University. In the military service during 1987 to 1988, he was an Associate Professor in the Institute of Resource Management, Defense Management College. In 1988, he joined the Department of Electrical Engineering, National Taiwan University. During 1993 to 1994 he was a Visiting Consultant of DSP Research Department, AT&T Bell Lab, Murray Hill. In 1997, he was a visiting scholar of the Department of Electrical Engineering, University of Washington, Seattle. During 2001 to 2004, he was the first director of the Graduate Institute of Electronics Engineering (GIEE) in National Taiwan University (NTU). Currently, he is a Professor of the Department of Electrical Engineering and GIEE in NTU, Taipei, Taiwan. He is also the director of the Electronics and Optoelectronics Research Laboratories in Industrial Technology Research Institute, Hsinchu, Taiwan. His current research interests are DSP architecture design, video processor design, and video coding systems. Dr. Chen has served as an Associate Editor of IEEE Transactions on Circuits and Systems for Video Technology since 1996, as Associate Editor of IEEE Transactions on VLSI Systems since 1999, and as Associate Editor of IEEE Transactions on Circuits and Systems II since 2000. He has been the Associate Editor of the Journal of Circuits, Systems, and Signal Processing since 1999, and a Guest Editor for the Journal of Video Signal Processing Systems. He is also the Associate Editor of the Proceedings of the IEEE. He was the General Chairman of the 7th VLSI Design/CAD Symposium in 1995 and of the 1999 IEEE Workshop on Signal Processing Systems: Design and Implementation. He is the Past-Chair of Taipei Chapter of IEEE Circuits and Systems (CAS) Society, and is a member of the IEEE CAS Technical Committee of VLSI Systems and Applications, the Technical Committee of Visual Signal Processing and Communications, and the IEEE Signal Processing Technical Committee of Design and Implementation of SP Systems. He is the Chair-Elect of the IEEE CAS Technical Committee on Multimedia Systems and Applications. During 2001–2002, he served as a Distinguished Lecturer of the IEEE CAS Society. He received the Best Paper Award from the R.O.C. Computer Society in 1990 and 1994. Annually from 1991 to 1999, he received Long-Term (Acer) Paper Awards. In 1992, he received the Best Paper Award of the 1992 Asia-Pacific Conference on circuits and systems in the VLSI design track. In 1993, he received the Annual Paper Award of the Chinese Engineer Society. In 1996 and 2000, he received the Outstanding Research Award from the National Science Council, and in 2000, the Dragon Excellence Award from Acer. He is a member of Phi Tan Phi.

About this article

Cite this article

Chang, YC., Hsu, CW., Chao, WM. et al. Interactive Content-aware Video Streaming System with Fine Granularity Scalability. J VLSI Sign Process Syst Sign Image Video Technol 44, 117–134 (2006). https://doi.org/10.1007/s11265-006-7511-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-006-7511-8

Keywords

Search

Navigation