Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

A motion compensated lifting wavelet codec for 3D video coding

  • Correspondence
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

A motion compensated lifting (MCLIFT) framework for the 3D wavelet video coding is proposed in this paper. By using bi-directional motion compensation in each lifting step of the temporal direction, the video frames are effectively de-correlated. With the proper entropy coding and bit-stream packaging schemes, the MCLIFT wavelet video coder is scalable at frame rate and quality level. Experimental results show that the MCLIFT video coder outperforms the 3D wavelet video coder without motion by an average of 0.9–1.3dB, and outperforms MPEG-4 coder by an average of 0.2–0.6dB.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Explore related subjects

Find the latest articles, discoveries, and news in related topics.

References

  1. VM Ad-Hoc Group. JPEG2000 Verification Model 6.0. ISO/IEC JTC1/SC29/WG1N1575, Jan., 2000.

  2. Cheng P, Li J, Kuo J. Rate control for embeded wavelet video coder.IEEE Trans., Circuit and System for Video Technology, Aug., 1997, 7(4): 696–702.

    Article  Google Scholar 

  3. Marpe D, Cycon H. Very low bit-rate video coding using wavelet-based techniques.IEEE Trans. Circuits and Systems for Video Technology, Feb., 1999, 9(1): 85–94.

    Article  Google Scholar 

  4. Asbun E, Salama P, Delp E J. A rate-distortion approach to wavelet-based encoding of predictive error frames.IEEE International Conference on Image Processing (ICIP2000), Vancouver, Canada, Sept. 10–13, 2000, 3: 150–153.

  5. Blasiak D, Chan W Y. Efficient wavelet coding of motion compensated prediction residuals. InProc. International Conference on Image Processing, (ICIP 98), Chicago, Illinois, 1998, Vol.2, pp.287–291.

  6. Wien M. Hierarchical wavelet video coding using warping prediction. InIEEE Int. Conf. Image Processing, (ICIP2000), Vancouver, Canada, Sept. 10–13, 2000, Vol.3, pp.142–145.

  7. Kim B J, Pearlman W A. An embedded wavelet video coder using three-dimensional set partitioning in hierarchical trees (SPIHT). InProc. Data Compression Conference (DCC'97), Snowbird. Utah, March 25, 1997, pp.251–260.

  8. Kim B J, Xiong Z, Pearlman W A. Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT).IEEE Trans. Circuits and Systems for Video Technology, December, 2000, 10(8): 1374–1387.

    Article  Google Scholar 

  9. Zhang Y Q, Zafar S. Motion-compensated wavelet transform coding for color video compression.IEEE Trans. Circuits and Systems for Video Technology, Sept., 1992, 2(3): 285–296.

    Article  Google Scholar 

  10. Taubman D, Zakhor A. Multirate 3-D subband coding of video.IEEE Trans. Image Processing, Sept., 1994, 3(5): 572–588.

    Article  Google Scholar 

  11. Ohm J R. Three-dimensional subband coding with motion compensation. InIEEE Trans. Image Processing, Sept., 1994, 3(5): 559–571.

  12. Wang A, Xiong Z, Chou P Aet al. Three-dimensional wavelet coding of video with global motion compensation. InProc. Data Compression Conference'99, Snowbird, Utah, March 29, 1999, pp.404–413.

  13. Xu J Z, Li S, Zhang Y Q, Three-dimensional shapeadaptive discrete wavelet transforms for efficient objectbased video coding.IEEE/SPIE Visual Communications and Image Processing (VCIP 2000), Perth, June, 2000, pp.336–344.

  14. MPEG-4 Video Verification Model Version 16.0. ISO/IEC JTC 1/SC29/WG11 N3312, March, 2000.

  15. Sweldens W. The lifting scheme: A new philosophy in biorthogonal wavelet constructions. InProc. Wavelet Applications in Signal and Image Processing III, SPIE 2569, 1995, pp.68–79.

  16. Daubechies I, Sweldens W. Factoring wavelet transforms into lifting steps.J. Fourier Anal. Appl., 1998, 4: 247–269.

    Article  MATH  MathSciNet  Google Scholar 

  17. Luo L, Wu Y, Li J, Zhang Y Q. Compression of concentric mosaic scenery with alignment and 3D wavelet transform.SPIE Image and Video Communications and Processing, Vol.3974, San Jose, CA, Jan., 2000, pp.31–42.

  18. Luo L, Li J, Li Set al. Motion compensated lifting wavelet and its application in video coding.IEEE Int. Conf. Multimedia and Expo (ICME 2001), Tokyo, Japan, Aug., 2001, pp.481–484.

  19. Luo L, Xu J, Li S, Zhuang Z. Rate control with smoothed temporal distortion for a 3D embedded wavelet video coder.IEEE Int. Conf. Information, Communications & Signal Processing (ICICS 2001), Singapore, Oct., 2001.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lin Luo.

Additional information

This work was performed when the author was with Microsoft Research Asia.

LUO Lin received the B.E. and M.E. degrees from University of Science and Technology of China (USTC) in 1998 and 2000, respectively. She is currently pursuing the Ph.D. degree in electronic engineering at USTC. Her research interests are high-dimensional wavelet coding for video and some graphic medias. Dr. Luo was awarded Microsoft Fellowship from Microsoft Research China in 2000. She is a co-recipient of the Best Student Paper Award of SPIE/IEEE Visual Communications and Image Processing in 2000.

LI Jin received the M.S. and Ph.D. degrees in electrical engineering from Tsinghua University in 1991 and 1994, respectively. He was a research associate at the University of Southern California, Los Angeles, from 1994 to 1996, and a member of technical staff at Sharp Laboratories of America, Camas, WA, from 1996 to 1999. He joined Microsoft Research in 1999, and was a researcher/project leader at Microsoft Research China, Beijing, from 1999 to 2000, and moved to Microsoft Research, Redmond, WA, in 2001. Since 2000, he has also served as an adjunct professor with the Electrical Engineering Department, Tsinghua University. He is an active contributor for the ISO JPEG 2000/MPEG4 Project, and has published over 50 technical papers in various journals and conferences relating to multimedia compression and communication. He is an Area Editor for the Journal of Visual Communication and Image Representation. He was the recipient of the 1994 Ph.D. Dissertation Award from Tsinghua University and the 1998 Young Investigator Award from SPIE Visual Communication and Image Processing.

LI ShiPeng received his B.E. and M.E. degrees both in electrical engineering from the University of Science and Technology of China (USTC) in 1988 and 1991, respectively. He received his Ph.D. degree in electrical engineering from Lehigh University, Bethlehem, PA, in 1996. From Oct. 1996 to May 1999, Dr. Li was with Multimedia Technology Laboratory at Sarnoff Corporation in Princeton, NJ (formerly David Sarnoff Research Center, and RCA Laboratories) as a member of technical staff. He joined Microsoft Research Asia in May 1999. He is currently the research manager of Internet media group. His research interests include scalable media coding and streaming, wireless video Communication, application level networking, object-based image and video coding, video object tracking and extraction, digital right management, etc. He has been actively involved in research and development of digital television, MPEG, JPEG, image/video compression, next generation multimedia standards and applications, consumer electronics. He has authored and co-authored over 70 technical publications and over 20 granted and pending US patents in image/video compression and communications, digital television, multimedia and wireless communication. Dr. Li is a member of Visual Signal Processing and Communications Committee of IEEE Circuits and Systems Society. Dr. Li was the first recipient of dual Sarnoff technical achievement awards in ten years.

ZHUANG ZhenQuan received the Ph.D. degree in electrical engineering from Zhejiang University, China in 1960. Dr. Zhuang is a professor of the Department of Electronic Science and Technology, University of Science and Technology of China (USTC). He is the director of the Intelligent Information Processing Institute of USTC. His research interest is bio-informatics. video and image processing. He has published over 60 technical papers in various journals and conferences in genetic algorithm, neural networks, VLSI, and data mining, etc.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Luo, L., Li, J., Li, S. et al. A motion compensated lifting wavelet codec for 3D video coding. J. Comput. Sci. & Technol. 18, 214–222 (2003). https://doi.org/10.1007/BF02948887

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02948887

Keywords