Abstract
A motion compensated lifting (MCLIFT) framework for the 3D wavelet video coding is proposed in this paper. By using bi-directional motion compensation in each lifting step of the temporal direction, the video frames are effectively de-correlated. With the proper entropy coding and bit-stream packaging schemes, the MCLIFT wavelet video coder is scalable at frame rate and quality level. Experimental results show that the MCLIFT video coder outperforms the 3D wavelet video coder without motion by an average of 0.9–1.3dB, and outperforms MPEG-4 coder by an average of 0.2–0.6dB.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.References
VM Ad-Hoc Group. JPEG2000 Verification Model 6.0. ISO/IEC JTC1/SC29/WG1N1575, Jan., 2000.
Cheng P, Li J, Kuo J. Rate control for embeded wavelet video coder.IEEE Trans., Circuit and System for Video Technology, Aug., 1997, 7(4): 696–702.
Marpe D, Cycon H. Very low bit-rate video coding using wavelet-based techniques.IEEE Trans. Circuits and Systems for Video Technology, Feb., 1999, 9(1): 85–94.
Asbun E, Salama P, Delp E J. A rate-distortion approach to wavelet-based encoding of predictive error frames.IEEE International Conference on Image Processing (ICIP2000), Vancouver, Canada, Sept. 10–13, 2000, 3: 150–153.
Blasiak D, Chan W Y. Efficient wavelet coding of motion compensated prediction residuals. InProc. International Conference on Image Processing, (ICIP 98), Chicago, Illinois, 1998, Vol.2, pp.287–291.
Wien M. Hierarchical wavelet video coding using warping prediction. InIEEE Int. Conf. Image Processing, (ICIP2000), Vancouver, Canada, Sept. 10–13, 2000, Vol.3, pp.142–145.
Kim B J, Pearlman W A. An embedded wavelet video coder using three-dimensional set partitioning in hierarchical trees (SPIHT). InProc. Data Compression Conference (DCC'97), Snowbird. Utah, March 25, 1997, pp.251–260.
Kim B J, Xiong Z, Pearlman W A. Low bit-rate scalable video coding with 3-D set partitioning in hierarchical trees (3-D SPIHT).IEEE Trans. Circuits and Systems for Video Technology, December, 2000, 10(8): 1374–1387.
Zhang Y Q, Zafar S. Motion-compensated wavelet transform coding for color video compression.IEEE Trans. Circuits and Systems for Video Technology, Sept., 1992, 2(3): 285–296.
Taubman D, Zakhor A. Multirate 3-D subband coding of video.IEEE Trans. Image Processing, Sept., 1994, 3(5): 572–588.
Ohm J R. Three-dimensional subband coding with motion compensation. InIEEE Trans. Image Processing, Sept., 1994, 3(5): 559–571.
Wang A, Xiong Z, Chou P Aet al. Three-dimensional wavelet coding of video with global motion compensation. InProc. Data Compression Conference'99, Snowbird, Utah, March 29, 1999, pp.404–413.
Xu J Z, Li S, Zhang Y Q, Three-dimensional shapeadaptive discrete wavelet transforms for efficient objectbased video coding.IEEE/SPIE Visual Communications and Image Processing (VCIP 2000), Perth, June, 2000, pp.336–344.
MPEG-4 Video Verification Model Version 16.0. ISO/IEC JTC 1/SC29/WG11 N3312, March, 2000.
Sweldens W. The lifting scheme: A new philosophy in biorthogonal wavelet constructions. InProc. Wavelet Applications in Signal and Image Processing III, SPIE 2569, 1995, pp.68–79.
Daubechies I, Sweldens W. Factoring wavelet transforms into lifting steps.J. Fourier Anal. Appl., 1998, 4: 247–269.
Luo L, Wu Y, Li J, Zhang Y Q. Compression of concentric mosaic scenery with alignment and 3D wavelet transform.SPIE Image and Video Communications and Processing, Vol.3974, San Jose, CA, Jan., 2000, pp.31–42.
Luo L, Li J, Li Set al. Motion compensated lifting wavelet and its application in video coding.IEEE Int. Conf. Multimedia and Expo (ICME 2001), Tokyo, Japan, Aug., 2001, pp.481–484.
Luo L, Xu J, Li S, Zhuang Z. Rate control with smoothed temporal distortion for a 3D embedded wavelet video coder.IEEE Int. Conf. Information, Communications & Signal Processing (ICICS 2001), Singapore, Oct., 2001.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was performed when the author was with Microsoft Research Asia.
LUO Lin received the B.E. and M.E. degrees from University of Science and Technology of China (USTC) in 1998 and 2000, respectively. She is currently pursuing the Ph.D. degree in electronic engineering at USTC. Her research interests are high-dimensional wavelet coding for video and some graphic medias. Dr. Luo was awarded Microsoft Fellowship from Microsoft Research China in 2000. She is a co-recipient of the Best Student Paper Award of SPIE/IEEE Visual Communications and Image Processing in 2000.
LI Jin received the M.S. and Ph.D. degrees in electrical engineering from Tsinghua University in 1991 and 1994, respectively. He was a research associate at the University of Southern California, Los Angeles, from 1994 to 1996, and a member of technical staff at Sharp Laboratories of America, Camas, WA, from 1996 to 1999. He joined Microsoft Research in 1999, and was a researcher/project leader at Microsoft Research China, Beijing, from 1999 to 2000, and moved to Microsoft Research, Redmond, WA, in 2001. Since 2000, he has also served as an adjunct professor with the Electrical Engineering Department, Tsinghua University. He is an active contributor for the ISO JPEG 2000/MPEG4 Project, and has published over 50 technical papers in various journals and conferences relating to multimedia compression and communication. He is an Area Editor for the Journal of Visual Communication and Image Representation. He was the recipient of the 1994 Ph.D. Dissertation Award from Tsinghua University and the 1998 Young Investigator Award from SPIE Visual Communication and Image Processing.
LI ShiPeng received his B.E. and M.E. degrees both in electrical engineering from the University of Science and Technology of China (USTC) in 1988 and 1991, respectively. He received his Ph.D. degree in electrical engineering from Lehigh University, Bethlehem, PA, in 1996. From Oct. 1996 to May 1999, Dr. Li was with Multimedia Technology Laboratory at Sarnoff Corporation in Princeton, NJ (formerly David Sarnoff Research Center, and RCA Laboratories) as a member of technical staff. He joined Microsoft Research Asia in May 1999. He is currently the research manager of Internet media group. His research interests include scalable media coding and streaming, wireless video Communication, application level networking, object-based image and video coding, video object tracking and extraction, digital right management, etc. He has been actively involved in research and development of digital television, MPEG, JPEG, image/video compression, next generation multimedia standards and applications, consumer electronics. He has authored and co-authored over 70 technical publications and over 20 granted and pending US patents in image/video compression and communications, digital television, multimedia and wireless communication. Dr. Li is a member of Visual Signal Processing and Communications Committee of IEEE Circuits and Systems Society. Dr. Li was the first recipient of dual Sarnoff technical achievement awards in ten years.
ZHUANG ZhenQuan received the Ph.D. degree in electrical engineering from Zhejiang University, China in 1960. Dr. Zhuang is a professor of the Department of Electronic Science and Technology, University of Science and Technology of China (USTC). He is the director of the Intelligent Information Processing Institute of USTC. His research interest is bio-informatics. video and image processing. He has published over 60 technical papers in various journals and conferences in genetic algorithm, neural networks, VLSI, and data mining, etc.
Rights and permissions
About this article
Cite this article
Luo, L., Li, J., Li, S. et al. A motion compensated lifting wavelet codec for 3D video coding. J. Comput. Sci. & Technol. 18, 214–222 (2003). https://doi.org/10.1007/BF02948887
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02948887