Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

A polygon soup representation for multiview coding

Published: 01 July 2010 Publication History

Abstract

This paper presents a polygon soup representation for multiview data. Starting from a sequence of multiview video plus depth (MVD) data, the proposed quad-based representation takes into account, in a unified manner, different issues such as compactness, compression, and intermediate view synthesis. The representation is extracted from MVD data in two steps. First, a set of 3D quads is extracted thanks to quadtree decomposition performed on depth maps. Second, a selective elimination of the quads is performed in order to reduce inter-view redundancies and thus provide a compact representation. Moreover, the proposed methodology for extracting the representation allows to reduce ghosting artifacts. Finally, an adapted compression technique is proposed that limits coding artifacts. The results presented on two real sequences show that the proposed representation provides a good trade-off between rendering quality and data compactness.

References

[1]
A. Smolic, K. Müller, P. Merkle, P. Kauff, T. Wiegand, An overview of available and emerging 3d video formats and depth enhanced stereo as efficient generic solution, in: Picture Coding Symposium, Chicago, US, 2009.
[2]
T. Kobayashi, T. Fujii, T. Kimoto, M. Tanimoto, Interpolation of ray-space data by adaptive filtering, in: Three-dimensional Image Capture and Applications, 2000, pp. 252-259.
[3]
Fehn, C., Kauff, P., Op de Beeck, M., Ernst, F., IJsselsteijn, W., Pollefeys, M., Van Gool, L., Ofek, E. and Sexton, I., An evolutionary and optimised approach on 3d-tv. In: Proceedings of International Broadcast Conference, Amsterdam, The Netherlands. pp. 357-365.
[4]
Zitnick, C.L., Kang, S.B., Uyttendaele, M., Winder, S. and Szeliski, R., High-quality video view interpolation using a layered representation. ACM Transactions on Graphics. v23 i3. 600-608.
[5]
A. Smolic, K. Muller, K. Dix, P. Merkle, P. Kauff, T. Wiegand, Intermediate view interpolation based on multiview video plus depth for advanced 3d video systems, in ICIP, 2008, pp. 2448-2451.
[6]
J. Shade, S. Gortler, L. He, R. Szeliski, Layered depth images, in ACM SIGGRAPH, 1998, pp. 231-242.
[7]
W.H.A. Bruls, C. Varekamp, R.K. Gunnewiek, B. Barenbrug, A. Bourge, Enabling introduction of stereoscopic (3d) video: formats and compression standards, in ICIP, 2007, pp. 89-92.
[8]
K. Müller, A. Smolic, K. Dix, P. Kauff, T.Wiegand, Reliability-based generation and view synthesis in layered depth video, in MMSP, 2008, pp. 34-39.
[9]
P. Gargallo, P. Sturm, Bayesian 3d modeling from images using multiple depth maps, in CVPR '05, Washington, DC, USA, 2005, vol. 2, pp. 885-891.
[10]
Pollefeys, M., Nist'er, D., Frahm, J.M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S.J., Merrell, P., Salmi, C., Sinha, S., Talton, B., Wang, L., Yang, Q., Stew'enius, H., Yang, R., Welch, G. and Towles, H., Detailed real-time urban 3d reconstruction from video. International Journal of Computer Vision. v78 i2-3. 143-167.
[11]
Merkle, P., Smolic, A., Muller, K. and Wiegand, T., Multi-view video plus depth representation and coding. ICIP. v1. 201-204.
[12]
Merkle, Y. Morvan, A. Smolic, D. Farin, K. Muller, P.H.N. de With, T. Wiegand, The effect of depth compression on multiview rendering quality, in: 3DTV Conference, 2008.
[13]
Maitre, M. Do, Shape-adaptive wavelet encoding of depth maps, in: Picture Coding Symposium, Chicago, US, 2009.
[14]
S. Yea, A. Vetro, Multi-layered coding of depth for virtual view synthesis, in: Picture Coding Symposium, Chicago, US, 2009.
[15]
J. Evers-Senne, J. Woetzel, R. Koch, Modelling and rendering of complex scenes with a multi-camera rig, in: Conference on Visual Media Production (CVMP), 2004.
[16]
Oh, S. Yea, Y. Ho, Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3d video, in: Picture Coding Symposium, Chicago, US, 2009.
[17]
Tanimoto, M., Overview of free viewpoint television. Signal Processing: Image Communication. v21 i6. 454-461.
[18]
C. Buehler, M. Bosse, L. McMillan, S.J. Gortler, M.F. Cohen, Unstructured lumigraph rendering, in: Eugene Fiume (Ed.) SIGGRAPH 2001, Computer Graphics Proceedings, ACM Press/ACM SIGGRAPH, 2001, pp. 425-432.
[19]
ISO/IEC ITU-T recommandation H264: advanced Video coding for generic audiovisual services, International Standard, Joint Video Team (JVT) of ISO-IEC MPEG & ITU-T VCEG, May 2003.
[20]
ISO/IEC JTC1/SC29/WG11, Text of ISO/IEC 14496-10:200X/FDAM 1 Multiview Video Coding, Doc. N9978, Hannover, Germany, July 2008.
[21]
M. Tanimoto, T. Fujii, K. Suzuki, N. Fukushima, Y. Mori, Reference Softwares for Depth Estimation and View Synthesis, ISO/IEC JTC1/SC29/WG11MPEG2008/M15377, April 2008.
[22]
Yin Zhao, Lu Yu, Peak Signal-to-Perceptible-Noise Ratio Tool: PSPNR 1.0, ISO/IEC JTC1/SC29/WG11 MPEG2009/M16584, London 2009.
[23]
Chou, Chun-Hsien and Li, Yun-Chin, A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile. IEEE Transactions on Circuits and Systems for Video Technology. v5 i6. 467-476.
[24]
Chou, Chun-Hsien and Chen, Chi-Wei, A perceptually optimized 3d subband codec for video communication over wireless channels. IEEE Transactions on Circuits and Systems for Video Technology. v6 i2. 143-156.

Cited By

View all

Index Terms

  1. A polygon soup representation for multiview coding
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    Publisher

    Academic Press, Inc.

    United States

    Publication History

    Published: 01 July 2010

    Author Tags

    1. 3D video
    2. Ghosting artifact
    3. Multiview coding
    4. Multiview video plus depth
    5. Polygon soup
    6. Quadtree
    7. Redundancy simplification
    8. View synthesis

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 0
      Total Downloads
    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 22 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media