Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Coding and Quality Evaluation of Affordable 6DoF Video Content

  • Conference paper
  • First Online:
Image and Graphics (ICIG 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12890))

Included in the following conference series:

  • 2662 Accesses

Abstract

We present a coding and quality evaluation method for Six Degrees of Freedom (6DoF) video content. Firstly, the 6DoF video content is generated using an affordable capturing setup, and represented as the commonly used 6DoF format 3-D mesh. To overcome the difficulty in exploiting the temporal redundancy in mesh with different connectivity at every frame, we transform the mesh sequence into colored point clouds for compression, which saves the bit budget for connectivity while keeping the photo-realistic characteristics of the 3-D object. We compress the point cloud sequence using MPEG video-based point cloud compression structure, which can achieve the bit rate close to common media format. We also conduct projection-based and point-based quality evaluation to examine the compression distortion effect. Particularly, we employ PCA to find the representative viewing perspective for projection. We will release some data set and source codes to foster further research in this area.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://github.com/I2MLab/Translation-and-Scaling-for-geometry-cooridnates-of-point-clouds.

References

  1. Point cloud compression category 2 reference software, TMC2 v7.0. http://mpegx.intevry.fr/software/MPEG/PCC/TM/mpeg-pcc-tmc2.git. Accessed Mar 2020

  2. Collet, A., et al.: High-quality streamable free-viewpoint video. ACM Trans. Graph. (TOG) 34(4), 69 (2015)

    Article  Google Scholar 

  3. Tian, D., Ochimizu, H., Feng, C., Cohen, R., Vetro, A.: Evaluation metrics for point cloud compression. ISO/IEC JTC1/SC29/WG11 MPEG2016/M39966, Geneva, CH (2017)

    Google Scholar 

  4. Eisert, P., Steinbach, E., Girod, B.: Multi-hypothesis, volumetric reconstruction of 3-D objects from multiple calibrated camera views. In: 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 1999. Proceedings, vol. 6, pp. 3509–3512 (1999)

    Google Scholar 

  5. Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., Stuetzle, W.: Surface reconstruction from unorganized points. In: ACM SIGGRAPH 1992 Proceedings, pp. 71–78 (1992)

    Google Scholar 

  6. Mammou, K.: PCC Test Model Category 2 v0. ISO/IEC JTC1/SC29 WG11 Doc. N17248, Macau, China (2017)

    Google Scholar 

  7. Krichenbauer, M., Yamamoto, G., Taketom, T., Sandor, C., Kato, H.: Augmented reality versus virtual reality for 3D object manipulation. IEEE Trans. Visual. Comput. Graph. 24(2), 1038–1048 (2018)

    Article  Google Scholar 

  8. Kubota, A., Smolic, A., Magnor, M., Tanimoto, M., Chen, T., Zhang, C.: Multiview imaging and 3DTV. IEEE Signal Process. Mag. 24(6), 10–21 (2007)

    Article  Google Scholar 

  9. Liu, Y., Dai, Q., Xu, W.: A point-cloud-based multiview stereo algorithm for free-viewpoint video. IEEE Trans. Visual. Comput. Graph. 16(3), 407–418 (2010)

    Article  Google Scholar 

  10. Maglo, A., Lavoué, G., Dupont, F., Hudelot, C.: 3D mesh compression: survey, comparisons, and emerging trends. ACM Comput. Surv. 47(3), 44 (2015)

    Article  Google Scholar 

  11. Mamou, K., Zaharia, T., Prêteux, F.: FAMC: the MPEG-4 standard for animated mesh compression. In: 15th IEEE International Conference on Image Processing, 2008. ICIP 2008, pp. 2676–2679. IEEE (2008)

    Google Scholar 

  12. Mamou, K., Zaharia, T., Prêteux, F.: TFAN: a low complexity 3D mesh compression algorithm. Comput. Anim. Virtual Worlds 20(2–3), 343–354 (2009)

    Article  Google Scholar 

  13. Mekuria, R., Sanna, M., Izquierdo, E., Bulterman, D.C., Cesar, P.: Enabling geometry-based 3-D tele-immersion with fast mesh compression and linear rateless coding. IEEE Trans. Multimedia 16(7), 1809–1820 (2014)

    Article  Google Scholar 

  14. Muja, M., G. Lowe, D.: Fast approximate nearest neighbors with automatic algorithm configuration. In: VISAPP International Conference on Computer Vision Theory and Applications, pp. 331–340 (2009)

    Google Scholar 

  15. Pagés, R., Amplianitis, K., Monaghan, D., Ondřej, J., Smolić, A.: Affordable content creation for free-viewpoint video and VR/AR applications. J. Vis. Commun. Image Represent. 53, 192–201 (2018)

    Article  Google Scholar 

  16. Peters, J., Reif, U.: Subdivision Surfaces. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-76406-9

  17. Smolic, A., et al.: Free viewpoint video extraction, representation, coding, and rendering. In: IEEE International Conference on Image Processing, 2004. ICIP 2004, vol. 5, pp. 3287–3290 (2004)

    Google Scholar 

  18. Starck, J., Hilton, A.: Surface capture for performance-based animation. IEEE Comput. Graph. Appl. 27(3), 21–31 (2007)

    Article  Google Scholar 

  19. Sullivan, G.J., Ohm, J.R., Han, W.J., Wiegand, T., et al.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)

    Article  Google Scholar 

  20. Theobalt, C., Ziegler, G., Magnor, M., Seidel, H.P.: Model-based free-viewpoint video: acquisition, rendering, and encoding. In: Proceedings of Picture Coding Symposium, San Francisco, USA, pp. 1–6 (2004)

    Google Scholar 

  21. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  22. Wu, C., Varanasi, K., Liu, Y., Seidel, H.P., Theobalt, C.: Shading-based dynamic shape refinement from multi-view video under general illumination. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 1108–1115 (2011)

    Google Scholar 

  23. Zerman, E., Gao, P., Ozcinar, C., Smolic, A.: Subjective and objective quality assessment for volumetric video compression. In: IS&T Electronic Imaging, Image Quality and System Performance XVI (2019)

    Google Scholar 

Download references

Acknowledgements

This work is supported in part by Aeronautical Science Foundation of China under Grant 201951052001, the Natural Science Foundation of Jiangsu Province under Grant BK20170806, and the Natural Science Foundation of China under Grant 61701227. The authors would like to thank Prof. A. Smolic, Dr. E. Zerman, and Dr. C. Ozcinar for their guidance and helpful advice on various technical issues examined in this paper. The authors also would like to thank Volograms Ltd. For making their created holograms accessible.

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, China

    Pan Gao

  2. Science and Technology on Electro-Optic Control Laboratory, Luoyang, China

    Pan Gao, Ran Wei & Yingjie Liu

  3. Charles Sturt University, Bathurst, NSW, 2795, Australia

    Manoranjan Paul

Authors
  1. Pan Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ran Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yingjie Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Manoranjan Paul
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pan Gao .

Editor information

Editors and Affiliations

  1. Peking University, Beijing, China

    Yuxin Peng

  2. Tsinghua University, Beijing, China

    Shi-Min Hu

  3. Tampere University, Tampere, Finland

    Moncef Gabbouj

  4. Zhejiang University, Hangzhou, China

    Kun Zhou

  5. Technion – Israel Institute of Technology, Haifa, Israel

    Michael Elad

  6. Tsinghua University, Beijing, China

    Kun Xu

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gao, P., Wei, R., Liu, Y., Paul, M. (2021). Coding and Quality Evaluation of Affordable 6DoF Video Content. In: Peng, Y., Hu, SM., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds) Image and Graphics. ICIG 2021. Lecture Notes in Computer Science(), vol 12890. Springer, Cham. https://doi.org/10.1007/978-3-030-87361-5_55

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87361-5_55

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87360-8

  • Online ISBN: 978-3-030-87361-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation