Comparison of HEVC-based OMAF-compliant 6K effective packings for viewport-dependent 360-degree video streaming
Authors: 
Maryam Homayouni, Alireza Zare, Alireza Aminlou, Miska M. Hannuksela, Moncef GabboujAuthors Info & Claims
Maryam Homayouni, Alireza Zare, Alireza Aminlou, Miska M. Hannuksela, Moncef GabboujAuthors Info & ClaimsPages 15 - 20
Abstract
Omnidirectional MediA Format (OMAF), a recent standard for representation of 360° video content, supports only equirectangular projection (ERP) and cubemap projection (CMP) and their region-wise packing with a 4K decoding-capability constraint on the end-user devices. Streaming of 4K content allows only a limited viewport resolution, which is lower than the resolution of many current head-mounted displays (HMDs). Two 6K-effective multi-resolution packing schemes for ERP and CMP are recommended by the OMAF standard, which take full advantages of HMDs with quad HD resolution while sticking with 4K-decoding constraint. This paper studies and compares the performance of these two packings in the context of viewport-adaptive streaming using the High Efficiency Video Coding (HEVC) standard and Zonal-PSNR test methodology. Overall, the experimental results show that rate-distortion performance of both packings sequence wise mixed but similar in average.
References
[1]
Y. Sánchez, R. Skupin, and T. Schierl, "Compressed domain video processing for tile based panoramic streaming using HEVC," Proc. of IEEE International Conference on Image Processing (ICIP), pp. 2244--2248, Sep. 2015.
[2]
A. Zare, A. Aminlou, M. M. Hannuksela and M. Gabbouj, "HEVC-compliant tile-based streaming of panoramic video for virtual reality applications," in Proc. of the 2016 ACM on Multimedia Conference, pp. 601--605, Oct. 2016.
[3]
R. Ghaznavi-Youvalari et al., "Comparison of HEVC coding schemes for tile-based viewport-adaptive streaming of omnidirectional video," 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), pp. 1--6, Luton, United Kingdom, 2017.
[4]
A. Zare, A. Aminlou, and M. M. Hannuksela, "Virtual reality content streaming: viewport-dependent and tile-based techniques," IEEE International Conference on Image Processing (ICIP), Sep. 2017
[5]
M. M. Hannuksela, Y.-K. Wang, and A. Hourunranta, "An overview of the OMAF standard for 360° video," Proc. of Data Compression Conference, Mar. 2019.
[6]
M. M. Hannuksela, A. Zare, and Y. Sanchez, "[OMAF] Arrangements for achieving 6K effective resolution with the HEVC viewport dependent baseline profile," document: MPEG M41610, Oct. 2017.
[7]
A. Zare, A. Aminlou, and M. M. Hannuksela, "6K effective resolution with 4K HEVC decoding capability for OMAF-compliant 360° video streaming," Proc. of 23rd Packet Video Workshop, June 2018.
[8]
A. Zare, M. Homayouni, A. Aminlou, M. M. Hannuksela, and M. Gabbouj," 6K and 8K Effective Resolution with 4K HEVC Decoding Capability for 360 Video Streaming," ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 15, No. 2, pp. 1--22, July 2019.
[9]
X. Corbillon, F. De Simone, and G. Simon, "360-Degree Video Head Movement Dataset," in Proc. of the 8th ACM on Multimedia Systems Conference (MMSys'17). ACM, New York, NY, USA, 199--204, 2017.
[10]
R. Ghaznavi-Youvalari, A. Aminlou, and M. M. Hannuksela, "Analysis of regional down-sampling methods for coding of omnidirectional video," Picture Coding Symposium (PCS), 2016.
[11]
A. Aminlou, K. Kammachi-Sreedhar, A. Zare and, M. M. Hannuksela, "Testing methodology for viewport-dependent encoding and streaming," ITU-T Joint Video Exploration Team (JVET), document JVET-D0079, Chengdu, Oct. 2016.
[12]
M. Yu, H. Lakshman and B. Girod, "A Framework to Evaluate Omnidirectional Video Coding Schemes," 2015 IEEE International Symposium on Mixed and Augmented Reality, pp. 31--36, Fukuoka, 2015.
[13]
A. Singla, S. Fremerey, A. Raake, P. List, and B. Feiten, "Measurement of User Exploration Behavior for Omnidirectional (360°) Videos with a Head Mounted Display," ITU-T Joint Video Exploration Team (JVET), document: JVET-H0050, Macao, Oct. 2017.
[14]
High Efficiency Video Coding (HEVC), Fraunhofer Institut for Telecommunications, Heinrich Hertz Institute, Accessed Apr. 2016 from https://hevc.hhi.fraunhofer.de/.
[15]
J. Boyce, K. Suehring, X. Li, V. Seregin, "JVET common test conditions and software reference configurations," Joint Video Exploration Team of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-J1010, Apr. 2018, San Diego, USA.
[16]
<u>360Lib,_accessed_February_2019,_from https://jvet.hhi.fraunhofer.de/svn/svn_360Lib/tags/360Lib-5.0/</u>
[17]
G. Bjøntegard, "Calculation of average PSNR differences between RD-curves," document: VCEG-M33, Austin, 2001.
Index Terms
- Comparison of HEVC-based OMAF-compliant 6K effective packings for viewport-dependent 360-degree video streaming
Recommendations
6K and 8K Effective Resolution with 4K HEVC Decoding Capability for 360 Video Streaming
Special Section on Cross-Media Analysis for Visual Question Answering, Special Section on Big Data, Machine Learning and AI Technologies for Art and Design and Special Section on MMSys/NOSSDAV 2018The recent Omnidirectional MediA Format (OMAF) standard, which specifies the delivery of 360° video content, supports only equirectangular projection (ERP) and cubemap projection and their region-wise packing with a limitation on video decoding ...
HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications
MM '16: Proceedings of the 24th ACM international conference on MultimediaDelivering wide-angle and high-resolution spherical panoramic video content entails a high streaming bitrate. This imposes challenges when panorama clips are consumed in virtual reality (VR) head-mounted displays (HMD). The reason is that the HMDs ...
6K Effective Resolution with 4K HEVC Decoding Capability for OMAF-compliant 360° Video Streaming
PV '18: Proceedings of the 23rd Packet Video WorkshopThe recent Omnidirectional MediA Format (OMAF) standard specifies delivery of 360° video content. OMAF supports only equirectangular (ERP) and cubemap projections and their region-wise packing with a limitation on video decoding capability to the ...
Comments
Information & Contributors
Information
Published In
June 2020
47 pages
ISBN:9781450379465
DOI:10.1145/3386292
- General Chair:
- Hermann Hellwagner,
- Program Chairs:
- Yao Liu,
- Igor D. D. Curcio
Copyright © 2020 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 June 2020
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
MMSys '20
Sponsor:
Acceptance Rates
PV '20 Paper Acceptance Rate 6 of 14 submissions, 43%;
Overall Acceptance Rate 8 of 23 submissions, 35%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 110Total Downloads
- Downloads (Last 12 months)8
- Downloads (Last 6 weeks)2
Reflects downloads up to 26 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in