demonstration

HTML5 MSE playback of MPEG 360 VR tiled streaming: JavaScript implementation of MPEG-OMAF viewport-dependent video profile with HEVC tiles

Authors:

Dimitri Podborski,

Jangwoo Son,

Gurdeep Singh Bhullar,

Robert Skupin,

Yago Sanchez,

Cornelius Hellge,

Thomas SchierlAuthors Info & Claims

MMSys '19: Proceedings of the 10th ACM Multimedia Systems Conference

Pages 324 - 327

https://doi.org/10.1145/3304109.3323835

Published: 18 June 2019 Publication History

Get Access

Abstract

Virtual Reality (VR) and 360-degree video streaming have gained significant attention in recent years. First standards have been published in order to avoid market fragmentation. For instance, 3GPP released its first VR specification to enable 360-degree video streaming over 5G networks which relies on several technologies specified in ISO/IEC 23090-2, also known as MPEG-OMAF. While some implementations of OMAF-compatible players have already been demonstrated at several trade shows, so far, no web browser-based implementations have been presented. In this demo paper we describe a browser-based JavaScript player implementation of the most advanced media profile of OMAF: HEVC-based viewport-dependent OMAF video profile, also known as tile-based streaming, with multi-resolution HEVC tiles. We also describe the applied workarounds for the implementation challenges we encountered with state-of-the-art HTML5 browsers. The presented implementation was tested in the Safari browser with support of HEVC video through the HTML5 Media Source Extensions API. In addition, the WebGL API was used for rendering, using region-wise packing metadata as defined in OMAF.

References

[1]

3GPP. 2019. 5G; 3GPP Virtual reality profiles for streaming applications. Technical Specification (TS) 26.118. 3rd Generation Partnership Project. Version 15.1.0.

Google Scholar

[2]

GPAC 2019. GPAC Multimedia Open Source Project, JavaScript version of GPAC's MP4Box tool. Retrieved April 19, 2019 from https://gpac.github.io/mp4box.js

Google Scholar

[3]

Fraunhofer HHI. 2019. Better quality for 360-degree video. Retrieved April 19, 2019 from http://hhi.fraunhofer.de/omaf

Google Scholar

[4]

Fraunhofer HHI. 2019. HTML5 MSE Playback of MPEG 360 VR Tiled Streaming. Retrieved April 19, 2019 from https://github.com/fraunhoferhhi/omaf.js

Google Scholar

[5]

ISO/IEC 2017. 14496-15, Information technology - Coding of audio-visual objects - Part 15: Carriage of network abstraction layer (NAL) unit structured video in the ISO base media file format. ISO/IEC.

Google Scholar

[6]

ISO/IEC 2019. 23090-2, Information technology - coded representation of immersive media (MPEG-I) - Part 2: Omnidirectional media format. ISO/IEC.

Google Scholar

[7]

W3C Media and Entertainment Interest Group. 2018. Frame accurate seeking of HTML5 MediaElement. Retrieved April 19, 2019 from https://github.com/w3c/media-and-entertainment/issues/4

Google Scholar

[8]

three.js 2019. Three.js, JavaScript 3D Library. Retrieved April 19, 2019 from https://threejs.org/ Version r101.

Google Scholar

[9]

David V. 2017. Video MSE issues as of March 01 2017. Retrieved April 19, 2019 from https://developer.microsoft.com/en-us/microsoft-edge/platform/issues/11147314

Google Scholar

Cited By

View all

Araújo GGarcia HFarias MPrakash RCarvalho MGutiérrez JFarias MCortés C(2023)360EAVP: A 360-degree Edition-Aware Video PlayerProceedings of the 15th International Workshop on Immersive Mixed and Virtual Environment Systems10.1145/3592834.3592879(18-23)Online publication date: 7-Jun-2023
https://dl.acm.org/doi/10.1145/3592834.3592879
Zhang QWei JWang SMa SGao W(2023)RealVR: Efficient, Economical, and Quality-of- Experience-Driven VR Video System Based on MPEG OMAFIEEE Transactions on Multimedia10.1109/TMM.2022.319069725(5386-5399)Online publication date: 2023
https://doi.org/10.1109/TMM.2022.3190697
Shen GMa MXu G(2023)An Optimal SVC Bitstream Schema for Viewport-Dependent 360-Degree Video Streaming2023 9th International Conference on Virtual Reality (ICVR)10.1109/ICVR57957.2023.10169672(15-22)Online publication date: 12-May-2023
https://doi.org/10.1109/ICVR57957.2023.10169672
Show More Cited By

Index Terms

HTML5 MSE playback of MPEG 360 VR tiled streaming: JavaScript implementation of MPEG-OMAF viewport-dependent video profile with HEVC tiles
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia streaming
  2. World Wide Web
    1. Web services
      1. RESTful web services

Recommendations

HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications
MM '16: Proceedings of the 24th ACM international conference on Multimedia

Delivering wide-angle and high-resolution spherical panoramic video content entails a high streaming bitrate. This imposes challenges when panorama clips are consumed in virtual reality (VR) head-mounted displays (HMD). The reason is that the HMDs ...
Immersive 360° VR tiled streaming system for esports service
MMSys '18: Proceedings of the 9th ACM Multimedia Systems Conference

This paper shows how a system was designed and implemented for the live tiled streaming of 360° Virtual Reality(VR) eSports based on HEVC. A virtual camera technique was designed and implemented based on the Unity and Unreal engines as a means of ...
6K Effective Resolution with 4K HEVC Decoding Capability for OMAF-compliant 360° Video Streaming
PV '18: Proceedings of the 23rd Packet Video Workshop

The recent Omnidirectional MediA Format (OMAF) standard specifies delivery of 360° video content. OMAF supports only equirectangular (ERP) and cubemap projections and their region-wise packing with a limitation on video decoding capability to the ...

Comments

Information & Contributors

Information

Published In

MMSys '19: Proceedings of the 10th ACM Multimedia Systems Conference

June 2019

374 pages

ISBN:9781450362979

DOI:10.1145/3304109

General Chair:
Michael Zink
University of Massachusetts Amherst
,
Program Chairs:
Laura Toni
University College London
,
Ali C. Begen
Özyeğin University/Networked Media

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2019

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

MMSys '19

Sponsor:

SIGMM

MMSys '19: 10th ACM Multimedia Systems Conference

June 18 - 21, 2019

Massachusetts, Amherst

Acceptance Rates

MMSys '19 Paper Acceptance Rate 40 of 82 submissions, 49%;

Overall Acceptance Rate 176 of 530 submissions, 33%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
268
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Araújo GGarcia HFarias MPrakash RCarvalho MGutiérrez JFarias MCortés C(2023)360EAVP: A 360-degree Edition-Aware Video PlayerProceedings of the 15th International Workshop on Immersive Mixed and Virtual Environment Systems10.1145/3592834.3592879(18-23)Online publication date: 7-Jun-2023
https://dl.acm.org/doi/10.1145/3592834.3592879
Zhang QWei JWang SMa SGao W(2023)RealVR: Efficient, Economical, and Quality-of- Experience-Driven VR Video System Based on MPEG OMAFIEEE Transactions on Multimedia10.1109/TMM.2022.319069725(5386-5399)Online publication date: 2023
https://doi.org/10.1109/TMM.2022.3190697
Shen GMa MXu G(2023)An Optimal SVC Bitstream Schema for Viewport-Dependent 360-Degree Video Streaming2023 9th International Conference on Virtual Reality (ICVR)10.1109/ICVR57957.2023.10169672(15-22)Online publication date: 12-May-2023
https://doi.org/10.1109/ICVR57957.2023.10169672
Li JZhang HMa H(2023)DRL-based transmission control for QoE guaranteed transmission efficiency optimization in tile-based panoramic video streamingMultimedia Systems10.1007/s00530-023-01129-329:5(2761-2777)Online publication date: 30-Jun-2023
https://doi.org/10.1007/s00530-023-01129-3
Hannuksela MWang Y(2021)An Overview of Omnidirectional MediA Format (OMAF)Proceedings of the IEEE10.1109/JPROC.2021.3063544109:9(1590-1606)Online publication date: Sep-2021
https://doi.org/10.1109/JPROC.2021.3063544
Timmerer CBegen AAmsaleg LHuet BLarson MGravier GHung HNgo CTsang Ooi W(2019)A Journey Towards Fully Immersive Media AccessProceedings of the 27th ACM International Conference on Multimedia10.1145/3343031.3350543(2703-2705)Online publication date: 15-Oct-2019
https://dl.acm.org/doi/10.1145/3343031.3350543

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications

Immersive 360° VR tiled streaming system for esports service

6K Effective Resolution with 4K HEVC Decoding Capability for OMAF-compliant 360° Video Streaming