research-article

Transitions of viewport quality adaptation mechanisms in 360 degree video streaming

Authors:

Christian Koch,

Arne-Tobias Rak,

Ralf Steinmetz,

Amr RizkAuthors Info & Claims

NOSSDAV '19: Proceedings of the 29th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

Pages 14 - 19

https://doi.org/10.1145/3304112.3325609

Published: 21 June 2019 Publication History

Abstract

Virtual reality has been gaining popularity in recent years fueled by the proliferation of affordable consumer-grade devices such as Oculus Rift, HTC Vive, and Samsung VR. Amongst the various VR applications, 360° video streaming is currently one of the most popular ones. However, it poses a series of challenges to the serving content distribution systems. One challenge is the significantly increased bandwidth requirement for streaming such content in real time. Recent research has shown that only streaming the content that is in the user's (field-of-view) FoV in high quality can lead to strong bandwidth savings. This can be achieved by analyzing the viewers head orientation and movement based on sensor information. Alternatively, historic information from users that watched the content in the past can be considered to prefetch 360° video data in high quality assuming the viewer will direct the FoV to these areas. This paper presents a 360° video streaming system that transitions between sensor- and content-based predictive mechanisms. We evaluate the effects of our system on the Quality of Experience (QoE) of such a VR streaming system and show that the perceived quality can be increased between 50% and 80% compared to systems that only apply either one of the two approaches.

References

[1]

Akamai. 2017. Q1 State of the Internet - Connectivity Report.

[2]

Yanan Bao et al. 2016. Shooting a Moving Target: Motion-prediction-based Transmission for 360-degree Videos. In IEEE Big Data. 1161--1170.

[3]

Yanan Bao et al. 2016. Viewing 360 Degree Videos: Motion Prediction and Bandwidth Optimization. In IEEE ICNP. 1--2.

[4]

Divyashri Bhat et al. 2018. SABR: Network-Assisted Content Distribution for QoE-Driven ABR Video Streaming. ACM TOMM 14, 2s (2018), 32.

[5]

Jacob Chakareski et al. 2018. Viewport-Driven Rate-Distortion Optimized 360° Video Streaming. arXiv preprint arXiv:1803.08177 (2018).

[6]

Xavier Corbillon. 2017. 360Degree Head Movement Dataset. https://github.com/xmar/360Degree_Head_Movement_Dataset.

[7]

Xavier Corbillon et al. 2017. 360-Degree Video Head Movement Dataset. In ACM MMSys. 199--204.

Digital Library

[8]

Xavier Corbillon et al. 2017. Viewport-Adaptive Navigable 360-Degree Video Delivery. In IEEE ICC. 1--7.

[9]

Ching-Ling Fan et al. 2017. Fixation Prediction for 360 Video Streaming in Head-Mounted Virtual Reality. In ACM NOSSDAV. 67--72.

[10]

Alexander Frömmgen et al. 2015. Towards the Description and Execution of Transitions in Networked Systems. In IFIP AIMS. 17--29.

[11]

Mario Graf et al. 2017. Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP: Design, Implementation, and Evaluation. In ACM MMSys. 261--271.

Digital Library

[12]

Lynn Harrison. 2003. Basic 3D Objects. In Introduction to 3D Game Engine Design. Springer, 113--166.

[13]

Evgeny Kuzyakov et al. 2016. Next-generation Video Encoding Techniques for 360 Video and VR.

[14]

Afshin Taghavi Nasrabadi et al. 2017. Adaptive 360-Degree Video Streaming using Scalable Video Coding. In ACM MM. 1689--1697.

[15]

Duc V Nguyen et al. 2017. A New Adaptation Approach for Viewport-adaptive 360° Video Streaming. In IEEE ISM. 38--44.

[16]

Stefano Petrangeli et al. 2017. An HTTP/2-Based Adaptive Streaming Framework for 360 Virtual Reality Videos. In ACM MM. 306--314.

[17]

Stefano Petrangeli et al. 2017. Improving Virtual Reality Streaming using HTTP/2. In ACM MMSys. 225--228.

Digital Library

[18]

Feng Qian et al. 2016. Optimizing 360 Video Delivery over Cellular Networks. In ACM All Things Cellular. 1--6.

[19]

Afshin TaghaviNasrabadi et al. 2017. Adaptive 360-Degree Video Streaming using Layered Video Coding. In IEEE VR. 347--348.

[20]

Cong Wang et al. 2016. SQUAD: A Spectrum-based Quality Adaptation for Dynamic Adaptive Streaming over HTTP. In ACM MMSys. 1--12.

Digital Library

[21]

Keith Winstein et al. 2013. Stochastic Forecasts Achieve High Throughput and Low Delay over Cellular Networks. In USENIX NSDI, Vol. 1. 2--3.

Digital Library

[22]

Lan Xie et al. 2017. 360ProbDASH: Improving QoE of 360 Video Streaming Using Tile-based HTTP Adaptive Streaming. In ACM MM. 315--323.

[23]

Alireza Zare et al. 2016. HEVC-compliant tile-based Streaming of Panoramic Video for Virtual Reality Applications. In ACM MMSys. 601--605.

Cited By

Dziubinski KBandai M(2024)Local and Global Viewport History Sampling for Improved User Quality of Experience in Viewport-Aware Tile-Based 360-Degree Video StreamingIEEE Access10.1109/ACCESS.2024.346369212(137455-137471)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3463692
Rizk AHellwagner HTimmerer CZink M(2024)Adaptivity in Video Streaming Through the Transition LensFrom Multimedia Communications to the Future Internet10.1007/978-3-031-71874-8_3(31-45)Online publication date: 13-Sep-2024
https://doi.org/10.1007/978-3-031-71874-8_3
Wang YMan HWang XFan X(2023)Multi-stream-Based Low-Latency Viewport Switching Scheme for Panoramic VideosPattern Recognition and Computer Vision10.1007/978-981-99-8552-4_9(104-116)Online publication date: 28-Dec-2023
https://doi.org/10.1007/978-981-99-8552-4_9
Show More Cited By

Index Terms

Transitions of viewport quality adaptation mechanisms in 360 degree video streaming
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Video segmentation
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia streaming

Recommendations

A client-based adaptation framework for 360-degree video streaming
Highlights
- The use of estimated bitrate/quality improves the viewport quality significantly.
Abstract
360-degree video is one of the key components of Virtual Reality (VR) applications. 360-degree videos viewed on Head Mounted Displays can offer impressive viewing experiences to users. Yet, streaming of 360-degree videos over the ...
A survey on 360-degree video: Coding, quality of experience and streaming
Abstract
The commercialization of Virtual Reality (VR) headsets has made immersive and 360-degree video streaming the subject of intense interest in the industry and research communities. While the basic principles of video streaming are the ...
Power Evaluation of 360 VR Video Streaming on Head Mounted Display Devices
NOSSDAV'17: Proceedings of the 27th Workshop on Network and Operating Systems Support for Digital Audio and Video

Virtual reality (VR) video streaming with 360-degree views has become a trending video application recently. While providing the users with immersive video viewing experiences, the 360 video streaming introduces significantly higher overhead than the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

NOSSDAV '19: Proceedings of the 29th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

June 2019

86 pages

ISBN:9781450362986

DOI:10.1145/3304112

General Chair:
Ali C. Begen
Özyeğgin University/Networked Media, Turkey
,
Program Chairs:
Thomas Schierl
Fraunhofer HHI, Germany
,
Sejin Oh
LG Electronics, South Korea

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

MMSys '19

Sponsor:

SIGMM

MMSys '19: 10th ACM Multimedia Systems Conference

June 21, 2019

Massachusetts, Amherst

Acceptance Rates

NOSSDAV '19 Paper Acceptance Rate 12 of 32 submissions, 38%;

Overall Acceptance Rate 118 of 363 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
334
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Dziubinski KBandai M(2024)Local and Global Viewport History Sampling for Improved User Quality of Experience in Viewport-Aware Tile-Based 360-Degree Video StreamingIEEE Access10.1109/ACCESS.2024.346369212(137455-137471)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3463692
Rizk AHellwagner HTimmerer CZink M(2024)Adaptivity in Video Streaming Through the Transition LensFrom Multimedia Communications to the Future Internet10.1007/978-3-031-71874-8_3(31-45)Online publication date: 13-Sep-2024
https://doi.org/10.1007/978-3-031-71874-8_3
Wang YMan HWang XFan X(2023)Multi-stream-Based Low-Latency Viewport Switching Scheme for Panoramic VideosPattern Recognition and Computer Vision10.1007/978-981-99-8552-4_9(104-116)Online publication date: 28-Dec-2023
https://doi.org/10.1007/978-981-99-8552-4_9
Wong EWahab NSaeed FAlharbi N(2022)360-Degree Video Bandwidth Reduction: Technique and Approaches Comprehensive ReviewApplied Sciences10.3390/app1215758112:15(7581)Online publication date: 28-Jul-2022
https://doi.org/10.3390/app12157581
Rudolph MRizk AGao WLi GYuan HHamzaoui RLi ZLiu S(2022)View-Adaptive Streaming of Point Cloud Scenes through combined Decomposition and Video-based CodingProceedings of the 1st International Workshop on Advances in Point Cloud Compression, Processing and Analysis10.1145/3552457.3555732(41-49)Online publication date: 14-Oct-2022
https://dl.acm.org/doi/10.1145/3552457.3555732
Dziubinski KBandai M(2022)Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video StreamingIEEE Access10.1109/ACCESS.2022.320433110(94652-94667)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3204331
Dziubinski KBandai M(2021)Advancing User Quality of Experience Using Viewport Archives in Viewport-Aware Tile-Based 360-Degree Video Streaming2021 IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR 2021)10.1109/CQR39960.2021.9446227(1-6)Online publication date: 13-May-2021
https://doi.org/10.1109/CQR39960.2021.9446227
Alkhalili YMeuser TSteinmetz R(2020)A Survey of Volumetric Content Streaming Approaches2020 IEEE Sixth International Conference on Multimedia Big Data (BigMM)10.1109/BigMM50055.2020.00035(191-199)Online publication date: Sep-2020
https://doi.org/10.1109/BigMM50055.2020.00035

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten