Design, development and evaluation of adaptative and interactive solutions for high-quality viewport-aware VR360 video processing and delivery: research proposal
Pages 367 - 371
Abstract
This paper contains the research proposal of Miguel Fernández Dasí that was presented at the MMSys 2022 doctoral symposium.1 The production and consumption of multimedia content is continuously increasing, and this particularly affects to immersive formats, like VR360 video. Even though significant advances have been witnessed with regard to the processing, delivery and consumption of interactive VR360 video, key challenges and research questions still need to be addressed to efficiently provide multi-camera and multi-user VR360 video services over distributed and heterogeneous environments. This research work aims at providing novel and efficient contributions to overcome existing limitations in this topic. First, it will develop an end-to-end modular VR360 video platform, including the measurement of Quality of Service (QoS) and activity metrics, to be used as a research testbed. Second, it will provide web-compliant viewport-aware video processing and delivery strategies to dynamically concentrate the video resolution on the users' viewport, with a single stream and decoding process through the web browser. Third, it will propose innovative encoding, signaling and synchronization solutions to enable an effective support for multi-camera VR360 services, with personalized, fast and in-sync switching features. Fourth, it will explore how to effectively provide social viewing scenarios between remote users while watching the same or related VR360 videos. The work also plans to contribute with low-latency delivery pipelines as well as with tools and algorithms to assess and model the Quality of Experience (QoE).
References
[1]
C.L. Fan, W.C. Lo, Y.T. Pai, CH. Hsu, "Survey on 360° Video Streaming: Acquisition, Transmission, and Display", ACM Comput. Surv. 52, 4, Article 71, Sept. 2019, 36 pages
[2]
M. Xu, C. Li, S. Zhang, P.L. Callet, "State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression", IEEE JSAC, vol. 14, no. 1, pp. 5--26, Jan. 2020
[3]
M. Montagud, E. Meyerson, I. Fraile, S. Fernández, "Modular Testbed for KPI Monitoring in Omnidirectional Video Streaming Scenarios", MMEDIA 2019, València (Spain), March 2019
[4]
David Kosiur. 2001. Understanding Policy-Based Networking (2nd. ed.). Wiley, New York, NY.
[5]
D. Gómez, J. A. Núñez, I. Fraile, M. Montagud, S. Fernández, "TiCMP: A lightweight and efficient Tiled Cubemap projection strategy for Immersive Videos in Web-based players", ACM N0SSDAV'18, Amsterdam, June 2018
[6]
P. Yu. Timokhin, M.V. Mikhaylyuk, E.M. Vozhegov, "Efficient methods and algorithms to synthesize 360-degree video based on cubemap projection of virtual environment", ISP RAS, 32:4, 2020
[7]
J. Lin, et al., "Efficient Projection and Coding Tools for 360° Video", IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 9, no. 1, pp. 84--97, March 2019
[8]
J. A. Núñez, M. Montagud, I. Fraile, D. Gómez, S. Fernández, "ImmersiaTV: an end-to-end toolset to enable customizable and immersive multi-screen TV experiences", Workshop on Virtual Reality, co-located with ACM TVX 2018, Seoul (South Korea), June 2018
[9]
F. Boronat, M. Montagud, P. Salvador, J. Pastor, "Wersync: a web platform for synchronized social viewing enabling interaction and collaboration", Journal of Network and Computer Applications, 175(1), 2021
[10]
S. Rothe, A. Schmidt, M. Montagud, D. Buschek, H. Hußman, "Social viewing in cinematic virtual reality: a design space for social movie applications", Virtual Reality, 25(3), 2021
[11]
M. Montagud, I. Fraile, E. Meyerson, S. Fernández, "Open-Source Accessibility-Enabled V360 Player", ACM IMX 2020, Barcelona (Spain), June 2020
[12]
M. Montagud, J. Antonio De Rus, R. Fayos-Jordán, M. Garcia-Pineda J. Segura-Garcia, "Open-Source Software Tools for Measuring Resources Consumption and DASH Metrics", ACM MMSYS 2020, Istambul (Turkey), June 2020
[13]
M. Fernández-Dasi, M. A. Torres-Font, M. Montagud, M. Garcia-Pineda, "Plataforma modular para la codificación y distribución interactiva de contenidos VR360 basada en campo de visión", JITEL 2021, A Coruña (Spain), October 2021
[14]
B. Nabajeet, M. G. Martini, "QoE modeling for HTTP adaptive video streaming-a survey and open challenges", IEEE ACCESS, 7, 2019
[15]
W. Lo, C. Huang and C. Hsu, "Edge-Assisted Rendering of 360° Videos Streamed to Head-Mounted Virtual Reality", 2018 IEEE International Symposium on Multimedia (ISM), Taichung, 2018
[16]
X. Hou, S. Dey, J. Zhang and M. Budagavi, "Predictive Adaptive Streaming to Enable Mobile 360-degree and VR Experiences," in IEEE Transactions on Multimedia, To Appear in 2021.
Index Terms
- Design, development and evaluation of adaptative and interactive solutions for high-quality viewport-aware VR360 video processing and delivery: research proposal
Recommendations
Towards Distributed and Interactive Multi-cam and Multi-device VR360 Video Experiences
IMX '23: Proceedings of the 2023 ACM International Conference on Interactive Media ExperiencesThe production and consumption of multimedia content is continuously increasing, and this particularly affects to immersive formats, like VR360 video. Even though significant advances have been witnessed with regard to the processing, delivery and ...
Viewport-driven DASH media playback for interactive storytelling: a seamless non-linear storyline experience
MMSys '19: Proceedings of the 10th ACM Multimedia Systems ConferenceOver the past few years, the HTTP Adaptive Streaming (HAS) technologies, e.g. the MPEG-DASH standard (DASH), became the predominant form of online video streaming. 360 Virtual Reality (VR) content have recently emerged on video streaming platform as a ...
Design and Analysis of QoE-Aware Quality Adaptation for DASH: A Spectrum-Based Approach
Special Section on Deep Learning for Mobile Multimedia and Special Section on Best Papers from ACM MMSys/NOSSDAV 2016The dynamics of the application-layer-based control loop of dynamic adaptive streaming over HTTP (DASH) make video bitrate selection for DASH a difficult problem. In this work, we provide a DASH quality adaptation algorithm, named SQUAD, that is ...
Comments
Information & Contributors
Information
Published In
June 2022
432 pages
ISBN:9781450392839
DOI:10.1145/3524273
- General Chairs:
- Niall Murray,
- Gwendal Simon,
- Mylene Farias,
- Program Chairs:
- Irene Viola,
- Mario Montagud
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 August 2022
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- EU
- Secretaria d'Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu
- ACCIO (Generalitat de Catalunya)
Conference
MMSys '22
Sponsor:
Acceptance Rates
Overall Acceptance Rate 176 of 530 submissions, 33%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 71Total Downloads
- Downloads (Last 12 months)22
- Downloads (Last 6 weeks)1
Reflects downloads up to 15 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in