research-article

360° Video Viewing Dataset in Head-Mounted Virtual Reality

Authors:

Ching-Ling Fan,

Chun-Ying Huang,

Cheng-Hsin HsuAuthors Info & Claims

MMSys'17: Proceedings of the 8th ACM on Multimedia Systems Conference

Pages 211 - 216

https://doi.org/10.1145/3083187.3083219

Published: 20 June 2017 Publication History

Abstract

360° videos and Head-Mounted Displays (HMDs) are getting increasingly popular. However, streaming 360° videos to HMDs is challenging. This is because only video content in viewers' Field-of-Views (FoVs) is rendered, and thus sending complete 360° videos wastes resources, including network bandwidth, storage space, and processing power. Optimizing the 360° video streaming to HMDs is, however, highly data and viewer dependent, and thus dictates real datasets. However, to our best knowledge, such datasets are not available in the literature. In this paper, we present our datasets of both content data (such as image saliency maps and motion maps derived from 360° videos) and sensor data (such as viewer head positions and orientations derived from HMD sensors). We put extra efforts to align the content and sensor data using the timestamps in the raw log files. The resulting datasets can be used by researchers, engineers, and hobbyists to either optimize existing 360° video streaming applications (like rate-distortion optimization) and novel applications (like crowd-driven camera movements). We believe that our dataset will stimulate more research activities along this exciting new research direction.

References

[1]

2017. After mixed year, mobile AR to drive $108 billion VR/AR market by 2021. (2017). https://goo.gl/P9N0z0.

[2]

2017. Facebook. (2017). https://www.facebook.com/.

[3]

2017. Facebook Oculus Rift. (2017). https://www.oculus.com.

[4]

2017. HTC Vive. (2017). https://www.htcvive.com.

[5]

2017. Oculus Video. (2017). http://www.oculus.com/experiences/rift/926562347437041/.

[6]

2017. Samsung Gear VR. (2017). http://www.samsung.com/global/galaxy/gear-vr.

[7]

2017. YouTube. (2017). https://www.youtube.com/.

[8]

H. Ahmadi, S. Tootaghaj, S. Mowlaei, M. Hashemi, and S. Shirmohammadi. 2016. GSET somi: a game-specific eye tracking dataset for somi. In Proc. of ACM International Conference on Multimedia Systems (MMSys'16). Klagenfurt, Austria, 42:1--42:6.

Digital Library

[9]

A. Borji, M. Cheng, H. Jiang, and J. Li. 2014. Salient object detection: A survey. arXiv preprint arXiv:1411.5878 (2014).

[10]

François Chollet. 2015. Keras. https://github.com/fchollet/keras. (2015).

[11]

X. Corbillon, A. Devlic, G. Simon, and J. Chakareski. 2017. Viewport-Adaptive Navigable 360-Degree Video Delivery. In Proc. of IEEE International conference on communications (ICC' 17). Paris, France, Accepted to Appear.

[12]

M. Cornia, L. Baraldi, G. Serra, and R. Cucchiara. 2016. A Deep Multi-Level Network for Saliency Prediction. In Proc. of International Conference on Pattern Recognition (ICPR'16). Cancun, Mexico, 3488--3493.

[13]

L. D'Acunto, J. Berg, E. Thomas, and O. Niamut. 2016. Using MPEG DASH SRD for zoomable and navigable video. In Proc. of ACM International Conference on Multimedia Systems (MMSys'16). Klagenfurt, Austria, 34:1--34:4.

Digital Library

[14]

J. Feuvre and C. Concolato. 2016. Tiled-based adaptive streaming using MPEG-DASH. In Proc. of ACM International Conference on Multimedia Systems (MMSys'16). Klagenfurt, Austria, 41:1--41:3.

Digital Library

[15]

Chun-Ying Huang, Cheng-Hsin Hsu, Yu-Chun Chang, and Kuan-Ta Chen. 2013. GamingAnywhere: An Open Cloud Gaming System. In Proc. of ACM International Conference on Multimedia Systems (MMSys'13). Oslo, Norway, 36--47.

Digital Library

[16]

Y. Kavak, E. Erdem, and A. Erdem. 2017. A comparative study for feature integration strategies in dynamic saliency estimation. Signal Processing: Image Communication 51 (November 2017), 13--25.

Digital Library

[17]

B. Lucas and T. Kanade. 1981. An iterative image registration technique with an application to stereo vision. In Proc. of the International Joint Conference on Artificial Intelligence (IJCAI'7). Vancouver, BC, Canada, 674--679.

Digital Library

[18]

A. Mavlankar and B. Girod. 2010. Video streaming with interactive pan/tilt/zoom. In Signals and Communication Technology. 431--455.

[19]

OpenTrack:head tracking software 2017. OpenTrack: head tracking software. (2017). https://github.com/opentrack/opentrack.

[20]

M. Riegler, M. Larson, C. Spampinato, P. Halvorsen, M. Lux, J. Markussen, K. Pogorelov, C. Griwodz, and H. Stensland. 2016. Right Inflight?: A Dataset for Exploring the Automatic Prediction of Movies Suitable for a Watching Situation. In Proc. of ACM International Conference on Multimedia Systems (MMSys'16). Klagenfurt, Austria, 45:1--45:6.

Digital Library

[21]

K. Simonyan and A. Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).

[22]

The OpenCV Library 2000. The OpenCV Library. (2000). http://opencv.org.

[23]

T. Vigier, J. Rousseau, M. Silva, and P. Callet. 2016. A new HD and UHD video eye tracking Dataset. In Proc. of ACM International Conference on Multimedia Systems (MMSys'16). Klagenfurt, Austria, 48:1--48:6.

Digital Library

[24]

M. Yu, H. Lakshman, and B. Girod. 2015. A Framework to Evaluate Omnidirectional Video Coding Schemes. In Proc. of IEEE International Symposium on Mixed and Augmented Reality (ISMAR'15). Fukuoka, Japan, 31--36.

Digital Library

Cited By

Partarakis NZabulis X(2024)A Review of Immersive Technologies, Knowledge Representation, and AI for Human-Centered Digital ExperiencesElectronics10.3390/electronics1302026913:2(269)Online publication date: 7-Jan-2024
https://doi.org/10.3390/electronics13020269
Su WLi YChen HMa Z(2024)Compass: A Prefetching Framework with Viewport Patching for 360° Video StreamingProceedings of the 2024 SIGCOMM Workshop on Emerging Multimedia Systems10.1145/3672196.3673396(45-51)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3672196.3673396
Xu RLiu CHu MQian SZhang YLin T(2024)OMMSProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3653435(429-434)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3625468.3653435
Show More Cited By

Index Terms

360° Video Viewing Dataset in Head-Mounted Virtual Reality

Recommendations

Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual Reality
NOSSDAV'17: Proceedings of the 27th Workshop on Network and Operating Systems Support for Digital Audio and Video

We study the problem of predicting the Field-of-Views (FoVs) of viewers watching 360° videos using commodity Head-Mounted Displays (HMDs). Existing solutions either use the viewer's current orientation to approximate the FoVs in the future, or ...
360-Degree Video Head Movement Dataset
MMSys'17: Proceedings of the 8th ACM on Multimedia Systems Conference

While Virtual Reality applications are increasingly attracting the attention of developers and business analysts, the behaviour of users watching 360-degree (i.e. omnidirectional) videos has not been thoroughly studied yet. This paper introduces a ...
Don’t make me sick: investigating the incidence of cybersickness in commercial virtual reality headsets
Abstract
The resurgence of interest in the use of virtual reality (VR) technology for research and entertainment purposes has led to an increase in concerns about human factor issues inherent in VR technology. One issue that has received a great deal of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MMSys'17: Proceedings of the 8th ACM on Multimedia Systems Conference

June 2017

407 pages

ISBN:9781450350020

DOI:10.1145/3083187

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Artifacts Available

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MMSys'17

Sponsor:

SIGMM

MMSys'17: Multimedia Systems Conference 2017

June 20 - 23, 2017

Taipei, Taiwan

Acceptance Rates

MMSys'17 Paper Acceptance Rate 13 of 47 submissions, 28%;

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

161
Total Citations
View Citations
2,519
Total Downloads

Downloads (Last 12 months)210
Downloads (Last 6 weeks)22

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Partarakis NZabulis X(2024)A Review of Immersive Technologies, Knowledge Representation, and AI for Human-Centered Digital ExperiencesElectronics10.3390/electronics1302026913:2(269)Online publication date: 7-Jan-2024
https://doi.org/10.3390/electronics13020269
Su WLi YChen HMa Z(2024)Compass: A Prefetching Framework with Viewport Patching for 360° Video StreamingProceedings of the 2024 SIGCOMM Workshop on Emerging Multimedia Systems10.1145/3672196.3673396(45-51)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3672196.3673396
Xu RLiu CHu MQian SZhang YLin T(2024)OMMSProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3653435(429-434)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3625468.3653435
Baldoni SBattisti FChiariotti FMistrorigo FShofi ATestolina PTraspadini AZanella AZorzi M(2024)QuestsetProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3652187(408-414)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3625468.3652187
Park SDas S(2024)Cross-Layer Scheduling in QUIC and Multipath QUIC for 360-Degree Video Streaming2024 IEEE Wireless Communications and Networking Conference (WCNC)10.1109/WCNC57260.2024.10571146(1-6)Online publication date: 21-Apr-2024
https://doi.org/10.1109/WCNC57260.2024.10571146
Wang MChen XYang XPeng SZhao YXu MXu C(2024)CoLive: Edge-Assisted Clustered Learning Framework for Viewport Prediction in 360$^{\circ }$ Live StreamingIEEE Transactions on Multimedia10.1109/TMM.2023.333011226(5078-5091)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3330112
Tan XWang SXu XZheng QYang JChen S(2024)DACOD360: Deadline-Aware Content Delivery for 360-Degree Video Streaming Over MEC NetworksIEEE Transactions on Multimedia10.1109/TMM.2023.332143926(4168-4182)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3321439
Jin YZhang WXu ZWang FLiu X(2024)Privacy-Preserving Gaze-Assisted Immersive Video StreamingIEEE Transactions on Mobile Computing10.1109/TMC.2024.345251023:12(15098-15113)Online publication date: Dec-2024
https://doi.org/10.1109/TMC.2024.3452510
Bi SChen HLi XWang SWu YQian L(2024)A Two-Stage Deep Reinforcement Learning Framework for MEC-Enabled Adaptive 360-Degree Video StreamingIEEE Transactions on Mobile Computing10.1109/TMC.2024.344320023:12(14313-14329)Online publication date: Dec-2024
https://doi.org/10.1109/TMC.2024.3443200
Chen YOmoma SKwon HInaltekin HGorlatova M(2024)Quantifying and Exploiting VR Frame Correlations: An Application of a Statistical Model for Viewport PoseIEEE Transactions on Mobile Computing10.1109/TMC.2024.339977023:12(11466-11482)Online publication date: Dec-2024
https://doi.org/10.1109/TMC.2024.3399770
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents