short-paper

A quality of experience evaluation system and research challenges for networked virtual reality-based teleoperation applications

Authors:

David Concannon,

Ronan Flynn, and

Niall MurrayAuthors Info & Claims

MMVE '19: Proceedings of the 11th ACM Workshop on Immersive Mixed and Virtual Environment Systems

June 2019

Pages 10 - 12

https://doi.org/10.1145/3304113.3326119

Published: 18 June 2019 Publication History

Abstract

Teleoperation applications are designed to assist humans in operating complex mechanical systems. Interfaces to teleoperation systems have always been challenging. Recently the potential of virtual reality (VR) has been a topic of interest, particularly with the availability of head mounted displays and interaction controller devices. As a result, research into the viability of VR as a technology to support remote operation and improved human machine interaction has emerged. It is assumed that VR will offer the user a more immersive and natural experience when operating a virtual representation of a mechanical system. To achieve this, there are a number of research challenges that need to be addressed. In this short paper, we introduce and discuss key challenges for VR-based teleoperation systems. Since the key focus of our work is understand user quality of experience (QoE) of VR-based teleoperation applications, the design and implementation of an implicit and explicit QoE Evaluation system is also presented.

References

[1]

Möller, S. and Raake, A. eds., 2014. Quality of experience: advanced concepts, applications and methods. Springer.

Digital Library

[2]

Keighrey, C., Flynn, R., Murray, S., Brennan, S. and Murray, N., 2017. Comparing User QoE via Physiological and Interaction Measurements of Immersive AR and VR Speech and Language Therapy Applications. In Proceedings of the on Thematic Workshops of ACM Multimedia 2017. ACM, 485--492.

Digital Library

[3]

Salgado, D.P., Martins, F.R., Rodrigues, T.B., Keighrey, C., Flynn, R., Naves, E.L.M. and Murray, N., 2018. A QoE assessment method based on EDA, heart rate and EEG of a virtual reality assistive technology system. In Proceedings of the 9th ACM Multimedia Systems Conference. ACM, 517--520.

[4]

Keighrey, C., Flynn, R., Murray, S. and Murray, N., 2017. A QoE evaluation of immersive augmented and virtual reality speech & language assessment applications. In 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 1--6.

[5]

Jarschel, M., Schlosser, D., Scheuring, S. and Hoßfeld, T., 2011. An evaluation of QoE in cloud gaming based on subjective tests. In 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing. IEEE, 330--335.

Digital Library

[6]

Rosen, R., Von Wichert, G., Lo, G. and Bettenhausen, K.D., 2015. About the importance of autonomy and digital twins for the future of manufacturing. IFAC-PapersOnLine 48, 3, 567--572.

[7]

Schuemie, M.J., Van Der Straaten, P., Knjn, M. and Van Der Mast, C.A., 2001. Research on presence in virtual reality: A survey. CyberPsychology & Behavior 4, 2, 183--201.

[8]

Davis, S., Nesbitt, K. and Nalivaiko, E., 2015. Comparing the onset of cybersickness using the Oculus Rift and two virtual roller coasters. In Proceedings of the 11th Australasian Conference on Interactive Entertainment (IE 2015) (Vol. 27, p. 30).

[9]

Ukai, K. and Howarth, P.A., 2008. Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations. Displays 29, 2, 106--116.

[10]

Martel, E. and Muldner, K., 2017. Controlling VR games: control schemes and the player experience. Entertainment computing 21, 19--31.

[11]

ITU-T RECOMMENDATION, P., 1999. Subjective video quality assessment methods for multimedia applications. International telecommunication union.

[12]

Hoβfeld, T., Schatz, R. and Egger, S., 2011. SOS: The MOS is not enough!. In 2011 Third International Workshop on Quality of Multimedia Experience. IEEE, 131--136.

[13]

Sheridan, T.B., 1993. Space teleoperation through time delay: Review and prognosis. IEEE Transactions on robotics and Automation 9, 5, 592--606.

[14]

Montagud, M., Boronat, F., Stokking, H. and van Brandenburg, R., 2012. Inter-destination multimedia synchronization: schemes, use cases and standardization. Multimedia systems 18, 6, 459--482.

[15]

Gutwin, C., 2001. The effects of network delays on group work in real-time groupware. In ECSCW 2001. Proceedings of the Seventh European Conference on Computer Supported Cooperative Work. Springer, Dordrecht, 299--318

Digital Library

[16]

HTC Corporation. 2019. VIVE<sup>™</sup> | Discover Virtual Reality Beyond Imagination. Retrieved 19<sup>th</sup> April from https://www.vive.com/eu/.

[17]

Unity Technologies. 2019. Unity. Retrieved 19<sup>th</sup> April from https://unity.com/.

[18]

Fanuc Corporation. 2019. ROBOSHOT electrical injection moulding machine. Retrieved 19<sup>th</sup> April from https://www.fanuc.eu/dk/en/roboshot/.

[19]

Exit Games. 2019. Photon Unity 3D Networking Framework SDKs and Game Backend | Photon Engine. Retrieved 19<sup>th</sup> April from https://www.photonengine.com/pun/.

[20]

Marco Pol, 2013. The Virtual World of Marc O Polo. Retrieved 19<sup>th</sup> April from https://blog.mrpol.nl/2010/01/14/network-emulator-toolkit/.

[21]

Empatica Inc. 2019. Real-time physiological signals | E4 EDA/GSR sensor. Retrieved April 19<sup>th</sup> from https://www.empatica.com/research/e4/.

[22]

Tobii AB. 2019. Eye tracking technology for research - Tobii Pro. Retrieved April 19<sup>th</sup> from https://www.tobiipro.com/.

[23]

Arndt, S., Radun, J., Antons, J.N. and Möller, S., 2014. Using eye-tracking and correlates of brain activity to predict quality scores. In 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX). IEEE, 281--285.

Cited By

Sameri JVan Damme SSchwarzmann SWei QTrivisonno RDe Turck FVega M(2024)Collaborative Cooking in VRProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3652201(509-515)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3625468.3652201
Xia PZhou TYe YDu J(2024)Human Autonomy Teaming for ROV Shared ControlJournal of Computing in Civil Engineering10.1061/JCCEE5.CPENG-575638:4Online publication date: Jul-2024
https://doi.org/10.1061/JCCEE5.CPENG-5756
Su YChen XZhou CPearson LPretty CChase J(2023)Integrating Virtual, Mixed, and Augmented Reality into Remote Robotic Applications: A Brief Review of Extended Reality-Enhanced Robotic Systems for Intuitive Telemanipulation and Telemanufacturing Tasks in Hazardous ConditionsApplied Sciences10.3390/app13221212913:22(12129)Online publication date: 8-Nov-2023
https://doi.org/10.3390/app132212129
Show More Cited By

Index Terms

A quality of experience evaluation system and research challenges for networked virtual reality-based teleoperation applications
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Subjective Evaluation of an Olfaction Enhanced Immersive Virtual Reality Environment
AltMM '17: Proceedings of the 2nd International Workshop on Multimedia Alternate Realities

Recent research efforts have reported findings on user Quality of Experience (QoE) of immersive virtual reality (VR) experiences. Truly immersive multimedia experiences also include multisensory components such as factional, tactile etc., in addition to ...
Read More
Visualizing the keyboard in virtual reality for enhancing immersive experience
SIGGRAPH '17: ACM SIGGRAPH 2017 Posters

Recently, virtual reality (VR) becomes more and more popular and provides users an immersive experience with a head-mounted display (HMD). However, in some applications, users have to interact with physical objects while immersed in VR. With a non-see-...
Read More
A Quality of Experience Model for Haptic Virtual Environments

Haptic-based Virtual Reality (VR) applications have many merits. What is still obscure, from the designer's perspective of these applications, is the experience the users will undergo when they use the VR system. Quality of Experience (QoE) is an ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MMVE '19: Proceedings of the 11th ACM Workshop on Immersive Mixed and Virtual Environment Systems

June 2019

53 pages

ISBN:9781450362993

DOI:10.1145/3304113

Conference Chairs:
Mario Montagud
i2CAT Foundation & University of Valencia, Spain
,
Francesca De Simone
CWI, Netherlands
,
General Chair:
Niall Murray
Athlone Institute of Technology, Ireland

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MMSys '19

Sponsor:

SIGMM

MMSys '19: 10th ACM Multimedia Systems Conference

June 18, 2019

Massachusetts, Amherst

Acceptance Rates

MMVE '19 Paper Acceptance Rate 9 of 18 submissions, 50%;

Overall Acceptance Rate 26 of 44 submissions, 59%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
413
Total Downloads

Downloads (Last 12 months)83
Downloads (Last 6 weeks)10

Other Metrics

View Author Metrics

Citations

Cited By

Sameri JVan Damme SSchwarzmann SWei QTrivisonno RDe Turck FVega M(2024)Collaborative Cooking in VRProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3652201(509-515)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3625468.3652201
Xia PZhou TYe YDu J(2024)Human Autonomy Teaming for ROV Shared ControlJournal of Computing in Civil Engineering10.1061/JCCEE5.CPENG-575638:4Online publication date: Jul-2024
https://doi.org/10.1061/JCCEE5.CPENG-5756
Su YChen XZhou CPearson LPretty CChase J(2023)Integrating Virtual, Mixed, and Augmented Reality into Remote Robotic Applications: A Brief Review of Extended Reality-Enhanced Robotic Systems for Intuitive Telemanipulation and Telemanufacturing Tasks in Hazardous ConditionsApplied Sciences10.3390/app13221212913:22(12129)Online publication date: 8-Nov-2023
https://doi.org/10.3390/app132212129
Si WZhong TWang NYang C(2023)A multimodal teleoperation interface for human-robot collaboration2023 IEEE International Conference on Mechatronics (ICM)10.1109/ICM54990.2023.10102060(1-6)Online publication date: 15-Mar-2023
https://doi.org/10.1109/ICM54990.2023.10102060
Sehad NTu XRajasekaran AHellaoui HJäntti RDebbah M(2023)Towards enabling reliable immersive teleoperation through Digital Twin: A UAV command and control use caseGLOBECOM 2023 - 2023 IEEE Global Communications Conference10.1109/GLOBECOM54140.2023.10437527(6420-6425)Online publication date: 4-Dec-2023
https://doi.org/10.1109/GLOBECOM54140.2023.10437527
Shvetsov AShvetsova SGromov V(2023)Evaluation of user experience in the operation of electric vehicles in the Arctic regionsE3S Web of Conferences10.1051/e3sconf/202337104030371(04030)Online publication date: 28-Feb-2023
https://doi.org/10.1051/e3sconf/202337104030
Hynes EFlynn RLee BMurray N(2023)A QoE evaluation of augmented reality for the informational phase of procedure assistanceQuality and User Experience10.1007/s41233-023-00054-78:1Online publication date: 16-Feb-2023
https://doi.org/10.1007/s41233-023-00054-7
Srithammee NJitngernmadan P(2023)Holistic Evaluation Framework for VR Industrial TrainingProceedings of the 19th International Conference on Computing and Information Technology (IC2IT 2023)10.1007/978-3-031-30474-3_15(171-182)Online publication date: 24-May-2023
https://doi.org/10.1007/978-3-031-30474-3_15
Kuts VMarvel JAksu MPizzagalli SSarkans MBondarenko YOtto T(2022)Digital Twin as Industrial Robots Manipulation Validation ToolRobotics10.3390/robotics1105011311:5(113)Online publication date: 18-Oct-2022
https://doi.org/10.3390/robotics11050113
Moharana BKeighrey CScott DMurray NKeighrey C(2022)Subjective evaluation of group user QoE in collaborative virtual environment (CVE)Proceedings of the 14th International Workshop on Immersive Mixed and Virtual Environment Systems10.1145/3534086.3534333(23-29)Online publication date: 14-Jun-2022
https://dl.acm.org/doi/10.1145/3534086.3534333
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents