research-article

A Quality of Experience Model for Haptic Virtual Environments

Authors:

Abdelwahab Hamam,

Abdulmotaleb El Saddik,

Jihad Alja'amAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 10, Issue 3

Article No.: 28, Pages 1 - 23

https://doi.org/10.1145/2540991

Published: 17 April 2014 Publication History

Abstract

Haptic-based Virtual Reality (VR) applications have many merits. What is still obscure, from the designer's perspective of these applications, is the experience the users will undergo when they use the VR system. Quality of Experience (QoE) is an evaluation metric from the user's perspective that unfortunately has received limited attention from the research community. Assessing the QoE of VR applications reflects the amount of overall satisfaction and benefits gained from the application in addition to laying the foundation for ideal user-centric design in the future. In this article, we propose a taxonomy for the evaluation of QoE for multimedia applications and in particular VR applications. We model this taxonomy using a Fuzzy logic Inference System (FIS) to quantitatively measure the QoE of haptic virtual environments. We build and test our FIS by conducting a users' study analysis to evaluate the QoE of a haptic game application. Our results demonstrate that the proposed FIS model reflects the user's estimation of the application's quality significantly with low error and hence is suited for QoE evaluation.

References

[1]

H. Al Osman, M. Eid, and A. El Saddik. 2008. Evaluating ALPHAN: A network protocol for haptic interaction. In Proceedings of the 16th Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems.

Digital Library

[2]

A. Alamri, M. Eid, and A. El Saddik. 2008. A quality of performance model for evaluating post-stroke patients. In Proceedings of the IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA'08). 14--18.

[3]

C. Basdogan, C. H. Ho, M. A. Srinivasan, and M. Slater. 2000. An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput.-Hum. Interact. 7, 443--460.

Digital Library

[4]

K. Behr, A. Nosper, C. Klimmt, and T. Hartmann. 2005. Some practical considerations of ethical issues in VR research. Presence: Teleoperators Virtual Environ. 14, 668--676.

Digital Library

[5]

A. Bhattacharya, W. Wu, and Z. Yang. 2011. Quality of experience evaluation of voice communication systems using affect-based approach. In Proceedings of the 19th ACM International Conference on Multimedia. 929--932.

Digital Library

[6]

K. Black. 2004. Business Statistics: For Contemporary Decision Making. Leyh Publishing.

[7]

R. A. Cribbie, J. A. Gruman, and C. A. Arpin-Cribbie. 2004. Recommendations for applying tests of equivalence. J. Clinical Psych. 60, 1--10.

[8]

F. Danieau, J. Fleureau, A. Cabec, P. Kerbiriou, P. Guillotel, N. Mollet, M. Christie, and A. L'Ecuyer. 2012. Framework for enhancing video viewing experience with haptic effects of motion. In Proceedings of the Haptics Symposium. 541--546.

[9]

L. De Marez and K. De Moor. 2007. The challenge of user- and QoE-centric research and product development in today's ICT-environment. Observatorio (OBS&ast;) 1, 1--22.

[10]

C. De Vleeschouwer, T. Delmot, X. Marichal, and B. Macq. 1997. A fuzzy logic system for content-based bit-rate allocation. Signal Proces. Image Commun. 10, 115--141.

[11]

T. Ebrahimi. 2009. Quality of multimedia experience: past, present and future. In Proceedings of the 17th ACM International Conference on Multimedia. 3--4.

Digital Library

[12]

A. El Saddik. 2007. The potential of haptic technologies. IEEE Instrum. Meas. Mag. 10, 1, 10--17.

[13]

A. Gaggioli, M. Bassi, and A. Fave. 2003. Quality of experience in virtual environments. Emerging Commun. 5, 121--136.

[14]

A. Guerraz, C. Loscos, and R. Widenfeld. 2003. How to use physical parameters coming from the haptic device itself to enhance the evaluation of haptic benefits in user interface&quest; In Proceedings of the Eurohaptics Conference. 137--145.

[15]

F. Gutierrez, J. Pierce, V. M. Vergara, R. Coulter, L. Saland, T. P. Caudell, T. E. Goldsmith, and D. C. Alverson. 2007. The effect of degree of immersion upon learning performance in virtual reality simulations for medical education. Stud. Health Tech. Informatics 125, 155--160.

[16]

I. Hajshirmohammadi and S. Payandeh. 2007. Fuzzy set theory for performance evaluation in a surgical simulator. Presence: Teleoperators Virtual Environ. 16, 603--622.

Digital Library

[17]

A. Hamam, M. Eid, A. E. Saddik, and N. D. Georganas. 2008a. A quality of experience model for haptic user interfaces. In Proceedings of the Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems (HAS'08). 1--6.

Digital Library

[18]

A. Hamam, M. Eid, A. E. Saddik, and N. D. Georganas. 2008b. A fuzzy logic system for evaluating quality of experience of haptic-based applications. In Proceedings of the Eurohaptics Conference. Springer, 129--138.

Digital Library

[19]

A. Hamam, M. Eid, and A. E. Saddik. 2013. A. Effect of kinesthetic and tactile haptic feedback on the quality of experience of edutainment applications. Multimedia Tools Appl. 67, 2, 455--472.

Digital Library

[20]

A. Hamam and El Saddik, 2013. Towards a mathematical model for quality of experience evaluation of haptic applications. IEEE Trans. Instrum. Meas. 62, 12.

[21]

P. Huang, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2012. QoE assessment of olfactory media in remote ikebana with haptic media. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6.

[22]

Y. Ida, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment of interactivity and fairness in First Person Shooting with group synchronization control. In Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2.

Digital Library

[23]

W. Ijsselsteijn, Y. De Kort, K. Poels, A. Jurgelionis, and F. Bellotti. 2007. Characterising and measuring user experiences in digital games. In Proceedings of the International Conference on Advances in Computer Entertainment Technology.

[24]

K. Iwata, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment in haptic media, sound, and video transmission: Effect of playout buffering control. Comput. Entertain. 8, 12:1--12:14.

Digital Library

[25]

R. Jain. 2004. Quality of experience. IEEE Multimedia 11, 96--95.

Digital Library

[26]

L. A. Jones and H. Ho. 2008. Warm or Cool, Large or Small&quest; The Challenge of Thermal Displays. IEEE Trans. Haptics 1, 53--70.

Digital Library

[27]

M. Karam, F. A. Russo, and D. I. Fels. 2009. Designing the Model Human Cochlea: An Ambient Crossmodal Audio-Tactile Display. IEEE Trans. Haptics 2, 160--169.

Digital Library

[28]

Y. Kusunose, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment in networked air hockey game with haptic media. In Proceedings of the Annual Workshop on Network and Systems Support for Games. 1--2.

Digital Library

[29]

K. S. Park and R. V. Kenyon. 1999. Effects of network characteristics on human performance in a collaborative virtual environment. In Proceedings of the IEEE Conference on Virtual Reality.

Digital Library

[30]

E. H. Mamdani and S. Assilian. 1999. An experiment in linguistic synthesis with a fuzzy logic controller. Int. J. Human-Computer Studies 51, 135--147.

Digital Library

[31]

MATLAB Documentation, Fuzzy logic toolbox for use with MATLAB. Math Works Inc., 2001.

[32]

V. G. Miller. 1993. Measurement of self-perception of intuitiveness. Western J. Nursing Res. 15, 595.

[33]

C. C. Preston and A. M. Colman. 2000. Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. Acta Psychologica 104.

[34]

L. Nacke and C. A. Lindley. 2008. Flow and immersion in first-person shooters: measuring the player's gameplay experience. In Proceedings of the Conference on Future Play: Research, Play, Share. ACM, 81--88.

Digital Library

[35]

L. E. Nacke and C. A. Lindley. 2010. Affective ludology, flow and immersion in a first-person shooter: Measurement of player experience. Loading 3, 5.

[36]

A. Ramsey. 1997. Investigation of physiological measures relative to self-report of virtual reality induced sickness and effects (VRISE). In Proceedings of the International Workshop on Motion Sickness: Medical and Human Factors. 26--28.

[37]

G. H. Roid. 2004. Quality of performance and change-sensitive assessment of cognitive ability. In Proceedings of the International Test Users Conference. Austrahan Conference for Educational Research.

[38]

L. A. Rowe and R. Jain. 2005. ACM SIGMM retreat report on future directions in multimedia research. ACM Trans. Multimedia Comput. Commun. Appl. 1, 3--13.

Digital Library

[39]

R. Seroussi, M. H. Krag, P. Wilder, and M. H. Pope. 1989. The design and use of a microcomputerized real-time muscle fatigue monitor based on the medical frequency shift in the electromyographic signal. IEEE Trans. Biomed. Eng. 36, 284--286.

[40]

M. A. Srinivasan and C. Basdogan. 1997. Haptics in virtual environments: Taxonomy, research status, and challenges. Computers Graphics 21, 393--404.

[41]

D. L. Streiner. 2003. Unicorns do exist: a tutorial on “proving” the null hypothesis. Canadian J. Psych. 48, 756--761.

[42]

D. Strickland, L. Hodges, M. North, and S. Weghorst. 1997. Overcoming phobias by virtual exposure. Commun. ACM 40, 34--39.

Digital Library

[43]

P. Sweetser and P. Wyeth. 2005. GameFlow: a model for evaluating player enjoyment in games. Computers Entertain. 3, 3--3.

Digital Library

[44]

A. Tatematsu, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment in haptic media, sound and video transmission: Influences of network latency. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6.

[45]

L. X. Wang and J. M. Mendel. 1992. Generating fuzzy rules by learning from examples. IEEE Trans Syst. Man Cyber. 22, 1414--1427.

[46]

T. E. Whalen, S. Noel, and J. Stewart. 2003. Measuring the human side of virtual reality. In Proceedings of the IEEE International Symposium on Virtual Environments, Human- Computer Interfaces and Measurement Systems (VECIMS'03). 8--12.

[47]

W. Wu, A. Arefin, R. Rivas, K. Nahrstedt, R. Sheppard, and Z. Yang. 2009. Quality of experience in distributed interactive multimedia environments: toward a theoretical framework. In Proceedings of the 17th ACM International Conference on Multimedia. 481--490.

Digital Library

[48]

W. Wu, A. Arefin, Z. Huang, P. Agarwal, S. Shi, R. Rivas, and K. Nahrstedt. 2010. “I'm the Jedi&excl;” - A case study of user experience in 3D tele-immersive gaming. In Proceedings of the IEEE International Symposium on Multimedia. 220--227.

Digital Library

Cited By

Sudan Aran AEraslan E(2024)Sanal Gerçeklik Uygulamalarında Bulanık Mantık Yaklaşımı: Sistematik DerlemeJournal of Turkish Operations Management10.56554/jtom.13738508:1(269-278)Online publication date: 18-Jul-2024
https://doi.org/10.56554/jtom.1373850
Sousa NAlén ELosada NMelo M(2024)Virtual reality in wine tourism: Immersive experiences for promoting travel destinationsJournal of Vacation Marketing10.1177/13567667241267306Online publication date: 2-Aug-2024
https://doi.org/10.1177/13567667241267306
Guo KShimomura YHosoi JBan YWarisawa S(2024)GUI Presentation Method based on Binocular Rivalry for Non-overlay Information Recognition in Visual ScenesProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652939(193-204)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652939
Show More Cited By

Index Terms

A Quality of Experience Model for Haptic Virtual Environments
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Envisioning Haptic Design for Immersive Virtual Environments
DIS' 20 Companion: Companion Publication of the 2020 ACM Designing Interactive Systems Conference

Current techniques for haptics in immersive virtual environments (IVEs) allow users to perceive materials while exploring virtual surfaces. However, these experiences are usually restricted to the properties defined during the design phase of the IVE. ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
Desktop haptic virtual assembly using physically based modelling

This research investigates the feasibility of using a desktop haptic virtual environment as a design tool for evaluating assembly operations. Bringing virtual reality characteristics to the desktop, such as stereo vision, further promotes the use of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 10, Issue 3

April 2014

140 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/2602979

Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 April 2014

Accepted: 01 September 2013

Revised: 01 May 2013

Received: 01 September 2012

Published in TOMM Volume 10, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Qatar Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
836
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)7

Reflects downloads up to 01 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sudan Aran AEraslan E(2024)Sanal Gerçeklik Uygulamalarında Bulanık Mantık Yaklaşımı: Sistematik DerlemeJournal of Turkish Operations Management10.56554/jtom.13738508:1(269-278)Online publication date: 18-Jul-2024
https://doi.org/10.56554/jtom.1373850
Sousa NAlén ELosada NMelo M(2024)Virtual reality in wine tourism: Immersive experiences for promoting travel destinationsJournal of Vacation Marketing10.1177/13567667241267306Online publication date: 2-Aug-2024
https://doi.org/10.1177/13567667241267306
Guo KShimomura YHosoi JBan YWarisawa S(2024)GUI Presentation Method based on Binocular Rivalry for Non-overlay Information Recognition in Visual ScenesProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652939(193-204)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3652939
Kim SChoi DLee J(2024)EMPop: Pin Based Electromagnetic Actuation for Projection MappingExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3648642(1-4)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3648642
Zhang YSu YSun X(2024)A QoE Physiological Measure of VR With Vibrotactile Feedback Based on Frontal Lobe Power AsymmetryIEEE Transactions on Multimedia10.1109/TMM.2023.330581326(2932-2942)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3305813
Zhang HXue YLu YLee S(2024)A Fusion Model: Toward a Virtual, Physical, and Cognitive Integration and Its PrinciplesIEEE Consumer Electronics Magazine10.1109/MCE.2023.330048813:3(107-114)Online publication date: May-2024
https://doi.org/10.1109/MCE.2023.3300488
Sousa NAlén ELosada NMelo M(2024)Influencing wine tourists' decision-making with VR: The impact of immersive experiences on their behavioural intentionsTourism Management Perspectives10.1016/j.tmp.2024.10123551(101235)Online publication date: Mar-2024
https://doi.org/10.1016/j.tmp.2024.101235
Sousa NJorge FTeixeira MLosada NAlén EGuttentag D(2024)Does Technological Innovativeness Influence Users' Experiences With Virtual Reality Tourism?International Journal of Tourism Research10.1002/jtr.273026:4Online publication date: 8-Aug-2024
https://doi.org/10.1002/jtr.2730
Tasaka S(2023)Usefulness of QoS in Multidimensional QoE Prediction for Haptic–Audiovisual CommunicationsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/361324620:1(1-24)Online publication date: 18-Sep-2023
https://dl.acm.org/doi/10.1145/3613246
Oo MIshibashi YWai K(2023)Effect of Adaptive Reaction Force Control on Human Perception of Softness with Haptic Sense in Networked Virtual Environment2023 IEEE Conference on Computer Applications (ICCA)10.1109/ICCA51723.2023.10182078(158-163)Online publication date: 27-Feb-2023
https://doi.org/10.1109/ICCA51723.2023.10182078
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents