research-article

Being there again Presence in real and virtual environments and its relation to usability and user experience using a mobile navigation task

Authors:

Jennifer Brade,

Manfred Tscheligi,

Philipp KlimantAuthors Info & Claims

International Journal of Human-Computer Studies, Volume 101, Issue C

Pages 76 - 87

https://doi.org/10.1016/j.ijhcs.2017.01.004

Published: 01 May 2017 Publication History

Abstract

The possibility of using virtual environments instead of real field or laboratory environments is a promising research field. However, before virtual environments are able to replace the traditional environments the differences between the methods must be worked out. We take up on previous studies which compared different real and virtual environments concerning presence and usability and expand the research on the factor of user experience. We compared a virtual field environment (CAVE Cave Automatic Virtual Environment) and a real field environment (city center of Chemnitz, Germany) in a between-subject-design concerning presence, and evaluate its impact on the usability and the user experience of a geocaching game. The data of 60 participants was analyzed and shows significantly higher ecological validity for the real field environment but higher values for engagement and negative effects in the virtual field environment. Concerning usability, significant differences were verified between the two environments. All presence factors correlated significantly with usability in the CAVE, but did not correlate in the real-field environment. Concerning user experience, the CAVE showed significantly higher hedonic quality values, whereas the real field environment had higher pragmatic quality values. In both conditions presence and user experience factors were partly correlated. Our results indicate that virtual environments can be an alternative to real environments for user experience studies, when a high presence is achieved. virtual environments are an alternative for user experience studies.Ratings for usability are correlated with presence in VR.Ratings for user experience are correlated with presence in VR.

References

[1]

U.-V. Albrecht, K. Folta-Schoofs, M. Behrends, U. von Jan, Effects of mobile augmented reality learning compared to textbook learning on medical students: randomized controlled pilot study, J. Med. Internet Res., 15 (2013) 182.

[2]

A. Bangor, P. Kortum, J. Miller, Determining What individual SUS scores mean: adding an adjective rating scale, J. Usability Stud. (2009) 114-123.

Digital Library

[3]

W. Barfield, D. Zeltzer, T. Sheridan, M. Slater, Presence and Performance within Virtual Environments, Virtual Environments and Advanced Interface Design, Oxford University Press, Inc., New York, USA, 1995.

Digital Library

[4]

J. Brade, M. Lorenz, P. Klimant, F. Klimant, M. Putz, Virtual reality for industrial application The influence of presence and its relation to usability and user experience, Adv. Mater. Res., 1140 (2016) 537-544.

[5]

J. Brooke, SUS - A Quick and Dirty Usability Scale, Usability Evaluation in Industry, Taylor & Francis Inc, Bristol, 1996.

[6]

M. Busch, M. Lorenz, M. Tscheligi, C. Hochleitner, T. Schulz, Being There For Real Presence in Real and Virtual Environments and its Relation to Usability, NordiCHI, ACM, Helsinki, 2014.

Digital Library

[7]

C. Coelho, J. Tichon, T.J. Hine, G. Wallis, G. Riva, Media Presence and Inner Presence: The Sense of Presence in Virtual Reality Technologies, From communication to Presence: Cognition, Emotions and Culture Towards the Ultimate Communicative Experience, Festschrift in honor of Luigi Anolli, IOS Press, Amsterdam, 2006.

[8]

C. Cruz-Neira, D.J. Sandin, T.A. DeFanti, Surround-Screen Projection-Based Virtual Reality: the Design and Implementation of the CAVE, SIGGRAPH, ACM Press, 1993.

Digital Library

[9]

C. Cruz-Neira, D.J. Sandin, T.A. DeFanti, R.V. Kenyon, J.C. Hart, The cave: audio visual experience automatic virtual environment, Commun. ACM, 36 (1992) 64-72.

Digital Library

[10]

Y.A.W. de Kort, W.A. IJsselsteijn, J. Kooijman, Y. Schuurmans, virtual Laboratories: Comparability of real and virtual environments for environmental psychology, Presence.: Teleoperators Virtual Environ., 12 (2003) 360-373.

Digital Library

[11]

H.B.-L. Duh, V.H.-h. Chen, Usability evaluation for mobile device: a comparison of laboratory and field tests, ACM Press, Helsinki, 2006.

[12]

Fraunhofer-IGD, 2016. Instant reality.

[13]

A. Gorini, C.S. Capideville, G. de Leo, F. Mantovani, G. Riva, The role of immersion and Narrative in mediated presence: the virtual Hospital experience, Cyber., Behav., Soc. Netw., 14 (2011) 99-105.

[14]

Guy, E., Punpongsanon, P., Iwai, D., Sato, K., Boubekeur, T., 2015. LazyNav: 3D Ground Navigation with Non-Critical Body Parts, IEEE Symposium on 3D User Interfaces, Arles, pp. 4348.

[15]

M. Hassenzahl, N. Tractinsky, User experience - a research agenda, Behav. Inf. Technol., 25 (2006) 91-97.

[16]

A. Kaikkonen, T. Kallio, A. Keklinen, A. Kankainen, M. Cankar, Usability testing of mobile applications: a Comparison between laboratory and field testing, J. Usability Stud., 1 (2005) 4-16.

Digital Library

[17]

J. Kjeldskov, M.B. Skov, B.S. Als, R.T. Hegh, Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field, MobileHCI, Springer-Verlag, Berlin Heidelberg, 2004.

[18]

Laugwitz, B., Held, T., Schrepp, M., 2008. Construction and evaluation of a user experience questionnaire, hci and usability for education and work. In: Proceedings of the 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society. Springer-Verlag Berlin, Graz, pp. 6376.

Digital Library

[19]

Law, E.L.-C., Roto, V., Hassenzahl, M., Vermeeren, A.P.O.S., Kort, J., 2009. Understanding, scoping and defining user experience. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 719728.

Digital Library

[20]

J. Lessister, J. Freeman, E. Keogh, J. Davidoff, A cross-media presence Questionnaire: the ITC-sense of presence Inventory, Presence.: Teleoperators Virtual Environ., 10 (2001) 282-297.

Digital Library

[21]

Lexa, 2016. Fake GPS.

[22]

J.M. Loomis, J.J. Blascovich, A.C. Beall, Immersive virtual environment technology as a basic research tool in psychology, Behav. Res. Methods, Instrum., Comput. (1999) 557-564.

[23]

Lorenz, M., Busch, M., Rentzos, L., Tscheligi, M., Klimant, P., Frhlich, P., 2015. Im There! The Influence of Virtual Reality and Mixed Reality Environments Combined with Two Different Navigation Methods on Presence, IEEE Virtual Reality Conference 2015 Arles, France, pp. 223224.

[24]

K. Mania, Connections between lighting impressions and presence in real and virtual environments: an experimental study, AFRIGRAPH, ACM Press, 2001.

Digital Library

[25]

K. Mania, A. Chalmers, The effects of levels of immersion on memory and presence in virtual environments: a reality centered approach, Cyber. Behav., 4 (2004) 247-364.

[26]

M. Meehan, Physiological Reaction as an Objective Measure of Presence in Virtual Environments(Dissertation), University of North Carolina, 2001.

Digital Library

[27]

Nisenfeld, S., 2003. Using Reality to Evaluate the ITC Presence. Unpublished Master Thesis.

[28]

Patel, H., Nichols, S., 2004. View of the future: overview of the experimental programme via quantitative meta-analysis., Virtual Reality design and evaluation workshop, Nottingham, pp.

[29]

M. Rauschenberger, M. Schrepp, M.P. Cota, S. Olschner, J. Thomaschewski, Efficient measurement of the user experience of interactive products. how to use the user experience questionnaire (UEQ). Example: Spanish Language Version, Int. J. Artif. Intell. Interact. Multimed., 2 (2013) 39-45.

[30]

M.J. Schuemie, P. van der Straaten, M. Krijn, C.A.P.G. van der Mast, Research on presence in virtual reality: a survey, Cyber. Behav., 4 (2001) 183-201.

[31]

M. Slater, S. Wilbur, A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments, Presence.: Teleoperators Virtual Environ., 6 (1997) 603-616.

Digital Library

[32]

M. Slater, M. Usoh, A. Steed, Depth of presence in virtual environments, Presence: Teleoperators Virtual Environ., 3 (1994) 130-144.

Digital Library

[33]

H. Stumpf, E. Fay, Schlauchfiguren. Ein test zur Beurteilung des rumlichen Vorstellungsvermgens, Retrieved Gttingen (1983).

[34]

X. Sun, A. May, A comparison of field-based and lab-based experiments to evaluate user experience of personalised mobile devices, Adv. Hum.-Comput. Interact. (2013) 1-9.

Digital Library

[35]

S. Sylaiou, K. Mania, A. Karoulis, M. White, Exploring the relationship between presence and enjoyment in a virtual museum, Int. J. Hum.-Comput. Stud., 68 (2010) 243-253.

Digital Library

[36]

Tang, A., Biocca, F., Lim, L., 2004. Comparing differences in presence during social interaction in augmented reality versus virtual reality environments: An exploratory study, PRESENCE 2004, In: Proceedings of the 7th Annual International Workshop on Presence, Valencia, Spain, pp. 204208.

[37]

A. Toet, M.G. van Schaik, Effects of signals of disorder on fear of crime in real and virtual environments, J. Environ. Psychol., 32 (2012) 260-276.

[38]

Usoh, M., Catena, E., Arman, S., Slater, M., 2000. Using Presence Questionnaires in Reality, Presence: Teleoperators and Virtual Environments 9 (5), pp. 497503

Digital Library

[39]

Zwick, S., Rauprich, J., 2016. Actionbound.

Cited By

Chen QGong YLu Y(2023)User Experience of Digital Voice Assistant: Conceptualization and MeasurementACM Transactions on Computer-Human Interaction10.1145/362278231:1(1-35)Online publication date: 29-Nov-2023
https://dl.acm.org/doi/10.1145/3622782
Li YCh’ng ECobb S(2023)Factors Influencing Engagement in Hybrid Virtual and Augmented RealityACM Transactions on Computer-Human Interaction10.1145/358995230:4(1-27)Online publication date: 30-Mar-2023
https://dl.acm.org/doi/10.1145/3589952
Voinescu APetrini KStanton Fraser D(2023)Presence and simulator sickness predict the usability of a virtual reality attention taskVirtual Reality10.1007/s10055-023-00782-327:3(1967-1983)Online publication date: 24-Mar-2023
https://dl.acm.org/doi/10.1007/s10055-023-00782-3
Show More Cited By

Being there again Presence in real and virtual environments and its relation to usability and user experience using a mobile navigation task
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Usability engineering of virtual environments (VEs): identifying multiple criteria that drive effective VE system design

Designing usable and effective interactive virtual environment (VE) systems is a new challenge for system developers and human factors specialists. In particular, traditional usability principles do not consider characteristics unique to VE systems, ...
Effects on User Experience in an Edutainment Virtual Environment: Comparison Between CAVE and HMD
ECCE '17: Proceedings of the European Conference on Cognitive Ergonomics

The user experience in immersive virtual environment can be broadly defined by the feeling of presence and immersion in a virtual environment. The propensity of feeling "there" and "enveloped by" in the virtual environment seems to be essential in ...
Using a preamble to increase presence in digital virtual environments

Immersion in a digital virtual environment (DVE) increases the likelihood that individuals will feel present in the DVE and hence respond as they would in a similar physically grounded environment. Previous research utilizing high-fidelity technology ...

Comments

Information & Contributors

Information

Published In

cover image International Journal of Human-Computer Studies

International Journal of Human-Computer Studies Volume 101, Issue C

May 2017

88 pages

ISSN:1071-5819

Issue’s Table of Contents

Copyright © Elsevier Ltd.

Publisher

Academic Press, Inc.

United States

Publication History

Published: 01 May 2017

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen QGong YLu Y(2023)User Experience of Digital Voice Assistant: Conceptualization and MeasurementACM Transactions on Computer-Human Interaction10.1145/362278231:1(1-35)Online publication date: 29-Nov-2023
https://dl.acm.org/doi/10.1145/3622782
Li YCh’ng ECobb S(2023)Factors Influencing Engagement in Hybrid Virtual and Augmented RealityACM Transactions on Computer-Human Interaction10.1145/358995230:4(1-27)Online publication date: 30-Mar-2023
https://dl.acm.org/doi/10.1145/3589952
Voinescu APetrini KStanton Fraser D(2023)Presence and simulator sickness predict the usability of a virtual reality attention taskVirtual Reality10.1007/s10055-023-00782-327:3(1967-1983)Online publication date: 24-Mar-2023
https://dl.acm.org/doi/10.1007/s10055-023-00782-3
Niarchos APetousi DKatifori ASakellariadis PIoannidis Y(2023)Bridging the Gap Between the Physical and the Virtual in Tabletop Role Playing Games: Exploring Immersive VR TabletopsInteractive Storytelling10.1007/978-3-031-47655-6_30(489-503)Online publication date: 11-Nov-2023
https://dl.acm.org/doi/10.1007/978-3-031-47655-6_30
Dresel MPlaumann JJochems N(2023)Investigating Age Differences in Passive Haptic Feedback for Immersive Virtual Reality: A Pilot Study on Configuration TasksExtended Reality10.1007/978-3-031-43401-3_14(210-222)Online publication date: 6-Sep-2023
https://dl.acm.org/doi/10.1007/978-3-031-43401-3_14
Samonte MDacalaño NEsguerra CPotestades R(2022)ISEKAI: A Virtual Real Estate Web Application Utilizing Constructive Simulation for Improving User Experience in Online Home ToursProceedings of the 2022 6th International Conference on E-Business and Internet10.1145/3572647.3572701(68-76)Online publication date: 14-Oct-2022
https://dl.acm.org/doi/10.1145/3572647.3572701
Weerasinghe MČopič Pucihar KDucasse JQuigley AToniolo AMiguel ACaluya NKljun M(2022)Exploring the future building: representational effects on projecting oneself into the future office spaceVirtual Reality10.1007/s10055-022-00673-z27:1(51-70)Online publication date: 21-Jul-2022
https://dl.acm.org/doi/10.1007/s10055-022-00673-z
Tang LZuo YZhou J(2022)Environmental Boundaries and Road Regularity in Virtual Reality: Examining Their Effects on Navigation Performance and Spatial CognitionHuman Aspects of IT for the Aged Population. Design, Interaction and Technology Acceptance10.1007/978-3-031-05581-2_9(109-126)Online publication date: 26-Jun-2022
https://dl.acm.org/doi/10.1007/978-3-031-05581-2_9
Saad ALiebers JGruenefeld UAlt FSchneegass S(2021)Understanding Bystanders’ Tendency to Shoulder Surf Smartphones Using 360-degree Videos in Virtual RealityProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472058(1-8)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447526.3472058
Pallavicini FPepe AMinissi M(2020)Gaming in Virtual RealitySimulation and Gaming10.1177/104687811983142050:2(136-159)Online publication date: 18-Jun-2020
https://dl.acm.org/doi/10.1177/1046878119831420
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents