research-article

The effect of tracking delay on awareness states in immersive virtual environments: an initial exploration

Authors:

Giorgos Papadakis,

Katerina Mania,

Eftichios KoutroulisAuthors Info & Claims

VRCAI '11: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

Pages 475 - 482

https://doi.org/10.1145/2087756.2087848

Published: 11 December 2011 Publication History

Abstract

This paper presents an experimental methodology exploring the effect of tracking latency on object recognition after exposure to an immersive VE, in terms of both scene context and associated awareness states. System latency (time delay) and its visible consequences are fundamental Virtual Environment (VE) deficiencies that can hamper spatial awareness and memory. The immersive simulation consisted of a radiosity-rendered space divided in three zones including a kitchen/dining area, an office area and a lounge area. The space was populated by objects consistent as well as inconsistent with each zone's context. The simulation was displayed on a stereo head-tracked Head Mounted Display. Participants across two conditions of varying latency (system minimum latency vs added latency condition) were exposed to the VE and completed an object-based memory recognition task. Participants also reported one of three states of awareness following each recognition response which reflected either the recollection of contextual detail, the sense of familiarity unaccompanied by contextual information or even informed guesses. Preliminary results from initial pilot studies reveal better memory performance of objects in the low latency condition. A disproportionately large proportion of guess responses for consistent objects viewed with high latency is also observed and correspondingly a disproportionately low proportion of remember responses for consistent objects in the same latency condition.

References

[1]

Bliss, J. P., Tidwell, P. D., Guest, M. A. 1997. The Effectiveness of Virtual Reality for Administering Spatial Navigation Training to Firefighters. Presence: Teleoperators and Virtual Environments, 6(1), MIT Press, 73--86.

[2]

Brandt, K. R., Gardiner, J. M., & MacRae, C. N. 2006. The distinctiveness effect in forenames: The role of subjective experiences and recognition memory. British Journal of Psychology 269--280.

[3]

Brewer, W. F. & Treyens, J. 1981. Role of Schemata in Memory for Places. Cognitive Psychology, 1981, 13, 207--230.

[4]

Conway, M. A., et al. 1997. Changes in Memory Awareness During Learning: The Acquisition of Knowledge by Psychology Undergraduates. Journal of Experimental Psychology: General, 126(4), 393--413.

[5]

Cunningham D. W., Billock V. A., Tsou B. H. 2001. Sensorimotor adaptation to violations in temporal contiguity. Psychological Science, 12, 6, 532--535.

[6]

Cunningham D. W., Chatziastros A., von der Heyde M., Bulthoff H. H. 2001. Driving in the future: Temporal visuomotor adaptation and generalization. Journal of Vision, 1, 88--98.

[7]

Davenport, J. L. & Potter, M. C. 2004. Scene Consistency in Object and Background Perception. Psychological Science, 15(8), pp.559--564

[8]

Ellis S. R., Adelstein B. D., Baumler S., Jense G. J., Jacoby R. H. 1999. Sensor spatial distortion, visual latency, and update rate effects on 3D tracking in virtual environments. Proceedings of VR '99, pp. 218--221.

Digital Library

[9]

Ellis S. R., Bréant K., Menges B. M., Adelstein B. D. 1997. Operator interaction with virtual objects: effects of system latency. Proceedings HCI International, 973--976.

[10]

Ellis S. R., Mania K., Adelstein B. D., Hill M. 2004. Generalizability of latency detection in a variety of virtual environments. 48th Annual Meeting Human Factors and Ergonomics Society, New Orleans.

[11]

Ellis S. R., Wolfram A., Adelstein B. D. 2002. Large amplitude three-dimensional tracking in augmented environments: a human performance trade-off between system latency and update rate. Proceedings of the 46th Annual Meeting Human Factors and Ergonomics Society, 2149--2154.

[12]

Fink, W., Foo, P. S., Warren, W. 2007. Obstacle avoidance during walking in real and virtual environments, ACM Transactions on Applied Perception, 4(1).

Digital Library

[13]

Gardiner, J. M. and Richardson-Klavenhn, A. 1992. Remembering and Knowing. In: Tulving, E. and Craik, F. I. M., eds. 1992. Handbook of Memory. Oxford: Oxford University Press.

[14]

Garret A., Aguilar M., Barniv Y. 2002. A recurrent neural network approach to virtual environment latency reduction. Proceedings, IJCNN, Honolulu, HI.

[15]

Held R., Efstathiou A., Greene M. 1966. Adaptation to displaced and delayed visual feedback from the hand. Journal of Experimental Psychology 72, 6, 887--891.

[16]

Holingworth, A. & Henderson, J. M. 1998. Does consistent scene context facilitate object perception Journal of Experimental Psychology: General, 127(4), 398--415.

[17]

Kennedy R. S., Lane N. E., Lilienthal M. G., Berbaum K. S., Hettinger L. J. 1992. Profile analysis of simulator sickness symptoms: application to virtual environment systems. Presence, 1 (3), 295--301.

Digital Library

[18]

Koriat, A., Goldsmith, M. 1994. Memory in Naturalistic and Laboratory Contexts: Distinguishing the accuracy oriented and quantity oriented approaches to memory assessment. Journal of Experimental Psychology: General, 123, 297--315.

[19]

Levine, B., Black, S. E., Cabeza, R., Sinden, M., McIntosch, A. R., Toth, J. P., et al (1998). Episodic memory and the self in a case of isolated retrograde amnesia. Brain, 121, 1951--1973.

[20]

Liu A., Tharp G., Lai S., French L., Stark L. W. 1993. Some of what one needs to know about using head-mounted displays to improve teleoperator performance. IEEE Transactions on Robotics and Automation 9, 5, 638--48.

[21]

Mania K., Adelstein B. D., Ellis S. R., Hill M. 2004. Generalizability of latency detection in a variety of virtual environments. Submitted to First Symposium on Applied Perception in Graphics and Visualization, ACM-SIGGRAPH, Los Angeles, August.

[22]

Mania K., Adelstein B. D., Ellis S. R., Hill M. 2004. Perceptual sensitivity to head tracking latency in virtual environments with varying degrees of scene complexity. Proceedings of ACM Siggraph Symposium on Applied Perception in Graphics and Visualization, 39--47, ACM Press.

Digital Library

[23]

Mania K., Badariah S., Coxon M. 2010. Cognitive transfer of training from immersive virtual environments to reality. ACM Transactions on Applied Perception, ACM Press, 7(2), 9:1--9:14, ACM Press.

Digital Library

[24]

Mania K., Troscianko T., Hawkes R., A. Chalmers 2003. Fidelity metrics for virtual environment simulations based on spatial memory awareness states. Presence, Teleoperators and Virtual Environments, 12(3), 296--310. MIT Press.

Digital Library

[25]

Mania K., Wooldridge D., Coxon M., Robinson A. 2006. The effect of visual and interaction fidelity on spatial cognition in immersive virtual environments. IEEE Transactions on Visualization and Computer Graphics journal, 12(3): 396--404.

Digital Library

[26]

Mania, K., Robinson, A., Brandt. K. 2005. The Effect of Memory Schemas on Object Recognition in Virtual Environments. Presence Teleoperators and Virtual Environments, 6(1), 73--86, MIT Press.

Digital Library

[27]

McCabe, D. P., & Geraci, L. D. (2009). The influence of instructions and terminology on the accuracy of remember-know judgements. Consciousness and Cognition, 18, 401--413.

[28]

Meehan M., Razzaque S., Whitton M. C., Brooks Jr F. P. 2003. Effect of latency on presence in stressful virtual environments. Proceedings, IEEE Virtual Reality Conference, Los Angeles, pp. 141--148.

Digital Library

[29]

Mourkoussis, N., Rivera, F., Troscianko, T., Dixon, T., Hawkes, R., Mania, K. 2010. Quantifying Fidelity for Virtual Environment simulations employing memory schema assumptions. ACM Transactions on Applied Perception, 8(1), 2:2--2:21, ACM Press.

Digital Library

[30]

Minsky, M. 1975. A framework for representing knowledge. In P. H. Winston (Ed.), The Psychology of Computer Vision. McGraw-Hill.

[31]

Papadakis, G., Mania, K., Koutroulis, E. To appear 2011. A System to Measure, Control and Minimize end-to-end Head Tracking Latency in Immersive Simulations. The 10th International Conference on Virtual Reality Continuum and Its Applications in Industry 2011, Hong Kong.

Digital Library

[32]

Pichert, J. W., Anderson, R. C. 1966. Taking a different perspectives on a story. Journal of Educational Psychology 69, 309--315. SCHANK, R. C. 1999. Dynamic memory revisited. Cambridge, UK. Cambridge University Press.

Digital Library

[33]

Stanney, K. M., Mourant, R. R., Kennedy, R. S. 1998. Human factors issues in virtual environments: A review of the literature. Presence, Vol. 7:4, pp. 327--351.

Digital Library

[34]

Tulving, E. 1992. Elements of Episodic Memory, Oxford: Oxford Science Publications.

[35]

Uno M., Slater M. 1997. The sensitivity of presence to collision response. Proceedings of IEEE VRAIS, 95--101, 1997.

Digital Library

[36]

Waller, D., Hunt, E., Knapp. D. 1998. The Transfer of Spatial Knowledge in Virtual Environment Training. Presence: Tele-operators and Virtual Environments, 7(2), MIT Press.

Digital Library

[37]

Watson B., Walker N., Woytiuk P., Ribarsky W. 2003. Maintaining usability during 3D placement despite delay. Proceedings of IEEE Virtual Reality 2003, 133--140.

Digital Library

[38]

Welch R. B., Blackmon T. T., Liu A., Mellers B. A., Stark L. W. 1996. The effects of pictorial realism, delay of visual feedback and observer interactivity on the subjective sense of presence. Presence: Teleoperators and Virtual Environments 5, 3, 263--273.

Digital Library

[39]

Wheeler, M. A. & Stuss, D. T. (2003). Remembering and knowing in patients with frontal lobe injuries. Cortex, 39, 827--846.

[40]

XVR 2008. VR Media, http://www.vrmedia.it

[41]

Zotos, A., Mania, K., Mourkoussis, N. 2009. A Schema-based Selective Rendering Framework. ACM Siggraph Symposium on Applied Perception in Graphics and Visualization, 85--92, Chania, Crete, Greece.

Digital Library

Cited By

Yang MZhang JYu L(2019)Perceptual Tolerance to Motion-To-Photon Latency with Head Movement in Virtual Reality2019 Picture Coding Symposium (PCS)10.1109/PCS48520.2019.8954518(1-5)Online publication date: Nov-2019
https://doi.org/10.1109/PCS48520.2019.8954518
Li JXie NZhao W(2019)The choice of intrinsic axis under multi-cue conditionsCognitive Processing10.1007/s10339-019-00903-4Online publication date: 19-Jan-2019
https://doi.org/10.1007/s10339-019-00903-4
Caserman PMartinussen MGöbel S(2019)Effects of End-to-end Latency on User Experience and Performance in Immersive Virtual Reality ApplicationsEntertainment Computing and Serious Games10.1007/978-3-030-34644-7_5(57-69)Online publication date: 4-Nov-2019
https://doi.org/10.1007/978-3-030-34644-7_5
Show More Cited By

Index Terms

The effect of tracking delay on awareness states in immersive virtual environments: an initial exploration

Recommendations

Gender differences in spatial awareness in immersive virtual environments: a preliminary investigation
VRCAI '12: Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

This paper presents an experiment exploring gender differences in spatial navigation, memory performance and spatial awareness through a complex Virtual Environment (VE). The immersive simulation consisted of a radiosity-rendered space divided in four ...
The effect of stereo and context on memory and awareness states in immersive virtual environments
APGV '10: Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization

Spatial awareness is crucial for human performance efficiency of any task that entails perception of space. Memory of spaces is an imperfect reflection of the cognitive activity (awareness states) that underlies performance in such environments. ...
Multimodal "Sensory Illusions" for Improving Spatial Awareness in Virtual Environments
ECCE '16: Proceedings of the European Conference on Cognitive Ergonomics

Inaccurate judgement of distances in virtual environments (VEs) restricts their usefulness for engineering development, in which engineers must have a good understanding of the spaces they are designing. Multimodal feedback can improve depth perception ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '11: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

December 2011

617 pages

ISBN:9781450310604

DOI:10.1145/2087756

General Chairs:
Zhi-Qiang Liu
City University of Hong Kong, China
,
Joaquim Jorge
Technical University of Lisbon, Portugal
,
Zhigeng Pan
China Society of Image and Graphics and Hangzhou Normal University, China
,
Program Chairs:
Xiaopeng Zhang
Institute of Automation, CAS, China
,
Oscar Kin-Chung Au
City University of Hong Kong
,
Weiming Dong
Institute of Automation, CAS, China

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
VT Committee of the China Society of Image and Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRCAI '11

Sponsor:

SIGGRAPH

VRCAI '11: The 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

December 11 - 12, 2011

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
157
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yang MZhang JYu L(2019)Perceptual Tolerance to Motion-To-Photon Latency with Head Movement in Virtual Reality2019 Picture Coding Symposium (PCS)10.1109/PCS48520.2019.8954518(1-5)Online publication date: Nov-2019
https://doi.org/10.1109/PCS48520.2019.8954518
Li JXie NZhao W(2019)The choice of intrinsic axis under multi-cue conditionsCognitive Processing10.1007/s10339-019-00903-4Online publication date: 19-Jan-2019
https://doi.org/10.1007/s10339-019-00903-4
Caserman PMartinussen MGöbel S(2019)Effects of End-to-end Latency on User Experience and Performance in Immersive Virtual Reality ApplicationsEntertainment Computing and Serious Games10.1007/978-3-030-34644-7_5(57-69)Online publication date: 4-Nov-2019
https://doi.org/10.1007/978-3-030-34644-7_5
Blissing BBruzelius FEriksson O(2016)Effects of Visual Latency on Vehicle Driving BehaviorACM Transactions on Applied Perception (TAP)10.1145/297132014:1(1-12)Online publication date: 24-Aug-2016
https://dl.acm.org/doi/10.1145/2971320
Chang CHsu CHsu CChen KHanjalic ASnoek CWorring MBulterman DHuet BKelliher AKompatsiaris YLi J(2016)Performance Measurements of Virtual Reality SystemsProceedings of the 24th ACM international conference on Multimedia10.1145/2964284.2967303(655-659)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1145/2964284.2967303
Orlosky JKiyokawa KTakemura H(2014)Managing mobile text in head mounted displaysACM SIGMOBILE Mobile Computing and Communications Review10.1145/2636242.263624618:2(20-31)Online publication date: 3-Jun-2014
https://dl.acm.org/doi/10.1145/2636242.2636246
Coxon MMania K(2013)Measuring Memories for Objects and Their Locations in Immersive Virtual Environments: The Subjective Component of Memorial ExperienceHandbook of Human Centric Visualization10.1007/978-1-4614-7485-2_18(453-471)Online publication date: 25-Jun-2013
https://doi.org/10.1007/978-1-4614-7485-2_18

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten