article

Virtual Eyes Can Rearrange Your Body: Adaptation to Visual Displacement in See-Through, Head-Mounted Displays

Authors:

Frank A. Biocca,

J. P. RollandAuthors Info & Claims

Presence: Teleoperators and Virtual Environments, Volume 7, Issue 3

Pages 262 - 277

https://doi.org/10.1162/105474698565703

Published: 01 June 1998 Publication History

Abstract

Among the most critical issues in the design of immersive virtual environments are those that deal with the problem of technologically induced intersensory conflict and one of the results, sensorimotor adaptation. An experiment was conducted to support the design of a prototype see-through, head-mounted display (HMD). When wearing video see-through HMDs in augmented reality systems, subjects see the world around them through a pair of head-mounted video cameras. The study looked at the effects of sensory rearrangement caused by a HMD design that displaced the user's “virtual” eye position forward (165 mm) and above (62 mm) toward the spatial position of the cameras. The position of the cameras creates images of the world that are slightly downward and inward from normal. Measures of hand-eye coordination and speed on a manual pegboard task revealed substantial perceptual costs of the eye displacement initially, but also evidence of adaptation. Upon first wearing the video see-through HMD, subjects' pointing errors increased significantly along the spatial dimensions displaced (the y dimension, above-below the target, and z dimension, in front-behind the target). Speed of performance on the pegboard task decreased by 43% compared to baseline performance. Pointing accuracy improved by approximately 33% as subjects adapted to the sensory rearrangement, but it did not reach baseline performance. When subjects removed the see-through HMD, there was evidence that their hand-eye coordination had been altered. Negative aftereffects were observed in the form of greater errors in pointing accuracy compared to baseline. Although these aftereffects are temporary, the results may have serious practical implications for the use of video see-through HMDs by users (e.g., surgeons) who depend on very accurate hand-eye coordination.

References

[1]

Bajura, M., Fuchs, H., & Ohbuchi, R. (1992). Merging virtual objects with the real world. Computer Graphics, 26, 203- 210.

Digital Library

[2]

Berman, A. L., & Melzer, J. E. (1989). Optical collimating apparatus. U.S. Patent Number 4,859,031.

[3]

Biocca, F. (1996). Intelligence augmentation: The vision inside virtual reality. In B. Gorayska (Ed.), Cognitive technology: In search of a humane interface. Amsterdam: North Holland.

[4]

Biocca, F. (1989, May). The effect of literacy training on spatial attention to video monitors. Paper presented to International Communication Association, Washington, DC.

[5]

Biocca, F., & Delaney, B. (1995). Immersive virtual reality technology. In F. Biocca & Levy, M. (Eds.), Communication in the age of virtual reality. Hillsdale, NJ: Lawrence Erlbaum.

Digital Library

[6]

Biocca, F. (1993). Will simulation sickness slow down the diffusion of virtual environment technology. Presence: Teleoperators and Virtual Environment, 1 (3), 334-343.

[7]

Biocca, F. (1990, June). Asymmetries in the perception of camera movement and video-graphics: Effects of neurological structures and literacy training. Information Systems Division, International Communication Association, Dublin.

[8]

Buchroeder, R. A., Seeley, G. W., & Vukobradatovich, D. (1981). Design of a catadioptric VCASS helmet-mounted display. Optical Sciences Center, University of Arizona, under contract to U.S. Air Force Armstrong Aerospace Medical Research Laboratory, Wright-Patterson Air Force Base, Dayton, Ohio, AFAMRL-TR-81-133.

[9]

Carroll, J. M. (Ed). (1991). Designing interaction. Cambridge: Cambridge University Press.

[10]

Cole, M. (1974). Culture and thought. New York: Wiley.

[11]

Dolezal, H. (1982). Living in a world transformed: perceptual and performatory adaptation to visual distortion. Academic Press.

[12]

Droessler, J. G. & Rotier, D. J. (1990). Tilted cat helmet-mounted display. Optical Engineering, 29(8), 849-854.

[13]

Durlach, N. & Mavor, A. (1995). Virtual reality: Scientific and technological challenges. Washington, D.C.: National Academy Press.

[14]

Edwards, E. K., Rolland, J. P., & Keller, K. P. (1993). Video see-through design for merging of real and virtual environments. Proceedings of IEEE VRAIS'93, 223-233.

[15]

Ewert, P. N. (1930). A study on the effect of inverted retinal stimulation upon spatially coordinated behavior. Genetic Psychological Monographs, 7, 3-4.

[16]

Gorayska & Mey (Eds.) (1995). Cognitive technology. Amsterdam: Elsevier, North Holland.

[17]

Harris, C. S. (1965). Perceptual adaptation to inverted, reversed, and displaced vision. Psychological Review, 72, 419- 444.

[18]

Held, R., & Bossom, J. (1961). Neonatal deprivation and adult rearrangement: Complementary techniques for analyzing plastic sensory-motor coordination. Journal of Comparative Physiological Psychology, 54, 33-37.

[19]

Held, R., & Gottlieb, N. (1958). Technique for studying adaptation to disarranged hand-eye coordination. Perceptual and Motor Skills, 8, 83-86.

[20]

Howlett, E. M. (1983). Wide-angle color photography method and system. U.S. Patent Number 4,406,532.

[21]

Kaiser Electrooptics (1992). Personal communications.

[22]

Kaufman, L. (1974). Sight and mind. New York: Oxford University Press.

[23]

Kennedy, R., Berbaum, K. S., Lilienthal, M. G., Dunlap, M. P., Mulligan, B. E., & Funaro, J. F. (1987). Guidelines for alleviation of simulator sickness symptomatology. Orlando, FL: Navy Training Systems Center, NAVTRA SYSCEN TR-87- 007.

[24]

Kennedy, R., Lane, N., Lilitenthal, M. G., Berbaum, K. S., & Hettinger, L. J. (1992). Profile analysis of simulator sickness symptoms: Applications to virtual environment systems. Presence: Teleoperators and Virtual Environments, 1(3), 295- 302.

Digital Library

[25]

Kohler, I. (1964). The formation and transformation of the perceptual world. New York: International Universities Press.

[26]

Kornheiser, A. S. (1976). Adaptation to laterally displaced vision: A review. Psychological Bulletin, 83, 783-816.

[27]

McGonigle, B. O., & Flook, J. P. (1978). Long-term retention of single and multistate prismatic adaptation by humans. Nature, 272, 364-366.

[28]

McLuhan, M., & McLuhan, E. (1988). Laws of media. Toronto: University of Toronto Press.

[29]

McLuhan, M. (1966). Understanding media. New York: Signet.

[30]

Norman, D. (1988). The design of everyday things. New York: Doubleday.

[31]

Oman, C. (1991). Sensory conflict in motion sickness: An observer theory approach. In S. R. Ellis, M. Kaiser, & A. Grunwald (Eds.), Pictorial communication in virtual and real environments (pp. 363-376). London: Taylor & Francis.

[32]

Reason, J. T. (1975). Motion sickness. London: Academic Press.

[33]

Reason, J. T. (1978). Motion sickeness adaptation: A neural mismatch model. Journal of the Royal Society of Medicine, 71, 819-829.

[34]

Rock, I. (1966). The nature of perceptual adaptation. New York: Basic Books.

[35]

Rolland, J. P. (1994). Head-mounted displays for virtual environments: the optical interface. Presented at the International Optical Design Conference, Proc. OSA 22., p329- 333.

[36]

Rolland, J. P., Holloway, R. L., & Fuchs, H. (1994). A comparison of optical and video see-through head-mounted displays. Proc. SPIE 2351, 293-307.

[37]

Rolland, J. P., Ariely, D., & Gibson, W. (1995). Towards quantifying depth and size perception in virtual environments. Presence: Teleoperators and Virtual Environments, 4 (1), 24-49.

Digital Library

[38]

Simon, H. A. (1969). The sciences of the artificial. Boston: MIT Press.

[39]

Snyder, F. W., & Pronko, N. H. (1952). Vision with spatial inversion. Wichita, KA.: University of Wichita Press.

[40]

State, A., Chen, D. T., Tector, C., Brandt, A., Chen, H., Ohbuchi, R., Bajura, M., & Fuchs, H. (1994). Case Study: Observing a volume-rendered fetus within a pregnant patient. Proc. of IEEE Visualization '94. Los Altos, California: IEEE Computer Society Press, D. Bergeron & A. E. Kaufman (Eds), 364-368.

[41]

Stratton, G. (1896). Some preliminary experiments on vision without inversion of the retinal image. Psychological Review, 3, 611-617.

[42]

Stratton, G. (1897). Vision without inversion of the retinal image. Psychological Review, 4, 361-360.

[43]

Taylor, J. G. (1962). The behavioral basis of perception. New Haven: Yale University Press.

[44]

Vygotsky, L. L. (1978). Mind & Society (M. Cole, V. V. John-Steiner, S. S. Scribner, & E. E. Souberman, Eds.). Cambridge, MA: Harvard University Press.

[45]

Welch, R. B. (1978). Perceptual modification: Adapting to altered sensory environments. New York: Academic Press.

[46]

Welch, R. B. (1995). Adaptation to telesystems. Unpublished manuscript, NASA-Ames Research Center, Moffett Field, CA.

[47]

Welch, R. B., Bridgemen, B., Sulekha, A., & Browman, K. E. (1993). Alternating prism exposure causes dual adaptation and generalization to a novel displacement. Perception & Psychophysics, 54(2), 195-204.

[48]

Yao, J. (1994). Model observers for predicting human performance on signal-detection tasks. Unpublished doctoral dissertation, University of Arizona.

Cited By

Wähnert SSchäfer U(2024)Sensorimotor adaptation in virtual reality: Do instructions and body representation influence aftereffects?Virtual Reality10.1007/s10055-024-00957-628:1Online publication date: 22-Feb-2024
https://dl.acm.org/doi/10.1007/s10055-024-00957-6
Guan PPenner EHegland JLetham BLanman D(2023)Perceptual Requirements for World-Locked Rendering in AR and VRSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618134(1-10)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618134
Kuo GPenner EMoczydlowski SChing ALanman DMatsuda N(2023)Perspective-Correct VR Passthrough Without ReprojectionACM SIGGRAPH 2023 Conference Proceedings10.1145/3588432.3591534(1-9)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1145/3588432.3591534
Show More Cited By

Virtual Eyes Can Rearrange Your Body: Adaptation to Visual Displacement in See-Through, Head-Mounted Displays
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

The presence of an avatar can reduce cybersickness in Virtual Reality
Abstract
Virtual Reality (VR) applications are increasingly being utilized for research, healthcare, and education. Despite their benefits, many VR users report motion sickness-like sensations (cybersickness), such as headache, disorientation, or nausea. ...
Extending the human body in virtual reality: effect of sensory feedback on agency and ownership of virtual wings
VRIC '16: Proceedings of the 2016 Virtual Reality International Conference

Understanding how users can extend their bodies to control avatars can help to make the avatar control and interaction more intuitive and engaging. This paper investigates how multisensory stimuli in a virtual reality environment can contribute to the ...
Can Haptic Feedback on One Virtual Object Increase the Presence of Another Virtual Object?
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

This paper investigated whether increased presence from experiencing haptic feedback on one virtual object can transfer to another virtual object. Two similar studies were run in different environments: an immersive virtual environment and a mixed ...

Comments

Information & Contributors

Information

Published In

cover image Presence: Teleoperators and Virtual Environments

Presence: Teleoperators and Virtual Environments Volume 7, Issue 3

June 1998

102 pages

ISSN:1054-7460

Issue’s Table of Contents

Publisher

MIT Press

Cambridge, MA, United States

Publication History

Published: 01 June 1998

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wähnert SSchäfer U(2024)Sensorimotor adaptation in virtual reality: Do instructions and body representation influence aftereffects?Virtual Reality10.1007/s10055-024-00957-628:1Online publication date: 22-Feb-2024
https://dl.acm.org/doi/10.1007/s10055-024-00957-6
Guan PPenner EHegland JLetham BLanman D(2023)Perceptual Requirements for World-Locked Rendering in AR and VRSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618134(1-10)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618134
Kuo GPenner EMoczydlowski SChing ALanman DMatsuda N(2023)Perspective-Correct VR Passthrough Without ReprojectionACM SIGGRAPH 2023 Conference Proceedings10.1145/3588432.3591534(1-9)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1145/3588432.3591534
Abtahi PHough SLanday JFollmer S(2022)Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517706(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517706
Abtahi P(2021)From Illusions to Beyond-Real Interactions in Virtual RealityAdjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3474349.3477586(153-157)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3474349.3477586
Smart PClowes RHeersmink R(2017)Minds OnlineFoundations and Trends in Web Science10.1561/18000000266:1-2(1-232)Online publication date: 20-Sep-2017
https://dl.acm.org/doi/10.1561/1800000026
Kim SLee JPark JDunne LMartin TBeigl M(2014)The effects of visual displacement on simulator sickness in video see-through head-mounted displaysProceedings of the 2014 ACM International Symposium on Wearable Computers10.1145/2634317.2634339(79-82)Online publication date: 13-Sep-2014
https://dl.acm.org/doi/10.1145/2634317.2634339
Biocca F(2014)Connected to My AvatarProceedings of the 6th International Conference on Social Computing and Social Media - Volume 853110.1007/978-3-319-07632-4_40(421-429)Online publication date: 22-Jun-2014
https://dl.acm.org/doi/10.1007/978-3-319-07632-4_40
Dragan ASrinivasa SLee K(2013)Teleoperation with intelligent and customizable interfacesJournal of Human-Robot Interaction10.5898/JHRI.2.2.Dragan2:2(33-57)Online publication date: 18-Jun-2013
https://dl.acm.org/doi/10.5898/JHRI.2.2.Dragan
Lin QRieser JBodenheimer BHoyet LSanders BGeigel JStefanucci J(2013)Stepping off a ledge in an HMD-based immersive virtual environmentProceedings of the ACM Symposium on Applied Perception10.1145/2492494.2492511(107-110)Online publication date: 22-Aug-2013
https://dl.acm.org/doi/10.1145/2492494.2492511
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents