research-article

Levels of realism: from virtual reality to real virtuality

Authors:

Andrej FerkoAuthors Info & Claims

SCCG '08: Proceedings of the 24th Spring Conference on Computer Graphics

Pages 19 - 25

https://doi.org/10.1145/1921264.1921272

Published: 21 April 2008 Publication History

Abstract

Realism in real-time has long been a "holy grail" of the computer graphics community. While real-time performance is typically accepted as 25fps and above, the definition of realism remains less clear. If we were able to simulate the physics of the real world to minute detail then it would be possible for us to achieve images which were physically correct. However, the amount of computation required for such physical accuracy of complex scenes precludes any possibility of achieving such images in reasonable, let alone real-time, on a desktop computer for many years to come. Furthermore, there is no guarantee of realism as these images do not take into account how the human may perceive this information. Our perception of an environment is not only what we see, but may be significantly influenced by other sensory input, including sound, smell, touch, and even taste. If virtual environments are ever to be regularly used as a valuable tool to experiment in the virtual world with confidence that the results are the same as would be experienced in the real world, then we need to be able to compute these environments to be perceptually equivalent as if we were "there" in the real world; so called "there-reality" or real virtuality. This paper surveys promising efforts to date and identifies and discusses future research directions.

References

[1]

Autodesk. 2006. Fake or foto. http://www.autodesk.com/eng/etc/fake_or_foto/index.html.

[2]

Bandler, R., and Grinder, J. 1975. The Structure of Magic I: A Book About Language and Therapy. Science & Behavior Books.

[3]

Bandler, R., and Grinder, J. 1979. Frogs into Princes: Neuro Linguistic Programming. Real People Press.

[4]

Calvert, G., and Thesen, T. 2004. Multisensory integration: Methodological approaches and emerging principles in the human brain. Journal of Physiology 98, 191--205.

[5]

Cater, K., Chalmers, A., and Ward, G. 2003. Exploiting visual tasks for selective rendering. In Eurographics Symposium on Rendering, Eurographics, 270--280.

Digital Library

[6]

Chalmers, A., Green, C., and Hall, M. 2000. Firelight: Graphics and archaeology. SIGGRAPH Electronic Theatre.

[7]

Chalmers, A., McNamara, A., Daly, S., Myszkowski, K., and T., T. 2000. Image Quality Metrics. SIGGRAPH 2000 Course 44.

[8]

Chalmers, A., Debattista, K., and dos Santos, L. 2006. Selective rendering: Computing only what you see. In Graphite 2006, ACM SIGGRAPH, 9--18.

Digital Library

[9]

Chalmers, A., Debattista, K., Mastoropoulou, G., and dos Santos, L. 2007. There-Reality: Selective Rendering in High Fidelity Virtual Environments. The International Journal of Virtual Reality 6, 1, 1--10.

[10]

Daly, S. 1993. The visible differences predictor: an algorithm for the assessment of image fidelity. Digital images and human vision, 179--206.

Digital Library

[11]

Debevec, P., Taylor, C., and Malik, J. 1996. Modeling and rendering architecture from photographs. In SIGGRAPH 96, ACM Press, 11--20.

Digital Library

[12]

Debevec, P. 1996. Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In SIGGRAPH 98, ACM Press, 189--198.

Digital Library

[13]

Debevec, P. 2006. Virtual cinematography: Relighting through computation. Computer 39, 8, 57--65.

Digital Library

[14]

Ellis, G., and Chalmers, A. 2006. The Effect of Translational Ego-Motion on the Perception of High Fidelity Animations. SCCG 2006.

[15]

Faraday, P. 1999. Visually Critiquing Web Pages. In Eurographics Workshop on Multimedia, Eurographics, 155--166.

[16]

Ferwerda, J. 2003. Three varieties of realism in computer graphics. Proceedings SPIE Human Vision and Electronic Imaging, 290--297.

[17]

Gilchrist, A., Delman, S., and Jacobsen, A. 1983. The classification and integration of edges as critical to the perception of reflectance and illumination. Perception and Psychophysics 33, 425--436.

[18]

Gortler, S., Grzeszczuk, R., Szeliski, R., and Cohen, M. 1996. The lumigraph. In SIGGRAPH 96, ACM Press, 43--54.

Digital Library

[19]

Gygax, G., and Arneson, D. 1974. Dungeons & dragons. Tactical Studies Rules, Inc. (TSR).

[20]

James, W. 1890. The Principles of Psychology: Volume 1. Holt, New York.

[21]

Lengyel, J. 1998. The Convergence of Graphics and Vision. IEEE Computer 31, 7, 46--53.

Digital Library

[22]

Longhurst, P., Ledda, P., and Chalmers, A. 2003. Psychophysically based artistic techniques for increased perceived realism of virtual environments. In AFRIGRAPH 2003, ACM SIGGRAPH, 123--131.

Digital Library

[23]

Mack, A., and Rock, I. 1998. Inattentional Blindness. Massachusetts Institute of Technology Press.

[24]

Mania, K., Troscianko, T., Hawkes, R., and Chalmers, A. 2003. Fidelity Metrics for Virtual Environment Simulations based on Spatial Memory Awareness States. Presence, Teleoperators and Virtual Environments, 296--310.

Digital Library

[25]

Mantiuk, R., Daly, S., Myszkowski, K., and Seidel, H.-P. 2005. Predicting Visible Differences in High Dynamic Range Images - Model and its Calibration. Human Vision and Electronic Imaging X, IS&T/SPIE's 17th Annual Symposium on Electronic Imaging, 204--214.

[26]

Marsland, S., Nehmzow, U., and Shapiro, J. 2000. Novelty detection on a mobile robot using habituation. From Animals to Animats: The 6th International Conference on Simulation of Adaptive Behaviour.

[27]

Mastoropoulou, G., and Chalmers, A. 2003. The effect of music on the perception of display rate and duration of animated sequences: an experimental study. In TPCG'04: Theory and Practice of Computer Graphics 2004, IEEE Press, 128--134.

Digital Library

[28]

Mastoropoulou, G., Debattista, K., Chalmers, A., and Troscianko, T. 2005. Auditory bias of visual attention for perceptuallyg uided selective rendering of animations. Graphite 2005, 363--369.

Digital Library

[29]

McGurk, H., and MacDonald, J. 1976. Hearing lips and seeing voices. Nature 264, 746--748.

[30]

McNamara, A. 2006. Exploring visual and automatic measures of perceptual fidelity in real and simulated imagery. ACM TAP 3, 3, 217--238.

Digital Library

[31]

Meyer, G., Rushmeier, H., Cohen, M., Greenberg, D., and Torrance, K. 1986. An Experimental Evaluation of Computer Graphics Imagery. ACM Transactions on Graphics 5, 1, 30--50.

Digital Library

[32]

Mori, M. 1970. Bukimi no tani the uncanny valley. Energy, 33.

[33]

Müller, G., Meseth, J., Sattler, M., Sarlette, R., and R., K. 2005. Acquisition, Synthesis, and Rendering of Bidirectional Texture Functions. Computer Graphics Forum 24, 1, 83.

[34]

Myszkowski, K. 1998. The visible differences predictor: Applications to global illumination problems. Proceedings of Eurographics Rendering Workshop 98 5, 1, 233--236.

[35]

NLP-Center. http://www.nlp-center.net/articles/nlp-controversy.html.

[36]

Nunez, D., and Blake, E. H. 2003. Conceptual priming as a determinant of presence in virtual environments. In Afrigraph 2003, ACM SIGGRAPH, 101--108.

Digital Library

[37]

Qvortrup, L. 2001. Virtual Interaction: Interaction in Virtual Inhabited 3D Worlds. Springer, London.

Digital Library

[38]

Rademacher, P., Lengyel, J., Cutrell, E., and Whitted, T. 2001. Measuring the Perception of Visual Realism in Images. In Eurographics Symposium on Rendering, Eurographics, 235--248.

Digital Library

[39]

Ramanarayanan, G., Ferwerda, J., Walter, B., and Bala, K. 2007. Visual Equivalence: towards a new standard for image fidelity. In SIGGRAPH '07, ACM Press.

Digital Library

[40]

Ramic, B., Chalmers, A., Hasic, J., and Rizvic, S. 2007. Selective Rendering in a Multimodal Environment: Scent and Graphics. SCCG 2007: Spring Conference on Computer Graphics, 189--192.

[41]

Rimell, S., Howard, D., Tyrrell, A., Kirk, P., and Hunt, A. 2002. Cymatic: restoring the physical manifestation of digital sound using haptic interfaces to control a new computer based musical instrument. In ICMC02: International Computer Music Conference.

[42]

Rothbaum, B., Hodges, L., Alarcon, R., Ready, D., Shahar, F., Graap, K., Pair, J., Hebert, P., Gotz, D., Wills, B., and Baltzell, D. 1999. Virtual Reality Exposure Therapy for PTSD Vietnam Veterans: A Case Study. Journal of Traumatic Stress 12, 263--271.

[43]

Rushmeier, H., Ward, G., Piatko, Sanders, P., and Rust, B. 1995. Comparing real and synthetic images: Some ideas about metrics. In Eurographics Rendering Workshop 1995, Springer Wien.

[44]

Schubert, T., and Crusius, J. 2002. Five Theses on the Book Problem: Presence in Books, Film and VR. 5th Annual International Workshop on Presence.

[45]

Slater, M., Usoh, M., and Steed, A. 1994. Depth of Presence in Virtual Environments. Presence: Teleoperators and Virtual Environments 3, 130--144.

Digital Library

[46]

Storms, R. 1998. Auditory-Visual Cross-Modal Perception Phenomena. PhD thesis, Naval Postgraduate School, Monterey, California.

[47]

Ulbricht, C., Wilkie, A., and Purgathofer, W. 2005. Verification of Physically Based Rendering Algorithms. State of the Art Reports, Eurographics '05, 95--112.

[48]

Wachowski, L., and Wachowski, A., 1999. The matrix. http://en.wikipedia.org/wiki/The_matrix.

[49]

Winkler, S., and Faller, C. 2005. Audiovisual quality evaluation of low-bitrate video. In SPIE/IS&T Human Vision and Electronic Imaging, SPIE, vol. 5666, 139--148.

[50]

Witmer, B., and Singer, M. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence: Tele-operators and Virtual Environments 7, 3, 225--240.

Digital Library

Cited By

You CChen YChan LHu MSun WPan TPan HZhang YKostakos VKay JHoang T(2024)The Fourth Workshop on Multiple Input Modalities and Sensations for VR/AR Interactions (MIMSVAI)Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677570(988-991)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677570
Christophers LMulvaney PRooney B(2024)The Felt Realism of “Unreal” Environments: Testing a Dual Awareness Model of Subjective RealismInternational Journal of Human–Computer Interaction10.1080/10447318.2023.229161540:24(8890-8908)Online publication date: 2-Jan-2024
https://doi.org/10.1080/10447318.2023.2291615
Lin CHsu Y(2023)The new ethical thinking in CGI immersive journalismConvergence: The International Journal of Research into New Media Technologies10.1177/1354856523117617729:4(1033-1053)Online publication date: 5-Jul-2023
https://doi.org/10.1177/13548565231176177
Show More Cited By

Index Terms

Levels of realism: from virtual reality to real virtuality
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

The effect of avatar realism in immersive social virtual realities
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology

This paper investigates the effect of avatar realism on embodiment and social interactions in Virtual Reality (VR). We compared abstract avatar representations based on a wooden mannequin with high fidelity avatars generated from photogrammetry 3D scan ...
Real virtuality: a step change from virtual reality
SCCG '09: Proceedings of the 25th Spring Conference on Computer Graphics

Humans perceive the world with all five senses: visuals, audio, smell, touch and taste. Crossmodal effects, i.e. the interaction of the senses, can have a major influence on how environments are being perceived, even to the extent that large amounts of ...
Virtual smell: authentic smell diffusion in virtual environments
AFRIGRAPH '10: Proceedings of the 7th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa

Smell is a key human sense. In the real world, smell plays a leading role in helping us appreciate an environment, for example the smell of fresh coffee, or the dead body. High-fidelity virtual environments are being increasingly used as an accurate ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SCCG '08: Proceedings of the 24th Spring Conference on Computer Graphics

April 2008

196 pages

ISBN:9781605589572

DOI:10.1145/1921264

Conference Chair:
Karol Myszkowski
MPI Informatik, Germany

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Comenius University: Comenius University

In-Cooperation

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SCCG08

Sponsor:

Comenius University

SCCG08: Spring Conference on Computer Graphics

April 21 - 23, 2008

Budmerice, Slovakia

Acceptance Rates

Overall Acceptance Rate 67 of 115 submissions, 58%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
1,037
Total Downloads

Downloads (Last 12 months)129
Downloads (Last 6 weeks)7

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

You CChen YChan LHu MSun WPan TPan HZhang YKostakos VKay JHoang T(2024)The Fourth Workshop on Multiple Input Modalities and Sensations for VR/AR Interactions (MIMSVAI)Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677570(988-991)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677570
Christophers LMulvaney PRooney B(2024)The Felt Realism of “Unreal” Environments: Testing a Dual Awareness Model of Subjective RealismInternational Journal of Human–Computer Interaction10.1080/10447318.2023.229161540:24(8890-8908)Online publication date: 2-Jan-2024
https://doi.org/10.1080/10447318.2023.2291615
Lin CHsu Y(2023)The new ethical thinking in CGI immersive journalismConvergence: The International Journal of Research into New Media Technologies10.1177/1354856523117617729:4(1033-1053)Online publication date: 5-Jul-2023
https://doi.org/10.1177/13548565231176177
Chiossi FTurgut YWelsch RMayer S(2023)Adapting Visual Complexity Based on Electrodermal Activity Improves Working Memory Performance in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36042437:MHCI(1-26)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604243
You CChen YChan LHu MSun WLee Y(2023)The Third Workshop on Multiple Input Modalities and Sensations for VR/AR Interactions (MIMSVAI)Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3605105(769-772)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594739.3605105
Keshava AGottschewsky NBalle SNezami FSchüler TKönig P(2023)Action affordance affects proximal and distal goal‐oriented planningEuropean Journal of Neuroscience10.1111/ejn.1596357:9(1546-1560)Online publication date: 27-Mar-2023
https://doi.org/10.1111/ejn.15963
Amini Gougeh RFalk T(2023)Towards instrumental quality assessment of multisensory immersive experiences using a biosensor-equipped head-mounted displayQuality and User Experience10.1007/s41233-023-00062-78:1Online publication date: 15-Oct-2023
https://doi.org/10.1007/s41233-023-00062-7
Yuan Zhu HLin C(2023)Virtual/Augmented/Mixed Reality Technologies for Enabling MetaverseMetaverse Communication and Computing Networks10.1002/9781394160013.ch6(125-155)Online publication date: 6-Oct-2023
https://doi.org/10.1002/9781394160013.ch6
Zhang YSong Y(2022)The Effects of Sensory Cues on Immersive Experiences for Fostering Technology-Assisted Sustainable Behavior: A Systematic ReviewBehavioral Sciences10.3390/bs1210036112:10(361)Online publication date: 27-Sep-2022
https://doi.org/10.3390/bs12100361
You CChen YTsai HChen C(2022)The Second Workshop on Multiple Input Modalities and Sensations for VR/AR Interactions (MIMSVAI)Adjunct Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable Computers10.1145/3544793.3560372(506-509)Online publication date: 11-Sep-2022
https://dl.acm.org/doi/10.1145/3544793.3560372
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten