article

Sharing and analyzing data from presence experiments

Authors:

Doron Friedman,

Christoph Guger,

Mel SlaterAuthors Info & Claims

Presence: Teleoperators and Virtual Environments, Volume 15, Issue 5

Pages 599 - 610

https://doi.org/10.1162/pres.15.5.599

Published: 01 October 2006 Publication History

Abstract

Presence research relies heavily on empirical experiments involving subjects in mediated environments. Since presence is a complex, multidimensional concept, experiments on presence can be extremely resource intensive and produce large amounts of data of different types. As the presence community matures, we would like to suggest that data collected in experiments be made publicly available to the community. This will allow the verification of experimental results, comparison of results of experiments carried out in different laboratories, and evaluation of new data-analysis methods. This will, eventually, lead to consistency in approaches and increased confidence in results. In this paper we present the complete dataset from a large-scale experiment that we have carried out in highly immersive virtual reality. We describe the data we have gathered and give examples of the types of analysis that can be made based on that data.

References

[1]

Bierbaum, A., Just, C., Hartling, P., Meinert, K., Baker, A., & Cruz-Neira, C. (2001). VR Juggler: A virtual platform for virtual reality application development. Proceedings IEEE Virtual Reality 2001, 89-96.

[2]

Biocca, F., Burgoon, J., Harms, C., & Stoner, M. (2001). Criteria and scope conditions for a theory and measure of social presence. Proceedings of the Fourth Annual International Workshop: Presence 2001.

[3]

Billinghurst, M., & Weghorst, S. (1995). The use of sketch maps to measure cognitive maps of virtual environments. Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95), 40-47.

[4]

Bowman, D. A., Johnson, D. B., & Hodges, L. F. (1999). Testbed evaluation of virtual environment interaction techniques. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, 26-33.

[5]

Cruz-Neira, C., Sandin, D. J., & DeFanti, T. (1993). Surround-screen projection-based virtual reality: The design and implementation of the CAVE. Proceedings of Computer Graphics (SIGGRAPH) Proceedings, Annual Conference Series, 135-142.

[6]

Florian, G., Stancak, A., & Pfurtscheller, G. (1998). Cardiac response induced by voluntary self-paced finger movement. International Journal of Psychophysiology, 28(3), 273-283.

[7]

Foster, I., & Kesselman, C. (2003). The Grid 2: Blueprint for a new computing infrastructure. San Mateo, CA: Morgan Kaufmann.

[8]

Frecon, E., Smith, E., Steed, A., Stenius, M., & Stahl, O. (2001). An overview of the COVEN platform. Presence: Teleoperators and Virtual Environments, 10, 109-127.

Digital Library

[9]

Freeman, J., Avons, S. E, Pearson, D., & IJsselsteijn, W. A. (1999). Effects of sensory information and prior experience on direct subjective ratings of presence. Presence: Teleoperators and Virtual Environments, 8, 1-13.

Digital Library

[10]

Freeman, J., Avons, S. E., Meddis, R., Pearson, D. E., & IJsselsteijn, W. (2000). Using behavioral realism to estimate presence: A study of the utility of postural responses to motion stimuli. Presence: Teleoperators and Virtual Environments, 9(2), 149-164.

Digital Library

[11]

Friedman, D., Feldman, Y., Shamir, A., & Dagan, T. (2004). Automated creation of movie summaries in interactive virtual environments. Proceedings of IEEE Virtual Reality 2004, 191-198.

[12]

Friedman, D., Leeb, R., Antley, A., Garau, M., Guger, C., Keinrath, C., et al. (2006). Navigating virtual reality by thought: First steps. Presence: Teleoperators and Virtual Environments , in press.

[13]

Garau, M. (2003). The impact of avatar fidelity on social interaction in virtual environments. Unpublished doctoral dissertation, University College London.

[14]

Garau, M., Ritter-Widenfeld, H., Antley, A., Friedman, D., Brogni, A., & Slater, M. (2004). Temporal and spatial variations in presence: A qualitative analysis. Proceedings of the 7th Annual International Workshop on Presence PRESENCE 2004, 232-239.

[15]

Greenhalgh, C., Flintham, M., Purbrick, J., & Benford, S. (2001). Applications of temporal links: Recording and replaying virtual environments. Proceedings of IEEE VR 2002 (Virtual Reality), 1-8.

[16]

Hart, J. C. (1993). On recording virtual environments. Proceedings of IEEE Visualization'93 Symposium on Research Frontiers in Virtual Reality, 80-83.

[17]

Hoffman, H. G., Richards, T., Coda, B., Richards, A., & Sharar, S. R. (2003). The illusion of presence in immersive virtual reality during an fMRI brain scan. CyberPsychology and Behavior, 6(3), 127-131.

[18]

IJsselsteijn, W., Freeman, J., & de Ridder, H. (2001). Presence: Where are we? CyberPsychology and Behavior, 4(2), 179-182.

[19]

Imai, T., Johnson, A., Leigh, J., Pape, D., & DeFanti, T. (1999). Supporting transoceanic collaborations in a virtual environment. Proceedings of the 5th Asia-Pacific Conference on Communications 4th Optoelectronics and Communications Conference, APCC/OECC'99, 1059-1062.

[20]

Kennedy, R. S., Lane, N. E., Berbaum, K. S., Lilienthal, M. G. (1993). Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. International Journal of Aviation Psychology, 3(3), 203-220.

[21]

Lessiter, J., Freeman, J., Keogh, E., & Davidoff, J. (2001). A cross-media presence questionnaire: The ITC-sense of presence inventory. Presence: Teleoperators and Virtual Environments, 10, 282-297.

[22]

MacKenzie, I. S., & Buxton, W. A. S. (1992). Extending Fitts' law to two-dimensional tasks. Proceedings of ACM CHI 1992 Conference on Human Factors in Computing Systems , 219-226.

[23]

Mania, K., Troscianko, T., Hawkes, R., & Chalmers, A. (2003). Fidelity metrics for virtual environment simulations based on spatial memory awareness states. Presence: Teleoperators and Virtual Environments, 12(3), 296-310.

Digital Library

[24]

Meehan, M., Insko, B., Whitton, M., & Brooks, F. P. (2002). Physiological measures of presence in stressful virtual environments. ACM Transactions on Graphics, 21, 645-652.

Digital Library

[25]

Newman, J., Wagner, M., Bauer, M., MacWilliams, A., Pintaric, T., Beyer, D., et al. (2004). Ubiquitous tracking for augmented reality. International Symposium on Mixed and Augmented Reality (ISMAR), 192-201.

[26]

Poupyrev, I., Weghorst, S., Billinghurst, M., & Ichikawa, T. (1997). A framework and testbed for studying manipulation techniques for immersive VR. Proceedings of the ACM Symposium on Virtual Reality Software and Technology , 21-28.

[27]

Schubert, T., Friedmann, F., & Regenbrecht, H. (2001). The experience of presence: Factor analytic insights. Presence: Teleoperators and Virtual Environments, 10, 266-281.

Digital Library

[28]

Sheridan, T. B. (1992). Musings on telepresence and virtual presence. Presence: Teleoperators and Virtual Environments, 1, 120-125.

[29]

Slater, M. (1999). Measuring presence: A response to the Witmer and Singer presence questionnaire. Presence: Teleoperators and Virtual Environments, 8, 560-565.

Digital Library

[30]

Slater, M., & Steed, A. (2000). A virtual presence counter. Presence: Teleoperators and Virtual Environments, 9, 413-434.

Digital Library

[31]

Slater, M. (2004). How colorful was your day? Why questionnaires cannot assess presence in virtual environments. Presence: Teleoperators and Virtual Environments, 13, 484-493.

Digital Library

[32]

Slater, M., Guger, C., Edlinger, G., Leeb, R., Pfurtscheller, G., Antley, A., et al. (2006). Analysis of physiological responses to a social situation in an immersive virtual environment. Presence: Teleoperators and Virtual Environments, 15(5), 553-569.

Digital Library

[33]

van Someren, M. W., Barnard Y. F., & Sandberg, J. A. C. (1994). The think aloud method. London: Academic Press.

[34]

Steed, A., Mortensen, J., & Frecon, E. (2001). Spelunking: Experiences using the Dive system on Cave-like platforms. Immersive Projection Technologies and Virtual Environments , 153-164.

[35]

Steed, A., & Parker, C. (2005). Evaluating effectiveness of interaction techniques across immersive virtual environment systems. Presence: Teleoperators and Virtual Environments, 14(5), 511-527.

Digital Library

[36]

Steed, A., Vinayagamoorthy, V., & Brogni, A. (2005). Using breaks in presence to identify usability issues. Proceedings of the 11th International Conference on Human Computer Interaction , 22-27.

[37]

Thomsen, M. (2004). Discovering mixed reality: Inventing design criteria for an action-based mixed reality. Unpublished doctoral dissertation, University College London.

[38]

Usoh, M., Catena, E., Arman, S., & Slater, M. (2000). Using presence questionnaires in reality. Presence: Teleoperators and Virtual Environments, 9, 497-503.

Digital Library

[39]

Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33, 448-459.

[40]

Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7, 225-240.

Digital Library

Cited By

Rey BAlcañiz MTembl JParkhutik V(2018)Brain activity and presenceVirtual Reality10.5555/3227214.322735314:1(55-65)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.5555/3227214.3227353
Steptoe WSteed A(2018)Multimodal data capture and analysis of interaction in lmmersive collaborative virtual environmentsPresence: Teleoperators and Virtual Environments10.1162/PRES_a_0012321:4(388-405)Online publication date: 29-Dec-2018
https://dl.acm.org/doi/10.1162/PRES_a_00123
Steinicke FBruder GHinrichs KSteed ADavidson DFullerton TSchrier K(2009)Presence-enhancing real walking user interface for first-person video gamesProceedings of the 2009 ACM SIGGRAPH Symposium on Video Games10.1145/1581073.1581091(111-118)Online publication date: 4-Aug-2009
https://dl.acm.org/doi/10.1145/1581073.1581091

Index Terms

Sharing and analyzing data from presence experiments

Recommendations

Packing experiments for sharing and publication
SIGMOD '13: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data

Reproducibility is a core component of the scientific process. Revisiting and reusing past results allow science to move forward - "standing on the shoulders of giants", as Newton once said. An impediment to the adoption of computational reproducibility ...
Analyzing software engineering experiments: everything you always wanted to know but were afraid to ask
ICSE '18: Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings

Experimentation is a key issue in science and engineering. But it is one of software engineering's stumbling blocks. Quite a lot of experiments are run nowadays, but it is a risky business. Software engineering has some special features, leading to some ...
Analyzing software engineering experiments: everything you always wanted to know but were afraid to ask
ICSE-C '17: Proceedings of the 39th International Conference on Software Engineering Companion

Experimentation is a key issue in science and engineering. But it is one of software engineering's stumbling blocks. Quite a lot of experiments are run nowadays, but it is a risky business. Software engineering has some special features, leading to some ...

Comments

Information & Contributors

Information

Published In

cover image Presence: Teleoperators and Virtual Environments

Presence: Teleoperators and Virtual Environments Volume 15, Issue 5

Special issue: 8th annual international workshop on presence II

October 2006

126 pages

ISSN:1054-7460

Issue’s Table of Contents

Publisher

MIT Press

Cambridge, MA, United States

Publication History

Published: 01 October 2006

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rey BAlcañiz MTembl JParkhutik V(2018)Brain activity and presenceVirtual Reality10.5555/3227214.322735314:1(55-65)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.5555/3227214.3227353
Steptoe WSteed A(2018)Multimodal data capture and analysis of interaction in lmmersive collaborative virtual environmentsPresence: Teleoperators and Virtual Environments10.1162/PRES_a_0012321:4(388-405)Online publication date: 29-Dec-2018
https://dl.acm.org/doi/10.1162/PRES_a_00123
Steinicke FBruder GHinrichs KSteed ADavidson DFullerton TSchrier K(2009)Presence-enhancing real walking user interface for first-person video gamesProceedings of the 2009 ACM SIGGRAPH Symposium on Video Games10.1145/1581073.1581091(111-118)Online publication date: 4-Aug-2009
https://dl.acm.org/doi/10.1145/1581073.1581091

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents