Article

Me, Myself, and the (Virtual) World: A Review of Learning Research in 4E Cognition and Immersive Virtual Reality

Authors:

Gregory McGowin,

Stephen M. Fiore,

Kevin OdenAuthors Info & Claims

Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry: 14th International Conference, VAMR 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Virtual Event, June 26 – July 1, 2022, Proceedings, Part II

Pages 59 - 73

https://doi.org/10.1007/978-3-031-06015-1_5

Published: 26 June 2022 Publication History

Abstract

This paper examines how the principles of 4E cognition can be used to interpret, and potentially improve, immersive virtual reality (I-VR). A selection of relevant 4E + I-VR studies are reviewed to illustrate this relationship. Towards this end, this paper provides: 1) an overview of Immersive Virtual reality (I-VR), 2) a summary of 4E cognition (embodied, enacted, embedded, extended), and 3) a discussion relevant literature in 4E cognition applied to learning in I-VR. The paper concludes with a series of recommendations that may offer possible routes of research that could expand this important area of inquiry.

References

[1]

Aagaard J 4E cognition and the dogma of harmony Philos. Psychol. 2021 34 2 165-181

[2]

Andreasen, N.K., Baceviciute, S., Pande, P., Makransky, G.: Virtual reality instruction followed by enactment can increase procedural knowledge in a science lesson. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 840–841. IEEE (2019)

[3]

Bailenson, J. (2018). Experience On Demand: What Virtual Reality Is, How It Works, and What It Can Do. WW Norton and Company

[4]

Briggs JC The promise of virtual reality Futurist 1996 30 5 13-18

[5]

Bowman DA and McMahan RP Virtual reality: how much immersion is enough? Computer 2007 40 7 36-43

[6]

Castro-Alonso JC and Fiorella L Castro-Alonso JC Interactive science multimedia and visuospatial processing Visuospatial processing for education in health and natural sciences 2019 Cham Springer 145-173

[7]

Christ, O., Sambasivam, M., Roos, A., Zahn, C.: Learning in immersive virtual reality: how does the 4E cognition approach fit in virtual didactic settings? In: Ahram, T., Taiar, R. (eds.) IHIET 2021. LNNS, vol. 319, pp. 790–796. Springer, Cham (2021).

[8]

Clark, A.: Supersizing the Mind: Embodiment, Action, and Cognitive Extension. OUP USA (2008)

[9]

Clark, A., Chalmers, D.: The extended mind. Analysis 58(1), 7–19 (1998).

[10]

Chittaro L and Buttussi F Exploring the use of arcade game elements for attitude change: two studies in the aviation safety domain Int. J. Hum. Comput. Stud. 2019 127 112-123

[11]

Carney J Thinking avant la lettre: a review of 4E cognition Evolu. Stud. Imagin. Cult. 2020 4 1 77-90

[12]

Della Gatta F, Garbarini F, Puglisi G, Leonetti A, Berti A, and Borroni P Decreased motor cortex excitability mirrors own hand disembodiment during the rubber hand illusion Elife 2016 5

[13]

Gonzalez-Grandón, X., Froese, T.: Grounding 4E cognition in Mexico: introduction to special issue on spotlight on 4E cognition research in Mexico (2018)

[14]

Hamilton D, McKechnie J, Edgerton E, and Wilson C Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design J. Comput. Educ. 2020 8 1 1-32

[15]

Hilfert T and König M Low-cost virtual reality environment for engineering and construction Visual. Eng. 2016 4 1 1-18

[16]

Hutchins E Cognition in the Wild 1995 Cambridge, Mass MIT Press

[17]

Johnson-Glenberg MC Immersive VR and education: embodied design principles that include gesture and hand controls Front. Robot. AI 2018 5 81

[18]

Kaplan AD, Cruit J, Endsley M, Beers SM, Sawyer BD, and Hancock PA The effects of virtual reality, augmented reality, and mixed reality as training enhancement methods: a meta-analysis Hum. Factors 2021 63 4 706-726

[19]

König, S.U., Keshava, A., Clay, V., Ritterhofer, K., Kuske, N., König, P.: Embodied Spatial Knowledge Acquisition in Immersive Virtual Reality: Comparison to Map Exploration. bioRxiv (2020)

[20]

Kontra C, Lyons DJ, Fischer SM, and Beilock SL Physical experience enhances science learning Psychol. Sci. 2015 26 6 737-749

[21]

Shumaker R Virtual Reality 2007 Heidelberg Springer

[22]

LaValle, S.: Virtual Reality (2019). Retrieved from http://vr.cs.uiuc.edu/

[23]

Lindgren R, Tscholl M, Wang S, and Johnson E Enhancing learning and engagement through embodied interaction within a mixed reality simulation Comput. Educ. 2016 95 174-187

[24]

Loomis JM, Blascovich JJ, and Beall AC Immersive virtual environment technology as a basic research tool in psychology Behav. Res. Methods Instrum. Comput. 1999 31 4 557-564

[25]

Makransky G and Lilleholt L A structural equation modeling investigation of the emotional value of immersive virtual reality in education Educ. Tech. Res. Dev. 2018 66 5 1141-1164

[26]

Makransky G and Petersen GB The cognitive affective model of immersive learning (CAMIL): a theoretical research-based model of learning in immersive virtual reality Educ. Psychol. Rev. 2021 33 3 937-958

[27]

Meyer, O.A., Omdahl, M.K., Makransky, G.: Investigating the effect of pre-training when learning through immersive virtual reality and video: a media and methods experiment. Comput. Educ. 140, 103603 (2019)

[28]

McGowin, G., Fiore, S.M., Oden, K.: Learning affordances: theoretical considerations for design of immersive virtual reality in training and education. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 65, no. 1, pp. 883–887. SAGE Publications, Los Angeles, CA (2021)

[29]

Menary, R.: Embodied narratives. J. Consciou. Stud. 15(6) (2008)

[30]

Mestre, D., Fuchs, P., Berthoz, A., Vercher, J.L.: Immersion et présence. Le traité de la réalité virtuelle. Paris: Ecole des Mines de Paris, pp. 309–38 (2006)

[31]

Newen, A., De Bruin, L., Gallagher, S.: 4E cognition: Historical roots, key concepts, and central issues. The Oxford Handbook of 4E Cognition, pp. 2–16 (2018)

[32]

Newton, O.B., Fiore, S.M., LaViola Jr, J.J.: An external cognition framework for visualizing uncertainty in support of situation awareness. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 61, no. 1, pp. 1198–1202. SAGE Publications, Los Angeles, CA (2017)

[33]

Pan Z, Cheok AD, Yang H, Zhu J, and Shi J Virtual reality and mixed reality for virtual learning environments Comput. Graph. 2006 30 1 20-28

[34]

Pillai, A.: Virtual reality based study to analyse pedestrian attitude towards autonomous vehicles (2017)

[35]

Pouw WT, Van Gog T, and Paas F An embedded and embodied cognition review of instructional manipulatives Educ. Psychol. Rev. 2014 26 1 51-72

[36]

Radianti J, Majchrzak TA, Fromm J, and Wohlgenannt I A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda Comput. Educ. 2020 147

[37]

Robbins, P., Aydede, M.: A short primer on situated cognition (2009)

[38]

Rowlands, M.J.: The New Science of the Mind: From Extended Mind to Embodied Phenomenology. MIT Press (2010)

[39]

Schiavio A and Van der Schyff D 4E music pedagogy and the principles of self-organization Behav. Sci. 2018 8 8 72

[40]

Schneegans, S., Schöner, G.: Dynamic field theory as a framework for understanding embodied cognition. Handbook of Cognitive Science, pp. 241–271 (2008)

[41]

Slater M Measuring presence: a response to the Witmer and Singer presence questionnaire Presence 1999 8 5 560-565

[42]

Slater M and Sanchez-Vives MV Enhancing our lives with immersive virtual reality Front. Robot. AI 2016 3 74

[43]

Slater, M., Wilbur, S.: A framework for immersive VEs (FIVE): speculations on the role of presence in VEs. Pres. Teleoper. VEs 6(6), 603–616 (1997)

[44]

Slater M Liu D, Dede C, Huang R, and Richards J Implicit learning through embodiment in immersive virtual reality Virtual, augmented, and mixed realities in education 2017 Singapore Springer 19-33

[45]

Smart P Extended cognition and the internet Philosop. Technol. 2017 30 3 357-390

[46]

Thompson, M., et al.: Immersion positively affects learning in virtual reality games compared to equally interactive 2d games. Inf. Learn. Sci. 122, 442–463 (2021).

[47]

Varela, F.J., Thompson, E., Rosch, E.: The Embodied Mind: Cognitive Science and Human Experience. MIT Press (1993)

[48]

Wang, A., Thompson, M., Uz-Bilgin, C., Klopfer, E.: Authenticity, interactivity, and collaboration in virtual reality games: best practices and lessons learned. Front. Virtual Real. 130 (2021)

[49]

Waterworth, J.A., Waterworth, E.L.: The meaning of presence (2003)

Cited By

Chatain JKapur MSumner R(2023)Three Perspectives on Embodied Learning in Virtual Reality: Opportunities for Interaction DesignExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585805(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585805

Index Terms

Me, Myself, and the (Virtual) World: A Review of Learning Research in 4E Cognition and Immersive Virtual Reality

Index terms have been assigned to the content through auto-classification.

Recommendations

Entangled cognition in immersive learning experience

Immersive learning environments in education provide a set of rich and diverse learning affordances (possibilities). Cognition in such environments can be considered as embodied, enacted, embedded, and extended (the 4Es of cognition). During such ...
Optimising the learning process with immersive virtual reality and non-immersive virtual reality in an educational environment

Teachers in higher education have a growing interest in embedding virtual reality in learning and teaching. This means that students can have a virtual exploration or a simulated experience in a range of situations. They can have an immersive virtual ...
Indoor skydiving in immersive virtual reality with embedded storytelling
VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology

We describe the Virtual Jump Simulator, which allows subjects to perform an indoor parachute jump in a virtual environment. The necessity to jump physically off a platform combined with immersive virtual reality and tactile feedback creates an ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry: 14th International Conference, VAMR 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Virtual Event, June 26 – July 1, 2022, Proceedings, Part II

Jun 2022

400 pages

ISBN:978-3-031-06014-4

DOI:10.1007/978-3-031-06015-1

Editors:
Jessie Y. C. Chen
U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA
,
Gino Fragomeni
U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

© Springer Nature Switzerland AG 2022.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 26 June 2022

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chatain JKapur MSumner R(2023)Three Perspectives on Embodied Learning in Virtual Reality: Opportunities for Interaction DesignExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585805(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585805

View Options

View options

Figures

Tables

Media

View Table of Conten