research-article

Performing versus observing: : Investigating the effectiveness of group debriefing in a VR-based safety education program

Authors:

Ikseon ChoiAuthors Info & Claims

Volume 175, Issue C

https://doi.org/10.1016/j.compedu.2021.104316

Published: 01 December 2021 Publication History

Abstract

How can students in a large classroom benefit from virtual reality (VR)-based instruction despite limited equipment? Group debriefing based on observed VR experiences provides a potential solution. This study employed a two-by-two factorial design to empirically investigate the feasibility and effectiveness of debriefing and types of VR experiences on enhancing VR learning outcomes. Second and third graders (n = 150) were randomly assigned to one of the four VR learning conditions: (1) performing individually with individual debriefing, (2) performing individually with no debriefing, (3) observing in a group with group debriefing, and (4) observing in a group with no debriefing. Study results reported moderate effect sizes of debriefing on increasing knowledge test as well as performance scores of the VR learners but revealed no significant difference between direct and observed VR learning experiences. The findings reveal that students can benefit from vicarious VR learning experiences if an instructional component of debriefing is provided in educational practice.

Highlights

•

Debriefing in VR-based instruction is effective in promoting knowledge acquisition.

•

Debriefing in VR-based instruction is effective in improving behavioral performance.

•

Direct and observed debriefing VR experiences are equally effective in learning.

References

[1]

M. Alcaiz, E. Bigné, J. Guixeres, Virtual reality in marketing: A framework, review, and research agenda, Frontiers in Psychology 10 (2019).

[2]

A. Bandura, Social learning theory, Prentice Hall, 1977.

[3]

A. Bandura, Social foundations of thought and action: A social cognitive theory, Prentice Hall, 1986.

[4]

V.A. Banks, N.A. Stanton, C. Harvey, What the drivers do and do not tell you: Using verbal protocol analysis to investigate driver behaviour in emergency situations, Ergonomics 57 (3) (2014) 332–342,.

[5]

J. Bennett, C.P. Saunders, A virtual tour of the cell: Impact of virtual reality on student learning and engagement in the STEM classroom, Journal of Microbiology & Biology Education 20 (2) (2019) 1–3,.

[6]

K.K. Bhagat, W.K. Liou, C.Y. Chang, A cost-effective interactive 3d virtual reality system applied to military live firing training, Virtual Reality 20 (2) (2016) 127–140.

[7]

A. Bhargava, J.W. Bertrand, A.K. Gramopadhye, K.C. Madathil, S.V. Babu, Evaluating multiple levels of an interaction fidelity continuum on performance and learning in near-field training simulations, IEEE Transactions on Visualization and Computer Graphics 24 (4) (2018) 1418–1427.

[8]

C.U. Bilgin, Y. Baek, H. Park, How debriefing strategies can improve student motivation and self-efficacy in came-based learning, Journal of Educational Computing Research 53 (2) (2015) 155–182.

[9]

H. Braund, C. DeLuca, Elementary students as active agents in their learning: An empirical study of the connections between assessment practices and student metacognition, Australian Educational Researcher 45 (March) (2018) 65–85.

[10]

P. Broadhead, Developing an understanding of young children's learning through play: The place of observation, interaction and reflection, British Educational Research Journal 32 (2) (2006) 191–207.

[11]

S.A. Bunge, N.M. Dudukovic, M.E. Thomason, C.J. Vaidya, J. Gabrieli, Immature frontal lobe contributions to cognitive control in children: Evidence from fMRI, Neuron 33 (2) (2002) 301–311.

[12]

G.C. Burdea, P. Coiffet, Virtual reality technology, Wiley, 2003.

Digital Library

[13]

U. Çakiroğlua, S. Gökoğlu, Development of fire safety behavioral skills via virtual reality, Computers & Education 133 (2019) 56–68.

[14]

J. Calvert, R. Abadia, Impact of immersing university and high school students in educational linear narratives using virtual reality technology, Computers & Education 159 (2020),.

[15]

Children’s Safety School, Children's safety education certification examinations, 2019, Retrieved December 13, 2020, from http://www.go119.org.

[16]

China Road Traffic Safety : Retrieved December 13, 2020, from http://www.rtsac.org/Sites/MainSite/.

[17]

R.E. Clark, Reconsidering research on learning from media, Review of Educational Research 53 (4) (1983) 445–459.

[18]

J. Cohen, Statistical power analysis for the behavioral sciences, 2nd ed., Erlbaum, 1988.

[19]

A. Collins, J.S. Brown, A. Holum, Cognitive apprenticeship: Making thinking visible, American Educator 15 (4) (1991) 1–18.

[20]

D. Crookall, Serious games, debriefing, and simulation/gaming as a discipline, Simulation & Gaming 41 (6) (2010) 898–920.

[21]

B. Dalgarno, M.J.W. Lee, What are the learning affordances of 3-D virtual environments?, British Journal of Educational Technology 41 (1) (2010) 10–32.

[22]

S. Decker, M. Fey, S. Sideras, S. Caballero, L. Rockstraw, T. Boese, A.E. Franklin, D. Gloe, L. Lioce, C.R. Sando, C. Meakim, J.C. Borum, Standards of best practice: Simulation standard VI: The debriefing process, Clinical Simulation in Nursing 9 (6) (2013) 26–29.

[23]

K.T. Dreifuerst, The essentials of debriefing in simulation learning: A concept analysis, Nursing Education Perspectives 30 (2) (2009) 109–114.

[24]

K.T. Dreifuerst, Using debriefing for meaningful learning to foster development of clinical reasoning in simulation, Journal of Nursing Education 51 (6) (2012) 326–333.

[25]

EDUCAUSE, 2020 EDUCAUSE Horizon Report™ teaching and learning edition, 2020, Retrieved December 13, 2020, from https://library.educause.edu/-/media/files/library/2020/3/2020_horizon_report_pdf.

[26]

Y.C. Fan, C.Y. Wen, A virtual reality soldier simulator with body area networks for team training, Sensors 19 (3) (2019),.

[27]

Z. Feng, V.A. González, R. Amor, R. Lovreglio, G. Cabrera-Guerrero, Immersive virtual reality serious games for evacuation training and research: A systematic literature review, Computers & Education 127 (2018) 252–266.

[28]

C. Ferguson, E.L. Den Broek, H. Van Oostendorp, On the role of interaction mode and story structure in virtual reality serious games, Computers & Education 143 (2020),.

Digital Library

[29]

A.C. Firu, A.I. Tapîrdea, A.I. Feier, G. Drăghici, Virtual reality in the automotive field in industry 4.0, Materials Today: Proceedings 45 (5) (2021) 4177–4182.

[30]

S.G. Forneris, D.O. Neal, J. Tiffany, M.B. Kuehn, H.M. Meyer, L.M. Blazovich, M. Smerillo, Enhancing clinical reasoning through simulation debriefing: A multisite study, Nursing Education Perspectives 36 (5) (2015) 304–310.

[31]

C. Fowler, Virtual reality and learning: Where is the pedagogy?, British Journal of Educational Technology 46 (2) (2015) 412–422.

[32]

A. Freeman, S.A. Becker, M. Cummins, A. Davis, C.H. Giesinger, NMC/CoSN horizon report: 2017 K–, 12 edition, New Media Consortium, 2017.

[33]

F. Ganier, C. Hoareau, J. Tisseau, Evaluation of procedural learning transfer from a virtual environment to a real situation: A case study on tank maintenance training, Ergonomics 57 (6) (2014) 828–843.

[34]

R. Gardner, Introduction to debriefing, Seminars in Perinatology 37 (3) (2013) 166–174,.

[35]

I. Han, Immersive virtual field trips in education: A mixed-methods study on elementary students' presence and perceived learning, British Journal of Educational Technology 51 (2) (2020) 420–435.

[36]

H. Harenčárová, Managing uncertainty in paramedics' decision making, Journal of Cognitive Engineering and Decision Making 11 (1) (2017) 42–62,.

[37]

D.L. Harm, L.C. Taylor, M.F. Reschke, J.T. Somers, J.J. Bloomberg, Sensorimotor coordination aftereffects of exposure to a virtual environment, The Visual Computer 24 (11) (2008) 995–999.

[38]

A. Homola, J. Chaloupka, K. Antos, B. Jezek, Hygiene aspects of the VR systems applications. Information Technology Applications in Biomedicine, ITAB 97, in: IEEE engineering in medicine & biology society region 8 international conference, IEEE, 1997.

[39]

J.D. Hoover, R.C. Giambatista, L.Y. Belkin, Eyes on, hands on: Vicarious observational learning as an enhancement of direct experience, The Academy of Management Learning and Education 11 (4) (2012) 591–608.

[40]

S.B. Issenberg, W.C. McGaghie, E.R. Petrusa, D. Lee Gordon, R.J. Scalese, Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review, Medical Teacher 27 (1) (2005) 10–28.

[41]

ITF, Road safety annual report 2018, OECD Publishing, Paris, 2018,.

[42]

J. Jung, J. Yu, Y. Seo, E. Ko, Consumer experiences of virtual reality: Insights from VR luxury brand fashion shows, Journal of Business Research 130 (2021) 517–524.

[43]

S. Kavanagh, A. Luxton-Reilly, B. Wuensche, B. Plimmer, A systematic review of virtual reality in education, Themes in Science and Technology Education 10 (2) (2017) 85–119.

[44]

F. Ke, X. Xu, Virtual reality simulation‐based learning of teaching with alternative perspectives taking, British Journal of Educational Technology 51 (6) (2020) 2544–2557.

[45]

G. a Klein, R. Calderwood, D. Macgregor, Eliciting knowledge, IEEE Transactions on Systems Man and Cybernetics 19 (3) (1989) 462–472. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=31053.

[46]

D.A. Kolb, Experiential learning: Experience as the source of learning and development, Prentice-Hall, New Jersey, 1984.

[47]

M.A. Kraft, Interpreting effect sizes of education interventions, Educational Researcher 49 (4) (2020) 241–253.

[48]

C. Kwon, Verification of the possibility and effectiveness of experiential learning using HMD-based immersive VR technologies, Virtual Reality 23 (1) (2019) 101–118.

Digital Library

[49]

L.C. Ledeman, Debriefing toward a systematic assessment of theory and practice, Simulation & Games 23 (2) (1992) 145–169.

[50]

H. Lee, T. Jung, M. Dieck, N. Chung, Experiencing immersive virtual reality in museums, Information & Management 57 (2020).

[51]

E.A. Lee, K.W. Wong, C.C. Fung, How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach, Computers & Education 55 (4) (2010) 1424–1442.

Digital Library

[52]

T. Levett-Jones, S. Lapkin, The effectiveness of debriefing in simulation-based learning for health professionals: A systematic review, JBI Database of Systematic Reviews and Implementation Reports 10 (51) (2012) 3295–3337.

[53]

T. Levett-Jones, S. Lapkin, A systematic review of the effectiveness of simulation debriefing in health professional education, Nurse Education Today 34 (6) (2014) e58–e63.

[54]

S.R. Lord, Virtual reality and the prevention of falls in the real world, The Lancet 388 (10050) (2016) 1132–1134.

[55]

M. Luctkar-Flude, J. Tyerman, M. Verkuyl, S. Goldsworthy, N. Harder, B. Wilson-Keates, J. Kruizinga, N. Gumapac, Effectiveness of debriefing methods for virtual simulation: A systematic review, Clinical Simulation in Nursing 57 (August) (2021) 18–30.

[56]

H. Luo, T. Yang, S. Kwon, M. Zuo, W. Li, I. Choi, Using virtual reality to identify and modify risky pedestrian behaviors amongst Chinese children, Traffic Injury Prevention 21 (1) (2020) 108–113.

[57]

H. Luo, G. Li, Q. Feng, Y Yang, M. Zuo, Virtual reality in K-12 and higher education: A systematic review of the literature from 2000–2019, Journal of Computer Assisted Learning 37 (3) (2021) 887–901.

[58]

M.J. Maas, J.M. Hughes, Virtual, augmented and mixed reality in K–12 education: A review of the literature, technology, Pedagogy and Education 29 (2) (2020) 231–249.

[59]

G. Makransky, T.S. Terkildsen, R.E. Mayer, Adding immersive virtual reality to a science lab simulation causes more presence but less learning, Learning and Instruction 60 (2019) 225–236.

[60]

R.N. McEwen, A.K. Dubé, Engaging or distracting: children's tablet computer use in education, Journal of Educational Technology & Society 18 (4) (2015) 9–23.

[61]

N.M. McNeil, D.H. Uttal, Rethinking the use of concrete materials in learning: Perspectives from development and education, Child Development Perspectives 3 (3) (2009) 137–139.

[62]

H. van der Meij, H. Leemkuil, J.-L. Li, Does individual or collaborative self-debriefing better enhance learning from games?, Computers in Human Behavior 29 (6) (2013) 2471–2479.

[63]

Z. Merchant, E.T. Goetz, L. Cifuentes, W. Keeney-Kennicutt, T.J. Davis, Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis, Computers & Education 70 (1) (2014) 29–40.

[64]

C. Merkx, J. Nawijn, Virtual reality tourism experiences: Addiction and isolation, Tourism Management 87 (5) (2021).

[65]

D. Michelet, J. Barre, J. Truchot, M.A. Piot, P. Cabon, A. Tesniere, Effect of computer debriefing on acquisition and retention of learning after screen-based simulation of neonatal resuscitation: Randomized controlled trial, JMIR Serious Games 8 (3) (2020).

[66]

L.G. Militello, C.E. Sushereba, M. Branlat, R. Bean, V. Finomore, Designing for military pararescue: Naturalistic decision-making perspective, methods, and frameworks, Journal of Occupational and Organizational Psychology 88 (2) (2015) 251–272,.

[67]

Ministry of Education of the People’s Republic of China, The handbook of child traffic safety knowledge, 2012, Retrieved December 13, 2020, from http://www.moe.gov.cn/s78/A06/A06_gggs/s8465/201201/t20120104_180959.html.

[68]

M.L. Nathan, S. Kovoor-Misra, No pain, yet gain: Vicarious organizational learning from crises in an inter-organizational field, The Journal of Applied Behavioral Science 38 (2) (2002) 245–266.

[69]

D.M. Odo, An investigation of the development of pre-service teacher assessment literacy through individualized tutoring and peer debriefing, Journal of Inquiry and Action in Education 7 (2) (2016) 2.

[70]

OECD, Keeping children safe in traffic, OECD Publishing, Paris, 2004,.

[71]

J.E. Ormrod, Human learning, 7th ed., Pearson Education, 2015.

[72]

M.D. Patterson, L.G. Militello, A. Bunger, R.G. Taylor, D.S. Wheeler, G. Klein, G.L. Geis, Leveraging the critical decision method to develop simulation-based training for early recognition of sepsis, Journal of Cognitive Engineering and Decision Making 10 (1) (2016) 36–56,.

[73]

J. Radianti, T.A. Majchrzak, J. Fromm, I. Wohlgenannt, A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda, Computers & Education 147 (2020),.

Digital Library

[74]

S. Rothe, A. Schmidt, M. Montagud, D. Buschek, H. Hußmann, Social viewing in cinematic virtual reality: A design space for social movie applications, Virtual Reality, 2020,.

Digital Library

[75]

E.N. Ryoo, E.H. Ha, The importance of debriefing in simulation-based learning: Comparison between debriefing and no debriefing, CIN: Computers, Informatics, Nursing 33 (12) (2015) 538–545.

[76]

G.L. Savoldelli, V.N. Naik, J. Park, H.S. Joo, R. Chow, S.J. Hamstra, Value of debriefing during simulated crisis management: Oral versus video-assisted oral feedback, Anesthesiology 105 (2) (2006) 279–285.

[77]

D.C. Schwebel, A.L. Davis, E.E. O'Neal, Child pedestrian injury: A review of behavioral risks and preventive strategies, American Journal of Lifestyle Medicine 6 (4) (2012) 292–302.

[78]

A.S. Shappell, S. Barbato, Post-immersion reflective practices, Journal of College and Character 11 (3) (2010),.

[79]

D. Shin, The role of affordance in the experience of virtual reality learning: Technological and affective affordances in virtual reality, Telematics and Informatics 34 (8) (2017) 1826–1836.

Digital Library

[80]

E Southgate, S Smith P, C Cividino, S Saxby, J Kilham, G Eather, …., C Bergin, Embedding immersive virtual reality in classrooms: Ethical, organisational and educational lessons in bridging research and practice, International Journal of Child-Computer Interaction 19 (2019) 19–29.

[81]

J. Steuer, Defining virtual reality: Dimensions determining, Telepresence 42 (4) (1992) 73–93.

[82]

A. Suh, J. Prophet, The state of immersive technology research: A literature analysis, Computers in Human Behavior 86 (2018) 77–90.

[83]

S.I. Tannenbaum, C.P. Cerasoli, Do team and individual debriefs enhance performance? A meta-analysis, Human Factors 55 (1) (2013) 231–245.

[84]

J. Tham, A.H. Duin, L. Gee, N. Ernst, B. Abdelqader, M. McGrath, Understanding virtual reality: Presence, embodiment, and professional practice, IEEE Transactions on Professional Communications 61 (2) (2018) 178–195.

[85]

D.J. Thomas, D. Singh, Letter to the editor: Virtual reality in surgical training, International Journal of Surgery 89 (May) (2021).

[86]

M. Verkuyl, M. Hughes, L. Atack, T. McCulloch, J. Lapum, D. Romaniuk, O. St-Amant, Comparison of self-debriefing alone or in combination with group debrief, Clinical Simulation in Nursing 19 (2018) 1–7.

[87]

N. Wetzel, A. Widmann, E. Schrger, The cognitive control of distraction by novelty in children aged 7–8 and adults, Psychophysiology 46 (3) (2009) 607–616.

[88]

B. Wu, X. Yu, X. Gu, Effectiveness of immersive virtual reality using head‐mounted displays on learning performance: A meta-analysis, British Journal of Educational Technology 51 (6) (2020) 1991–2005.

[89]

Y. Xie, L. Ryder, Y. Chen, Using interactive virtual reality tools in an advanced Chinese language class: A case study, TechTrends 63 (3) (2019) 251–259.

[90]

G. Yang, Y.‐T. Chen, X.‐L. Zheng, G.‐J. Hwang, From experiencing to expressing: A virtual reality approach to facilitating pupils' descriptive paper writing performance and learning behavior engagement, British Journal of Educational Technology 52 (2) (2021) 807–823,.

Cited By

Fitton IDark EOliveira da Silva MDalton JProulx MClarke CLutteroth C(2024)Watch This! Observational Learning in VR Promotes Better Far Transfer than Active Learning for a Fine Psychomotor TaskProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642550(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642550
Macias-Velasquez SMedellin-Castillo HGarcia-Barrientos A(2024)New-user experience evaluation in a semi-immersive and haptic-enabled virtual reality system for assembly operationsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103312190:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103312
Seo SPark HKoo C(2024)Impact of interactive learning elements on personal learning performance in immersive virtual reality for construction safety trainingExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124099251:COnline publication date: 24-Jul-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.124099
Show More Cited By

Index Terms

Performing versus observing: Investigating the effectiveness of group debriefing in a VR-based safety education program

Index terms have been assigned to the content through auto-classification.

Recommendations

Virtual reality for car-detailing skill development: Learning outcomes of procedural accuracy and performance quality predicted by VR self-efficacy, VR using anxiety, VR learning interest and flow experience
Abstract
While virtual reality (VR) training has been used in many examples of specialized skills training, its learning effect has also been explored with a focus on gross motor performance. Using VR can develop technical students' procedural ...
Highlights
- To explore how two types of learning outcomes could be predicted by students' VR flow experience.
Effects of virtual reality technology on primary school students’ creativity performance, learning engagement and mental flow
Abstract
Background: In primary school art education, it is crucial to foster innovative thinking, encourage hands-on creativity, and nurture an awareness of fundamental artistic aesthetics. Thus, the curriculum should emphasize art literacy development, ...
Personalized E-learning system with self-regulated learning assisted mechanisms for promoting learning performance

With the rapid development of Internet technologies, the conventional computer-assisted learning (CAL) is gradually moving toward to web-based learning. Additionally, instructors typically base their teaching methods to simultaneously interact with all ...

Comments

Information & Contributors

Information

Published In

cover image Computers & Education

Computers & Education Volume 175, Issue C

Dec 2021

270 pages

ISSN:0360-1315

Issue’s Table of Contents

Elsevier Ltd.

Publisher

Elsevier Science Ltd.

United Kingdom

Publication History

Published: 01 December 2021

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fitton IDark EOliveira da Silva MDalton JProulx MClarke CLutteroth C(2024)Watch This! Observational Learning in VR Promotes Better Far Transfer than Active Learning for a Fine Psychomotor TaskProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642550(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642550
Macias-Velasquez SMedellin-Castillo HGarcia-Barrientos A(2024)New-user experience evaluation in a semi-immersive and haptic-enabled virtual reality system for assembly operationsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103312190:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103312
Seo SPark HKoo C(2024)Impact of interactive learning elements on personal learning performance in immersive virtual reality for construction safety trainingExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124099251:COnline publication date: 24-Jul-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.124099
Zhong ZFeng SJin S(2024)Investigating the influencing factors of teaching anxiety in Virtual Reality environmentsEducation and Information Technologies10.1007/s10639-023-12152-229:7(8369-8391)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1007/s10639-023-12152-2
Mohsen MAlangari T(2024)Analyzing two decades of immersive technology research in education: Trends, clusters, and future directionsEducation and Information Technologies10.1007/s10639-023-11968-229:3(3571-3587)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1007/s10639-023-11968-2
Yong JWei JWang YDang JLei XLu W(2023)Heterogeneity in Extended Reality Influences Procedural Knowledge Gain and Operation TrainingIEEE Transactions on Learning Technologies10.1109/TLT.2023.328661216:6(1014-1033)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TLT.2023.3286612
Li WFeng QZhu XYu QWang Q(2023)Effect of summarizing scaffolding and textual cues on learning performance, mental model, and cognitive load in a virtual reality environmentComputers & Education10.1016/j.compedu.2023.104793200:COnline publication date: 24-May-2023
https://dl.acm.org/doi/10.1016/j.compedu.2023.104793
Zhong ZZhang GJin SWang JMa NFeng S(2022)Investigating the effect of peer instruction on learners with different cognitive styles in VR-based learning environmentEducation and Information Technologies10.1007/s10639-022-11115-327:8(11875-11899)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s10639-022-11115-3

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents