research-article

Enhancing subject matter assessments utilizing augmented reality and serious game techniques

Authors:

Brian Holtkamp,

Mohammed Alshair,

Daniel Biediger,

Michael Wilson,

Kyungki KimAuthors Info & Claims

FDG '19: Proceedings of the 14th International Conference on the Foundations of Digital Games

Article No.: 46, Pages 1 - 8

https://doi.org/10.1145/3337722.3337743

Published: 26 August 2019 Publication History

Abstract

In this paper, we utilize the Microsoft HoloLens, a wearable augmented-reality (AR) device, to investigate how well an AR-based assessment tool measures a student's comprehension of, skill in, and aptitude for a given subject matter. We added assessment capabilities to a serious game prototype built in collaboration with Construction Management faculty for their Occupational Safety and Health Administration (OSHA) safety course. In an effort to verify if these assessment elements are effective, we hosted a trial with sixteen university students who were enrolled in the OSHA safety course.

The trial consisted of a traditional pen-and-paper exam and an AR-based assessment. The AR-based assessment required the students to identify unsafe situations of virtually simulated workers, construction equipment, and/or vehicles in an AR diorama of an active construction site. We selected OSHA topics from eight categories ranging from proper ladder usage on the work site to workers wearing the correct protective equipment for where they are and what they're doing.

We find that 1.) students who performed well on a paper-based assessment also performed well within the AR-based assessment tool, 2.) students and faculty considered the AR trial more comprehensive and representative of knowledge, and 3.) user feedback reinforced the visual and interactive benefits of the AR over the paper-based exam. This trial shows promising results to adapt serious games and AR assessments into Computer Science and interdisciplinary subject matters that rely on visualization and spatial understanding.

References

[1]

Beatrice Aruanno, Franca Garzotto, and Mario Covarrubias Rodriguez. 2017. HoloLens-based Mixed Reality Experiences for Subjects with Alzheimer's Disease. In Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter (CHItaly '17). ACM, New York, NY, USA, 15:1--15:9.

Digital Library

[2]

K. Berkling and C. Thomas. 2013. Gamification of a Software Engineering course and a detailed analysis of the factors that lead to it's failure. In 2013 International Conference on Interactive Collaborative Learning (ICL). 525--530.

[3]

Nathan Dass, Joonyoung Kim, Sam Ford, Sudeep Agarwal, and Duen Horng (Polo) Chau. 2018. Augmenting Coding: Augmented Reality for Learning Programming. In Proceedings of the Sixth International Symposium of Chinese CHI (ChineseCHI '18). ACM, New York, NY, USA, 156--159.

Digital Library

[4]

Jorge Francisco Figueroa Flores. 2015. Using Gamification to Enhance Second Language Learning. Digital Education Review 27 (2015), 32--54. https://dialnet.unirioja.es/servlet/articulo?codigo=5495904

[5]

P. Fotaris, T. Mastoras, R. Leinfellner, Y. Rosunally, P. Fotaris, T. Mastoras, R. Leinfellner, and Y. Rosunally. 2016. Climbing up the leaderboard: An empirical study of applying gamification techniques to a computer programming class. Electronic Journal of E-Learning 14 (2016), 94--110. http://www.ejel.org/volume14/issue2

[6]

Nirit Gavish, Teresa GutiÃľrrez, Sabine Webel, Jorge RodrÃŋguez, Matteo Peveri, Uli Bockholt, and Franco Tecchia. 2015. Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interactive Learning Environments 23, 6 (Dec. 2015), 778--798.

[7]

Mehmet Kesim and Yasin Ozarslan. 2012. Augmented Reality in Education: Current Technologies and the Potential for Education. Procedia - Social and Behavioral Sciences 47 (Jan. 2012), 297--302.

[8]

R. N. Landers. {n. d.}. Developing a Theory of Gamified Learning: Linking Serious Games and Gamification of Learning. Simulation & Gaming 45, 6 ({n. d.}), 752--768.

Digital Library

[9]

Richard N. Landers and Amy K. Landers. 2014. An Empirical Test of the Theory of Gamified Learning: The Effect of Leaderboards on Time-on-Task and Academic Performance. Simulation & Gaming 45, 6 (Dec. 2014), 769--785.

Digital Library

[10]

Kangdon Lee. 2012. Augmented Reality in Education and Training. TechTrends 56, 2 (March 2012), 13--21.

[11]

Cen Li, Zhijiang Dong, Roland H. Untch, and Michael Chasteen. 2013. Engaging computer science students through gamification in an online social network based collaborative learning environment. International Journal of Information and Education Technology 3, 1 (2013), 72.

[12]

Chan-Sik Park and Hyeon-Jin Kim. 2013. A framework for construction safety management and visualization system. Automation in Construction 33 (Aug. 2013), 95--103.

[13]

Yeshwanth Pulijala, Minhua Ma, Matthew Pears, David Peebles, and Ashraf Ayoub. 2018. Effectiveness of Immersive Virtual Reality in Surgical Training-A Randomized Control Trial. Journal of Oral and Maxillofacial Surgery 76, 5 (May 2018), 1065--1072.

[14]

Tashko Rizov and Elena Rizova. 2015. Augmented Reality as a Teaching Tool in Higher Education. International Journal of Cognitive Research in Science, Engineering & Education (IJCRSEE) 3, 1 (Jan. 2015), 7--16. http://ezproxy.lib.uh.edu/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=a9h&AN=110555567&site=ehost-live

[15]

C.-H. Su and C.-H. Cheng. 2015. A mobile gamification learning system for improving the learning motivation and achievements. Journal of Computer Assisted Learning 31, 3 (June 2015), 268--286.

Digital Library

[16]

Alexandra Voinea, Alin Moldoveanu, and Florica Moldoveanu. 2016. Bringing the Augmented Reality Benefits to Biomechanics Study. In Proceedings of the 2016 Workshop on Multimodal Virtual and Augmented Reality (MVAR '16). ACM, New York, NY, USA, 9:1--9:6.

Digital Library

Cited By

Muñoz-La Rivera FMora-Serrano JOñate E(2024)A Critical Review of How EXtended Reality (XR) has Addressed Key Factors Influencing Safety on Construction Projects (fSCPs)Archives of Computational Methods in Engineering10.1007/s11831-023-10042-x31:4(2015-2048)Online publication date: 23-Jan-2024
https://doi.org/10.1007/s11831-023-10042-x
Ilbeigi MBairaktarova DMorteza A(2023)Gamification in Construction Engineering Education: A Scoping ReviewJournal of Civil Engineering Education10.1061/(ASCE)EI.2643-9115.0000077149:2Online publication date: Apr-2023
https://doi.org/10.1061/(ASCE)EI.2643-9115.0000077
Salinas DMuñoz-La Rivera FMora-Serrano J(2022)Critical Analysis of the Evaluation Methods of Extended Reality (XR) Experiences for Construction SafetyInternational Journal of Environmental Research and Public Health10.3390/ijerph19221527219:22(15272)Online publication date: 18-Nov-2022
https://doi.org/10.3390/ijerph192215272
Show More Cited By

Index Terms

Enhancing subject matter assessments utilizing augmented reality and serious game techniques
1. Applied computing
  1. Education
    1. Interactive learning environments
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Virtual reality and augmented reality for education: panel
SA '16: SIGGRAPH ASIA 2016 Symposium on Education: Talks

Since the last few decades, virtual reality (VR) and augmented-reality (AR) interfaces have shown the potential to enhance teaching and learning, by combining physical and virtual worlds and leveraging the advantages of both [Yannier et al. 2015]. ...
Treating cockroach phobia using a serious game on a mobile phone and augmented reality exposure: A single case study

In vivo exposure has proved its efficacy in the treatment of specific phobias; however, not all patients benefit from it. Communication and information technologies such as Virtual Reality (VR) and Augmented Reality (AR) have improved exposure treatment ...
Developing an augmented reality racing game
INTETAIN '08: Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINment

Augmented reality (AR) makes it possible to create games in which virtual objects are overlaid on the real world, and real objects are tracked and used to control virtual ones. We describe the development of an AR racing game created by modifying an ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

FDG '19: Proceedings of the 14th International Conference on the Foundations of Digital Games

August 2019

822 pages

ISBN:9781450372176

DOI:10.1145/3337722

Conference Chair:
Sebastian Deterding
University of York
,
General Chair:
Foaad Khosmood
California Polytechnic State University
,
Program Chairs:
Johanna Pirker
Graz University of Technology
,
Thomas Apperley
CEGCS Tampere University

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 August 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

FDG '19

FDG '19: The Fourteenth International Conference on the Foundations of Digital Games

August 26 - 30, 2019

California, San Luis Obispo, USA

Acceptance Rates

FDG '19 Paper Acceptance Rate 46 of 124 submissions, 37%;

Overall Acceptance Rate 152 of 415 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
262
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Muñoz-La Rivera FMora-Serrano JOñate E(2024)A Critical Review of How EXtended Reality (XR) has Addressed Key Factors Influencing Safety on Construction Projects (fSCPs)Archives of Computational Methods in Engineering10.1007/s11831-023-10042-x31:4(2015-2048)Online publication date: 23-Jan-2024
https://doi.org/10.1007/s11831-023-10042-x
Ilbeigi MBairaktarova DMorteza A(2023)Gamification in Construction Engineering Education: A Scoping ReviewJournal of Civil Engineering Education10.1061/(ASCE)EI.2643-9115.0000077149:2Online publication date: Apr-2023
https://doi.org/10.1061/(ASCE)EI.2643-9115.0000077
Salinas DMuñoz-La Rivera FMora-Serrano J(2022)Critical Analysis of the Evaluation Methods of Extended Reality (XR) Experiences for Construction SafetyInternational Journal of Environmental Research and Public Health10.3390/ijerph19221527219:22(15272)Online publication date: 18-Nov-2022
https://doi.org/10.3390/ijerph192215272
Erdogmus ERyherd EDiefes-Dux HArmwood-Gordon C(2021)Use of Virtual Reality to Improve Engagement and Self-Efficacy in Architectural Engineering Disciplines2021 IEEE Frontiers in Education Conference (FIE)10.1109/FIE49875.2021.9637182(1-7)Online publication date: 13-Oct-2021
https://dl.acm.org/doi/10.1109/FIE49875.2021.9637182

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten