research-article

A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using serious educational games, serious games, and simulations

Authors:

Richard L. Lamb,

Leonard Annetta,

Jonah Firestone,

Elisabeth EtopioAuthors Info & Claims

Computers in Human Behavior, Volume 80, Issue C

Pages 158 - 167

https://doi.org/10.1016/j.chb.2017.10.040

Published: 01 March 2018 Publication History

Abstract

Educational games and simulations provide teachers with powerful tools for teaching students in the sciences. Within the broad category of educational gaming, there are several types of games to include Serious Educational Games (SEG), Educational Simulations (ES), and Serious Games (SG). The purpose of this meta-analysis is to characterize and compare outcomes related to serious educational games, serious games, and educational simulations as they are presented in the educational literature. Specifically the authors intend to fill gaps left by previous studies, include major finding, and assess the current state of the field related to the use of these innovative technologies. The results of this study are in line with previous studies suggesting higher cognitive gains and increases in positive affective toward learning from subjects using SEGs, SGs, and ES. Effects were calculated from 46 empirical experimental studies. The examined studies suggest that ES, SGs, and SEGs do not differ in a statistically significant way when compared to traditional instruction but do differ from each other. More to this point, effect size outcomes are suggestive of a cumulative medium effect for cognition (d=.67) and affect (d=.51) with a small effect for behavior (d=.04). Three-dimensional games provide the greatest effect.Effects do not seem to persist in the university and above level.Greatest effect for games is seen in the development of skills.SEGs are more effective in increasing outcomes than SGs and simulations.

References

[1]

G.K. Akilli, Games and simulations: A new approach in education. Gaming and Simulations: Concepts, methodologies, tools and applications, ed. Information resources management association, 2011.

[2]

J.R. Anderson, G.H. Bower, Human associative memory, Psychology press, New York, NY, 2013.

[3]

L.A. Annetta, Video games in education: Why they should be used and how they are being used, Theory Into Practice, 47 (2008) 229-239.

[4]

L.A. Annetta, The I's have it: A framework for serious educational game design, Review of General Psychology, 14 (2010) 105.

[5]

L.A. Annetta, J.A. Shymansky, Investigating science learning for rural elementary school teachers in a professional - development project through three distance - education strategies, Journal of Research Inscience Teaching, 43 (2006) 1019-1039.

[6]

L.A. Annetta, E. Folta, M. Klesath, V-Learning: Distance education in the 21st century through 3D virtual learning environments, Springer, New York, NY, 2010.

[7]

L.A. Annetta, R. Lamb, B. Bowling, R. Cheng, Assessing engagement in serious educational games: The development of the student engaged learning in a technology rich interactive classroom (SELTIC), in: Handbook of research on improving learning and motivation through educational games: Multidisciplinary approaches, IGI Global, 2011, pp. 310-329.

[8]

L.A. Annetta, J. Minogue, S.Y. Holmes, M.T. Cheng, Investigating the impact of video games on high school students' engagement and learning about genetics, Computers & Education, 53 (2009) 74-85.

Digital Library

[9]

L. Annetta, R. Lamb, J. Minogue, E. Folta, S. Holmes, D. Vallett, R. Cheng, Safe science classrooms: Teacher training through serious educational games, Information Sciences, 264 (2014) 61-74.

Digital Library

[10]

T.H. Apperley, Genre and game studies: Toward a critical approach to video game genres, Simulation & Gaming, 37 (2006) 6-23.

Digital Library

[11]

A. Bandura, Self-efficacy: Toward a unifying theory of behavioral change, Psychological Review, 84 (1977) 191.

[12]

A. Bandura, Self-efficacy mechanism in human agency, American Psychologist, 37 (1982) 122.

[13]

F. Barban, G. Daniele Zannino, E. Macaluso, C. Caltagirone, G.A. Carlesimo, Letters persistence after physical offset: Visual word form area and left planum temporale. An fMRI study, Human Brain Mapping, 34 (2013) 1282-1292.

[14]

V.L. Bartelt, A.R. Dennis, L. Yuan, J.B. Barlow, Individual priming in virtual team decision-making, Group Decision and Negotiation, 22 (2013) 873-896.

[15]

R. Berkowitz, G. Bowen, R. Benbenishty, J.D. Powers, Across-cultural validity study of the school success profile learning organization measure in Israel, Children & Schools, 35 (2013) 137-146.

[16]

R.M. Bernard, P.C. Abrami, E. Borokhovski, C.A. Wade, R.M. Tamim, M.A. Surkes, Ameta-analysis of three types of interaction treatments in distance education, Review of Educational Research, 79 (2009) 1243-1289.

[17]

F.A. Bleasdale, Concreteness-dependent associative priming: Separate lexical organization for concrete and abstract words, Journal of Experimental Psychology: Learning, Memory, and Cognition, 13 (1987) 582.

[18]

J.S. Breuer, G. Bente, Why so serious? On the relation of serious games and learning, Eludamos. Journal for Computer Game Culture, 4 (2010) 7-24.

[19]

A. Catala, F. Garcia-Sanjuan, P. Pons, J. Jaen, Active creation of digital games as learning tools, in: Digital systems for open access to formal and informal learning, Springer, New York, NY, 2014, pp. 275-291.

[20]

W.K.R. Cheng, Relationship between visual attention and Flow experience in a serious educational Game: An eye tracking analysis, 2014.

[21]

M.T. Cheng, Y.W. Lin, H.C. She, Learning through playing Virtual Age: Exploring the interactions among student concept learning, gaming performance, in-game behaviors, and the use of in-game characters, Computers & Education, 86 (2015) 18-29.

Digital Library

[22]

M.T. Cheng, T. Su, W.Y. Huang, J.H. Chen, An educational game for learning human immunology: What do students learn and how do they perceive?, British Journal of Educational Technology, 45 (2014) 820-833.

[23]

A. Chiesa, R. Calati, A. Serretti, Does mindfulness training improve cognitive abilities? A systematic review of neuropsychological findings, Clinical Psychology Review, 31 (2011) 449-464.

[24]

R.C. Clark, R.E. Mayer, E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning, John Wiley & Sons, Hoboken, NJ, 2011.

Digital Library

[25]

W.M. Cox, E. Klinger, Handbook of motivational counseling: Goal-based approaches to assessment and intervention with addiction and other problems, John Wiley & Sons, Hoboken, NJ, 2011.

[26]

M. Csikszentmihalyi, Flow and the psychology of discovery and invention, Harper Perennial, New York, NY, 1997.

[27]

M.J. Dondlinger, Educational video game design: A review of the literature, Journal of Applied Educational Technology, 4 (2007) 21-31.

[28]

S. Duval, R. Tweedie, Trim and fill: A simple funnel-plotbased method of testing and adjusting for publication bias in meta-analysis, Biometrics, 56 (2000) 455-463.

[29]

T.L. Epstein, Sociocultural approaches to young People's historical understanding, Social Education, 61 (1997) 28-31.

[30]

P.A. Ertmer, A.T. Ottenbreit-Leftwich, Teacher technology change: How knowledge, confidence, beliefs, and culture intersect, Journal of Research on Technology in Education, 42 (2010) 255-284.

[31]

S.T. Fiske, S.E. Taylor, Social cognition: From brains to culture, Sage, Thousand Oaks, CA, 2013.

[32]

B.K. Hamre, R.C. Pianta, J.T. Downer, J. DeCoster, A.J. Mashburn, S.M. Jones, Teaching through interactions, The Elementary School Journal, 113 (2013) 461-487.

[33]

A.M. Hardin, C.A. Looney, M.A. Fuller, Self-efficacy, learning method appropriation and software skills acquisition in learner-controlled CSSTS environments, Information Systems Journal, 24 (2014) 3-27.

Digital Library

[34]

S. Hotton, J. Yoshimi, Extending dynamical systems theory to model embodied cognition, Cognitive Science, 35 (2011) 444-479.

[35]

G.J. Hwang, L.Y. Chiu, C.H. Chen, Acontextual game-based learning approach to improving students' inquiry-based learning performance in social studies courses, Computers & Education, 81 (2015) 13-25.

Digital Library

[36]

K. Kunkler, The role of medical simulation: An overview, The International Journal of Medical Robotics and Computer Assisted Surgery, 2 (2006) 203-210.

[37]

R. Lamb, Examination of allostasis and online laboratory simulations in a middle school science classroom, Computers in Human Behavior, 39 (2014) 224-234.

Digital Library

[38]

R.L. Lamb, Examination of the effects of dimensionality on cognitive processing in science: A computational modeling experiment comparing online laboratory simulations and serious educational games, Journal of Science Education and Technology, 25 (2016) 1-15.

[39]

R. Lamb, T. Akmal, K. Petrie, Development of a cognition-priming model describing learning in a STEM classroom, Journal of Research in Science Teaching, 52 (2015) 410-437.

[40]

R. Lamb, L. Annetta, Apilot study of online simulations and problem based learning in a chemistry classroom, Journal Virginia Science Educator, 3 (2009) 34-50.

[41]

R. Lamb, L. Annetta, Influences of gender on computer simulation outcomes, Meridian, 13 (2012).

[42]

R.L. Lamb, L. Annetta, The use of online modules and the effect on student outcomes in a high school chemistry class, Journal of Science Education and Technology, 22 (2013) 603-613.

[43]

R.L. Lamb, L. Annetta, J. Meldrum, D. Vallett, Measuring science interest: Rasch validation of the science interest survey, International Journal of Science and Mathematics Education, 10 (2012) 643-668.

[44]

R. Lamb, L. Annetta, D. Vallett, J. Firestone, M. Schmitter-Edgecombe, H. Walker, Psychosocial factors impacting STEM career selection, The Journal of Educational Research (2017) 1-13.

[45]

R.L. Lamb, L. Annetta, D.B. Vallett, T.D. Sadler, Cognitive diagnostic like approaches using neural-network analysis of serious educational videogames, Computers & Education, 70 (2014) 92-104.

Digital Library

[46]

R. Lamb, A. Cavagnetto, T. Akmal, Examination of the nonlinear dynamic systems associated with science student cognition while engaging in science information processing, International Journal of Science and Mathematics Education (2014) 1-19.

[47]

R.L. Lamb, D.B. Vallett, T. Akmal, K. Baldwin, Acomputational modeling of student cognitive processes in science education, Computers & Education, 79 (2014) 116-125.

Digital Library

[48]

R.L. Lamb, D. Vallett, L. Annetta, Development of a short-form measure of science and technology self-efficacy using Rasch analysis, Journal of Science Education and Technology, 23 (2014) 641-657.

[49]

J.E. Mazur, Learning and behavior, Psychology Press, New York, NY, 2015.

[50]

A. Mitchell, C. Savill-Smith, The use of computer and video games for learning: A review of the literature london, Learning and skills Development Agency, England, 2004.

[51]

G. Paine, Sonic Immersion: Interactive engagement in real-time immersive environments, SCAN Journal of Media Arts and Culture, 4 (2007).

[52]

N. Pearce, M. Weller, E. Scanlon, S. Kinsley, Digital scholarship considered: How new technologies could transform academic work, Education, 16 (2012).

[53]

L. Perlovsky, Language and emotions: Emotional sapirwhorf hypothesis, Neural Networks, 22 (2009) 518-526.

Digital Library

[54]

B. Schmitz, R. Klemke, M. Specht, The impact of coupled games on the learning experience of learners at-risk: An empirical study, Pervasive and Mobile Computing, 14 (2014) 57-65.

Digital Library

[55]

A.N. Schore, Attachment and the regulation of the right brain, Attachment & Human Development, 2 (2000) 23-47.

[56]

R.E. Slavin, Cooperative learning. Learning and cognition in education, Elsevier Academic Press, Boston: MA, 2011.

[57]

L.H. Somerville, D.D. Wagner, G.S. Wig, J.M. Moran, P.J. Whalen, W.M. Kelley, Interactions between transient and sustained neural signals support the generation and regulation of anxious emotion, Cerebral Cortex, 23 (2013) 49-60.

[58]

E.L. Usher, Self-efficacy for self-regulated learning, in: Encyclopedia of the sciences of learning, Springer, New York, NY, 2012, pp. 3001-3003.

[59]

D.B. Vallett, L. Annetta, Re-visioning K-12 education: Learning through failurenot social promotion, Psychology of Popular Media Culture, 3 (2014) 174.

[60]

J.J. Vogel, D.S. Vogel, J. Cannon-Bowers, C.A. Bowers, K. Muse, M. Wright, Computer gaming and interactive simulations for learning: A meta-analysis, Journal of Educational Computing Research, 34 (2006) 229-243.

[61]

W.E. Walker, J. Giddings, S. Armstrong, Training and learning for crisis management using a virtual simulation/gaming environment, Cognition, Technology & Work, 13 (2011) 163-173.

Digital Library

[62]

S. Walkowiak, T. Foulsham, A.F. Eardley, Individual differences and personality correlates of navigational performance in the virtual route learning task, Computers in Human Behavior, 45 (2015) 402-410.

Digital Library

[63]

K.E. Weick, K.M. Sutcliffe, D. Obstfeld, Organizing and the process of sense making, Organization Science, 16 (2005) 409-421.

Digital Library

[64]

P. Wouters, H. van Oostendorp, Overview of instructional techniques to facilitate learning and motivation of serious games, in: Instructional techniques to facilitate learning and motivation of serious games, Springer Publishing, New York, NY, 2017, pp. 1-16.

[65]

M.F. Young, S. Slota, A.B. Cutter, G. Jalette, G. Mullin, B. Lai, Our princess is in another castle a review of trends in serious gaming for education, Review of Educational Research, 82 (2012) 61-89.

[66]

C. Zimmerman, S. Croker, Aprospective cognition analysis of scientific thinking and the implications for teaching and learning science, Journal of Cognitive Education and Psychology, 13 (2014) 245-257.

[67]

M. Zyda, From visual simulation to virtual reality to games, Computer, 38 (2005) 25-32.

Digital Library

Cited By

Franke SHermes SRoidl M(2024)An Educational Game to Learn Picking Techniques in Warehousing – WareMoverSimulation and Gaming10.1177/1046878124125860655:5(964-975)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1177/10468781241258606
Kienitz AEitel AKrebs M(2024)Press START to Teach – Can Simulation Games Close the Theory-Practice Gap?Simulation and Gaming10.1177/1046878124125252155:5(837-855)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1177/10468781241252521
Cai MRebolledo Mendez GArevalo GTang SAbdullah YDemmans Epp C(2024)Toward Supporting Adaptation: Exploring Affect’s Role in Cognitive Load when Using a Literacy GameProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642150(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642150
Show More Cited By

A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using serious educational games, serious games, and simulations
1. Applied computing

Recommendations

Play to Learn: from Serious Games to just Games
GoodIT '23: Proceedings of the 2023 ACM Conference on Information Technology for Social Good

Games have been used for a few decades in research, formal education, and training of children and adults, and digital games are no strangers to educational uses. After all, everyone likes to play games, so it should stand to reason that educational ...
Towards A Comprehensive Serious Educational Games' Ontology
AMECSE '17: Proceedings of the 3rd Africa and Middle East Conference on Software Engineering

Serious Educational Games (SEGs) are games that have a purpose that differs from those for entertainment only. SEGs offer learners practicing what they learnt. The analysis and design of such games require integrating game design activities with ...
Serious Games: Foundations, Concepts and Practice

Comments

Information & Contributors

Information

Published In

cover image Computers in Human Behavior

Computers in Human Behavior Volume 80, Issue C

March 2018

473 pages

ISSN:0747-5632

Issue’s Table of Contents

Copyright © Elsevier Ltd.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 March 2018

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Franke SHermes SRoidl M(2024)An Educational Game to Learn Picking Techniques in Warehousing – WareMoverSimulation and Gaming10.1177/1046878124125860655:5(964-975)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1177/10468781241258606
Kienitz AEitel AKrebs M(2024)Press START to Teach – Can Simulation Games Close the Theory-Practice Gap?Simulation and Gaming10.1177/1046878124125252155:5(837-855)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1177/10468781241252521
Cai MRebolledo Mendez GArevalo GTang SAbdullah YDemmans Epp C(2024)Toward Supporting Adaptation: Exploring Affect’s Role in Cognitive Load when Using a Literacy GameProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642150(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642150
Guo KZhong YZainuddin ZChu S(2024)Applying game-related methods in the writing classroom: A scoping reviewEducation and Information Technologies10.1007/s10639-023-11998-w29:4(4481-4504)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s10639-023-11998-w
Nicolaidou IEgenfeldt-Nielsen SZupančič RHajslund SMilioni D(2023)Developing Fact FindersSocial Science Computer Review10.1177/0894439321107358641:4(1166-1186)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1177/08944393211073586
Ekin CPolat EHopcan S(2023)Drawing the big picture of games in educationComputers & Education10.1016/j.compedu.2022.104700194:COnline publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1016/j.compedu.2022.104700
Yılmaz EGriffiths M(2023)Children’s social problem-solving skills in playing videogames and traditional games: A systematic reviewEducation and Information Technologies10.1007/s10639-023-11663-228:9(11679-11712)Online publication date: 22-Feb-2023
https://dl.acm.org/doi/10.1007/s10639-023-11663-2
Salameh RLoh C(2022)Engagement and Players' Intended Behaviors in a Cybersecurity Serious GameInternational Journal of Gaming and Computer-Mediated Simulations10.4018/IJGCMS.31318514:1(1-21)Online publication date: 26-Oct-2022
https://dl.acm.org/doi/10.4018/IJGCMS.313185
Jang SPark JHong H(2022)In Visible Climate Change: Exploring Immersive Data Visualisation to Promote Climate Change Awareness in a VR GameExtended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play10.1145/3505270.3558335(146-152)Online publication date: 2-Nov-2022
https://dl.acm.org/doi/10.1145/3505270.3558335
Francisco VMoreno-Ger PHervás R(2022)Application of Competitive Activities to Improve Students’ ParticipationIEEE Transactions on Learning Technologies10.1109/TLT.2022.315317415:1(2-14)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1109/TLT.2022.3153174
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents