research-article

Does gamification matter?: a systematic mapping about the evaluation of gamification in educational environments

Authors:

Ana Carolina Tomé Klock,

Aline Nunes Ogawa,

Isabela Gasparini,

Marcelo Soares PimentaAuthors Info & Claims

SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

Pages 2006 - 2012

https://doi.org/10.1145/3167132.3167347

Published: 09 April 2018 Publication History

Abstract

Gamification is a technique that reuses game design and elements in others contexts, such as in e-commerces systems and virtual learning environments. When applied in the educational area, the gamification purpose is to promote a better user experience by improving students' motivation and engagement. There are already several studies applying gamification in the educational systems, and many ways to evaluate its effects on students. Thus, the aim of this work is to investigate how these studies evaluate gamification and compare its usage in educational environments through a systematic mapping. From the 832 studies returned by the search engines, only 20 of them met the defined selection criteria. As a result, these studies compared and evaluated gamification through students' interaction, performance, and user experience, based on their activities and answers in satisfaction surveys and tests.

References

[1]

A. Amriani, A. F. Aji, A. Y. Utomo, and K. M. Junus. 2013. An empirical study of gamification impact on e-Learning environment. In Proceedings of 2013 3rd International Conference on Computer Science and Network Technology. 265--269.

[2]

Paul E. Anderson, Thomas Nash, and Renée McCauley. 2015. Facilitating Programming Success in Data Science Courses Through Gamified Scaffolding and Learn2Mine. In Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE '15). ACM Press, New York, 99--104.

Digital Library

[3]

Yigal Attali and Meirav Arieli-Attali. 2015. Gamification in assessment: Do points affect test performance? Computers & Education 83 (2015), 57--63.

[4]

T. Auvinen, L. Hakulinen, and L. Malmi. 2015. Increasing Students' Awareness of Their Behavior in Online Learning Environments with Visualizations and Achievement Badges. IEEE Transactions on Learning Technologies 8, 3 (July 2015), 261--273.

Digital Library

[5]

Gabriel Barata, Sandra Gama, Joaquim Jorge, and Daniel Gonçalves. 2013. Improving Participation and Learning with Gamification. In Proceedings of the First International Conference on Gameful Design, Research, and Applications (Gamification '13). ACM Press, New York, 10--17.

Digital Library

[6]

Kevin Browne and Christopher Anand. 2013. Gamification and Serious Game Approaches for Introductory Computer Science Tablet Software. In Proceedings of the First International Conference on Gameful Design, Research, and Applications (Gamification '13). ACM Press, New York, 50--57.

Digital Library

[7]

Achilleas L. D. Buisman and Marko C. J. D. van Eekelen. 2014. Gamification in Educational Software Development. In Proceedings of the Computer Science Education Research Conference (CSERC '14). ACM Press, New York, 9--20.

Digital Library

[8]

Luis de Marcos, AdriÃąn Domínguez, Joseba Saenz de Navarrete, and Carmen Pagés. 2014. An empirical study comparing gamification and social networking on e-learning. Computers & Education 75 (2014), 82--91.

[9]

Simone de Sousa Borges, Vinicius H. S. Durelli, Helena Macedo Reis, and Seiji Isotani. 2014. A Systematic Mapping on Gamification Applied to Education. In Proceedings of the 29th Annual ACM Symposium on Applied Computing (SAC '14). ACM Press, New York, 216--222.

Digital Library

[10]

Paul Denny. 2013. The Effect of Virtual Achievements on Student Engagement. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM Press, New York, 763--772.

Digital Library

[11]

S. Deterding, M. Sicart, L. Nacke, K. O'Hara, and D. Dixon. 2011. Gamification. Using Game-design Elements in Non-gaming Contexts. In CHI '11 Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York, 2425--2428.

Digital Library

[12]

Darina Dicheva, Christo Dichev, Gennady Agre, and Galia Angelova. 2015. Gamification in Education: A Systematic Mapping Study. Journal of Educational Technology & Society 18, 3 (2015), 75--88.

[13]

Usef Faghihi, Albert Brautigam, Kris Jorgenson, David Martin, Angela Brown, Elizabeth Measures, and Sioui Maldonado-Bouchard. 2014. How Gamification Applies for Educational Purpose Specially with College Algebra. Procedia Computer Science 41 (2014), 182 -- 187.

[14]

Michael Filsecker and Daniel Thomas Hickey. 2014. A multilevel analysis of the effects of external rewards on elementary students' motivation, engagement and learning in an educational game. Computers & Education 75 (2014), 136--148.

[15]

L. Hakulinen, T. Auvinen, and A. Korhonen. 2013. Empirical Study on the Effect of Achievement Badges in TRAKLA2 Online Learning Environment. In 2013 Learning and Teaching in Computing and Engineering. 47--54.

Digital Library

[16]

Michael D. Hanus and Jesse Fox. 2015. Assessing the Effects of Gamification in the Classroom. Computers & Education 80 (Jan. 2015), 152--161.

Digital Library

[17]

Marc Hassenzahl. 2008. User Experience (UX): Towards an Experiential Perspective on Product Quality. In Proceedings of the 20th Conference on L'Interaction Homme-Machine (IHM '08). ACM Press, New York, 11--15.

Digital Library

[18]

Paul Hekkert. 2006. Design aesthetics: principles of pleasure in design. Psychology science 48, 2 (2006), 157.

[19]

Khe Foon Hew, Biyun Huang, Kai Wah Samuel Chu, and Dickson K.W. Chiu. 2016. Engaging Asian students through game mechanics: Findings from two experiment studies. Computers & Education 92 (2016), 221 -- 236.

Digital Library

[20]

K. M. Kapp. 2012. The Gamification of Learning and Instruction. John Wiley & Sons, San Francisco.

Digital Library

[21]

Markus Krause, Marc Mogalle, Henning Pohl, and Joseph Jay Williams. 2015. A Playful Game Changer: Fostering Student Retention in Online Education with Social Gamification. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale (L@S '15). ACM Press, New York, 95--102.

Digital Library

[22]

M. Laskowski. 2015. Implementing gamification techniques into university study path - A case study. In 2015 IEEE Global Engineering Education Conference (EDUCON). 582--586.

[23]

Alberto Mora, Daniel Riera, Carina Gonzalez, and Joan Arnedo-Moreno. 2015. A literature review of gamification design frameworks. In Games and virtual worlds for serious applications (VS-Games), 2015 7th international conference on. IEEE, 1--8.

[24]

Siobhan O'Donovan, James Gain, and Patrick Marais. 2013. A Case Study in the Gamification of a University-level Games Development Course. In Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference (SAICSIT '13). ACM Press, New York, 242--251.

Digital Library

[25]

Oscar Pedreira, FÃl'lix García, Nieves Brisaboa, and Mario Piattini. 2015. Gamification in software engineering âĂŞ A systematic mapping. Information and Software Technology 57 (2015), 157--168.

[26]

Lais Z. Pedro, Aparecida M. Z. Lopes, Bruno G. Prates, Julita Vassileva, and Seiji Isotani. 2015. Does Gamification Work for Boys and Girls?: An Exploratory Study with a Virtual Learning Environment. In Proceedings of the 30th Annual ACM Symposium on Applied Computing (SAC '15). ACM Press, New York, 214--219.

Digital Library

[27]

Mariana Peixoto and Carla Silva. 2017. A Gamification Requirements Catalog for Educational Software: Results from a Systematic Literature Review and a Survey with Experts. In Proceedings of the Symposium on Applied Computing (SAC '17). ACM Press, New York, 1108--1113.

Digital Library

[28]

Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic Mapping Studies in Software Engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering (EASE'08). BCS Learning & Development Ltd., Swindon, UK, 68--77.

Digital Library

[29]

Kai Petersen, Sairam Vakkalanka, and Ludwik Kuzniarz. 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology 64 (2015), 1--18.

Digital Library

[30]

Yvonne Rogers, Helen Sharp, and Jenny Preece. 2011. Interaction Design: Beyond Human - Computer Interaction (3rd ed.). Wiley Publishing.

Digital Library

[31]

Jorge Simões, Rebeca Diaz Redondo, and Ana FernÃąndez Vilas. 2013. A social gamification framework for a K-6 learning platform. Computers in Human Behavior 29, 2 (2013), 345--353.

Digital Library

[32]

C-H. Su and C-H. Cheng. 2015. A mobile gamification learning system for improving the learning motivation and achievements. Journal of Computer Assisted Learning 31, 3 (2015), 268--286.

Digital Library

[33]

A. Vaibhav and P. Gupta. 2014. Gamification of MOOCs for increasing user engagement. In 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE). 290--295.

Cited By

Simão CJardim M(2024)Aprendizagem gamificada no ensino fundamental e médio: uma revisão sistemática da literaturaCaderno Pedagógico10.54033/cadpedv21n4-19121:4(e4027)Online publication date: 30-Apr-2024
https://doi.org/10.54033/cadpedv21n4-191
Mohanty SChristopher B P(2024)The Role of Gamification Research in Human Resource Management: A PRISMA Analysis and Future Research DirectionSage Open10.1177/2158244024124315414:2Online publication date: 28-Apr-2024
https://doi.org/10.1177/21582440241243154
Lepe-Salazar FCortés-Álvarez T(2024)Towards an effective methodology for the integral gamification of classesMultimedia Tools and Applications10.1007/s11042-024-19846-wOnline publication date: 18-Jul-2024
https://doi.org/10.1007/s11042-024-19846-w
Show More Cited By

Index Terms

Does gamification matter?: a systematic mapping about the evaluation of gamification in educational environments
1. Applied computing
  1. Education
    1. Distance learning
2. General and reference
  1. Document types
    1. Surveys and overviews

Recommendations

A systematic mapping on gamification applied to education
SAC '14: Proceedings of the 29th Annual ACM Symposium on Applied Computing

Gamification is a term that refers to the use of game elements in non-game contexts with the goal of engaging people in a variety of tasks. There is a growing interest in gamification as well as its applications and implications in the field of ...
On the Pre-Perception of Gamification and Game-Based Learning in Higher Education Students: A Systematic Mapping Study
Background
The fields of gamification and game-based learning are growing and changing quickly, with researchers investigating the use of gamification in education using various methods and in numerous case studies, however, no research investigates the ...
Pre-service teachers’ perception of active learning methodologies in history: Flipped classroom and gamification in an e-learning environment
Abstract
The scientific literature reveals the impact of applying game-based videos and gamification on undergraduates' learning. This work proposes, within an online context, using these educational strategies to make students the active protagonists of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

April 2018

2327 pages

ISBN:9781450351911

DOI:10.1145/3167132

Conference Chairs:
Hisham M. Haddad
Kennesaw State University
,
Roger L. Wainwright
University of Tulsa
,
Richard Chbeir
University of Pau & Pays Adour, France

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Chamada Publica FAPESC/CNPq

Conference

SAC 2018

Sponsor:

SIGAPP

SAC 2018: Symposium on Applied Computing

April 9 - 13, 2018

Pau, France

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25

Sponsor:
sigapp

The 40th ACM/SIGAPP Symposium on Applied Computing

March 31 - April 4, 2025

Catania , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

37
Total Citations
View Citations
1,315
Total Downloads

Downloads (Last 12 months)96
Downloads (Last 6 weeks)5

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Simão CJardim M(2024)Aprendizagem gamificada no ensino fundamental e médio: uma revisão sistemática da literaturaCaderno Pedagógico10.54033/cadpedv21n4-19121:4(e4027)Online publication date: 30-Apr-2024
https://doi.org/10.54033/cadpedv21n4-191
Mohanty SChristopher B P(2024)The Role of Gamification Research in Human Resource Management: A PRISMA Analysis and Future Research DirectionSage Open10.1177/2158244024124315414:2Online publication date: 28-Apr-2024
https://doi.org/10.1177/21582440241243154
Lepe-Salazar FCortés-Álvarez T(2024)Towards an effective methodology for the integral gamification of classesMultimedia Tools and Applications10.1007/s11042-024-19846-wOnline publication date: 18-Jul-2024
https://doi.org/10.1007/s11042-024-19846-w
Karofyllidis SKousalidis GApostolidis HTsiatsos T(2024)Work-in-Progress: Gamified Simulation for Interactive Experiences in LearningSmart Mobile Communication & Artificial Intelligence10.1007/978-3-031-54327-2_25(243-253)Online publication date: 27-Feb-2024
https://doi.org/10.1007/978-3-031-54327-2_25
Albayrak ÖAlbayrak D(2023)Instructor-Related Factors Affecting Game Utilization in Software Engineering EducationHandbook of Research on Decision-Making Capabilities Improvement With Serious Games10.4018/978-1-6684-9166-9.ch007(151-175)Online publication date: 30-Jun-2023
https://doi.org/10.4018/978-1-6684-9166-9.ch007
Tuna A(2023)Gamification as an Assistive Tool for Children With Autism Spectrum DisorderInclusive Phygital Learning Approaches and Strategies for Students With Special Needs10.4018/978-1-6684-8504-0.ch007(151-168)Online publication date: 30-Jun-2023
https://doi.org/10.4018/978-1-6684-8504-0.ch007
Swacha JQueirós RPaiva J(2023)GATUGU: Six Perspectives of Evaluation of Gamified SystemsInformation10.3390/info1402013614:2(136)Online publication date: 19-Feb-2023
https://doi.org/10.3390/info14020136
Zourmpakis AKalogiannakis MPapadakis S(2023)Adaptive Gamification in Science Education: An Analysis of the Impact of Implementation and Adapted Game Elements on Students’ MotivationComputers10.3390/computers1207014312:7(143)Online publication date: 18-Jul-2023
https://doi.org/10.3390/computers12070143
Adetayo AOladipo YAdeleke OOdunewu A(2023)Gamification of Cataloguing and Classification Education in Nigeria Library and Information Science Schools: A Technology-Enhanced ApproachJournal of Education for Library and Information Science10.3138/jelis-2022-002864:4(370-384)Online publication date: 1-Oct-2023
https://doi.org/10.3138/jelis-2022-0028
Widodo PSubandowo MMusyarofah LSlamet JMing D(2023)Interactive gamification-flip-book for developing students' outcomesAdvances in Mobile Learning Educational Research10.25082/AMLER.2023.02.0023:2(754-762)Online publication date: 5-Jul-2023
https://doi.org/10.25082/AMLER.2023.02.002
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten