Abstract
Serious games, or else educational games, for programming are considered to have a positive impact on learning programming. Specifically, serious games are considered to motivate students and engage them in playing and learning programming. However, more research is required in order to study their effects in learning programming, as well as their added value in comparison with typical teaching approaches. In this study the effects of teaching programming to lower secondary school students with the serious game CodeCombat and the typical teaching approach are compared. Specifically, fifty-nine students formed an experimental group that was taught programming with CodeCombat and a control group that was taught programming through lecturing and problem solving in Python with a typical programming environment. The study aimed to investigate whether a game like CodeCombat that is based on a text-based real programming language: improves students’ performance in basic programming concepts; brings better learning outcomes in comparison with typical teaching methods; engages students’ interest. Data was collected through a pre and post test, as well as a survey prior the intervention and another one based on the Technology Acceptance Model at the end. It was concluded that the experimental group performed better than the control group, but this difference was not found to be statistically significant. CodeCombat was evaluated positively in terms of its perceived ease of use and usefulness, as well as the attitude towards its use. The results were neutral in terms of students’ behavioral intention to use CodeCombat, but were positive in using serious games for programming in general.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Alves, J. R., & Letouze, P. (2018). The Curriculum Integration of a course of ’Introduction to Programming Logic’with a Serious Game-Colobot. International Journal of Social Science and Humanity, 8(11), 275–280.
Brusilovsky, P., Calabrese, E., Hvorecky, J., Kouchnirenko, A., & Miller, P. (1997). Mini-languages: A way to learn programming principles. Education and Information Technologies, 2(1), 65–83.
Combéfis, S., Beresnevičius, G., & Dagienė, V. (2016). Learning programming through games and contests: Overview, characterisation and discussion. Olympiads in Informatics, 10(1), 39–60. https://doi.org/10.15388/ioi.2016.03
Danks, S., Fraumeni, B., Smrekar, M. (2019). CodeCombat: Implementation Study. Summary Report, February 2019, McREL International. Available from: https://codecombat.com/images/pages/impact/pdf/CodeCombat_ImplementationStudy_Summary.pdf
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 319–339.
Eguíluz, A., Garaizar, P., & Guenaga, M. (2018). An Evaluation of Open Digital Gaming Platforms for Developing Computational Thinking Skills. In Simulation and Gaming. InTech. https://doi.org/10.5772/intechopen.71339
Esper, S., Foster, S. R., & Griswold, W. G. (2013). CodeSpells: embodying the metaphor of wizardry for programming. In Proceedings of the 18th ACM conference on Innovation and technology in computer science education, 249–254.
Esper, S., Foster, S. R., Griswold, W. G., Herrera, C., & Snyder, W. (2014). CodeSpells: bridging educational language features with industry-standard languages. In Proceedings of the 14th Koli calling international conference on computing education research, 5–14.
Giannakoulas, A., & Xinogalos, S. (2020). A Review of Educational Games for Teaching Programming to Primary School Students. In Kalogiannakis, M., & Papadakis, S. (Ed.), Handbook of Research on Tools for Teaching Computational Thinking in P-12 Education (pp. 1–30). IGI Global. https://doi.org/10.4018/978-1-7998-4576-8.ch001.
Giannakoulas, A., Terzopoulos, G., Xinogalos, S., Satrtatzemi, M. (2021). A Proposal for an Educational Game Platform for Teaching Programming to Primary School Students. In: A. Reis et al. (eds) Technology and Innovation in Learning, Teaching and Education. TECH-EDU 2020. Communications in Computer and Information Science, vol 1384. Springer, Cham.Springer Nature Switzerland AG.
Giannakoulas, A., & Xinogalos, S. (2018). A pilot study on the effectiveness and acceptance of an educational game for teaching programming concepts to primary school students. Education and Information Technologies, 23, 2029–2052. https://doi.org/10.1007/s10639-018-9702-x
Gomes, A., & Mendes, A. J. (2007). An environment to improve programming education. In Proceedings of the 2007 international conference on Computer systems and technologies (pp. 1–6).
Kinzie, M. B., & Joseph, D. R. (2008). Gender differences in game activity preferences of middle school children: implications for educational game design. Educational Technology Research and Development, 56(5–6), 643–663. https://doi.org/10.1007/s11423-007-9076-z
Laporte, L., & Zaman, B. (2016). Informing Content-driven Design of Computer Programming Games: a Problems Analysis and a Game Review. In Proceedings of the 9th Nordic Conference on HumanComputer Interaction (p. 10). ACM. https://doi.org/10.1145/2971485.2971499
Malliarakis, C., Satratzemi, M., & Xinogalos, S. (2014a). Designing Educational Games for Computer Programming: A Holistic Framework. Electronic Journal of e-Learning, 12(3), 281–298.
Malliarakis, C., Satratzemi, M., & Xinogalos, S. (2014b). Educational games for teaching computer programming. In Research on e-learning and ICT in Education: Technological, Pedagogical and Instructional Perspectives (pp. 87–98). Springer.
Maloney, J., Resnick, M., Rusk, N., Silverman, B., Eastmond, E. (2010). The Scratch Programming Language and Environment, Transactions on Computing Education, 10, 4, Article 16 (November 2010), 15 pages. https://doi.org/10.1145/1868358.1868363
Maragkos K., & Grigoriadou M. (2005). The dynamics of electronic games in the learning process. A suggestion to address learning difficulties in scheduling tables. 3rd Pan-Hellenic ICT Teachers' Conference "Exploiting Information and Communication Technologies in Teaching Practice", Syros, 13–15 May 2005.
Michael, D. R., & Chen, S. L. (2005). Serious games: Games that educate, train, and inform. Muska & Lipman/Premier-Trade.
Miljanovic, Μ.Α., & Bradbury, J.S. (2018). A Review of Serious Games for Programming. In: Göbel S. et al. (eds) Serious Games. JCSG 2018. Lecture Notes in Computer Science, vol 11243, 2018, Springer, Cham, https://doi.org/10.1007/978-3-030-02762-9_21
Mitchell, A., & Savill-Smith, C. (2004). The use of computer and video games for learning. A review of the literature. Learning and Skills Development Agency.
Mladenović, M., Boljat, I., & Žanko, Ž. (2018). Comparing loops misconceptions in block-based and text-based programming languages at the K-12 level. Education and Information Technologies, 23, 1483–1500. https://doi.org/10.1007/s10639-017-9673-3
Nazry, N., Nazrina, M., & Romano, D. M. (2017). Mood and learning in navigation-based serious games. Computers in Human Behavior, 73, 596–604.
Papadakis S., Kalogiannakis M. (2018) Using Gamification for Supporting an Introductory Programming Course. The Case of ClassCraft in a Secondary Education Classroom. In: Brooks A., Brooks E., Vidakis N. (eds) Interactivity, Game Creation, Design, Learning, and Innovation. ArtsIT 2017, DLI 2017. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 229. Springer, Cham. https://doi.org/10.1007/978-3-319-76908-0_35
Papadakis, S. (2020). Evaluating a game-development approach to teach introductory programming concepts in secondary education. International Journal of Technology Enhanced Learning, 12(2), 127–145. https://doi.org/10.1504/ijtel.2020.106282.
Park, S. Y. (2009). An analysis of the technology acceptance model in Understanding University students’ behavioral intention to use e-learning. Educational Technology & Society, 12(3), 150–162.
Sáez-López, J. M., Román-González, M., & Vázquez-Cano, E. (2016). Visual programming languages integrated across the curriculum in elementary school: A two year case study using “Scratch” in five schools. Computers & Education, 97, 129–141.
Shuhidan, S. M., Hamilton, M., & D’Souza, D. (2011). Understanding novice programmer difficulties via guided learning. ACM, ITiCSE ’11, p. 213–217.
Siegle, D. (2017). Technology: Encouraging creativity and problem solving through coding. Gifted Child Today, 40(2), 117–123.
Vahldick, A., Mendes, A. J., & Marcelino, M. J. (2014). A review of games designed to improve introductory computer programming competencies. In Frontiers in Education Conference (FIE) (pp. 1–7). IEEE. https://doi.org/10.1109/FIE.2014.7044114
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS quarterly, 425–478.
Virvou, M., Katsionis, G., & Manos, K. (2005). Combining Software Games with Education: Evaluation of its Educational Effectiveness. Educational Technology & Society, Journal of International Forum of Educational Technology & Society and IEEE Learning Technology Task Force, 8(2), 54–65.
Weintrop, D., and Wilensky, U. (2017). Comparing Block-Based and Text-Based Programming in High School Computer Science Classrooms. ACM Trans. Comput. Educ. 18, 1, Article 3 (October 2017), 25 pages. https://doi.org/10.1145/3089799
Xinogalos, S. (2016). Designing and deploying programming courses: Strategies, tools, difficulties and pedagogy. Education and Information Technologies, 21(3), 559–588.
Yücel, Y., & Rızvanoğlu, K. (2019). Battling gender stereotypes: A user study of a code-learning game, “Code Combat”, with middle school children. Computers in Human Behavior, 99, 352–365.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kroustalli, C., Xinogalos, S. Studying the effects of teaching programming to lower secondary school students with a serious game: a case study with Python and CodeCombat. Educ Inf Technol 26, 6069–6095 (2021). https://doi.org/10.1007/s10639-021-10596-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-021-10596-y