Testing Robot Challenge: A Serious Game for Testing Learning
Pages 26 - 29
Abstract
Software testing education is becoming increasingly important both in academia and industry. Despite efforts to improve teaching approaches at the university level, many challenges persist for better preparing students for their future careers. In this position paper we present the Testing Robot Challenge tool implementing a serious game designed for motivating the students to practice testing and learn how to write effective unit tests in coverage testing. The game exploits the mechanism of the challenge that students can play against state-of-the-art tools for automated test case generation. It is configurable by teachers, in order to tune the complexity and type of challenges to the specific needs of the students and to the objectives of the course taught. To validate the tool, we performed a preliminary experiment involving 15 students of a Software Engineering course who provided generally positive feedback about it and useful comments for its future improvement.
References
[1]
Filippo Cacciotto, Tommaso Fulcini, Riccardo Coppola, and Luca Ardito. 2021. A Metric Framework for the Gamification of Web and Mobile GUI Testing. In 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 126–129. https://doi.org/10.1109/ICSTW52544.2021.00032
[2]
Sebastian Deterding, Miguel Sicart, Lennart Nacke, Kenton O’Hara, and Dan Dixon. 2011. Gamification. using game-design elements in non-gaming contexts. In CHI ’11. ACM, 2425–2428. isbn:9781450302685 https://doi.org/10.1145/1979742.1979575
[3]
Sebastian Elbaum, Suzette Person, Jon Dokulil, and Matt Jorde. 2007. Bug Hunt: Making Early Software Testing Lessons Engaging and Affordable. In Proceedings of the 29th International Conference on Software Engineering (ICSE ’07). IEEE CS, 688–697. isbn:0769528287 https://doi.org/10.1109/ICSE.2007.23
[4]
Gordon Fraser and Andrea Arcuri. 2014. A Large-Scale Evaluation of Automated Unit Test Generation Using EvoSuite. ACM Trans. Softw. Eng. Methodol., 24, 2 (2014), Article 8, dec, 42 pages. issn:1049-331X https://doi.org/10.1145/2685612
[5]
Gordon Fraser, Alessio Gambi, Marvin Kreis, and José Miguel Rojas. 2019. Gamifying a Software Testing Course with Code Defenders. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE ’19). ACM, 571–577. isbn:9781450358903 https://doi.org/10.1145/3287324.3287471
[6]
Gordon Fraser, Alessio Gambi, and José Miguel Rojas. 2020. Teaching Software Testing with the Code Defenders Testing Game: Experiences and Improvements. In IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 461–464. https://doi.org/10.1109/ICSTW50294.2020.00082
[7]
Félix García, Oscar Pedreira, Mario Piattini, Ana Cerdeira-Pena, and Miguel Penabad. 2017. A framework for gamification in software engineering. Journal of Systems and Software, 132 (2017), 21–40. issn:0164-1212 https://doi.org/10.1016/j.jss.2017.06.021
[8]
Vahid Garousi, Austen Rainer, Per Lauvås, and Andrea Arcuri. 2020. Software-testing education: A systematic literature mapping. Journal of Systems and Software, 165 (2020), 110570. issn:0164-1212 https://doi.org/10.1016/j.jss.2020.110570
[9]
Pedro Henrique Dias Valle, Armando Maciel Toda, Ellen Francine Barbosa, and José Carlos Maldonado. 2017. Educational games: A contribution to software testing education. In 2017 IEEE Frontiers in Education Conference (FIE). 1–8. https://doi.org/10.1109/FIE.2017.8190470
[10]
E.L. Jones. 2001. An experiential approach to incorporating software testing into the computer science curriculum. In 31st Annual Frontiers in Education Conference. 2, F3D–7. https://doi.org/10.1109/FIE.2001.963741
[11]
Beatriz Marín, Tanja E. J. Vos, Monique Snoeck, Ana C. R. Paiva, and Anna Rita Fasolino. 2023. ENACTEST project - European Innovation Alliance for Testing Education. In Proceedings of CAiSE 2023. 3413, CEUR-WS.org, 91–96. https://ceur-ws.org/Vol-3413/paper13.pdf
[12]
Antonio Materazzo, Tommaso Fulcini, Riccardo Coppola, and Marco Torchiano. 2023. Survival of the Tested: Gamified Unit Testing Inspired by Battle Royale. In 2023 IEEE/ACM 7th International Workshop on Games and Software Engineering (GAS). 1–7. https://doi.org/10.1109/GAS59301.2023.00008
[13]
Rebecca Smith, Terry Tang, Joe Warren, and Scott Rixner. 2017. An Automated System for Interactively Learning Software Testing. In Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE ’17). ACM, 98–103. isbn:9781450347044 https://doi.org/10.1145/3059009.3059022
[14]
Philipp Straubinger and Gordon Fraser. 2023. A Survey on What Developers Think About Testing. In 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE). 80–90. https://doi.org/10.1109/ISSRE59848.2023.00075
[15]
Porfirio Tramontana, Beatriz Marín, Ana C. R. Paiva, Alexandra Mendes, Tanja E. J. Vos, Domenico Amalfitano, Felix Cammaerts, Monique Snoeck, and Anna Rita Fasolino. 2024. State of the Practice in Software Testing Teaching in Four European Countries. In 17th IEEE International Conference on Software Testing, Verification and Validation (ICST) 2024. https://doi.org/10.1109/ICST60714.2024.00015
[16]
Wu Wen, Jiahui Sun, Ya Li, Peng Gu, and Jianfeng Xu. 2019. Design and Implementation of Software Test Laboratory Based on Cloud Platform. In 2019 IEEE 19th International Conference on Software Quality, Reliability and Security Companion (QRS-C). 138–144. https://doi.org/10.1109/QRS-C.2019.00039
[17]
Tamara Zivkovic and Miodrag Zivkovic. 2021. Survey of Learning Environments for Software Testing Education. In 7th Conference on the Engineering of Computer Based Systems (ECBS 2021). ACM, Article 7, 9 pages. isbn:9781450390576 https://doi.org/10.1145/3459960.3459971
Index Terms
- Testing Robot Challenge: A Serious Game for Testing Learning
Recommendations
Test Smells Learning by a Gamification Approach
Gamify 2024: Proceedings of the 3rd ACM International Workshop on Gamification in Software Development, Verification, and ValidationThe presence of test smells related to low-quality test cases is a known factor contributing to problems in maintaining both test suites and production code. The need to avoid and fix test smells is becoming more and more popular in the scientific ...
Gamifying a Software Testing Course with Code Defenders
SIGCSE '19: Proceedings of the 50th ACM Technical Symposium on Computer Science EducationSoftware testing is an essential skill for software developers, but it is challenging to get students engaged in this activity. The Code Defenders game addresses this problem by letting students compete over code under test by either introducing faults ("...
GAMFLEW: serious game to teach white-box testing
AbstractSoftware testing plays a fundamental role in software engineering, involving the systematic evaluation of software to identify defects, errors, and vulnerabilities from the early stages of the development process. Education in software testing is ...
Comments
Information & Contributors
Information
Published In
September 2024
37 pages
ISBN:9798400711138
DOI:10.1145/3678869
- General Chairs:
- Riccardo Coppola,
- Luca Ardito,
- Gordon Fraser,
- Maurizio Leotta
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 September 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Funding Sources
- ENACTEST (European innovation alliance for testing education)
Conference
Gamify '24
Sponsor:
Gamify '24: 3rd ACM International Workshop on Gamification in Software Development, Verification, and Validation
September 17, 2024
Vienna, Austria
Upcoming Conference
ISSTA '25
- Sponsor:
- sigsoft
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 127Total Downloads
- Downloads (Last 12 months)127
- Downloads (Last 6 weeks)45
Reflects downloads up to 08 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in