Abstract
Automated test execution scheduling is crucial in modern software development environments, where components are frequently updated with changes that impact their integration with hardware systems. Building test schedules, which focus on the right tests and make optimal use of the available resources, both time and hardware, under consideration of vast requirements on the selection of test cases and their assignment to certain test execution machines, is a complex optimization task. Manual solutions are time-consuming and often error-prone. Furthermore, when software and hardware components and test scripts are frequently added, removed or updated, static test execution scheduling is no longer feasible and the motivation for automation taking care of dynamic changes grows. Since 2012, our work has focused on transferring technology based on constraint programming for automating the testing of industrial robotic systems at ABB Robotics. After having successfully transferred constraint satisfaction models dedicated to test case generation, we present the results of a project called DynTest whose goal is to automate the scheduling of test execution from a large test repository, on distinct industrial robots. This paper reports on our experience and lessons learned for successfully transferring constraint-based optimization models for test execution scheduling at ABB Robotics. Our experience underlines the benefits of a close collaboration between industry and academia for both parties.
List of authors is given in alphabetical order.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Constraint Programming is a declarative programming framework which uses relations among logical variables and search procedures to find solutions of combinatorial problems [7].
References
Bartak, R., Salido, M.A., Rossi, F.: Constraint satisfaction techniques in planning and scheduling. J. Intell. Manuf. 21(1), 5–15 (2010)
Gotlieb, A., Marijan, D., Spieker, H.: Testing Industrial Robotic Systems: A New Battlefield! In: Software Engineering for Robotics, pp. 109–137. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-66494-7_4
Klotins, E., Gorschek, T., Sundelin, K., Falk, E.: Towards cost-benefit evaluation for continuous software engineering activities. Empir. Soft. Eng. 27, 157(2022) https://doi.org/10.1007/s10664-022-10191-w
Mossige, M., Gotlieb, A., Meling, H.: Using CP in Automatic Test Generation for ABB Robotics’ Paint Control System. In: O’Sullivan, B. (ed.) CP 2014. LNCS, vol. 8656, pp. 25–41. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10428-7_6
Mossige, M., Gotlieb, A., Meling, H.: Testing robot controllers using constraint programming and continuous integration. Inf. Softw. Technol. 57, 169–185 (2015)
Mossige, M., Gotlieb, A., Spieker, H., Meling, H., Carlsson, M.: Time-aware test case execution scheduling for cyber-physical systems. In: Principles and Practice of Constraint Programming (CP). Springer LNCS, vol. 10416 (2017)
Rossi, F., Beek, P.V., Walsh, T.: Handbook of Constraint Programming (Foundations of Artificial Intelligence). Elsevier Science Inc. (2006)
Spieker, H., Gotlieb, A., Marijan, D., Mossige, M.: Reinforcement learning for automatic test case prioritization and selection in continuous integration. In: Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis(ISSTA). pp. 12–22 (2017)
Spieker, H., Gotlieb, A., Mossige, M.: Rotational diversity in multi-cycle assignment problems. In: Proceedings of the AAAI Conference on Artificial Intelligence. pp. 7724–7731 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Gotlieb, A., Mossige, M., Spieker, H. (2023). Constraint-Guided Test Execution Scheduling: An Experience Report at ABB Robotics. In: Guiochet, J., Tonetta, S., Bitsch, F. (eds) Computer Safety, Reliability, and Security. SAFECOMP 2023. Lecture Notes in Computer Science, vol 14181. Springer, Cham. https://doi.org/10.1007/978-3-031-40923-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-40923-3_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-40922-6
Online ISBN: 978-3-031-40923-3
eBook Packages: Computer ScienceComputer Science (R0)