Abstract
Software regression testing occurs continuously during the software development process in order to detect faults as early as possible. Growing size of test suites on one hand and resource constraints on the other hand, necessitates the test case prioritization process. Test case prioritization techniques schedule test cases for regression testing in an order that increases the chances of early detection of faults. Some prior techniques used the notion of history-based test case prioritization. In this paper, we present a new approach for prioritization using historical test case performance data which considers time and resource constraints. This approach directly calculates the priority of each test case using historical information from the previous executions of the test case. The results of applying our approach to Siemens suite and Space program are also presented. Our results present interesting insights into the effectiveness of the proposed approach in terms of faster fault detection.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Mirarab, S.: A Bayesian Framework for Software Regression Testing. Master of applied science thesis, Waterloo, Ontario, Canadia (2008)
Burnstein, I.: Practical software testing: a process-oriented approach. Springer, New York (2003)
Rothermel, G., Untch, R.H., Chu, C., Harrold, M.J.: Test case prioritization: an empirical study. In: Proc. IEEE Int. Conf. on Software Maintenanc, Oxford, England, pp. 179–188 (1999)
Rothermel, G., Harrold, M.J.: A Safe, Efficient Regression Test Selection Technique. Proc. ACM Transactions on Software Engineering & Methodology 6(2), 173–210 (1997)
Rothermel, G., Untch, R.H., Chu, C., Harrold, M.J.: Prioritizing Test Cases for Regression Testing. Proc. IEEE Transactions on Software Engineering, 102–112 (2001)
Li, Z., Harmanand, M., Hierons, R.: Search Algorithms for Regression Test Case Prioritization. Proc. IEEE Transactions on Software Engineering 33, 225–237 (2007)
Kim, J.M., Porter, A.: A History-Based Test Prioritization Technique for Regression Testing in Resource Constrained Environment. In: Proc. 24th Int’l. Conf. Software Engineering, pp. 119–129 (2002)
Wong, W.E., Horgan, J.R., Londonm, S., Agrawal, H.: A study of effective regression testing in practice. In: Proc. 8th Int’l. Symp. Software Reliability Engineering, pp. 230–238 (1997)
Malishevsky, G., Elbaum, S., Rothermel, G., Kanduri, S.: Selecting a Cost-Effective Test Case Prioritization Technique. In: Proc. Software Quality Control, vol. 12, pp. 185–210 (2004)
Malishevsky, G., Ruthruff, J.R., Rothermel, G., Elbaum, S.: Cost-cognizant test case prioritization. Tech. Rep. Department of Computer Science and Engineering, Nebraska, Lincoln, TR-UNL-CSE-2006-0004 (March 2006)
Srivastava, P.R.: Test Case prioritization. Journal of Theoretical and Applied Information Technology (JATIT), BITS Pilani, India-333031
Korel, B., Koutsogiannakis, G., Tahat, L.H.: Model-based test prioritization heuristic methods and their evaluation. In: Proc. 3rd Int’l. Workshop on Advances in Model-Based Testing, London, UK (July 2007)
Elbaum, S., Malishevsky, A.G., Rothermel, G.: Prioritizing test cases for regression testing. In: Proc. 7th Int’l. Syrup. Software Testing and Analysis, August 2000, pp. 102–112 (2000)
Elbaum, S., Malishevsky, A.G., Rothermel, G.: Test Case Prioritization: A Family of Empirical Studies. Proc. IEEE Transactions on Software Engineering 28(2), 159–182 (2002)
Park, H., Ryu, H., Baik, J.: Historical Value-Based Approach for Cost-Cognizant Test Case Prioritization to Improve the Effectiveness of Regression Testing. In: 2nd Int’l. Conf. Secure System Integration and Reliability Improvement, Japan, pp. 39–46 (to appear, 2008)
Elbaum, S., Malishevsky, A.G., Rothermel, G.: Incorporating varying test costs and fault severities into test case prioritization. In: Proc. 23rd Int. Conf. on Software Engineering, Toronto, Ontario, Canada. IEEE Computer Society, Los Alamitos (2001)
Rothermel, G., Elbaum, S., Kinneer, A., Do, H.: Software-artifact infrastructure repository, http://www.c-se.unl.edu/~galileo/sir
SAS 9.1.3 Documentation, SAS/GRAPH 9.1 Reference, http://support.sas.com/documentation/onlinedoc/91pdf/index_913.html
Jeffrey, D., Gupta, N.: Improving Fault Detection Capability by Selectively Retaining Test Cases during Test Suite Reduction. Source IEEE Transactions on Software Engineering archive, 108–123 (2007)
Horgan, J.R., London, S.A.: ATAC: A Data Flow Coverage Testing Tool for C. In: Proc. Symp. Assessment of Quality Software Development Tools, May 1992, pp. 2–10 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fazlalizadeh, Y., Khalilian, A., Abdollahi Azgomi, M., Parsa, S. (2009). Incorporating Historical Test Case Performance Data and Resource Constraints into Test Case Prioritization. In: Dubois, C. (eds) Tests and Proofs. TAP 2009. Lecture Notes in Computer Science, vol 5668. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02949-3_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-02949-3_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02948-6
Online ISBN: 978-3-642-02949-3
eBook Packages: Computer ScienceComputer Science (R0)