Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1109/ICSE.2009.5070541acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
Article

MINTS: A general framework and tool for supporting test-suite minimization

Published: 16 May 2009 Publication History

Abstract

Test-suite minimization techniques aim to eliminate redundant test cases from a test-suite based on some criteria, such as coverage or fault-detection capability. Most existing test-suite minimization techniques have two main limitations: they perform minimization based on a single criterion and produce suboptimal solutions. In this paper, we propose a test-suite minimization framework that overcomes these limitations by allowing testers to (1) easily encode a wide spectrum of test-suite minimization problems, (2) handle problems that involve any number of criteria, and (3) compute optimal solutions by leveraging modern integer linear programming solvers. We implemented our framework in a tool, called MINTS, that is freely-available and can be interfaced with a number of different state-of-the-art solvers. Our empirical evaluation shows that MINTS can be used to instantiate a number of different test-suite minimization problems and efficiently find an optimal solution for such problems using different solvers.

References

[1]
H. Agrawal. Efficient coverage testing using global dominator graphs. In Proceedings of PASTE 99, pages 11-20, 1999.
[2]
P. Barth. A Davis-Putnam based enumeration algorithm for linear pseudo-Boolean optimization. Research Report MPI-I-95-2-003, Max-Planck-Institut für Informatik, January 1995.
[3]
D. L. Berre and A. Parrain. On extending SAT solvers for PB problems. In RCRA Workshop on Experimental Evaluation of Algorithms for Solving Problems with Combinatorial Explosion, July 2007.
[4]
J. Black, E. Melachrinoudis, and D. Kaeli. Bi-criteria models for all-uses test suite reduction. In ICSE 04, pages 106-115, May 2004.
[5]
V. Chavatal. A greedy heuristic for the set-covering problem. Mathematics of Operations Research, 4(3), Agust 1979.
[6]
T. H. Cormen, C. Stein, R. L. Rivest, and C. E. Leiserson. Introduction to Algorithms. The MIT Press, Cambridge, Massachusetts, 2001.
[7]
M. J. Harrold, R. Gupta, and M. L. Soffa. A methodology for controlling the size of a test suite. ACM TOSEM, 2(3):270-285, July 1993.
[8]
D. Jeffrey and N. Gupta. Improving fault detection capability by selectively retaining test cases during test suite reduction. IEEE TSE, 33(2):108-123, 2007.
[9]
J.-M. Kim and A. Porter. A history-based test prioritization technique for regression testing in resource constrained environments. In ICSE 02, pages 119-129, 2002.
[10]
H. K. N. Leung and L. J. White. A cost model to compare regression test strategies. In ICSM 91, pages 201-208, October 1991.
[11]
M. Marre and A. Bertolino. Using spanning set for coverage testing. IEEE TSE, 29(11):974-984, November 2003.
[12]
Pseudo-boolean evaluation 2007. http://www.cril. univ-artois.fr/PB07/, 2007.
[13]
G. Rothermel and M. J. Harrold. A safe, efficient regression test selection technique. ACM TOSEM, 6(2):173-210, April 1997.
[14]
G. Rothermel, M. J. Harrold, J. Ostrin, and C. Hong. An empirical study of the effects of minimization on the fault-detection capabilities of test suites. In ICSM 98, pages 34-43, November 1998.
[15]
G. Rothermel, R. H. Untch, C. Chu, and M. J. Harrold. Test Case Prioritization. IEEE TSE, 27(10):929-948, October 2001.
[16]
A. Srivastava and J. Thiagarajan. Effectively prioritizing tests in development environment. In ISSTA 02, pages 97-106, July 2002.
[17]
S. Tallam and N. Gupta. A concept analysis inspired greedy algorithm for test suite minimization. In PASTE 05, pages 35-42, September 2005.
[18]
F. Vokolos and P. Frankl. Pythia: A regression test selection tool based on text differencing. In Int'l Conf on Reliability, Quality and Safety of Software-intensive Systems, pages 3-21, May 1997.
[19]
H. P. Williams. Model Building in Mathematical Programming. John Wiley, 1993.
[20]
W. E. Wong, J. R. Horgan, S. London, and A. P. Mathur. Effect of test set minimization on fault detection effectiveness. In ICSE 95, pages 41-50, April 1995.

Cited By

View all
  • (2024)Resource Usage and Optimization Opportunities in Workflows of GitHub ActionsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3623303(1-12)Online publication date: 20-May-2024
  • (2024)ATSMJournal of Software: Evolution and Process10.1002/smr.262136:6Online publication date: 5-Jun-2024
  • (2022)Putting them under microscope: a fine-grained approach for detecting redundant test cases in natural languageProceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3540250.3549089(1161-1172)Online publication date: 7-Nov-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICSE '09: Proceedings of the 31st International Conference on Software Engineering
May 2009
643 pages
ISBN:9781424434534

Sponsors

Publisher

IEEE Computer Society

United States

Publication History

Published: 16 May 2009

Check for updates

Qualifiers

  • Article

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 25 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Resource Usage and Optimization Opportunities in Workflows of GitHub ActionsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3623303(1-12)Online publication date: 20-May-2024
  • (2024)ATSMJournal of Software: Evolution and Process10.1002/smr.262136:6Online publication date: 5-Jun-2024
  • (2022)Putting them under microscope: a fine-grained approach for detecting redundant test cases in natural languageProceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3540250.3549089(1161-1172)Online publication date: 7-Nov-2022
  • (2021)Seed selection for successful fuzzingProceedings of the 30th ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3460319.3464795(230-243)Online publication date: 11-Jul-2021
  • (2020)Multi-objective Integer Programming Approaches for Solving the Multi-criteria Test-suite Minimization ProblemACM Transactions on Software Engineering and Methodology10.1145/339203129:3(1-50)Online publication date: 1-Jun-2020
  • (2020)HeteroRefactorProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380340(493-505)Online publication date: 27-Jun-2020
  • (2020)Revisiting the relationship between fault detection, test adequacy criteria, and test set sizeProceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering10.1145/3324884.3416667(237-249)Online publication date: 21-Dec-2020
  • (2018)Test case prioritization for acceptance testing of cyber physical systems: a multi-objective search-based approachProceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3213846.3213852(49-60)Online publication date: 12-Jul-2018
  • (2018)Practical selective regression testing with effective redundancy in interleaved testsProceedings of the 40th International Conference on Software Engineering: Software Engineering in Practice10.1145/3183519.3183532(153-162)Online publication date: 27-May-2018
  • (2018)NemoProceedings of the 40th International Conference on Software Engineering10.1145/3180155.3180174(1039-1049)Online publication date: 27-May-2018
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media