research-article

Practical semantic test simplification

Author:

Sai ZhangAuthors Info & Claims

ICSE '13: Proceedings of the 2013 International Conference on Software Engineering

Pages 1173 - 1176

Published: 18 May 2013 Publication History

Get Access

Abstract

We present a technique that simplifies tests at the semantic level. We first formalize the semantic test simplification problem, and prove it is NP-hard. Then, we propose a heuristic algorithm, SimpleTest, that automatically transforms a test into a simpler test, while still preserving a given property. The key insight of SimpleTest is to reconstruct an executable and simpler test that exhibits the given property from the original one. Our preliminary study on 7 real-world programs showed the usefulness of SimpleTest.

References

[1]

H. Agrawal and J. R. Horgan. Dynamic program slicing. In PLDI, pages 246–256, 1990.

Digital Library

Google Scholar

[2]

J. Kleinberg. Algorithm Design. Pearson Education, 2006.

Digital Library

Google Scholar

[3]

Y. Lei and J. H. Andrews. Minimization of randomized unit test cases. In ISSRE, pages 267–276, 2005.

Digital Library

Google Scholar

[4]

A. Leitner, M. Oriol, A. Zeller, I. Ciupa, and B. Meyer. Efficient unit test case minimization. In ASE, 2007.

Digital Library

Google Scholar

[5]

C. Pacheco, S. K. Lahiri, M. D. Ernst, and T. Ball. Feedback-directed random test generation. In ICSE ’07, pages 75–84.

Digital Library

Google Scholar

[6]

J. Regehr, Y. Chen, P. Cuoq, E. Eide, C. Ellison, and X. Yang. Test-case reduction for c compiler bugs. In PLDI, 2012.

Digital Library

Google Scholar

[7]

M. Weiser. Program slicing. In ICSE, 1981.

Digital Library

Google Scholar

[8]

A. Zeller and R. Hildebrandt. Simplifying and isolating failure-inducing input. TSE, 28:183–200, February 2002.

Digital Library

Google Scholar

[9]

S. Zhang, Y. Lin, Z. Gu, and J. Zhao. Effective identification of failureinducing changes: a hybrid approach. In PASTE, 2008.

Digital Library

Google Scholar

[10]

S. Zhang, D. Saff, Y. Bu, and M. D.Ernst. Combined static and dynamic automated test generation. In ISSTA’ 2011.

Digital Library

Google Scholar

[11]

S. Zhang, C. Zhang, and M. D. Ernst. Automated documentation inference to explain failed tests. In Proc. ASE ’11.

Google Scholar

Cited By

View all

Groce AFlikkema PHolmes JYu TMarinov D(2017)Towards automated composition of heterogeneous tests for cyber-physical systemsProceedings of the 1st ACM SIGSOFT International Workshop on Testing Embedded and Cyber-Physical Systems10.1145/3107091.3107094(12-15)Online publication date: 13-Jul-2017
https://dl.acm.org/doi/10.1145/3107091.3107094
Holmes JGroce ABultan TSen K(2017)A suite of tools for making effective use of automatically generated testsProceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3092703.3098220(356-359)Online publication date: 10-Jul-2017
https://dl.acm.org/doi/10.1145/3092703.3098220
Groce AHolmes JKellar KBultan TSen K(2017)One test to rule them allProceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3092703.3092704(1-11)Online publication date: 10-Jul-2017
https://dl.acm.org/doi/10.1145/3092703.3092704
Show More Cited By

Index Terms

Practical semantic test simplification
1. General and reference
  1. Cross-computing tools and techniques
    1. Metrics
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

A semantic framework for test coverage
ATVA'06: Proceedings of the 4th international conference on Automated Technology for Verification and Analysis

Since testing is inherently incomplete, test selection has vital importance. Coverage measures evaluate the quality of a test suite and help the tester select test cases with maximal impact at minimum cost. Existing coverage criteria for test suites are ...
Fine-grained test minimization
ICSE '18: Proceedings of the 40th International Conference on Software Engineering

As a software system evolves, its test suite can accumulate redundancies over time. Test minimization aims at removing redundant test cases. However, current techniques remove whole test cases from the test suite using test adequacy criteria, such as ...
Optimizing test prioritization via test distribution analysis
ESEC/FSE 2018: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Test prioritization aims to detect regression faults faster via reordering test executions, and a large number of test prioritization techniques have been proposed accordingly. However, test prioritization effectiveness is usually measured in terms of ...

Comments

Information & Contributors

Information

Published In

ICSE '13: Proceedings of the 2013 International Conference on Software Engineering

May 2013

1561 pages

ISBN:9781467330763

General Chair:
David Notkin,
Program Chairs:
Betty H. C. Cheng,
Klaus Pohl

Publisher

IEEE Press

Publication History

Published: 18 May 2013

Check for updates

Qualifiers

Research-article

Conference

ICSE '13

Sponsor:

SIGSOFT

ICSE '13: 35th International Conference on Software Engineering

May 18 - 26, 2013

CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
138
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Groce AFlikkema PHolmes JYu TMarinov D(2017)Towards automated composition of heterogeneous tests for cyber-physical systemsProceedings of the 1st ACM SIGSOFT International Workshop on Testing Embedded and Cyber-Physical Systems10.1145/3107091.3107094(12-15)Online publication date: 13-Jul-2017
https://dl.acm.org/doi/10.1145/3107091.3107094
Holmes JGroce ABultan TSen K(2017)A suite of tools for making effective use of automatically generated testsProceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3092703.3098220(356-359)Online publication date: 10-Jul-2017
https://dl.acm.org/doi/10.1145/3092703.3098220
Groce AHolmes JKellar KBultan TSen K(2017)One test to rule them allProceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3092703.3092704(1-11)Online publication date: 10-Jul-2017
https://dl.acm.org/doi/10.1145/3092703.3092704
Wang JZimmermann TCleland-Huang JSu Z(2016)Constraint-based event trace reductionProceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering10.1145/2950290.2983964(1106-1108)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1145/2950290.2983964
Daka ECampos JFraser GDorn JWeimer WDi Nitto EHarman MHeymans P(2015)Modeling readability to improve unit testsProceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering10.1145/2786805.2786838(107-118)Online publication date: 30-Aug-2015
https://dl.acm.org/doi/10.1145/2786805.2786838
Guo HQiu Z(2015)A dynamic stochastic model for automatic grammar-based test generationSoftware—Practice & Experience10.1002/spe.227845:11(1519-1547)Online publication date: 1-Nov-2015
https://dl.acm.org/doi/10.1002/spe.2278
Zhang SErnst MJalote PBriand LHoek A(2014)Which configuration option should I change?Proceedings of the 36th International Conference on Software Engineering10.1145/2568225.2568251(152-163)Online publication date: 31-May-2014
https://dl.acm.org/doi/10.1145/2568225.2568251
Zhang LZhang LKhurshid S(2013)Injecting mechanical faults to localize developer faults for evolving softwareACM SIGPLAN Notices10.1145/2544173.250955148:10(765-784)Online publication date: 29-Oct-2013
https://dl.acm.org/doi/10.1145/2544173.2509551
Zhang LZhang LKhurshid SHosking AEugster PLopes C(2013)Injecting mechanical faults to localize developer faults for evolving softwareProceedings of the 2013 ACM SIGPLAN international conference on Object oriented programming systems languages & applications10.1145/2509136.2509551(765-784)Online publication date: 29-Oct-2013
https://dl.acm.org/doi/10.1145/2509136.2509551
Zhang SLü HErnst MPezzè MHarman M(2013)Automatically repairing broken workflows for evolving GUI applicationsProceedings of the 2013 International Symposium on Software Testing and Analysis10.1145/2483760.2483775(45-55)Online publication date: 15-Jul-2013
https://dl.acm.org/doi/10.1145/2483760.2483775
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A semantic framework for test coverage

Fine-grained test minimization

Optimizing test prioritization via test distribution analysis