research-article

Specification-based Test Case Generation with Genetic Algorithm

Authors:

Shaoying LiuAuthors Info & Claims

2019 IEEE Congress on Evolutionary Computation (CEC)

Pages 1382 - 1389

https://doi.org/10.1109/CEC.2019.8790233

Published: 10 June 2019 Publication History

Abstract

As the current specification-based testing (SBT) face some challenges in test case generation for regression testing, we propose a new method for efficient test case generation that combines formal specifications with genetic algorithm (GA). This method mainly reforms formal specifications though GA to generate inputs that can kill as many as possible mutants of the target program under test. For case study, two classic examples are presented to demonstrate the efficiency of this method. The result shows that this method is able to help efficiently generate useful test cases to uncover all the program mutants, which contributes to further maintenance of software.

References

[1]

W Eric Wong, Joseph R Horgan, Saul London, and Hiralal Agrawal. A study of effective regression testing in practice. In Software Reliability Engineering, 1997. Proceedings., The Eighth International Symposium on, pages 264–274. IEEE, 1997.

[2]

Hareton KN Leung and Lee White. Insights into regression testing (software testing). In Software Maintenance, 1989., Proceedings., Conference on, pages 60–69. IEEE, 1989.

[3]

Phil Stocks and David Carrington. A framework for specification-based testing. IEEE Transactions on software Engineering, (11):777–793, 1996.

[4]

Debra Richardson, Owen O’Malley, and Cindy Tittle. Approaches to specification-based testing, volume 14. ACM, 1989.

[5]

Sarfraz Khurshid and Darko Marinov. Testera: Specification-based testing of java programs using sat. Automated Software Engineering, 11(4):403–434, 2004.

Digital Library

[6]

A. J. Offutt and S. Liu. Generating Test Data from SOFL Specifications. Journal of Systems and Software, 49(1):49–62, December 1999.

Digital Library

[7]

Jeremy Dick and Alain Faivre. Automating the generation and sequencing of test cases from model-based specifications. In International Symposium of Formal Methods Europe, pages 268–284. Springer, 1993.

[8]

Cliff B Jones. Systematic software development using VDM, volume 2. Citeseer, 1990.

Digital Library

[9]

Shaoying Liu. Formal Engineering for Industrial Software Development: Using the SOFL Method. Springer Science & Business Media, 2013.

[10]

S. Liu and S. Nakajima. Combining Specification Testing, Correctness Proof, and Inspection for Program Verification in Practice. In Proceedings of the 3rd International Workshop on SOFL + MSVL (SOFL+MSVL 2013), pages 3–16, Queenstown, New Zealand, October 29 2013. LNCS 8332, Springer.

[11]

Koushik Sen. Concolic testing. In Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering, pages 571–572. ACM, 2007.

[12]

Yuji Sato and Taku Sugihara. Automatic generation of specification-based test cases by applying genetic algorithms in reinforcement learning. In International Workshop on Structured Object-Oriented Formal Language and Method, pages 59–71. Springer, 2015.

[13]

Juan Luo, Shaoying Liu, Yanqin Wang, and Tingliang Zhou. Applying sofl to a railway interlocking system in industry. In International Workshop on Structured Object-Oriented Formal Language and Method, pages 160–177. Springer, 2016.

[14]

Roy P Pargas, Mary Jean Harrold, and Robert R Peck. Test-data generation using genetic algorithms. Software testing, verification and reliability, 9(4):263–282, 1999.

[15]

Mark Harman, Yue Jia, and William B Langdon. Strong higher order mutation-based test data generation. In Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering, pages 212–222. ACM, 2011.

[16]

Stuart C Reid. An empirical analysis of equivalence partitioning, boundary value analysis and random testing. In Software Metrics Symposium, 1997. Proceedings., Fourth International, pages 64–73. IEEE, 1997.

[17]

Elaine J. Weyuker. More experience with data flow testing. IEEE transactions on software engineering, 19(9):912–919, 1993.

Digital Library

[18]

Shahid Mahmood. A systematic review of automated test data generation techniques, 2007.

[19]

Eliane Martins, Selma B Sabião, and Ana Maria Ambrosio. Condata: a tool for automating specification-based test case generation for communication systems. Software Quality Journal, 8(4):303–320, 1999.

Digital Library

[20]

Y. Chen, S. Liu, and F. Nagoya. An Approach to Integration Testing Based on Data Flow Specifications. In Proceedings of First International Colloquium on Theoretical Aspects of Computing, LNCS, pages 235–249, Guiyiang, China, September 20-24 2004. Springer-Verlag.

[21]

Vadim Okun. Specification mutation for test generation and analysis. PhD thesis, Citeseer, 2004.

Digital Library

[22]

John Henry Holland. Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. MIT press, 1992.

[23]

Richard A DeMillo, Richard J Lipton, and Frederick G Sayward. Hints on test data selection: Help for the practicing programmer. Computer, 11(4):34–41, 1978.

Digital Library

[24]

S. Liu. Formal Engineering for Industrial Software Development Using the SOFL Method. Springer-Verlag, ISBN 3-540-20602-7, 2004.

Cited By

Sugai KHosobe HLiu S(2021)SMT-Based Theorem Verification for Testing-Based Formal VerificationProceedings of the 2021 10th International Conference on Software and Computer Applications10.1145/3457784.3457823(251-257)Online publication date: 23-Feb-2021
https://dl.acm.org/doi/10.1145/3457784.3457823

Index Terms

Specification-based Test Case Generation with Genetic Algorithm

Index terms have been assigned to the content through auto-classification.

Recommendations

Refinement and Test Case Generation in UTP

This paper presents a theory of testing that integrates into Hoare and He's Unifying Theory of Programming (UTP). We give test cases a denotational semantics by viewing them as specification predicates. This reformulation of test cases allows for ...
Test Case Prioritization Technique Based on Genetic Algorithm
ICICIS '11: Proceedings of the 2011 International Conference on Internet Computing and Information Services

With the rapid development of information technology, software testing, as a software quality assurance, is becoming more and more important. In the software life cycle, each time the code has changed need to be regression testing. The huge test case ...
Efficient Software Test Case Generation Using Genetic Algorithm Based Graph Theory
ICETET '08: Proceedings of the 2008 First International Conference on Emerging Trends in Engineering and Technology

In orthodox software testing approach we generally use modeling based testing approach for generating the test cases of a given problem. This leads to confusion of the test input and the expected output for a given test case. More over we also can miss ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

2019 IEEE Congress on Evolutionary Computation (CEC)

Jun 2019

3404 pages

Copyright © 2019.

Publisher

IEEE Press

Publication History

Published: 10 June 2019

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sugai KHosobe HLiu S(2021)SMT-Based Theorem Verification for Testing-Based Formal VerificationProceedings of the 2021 10th International Conference on Software and Computer Applications10.1145/3457784.3457823(251-257)Online publication date: 23-Feb-2021
https://dl.acm.org/doi/10.1145/3457784.3457823

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents