Article

Free access

Automated program flaw finding using simulated annealing

Authors:

Keith ManderAuthors Info & Claims

ISSTA '98: Proceedings of the 1998 ACM SIGSOFT international symposium on Software testing and analysis

Pages 73 - 81

https://doi.org/10.1145/271771.271792

Published: 01 March 1998 Publication History

Abstract

One of the major costs in a software project is the construction of test-data. This paper outlines a generalised test-case data generation framework based on optimisation techniques. The framework can incorporate a number of testing criteria, for both functional and non-functional properties. Application of the optimisation framework to testing specification failures and exception conditions is illustrated. The results of a number of small case studies are presented and show the efficiency and effectiveness of this dynamic optimisation-base approach to generating test-data.

References

[1]

E. H~ L. Aarts and J. Korst. Simulated Aneealing and Boltzmann Machines. Wiley, 1988.

[2]

J. Barnes. High Integrity Ada: The 'SPARK Approach. Addison-Wesley, 1997.

[3]

B. Beizer. Software Testing Techniques. Thomson Computer Press, 2nd edition, 1990.

Digital Library

[4]

J. Clark and N. Tracey. Solving constraints in law 22117. Law/d5.1.1(e), European Commission - DG HI Industry, 1997. Legacey Assessment Worbence Feasibility Assessment.

[5]

L. Clarke. A system to generate test data and symbolically execute programs. IEEE Transactions on Software Engineering, SE-2(3):215-222, September 1976.

Digital Library

[6]

R. Demillo and A. Offutt. Constraint-based automatic test data generation. IEEE Transactions on Software Engineering, 17(9)~900-910, 1991.

Digital Library

[7]

K. A. Dowsland. Modem Heuristic Techniques for Combinatorial Problems, chfipter 2 - Simulated Annealing, pages .20-69. McGraw Hill, 1993.

Digital Library

[8]

F. Glover and M. Laguna'. Modem Heuristic Techniques for Combinatorial Problems, chapter 3- Tabu Search, pages 70- 150. McGraw Hill, 1993.

Digital Library

[9]

D- B. Goldberg. Genetic Algorithms in Search, Optimisation and Machine Learing. Addison-Wesley, 1989.

Digital Library

[10]

B. Jones, H. Sthamer, and D. Eyres. Automatic structural testing using genetic algorithms. Software Engineering Journal, 11(5):299-306, 1996.

[11]

S. Kirkpatrick, J. C. D. Gelatt, and M. P. Vecchi. Optimization by simulated annealing. Science, 220(4598):671--680, May 1983.

[12]

B. Korel. Automated software test data generation. IEEE ransactions oti Software Engineering, 16(8):870-879, 1990.

Digital Library

[13]

B. Korel. Automated test data generation for programs with procedures. ACM I¿TA, pages 209-215, 1996.

Digital Library

[14]

N. Metropolis, A. W. Rosenbluth, A. H. Teller, and E. Teller. Equation of state calculation by fast computing machine. Journal of Chem. Phys., 21:1087-1091, 1953.

[15]

W. Miller and D. Spooner. Automatic generation of floatingpoint test data. IEEE Transactions on Software Engineering, SE-2(3):223-226, September 1976.

Digital Library

[16]

A.J. Offutt and J. Pan. The dynamic domain reduction procedure for test data generation. http://www, isse. gmu. edu/faculty/ofut/rsrch/atdg, htrnl, 1996.

Digital Library

[17]

M. Duld. Tesintg - a challenge to method and tool developers. Software Engineering Journal, 6(2):59---64, March 1991.

Digital Library

[18]

Praxis Critical Systems.'$park-Ada Documentation 2.0,1995.

[19]

V. J. Rayward-Smith, I. H. Osman, C. R. Reeves, and G. D. Smith, editors. Modern Heuristic Search Methods. Wiley, 1996.

[20]

N. Trace), J. Clark, and K. Mander. The way forward for unifying dynamic test case generation: The optimisation-based approach. In Dependable Computing and Its Applications- To appear. IFIP, 1998.'

[21]

N. J. Tracey. Test-case data generation using optimisation techniques - first year dphil report. Department of Computer Science, University of York, 1997.

[22]

X. Yang. The automatic generation of software test data from z specifications. Technical report, Department of Computer Studies, University of Glamorgan, 1995.

Cited By

Gopi PRamalingam MArumugam C(2016)Search Based Test Data GenerationProceedings of the 9th Annual ACM India Conference10.1145/2998476.2998492(137-140)Online publication date: 21-Oct-2016
https://dl.acm.org/doi/10.1145/2998476.2998492
Baluda MDenaro GPezze M(2016)Bidirectional Symbolic Analysis for Effective Branch TestingIEEE Transactions on Software Engineering10.1109/TSE.2015.249006742:5(403-426)Online publication date: 1-May-2016
https://doi.org/10.1109/TSE.2015.2490067
Bohme MPaul S(2016)A Probabilistic Analysis of the Efficiency of Automated Software TestingIEEE Transactions on Software Engineering10.1109/TSE.2015.248727442:4(345-360)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1109/TSE.2015.2487274
Show More Cited By

Index Terms

Automated program flaw finding using simulated annealing

Recommendations

Automated program flaw finding using simulated annealing

One of the major costs in a software project is the construction of test-data. This paper outlines a generalised test-case data generation framework based on optimisation techniques. The framework can incorporate a number of testing criteria, for both ...
Data Generation for Path Testing

We present two stochastic search algorithms for generating test cases that execute specified paths in a program. The two algorithms are: a simulated annealing algorithm (SA), and a genetic algorithm (GA). These algorithms are based on an optimization ...
Diversity oriented test data generation using metaheuristic search techniques

We present a new test data generation technique which uses the concept of diversity of test sets as a basis for the diversity oriented test data generation - DOTG. Using DOTG we translate into an automatic test data generation technique the intuitive ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ISSTA '98: Proceedings of the 1998 ACM SIGSOFT international symposium on Software testing and analysis

March 1998

170 pages

ISBN:0897919718

DOI:10.1145/271771

Chairmen:
Mary Lou Soffa
Univ. of Pittsburgh, PA
,
Michal Young
Univ. of Oregan, Eugene
,
Editor:
Will Tracz
Lockheed Martin Federal systems, Owego, NY

ACM SIGSOFT Software Engineering Notes Volume 23, Issue 2
March 1998
162 pages
ISSN:0163-5948
DOI:10.1145/271775
Chairman:
Mary Lou Soffa
Univ. of Pittsburgh, PA
,
Editors:
Michal Young
Univ. of Oregon, Eugene
,
Will Tracz
Lockheed Martin Federal Systems, Owego, Ny
Issue’s Table of Contents

Copyright © 1998 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 March 1998

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ISSTA98

Sponsor:

SIGSOFT

ISSTA98: International Symposium on Software Testing and Analysis

March 2 - 4, 1998

Florida, Clearwater Beach, USA

Acceptance Rates

ISSTA '98 Paper Acceptance Rate 16 of 47 submissions, 34%;

Overall Acceptance Rate 58 of 213 submissions, 27%

Upcoming Conference

ISSTA '25

Sponsor:
sigsoft

34th ACM SIGSOFT International Symposium on Software Testing and Analysis

June 25 - 28, 2025

Trondheim , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

131
Total Citations
View Citations
1,092
Total Downloads

Downloads (Last 12 months)73
Downloads (Last 6 weeks)14

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gopi PRamalingam MArumugam C(2016)Search Based Test Data GenerationProceedings of the 9th Annual ACM India Conference10.1145/2998476.2998492(137-140)Online publication date: 21-Oct-2016
https://dl.acm.org/doi/10.1145/2998476.2998492
Baluda MDenaro GPezze M(2016)Bidirectional Symbolic Analysis for Effective Branch TestingIEEE Transactions on Software Engineering10.1109/TSE.2015.249006742:5(403-426)Online publication date: 1-May-2016
https://doi.org/10.1109/TSE.2015.2490067
Bohme MPaul S(2016)A Probabilistic Analysis of the Efficiency of Automated Software TestingIEEE Transactions on Software Engineering10.1109/TSE.2015.248727442:4(345-360)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1109/TSE.2015.2487274
Rao SJahan HLiu D(2016)A search-based approach for test suite generation from extended finite state machines2016 International Conference on Progress in Informatics and Computing (PIC)10.1109/PIC.2016.7949471(82-87)Online publication date: Dec-2016
https://doi.org/10.1109/PIC.2016.7949471
Metwally AHosam EHassan MRashad S(2016)WAP: A Novel Automatic Test Generation Technique Based on Moth Flame Optimization2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE)10.1109/ISSRE.2016.20(59-64)Online publication date: Oct-2016
https://doi.org/10.1109/ISSRE.2016.20
García BDueñas J(2015)Web browsing automation for applications quality controlJournal of Web Engineering10.5555/2871274.287128014:5-6(474-502)Online publication date: 1-Nov-2015
https://dl.acm.org/doi/10.5555/2871274.2871280
Böhme MPaul SCheung SOrso AStorey M(2014)On the efficiency of automated testingProceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering10.1145/2635868.2635923(632-642)Online publication date: 11-Nov-2014
https://dl.acm.org/doi/10.1145/2635868.2635923
Majma NBabamir S(2014)Software test case generation & test oracle design using neural network2014 22nd Iranian Conference on Electrical Engineering (ICEE)10.1109/IranianCEE.2014.6999712(1168-1173)Online publication date: May-2014
https://doi.org/10.1109/IranianCEE.2014.6999712
Bueno PJino MWong W(2014)Diversity oriented test data generation using metaheuristic search techniquesInformation Sciences: an International Journal10.1016/j.ins.2011.01.025259(490-509)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1016/j.ins.2011.01.025
Arcuri AYao X(2014)Co-evolutionary automatic programming for software developmentInformation Sciences: an International Journal10.1016/j.ins.2009.12.019259(412-432)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1016/j.ins.2009.12.019
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents