Article

Free access

Test template framework: a specification-based testing case study

Authors:

P. Stocks,

D. CarringtonAuthors Info & Claims

ISSTA '93: Proceedings of the 1993 ACM SIGSOFT international symposium on Software testing and analysis

Pages 11 - 18

https://doi.org/10.1145/154183.154190

Published: 01 July 1993 Publication History

PDF eReader

Abstract

A framework for specification-based testing is demonstrated on a symbol table case study, specified using the Z notation. Test derivation and structuring is discussed, as well as applications of the framework in deriving test oracles and aiding regressing testing during maintenance. Areas for further research and discussion are comparison of heuristics with regard to generated test suites and usability, formalising testing heuristics, and the discrepancy between functional testing and robustness testing.

References

[1]

J. Arkko, V. HirvisaJo, J. Kuusela, and E. NuutilL. Supporting testing of specifications and implementations. EUROMICRO Journal, 30(1- 5):297-302, August 1990. EUROMICRO'90.

Google Scholar

[2]

L. Boug4, N. Choquet, L. Fribourg, and M.-C. Gaudel. Test sets generation from algebraic specifications using logic programming. Journal of Systems and Software, 6(4):343-360, November 1986.

Digital Library

Google Scholar

[3]

G. Bernot, M.-C. Gaudel, and B. Marre. Software testing based on formal specifications: A theory and a tool. Software Engineering Journal, 6(6):387-405, November 1991.

Digital Library

Google Scholar

[4]

T.A. Budd. Mutation analysis: Ideas, examples, problems, and prospects. In B. Chandrasekaran and S. Radicchi, editors, Computer Program Testing. North-Holland, 1981.

Google Scholar

[5]

P.A.V. Hall. Towards testing with respect to formal specifications. In Second IEE/BCS Conference on So/tware Engineering 88, pages 159- 163. IEE, July 1988.

Google Scholar

[6]

I.J. Hayes. Specification directed module testing. IEEE Transactions on Software Engineering, 12(1):124-133, January 1986.

Digital Library

Google Scholar

[7]

I. Hayes, editor. Specification Case Studies. Series in Computer Science. Prentice Hall International, 1987.

Digital Library

Google Scholar

[8]

D.M. Hoffman and P. Strooper. Automated module testing in Prolog. IEEE Transactions on Software Engineering, 17(9):934-943, September 1991.

Digital Library

Google Scholar

[9]

D.J. Richardson, S. L. Aha, and T. O. O'Malley. Specification-based test oracles for reactive systems. In Proceedings o/the l~th International Con/erence on Software Engineering, pages 105- 118, Melbourne, Australia, May 1992.

Digital Library

Google Scholar

[10]

P. Stocks and D. Carrington. Deriving software test cases from formal specifications. In 6th Australian Software Engineering Con/erence, pages 327-340, July 1991.

Google Scholar

[11]

P. Stocks and D. Carrington. Test templates: A specification-based testing framework. In Proceedings of the 15th International Con}erence on Software Engineering, May 1993.

Digital Library

Google Scholar

[12]

J.M. Spivey. The Z Notation: A Reference Manual. Series in Computer Science. Prentice Hall International, 1989.

Digital Library

Google Scholar

Cited By

View all

Liu S(2011)Automatic Specification-Based TestingProceedings of the 2011 Fifth International Conference on Theoretical Aspects of Software Engineering10.1109/TASE.2011.36(5-8)Online publication date: 29-Aug-2011
https://dl.acm.org/doi/10.1109/TASE.2011.36
Chi HJones ENicol DFujimoto R(2006)Computational investigations of quasirandom sequences in generating test cases for specification-based testsProceedings of the 38th conference on Winter simulation10.5555/1218112.1218291(975-980)Online publication date: 3-Dec-2006
https://dl.acm.org/doi/10.5555/1218112.1218291
Chi HJones E(2006)Computational Investigations of Quasirandom Sequences in Generating Test Cases for Specification-Based TestsProceedings of the 2006 Winter Simulation Conference10.1109/WSC.2006.323184(975-980)Online publication date: Dec-2006
https://doi.org/10.1109/WSC.2006.323184
Show More Cited By

Index Terms

Test template framework: a specification-based testing case study
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging
  2. Software organization and properties
    1. Software functional properties
      1. Correctness
2. Theory of computation

Recommendations

Test template framework: a specification-based testing case study

A framework for specification-based testing is demonstrated on a symbol table case study, specified using the Z notation. Test derivation and structuring is discussed, as well as applications of the framework in deriving test oracles and aiding ...
A language for test case refinement in the test template framework
ICFEM'11: Proceedings of the 13th international conference on Formal methods and software engineering

Model-based testing (MBT) generates test cases by analysing a formal model of the system under test (SUT). In many MBT methods, these test cases are too abstract to be executed. Therefore, an executable representation of them is necessary to test the ...
A Test Class Framework for Generating Test Cases from Z Specifications
ICECCS '00: Proceedings of the 6th IEEE International Conference on Complex Computer Systems

Abstract: This paper introduces test classes and a test class framework for generating test cases from Z specifications. We define a test class using object-oriented concept in test framework instead of Phil Stock's test template. Our test framework for ...

Comments

Information & Contributors

Information

Published In

ISSTA '93: Proceedings of the 1993 ACM SIGSOFT international symposium on Software testing and analysis

August 1993

193 pages

ISBN:0897916085

DOI:10.1145/154183

Editors:
Thomas Ostrand
Siemens Corporate Research
,
Elaine Weyuker
New York Univ., New York, NY

ACM SIGSOFT Software Engineering Notes Volume 18, Issue 3
July 1993
192 pages
ISSN:0163-5948
DOI:10.1145/174146
Editor:
Lori A. Clarke
Univ. of Massachusetts, Amherst
Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 1993

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

ISSTA93

Sponsor:

SIGSOFT

ISSTA93: International Symposium on Software Testing and Analysis

June 28 - 30, 1993

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 58 of 213 submissions, 27%

Upcoming Conference

ISSTA '25

Sponsor:
sigsoft

34th ACM SIGSOFT International Symposium on Software Testing and Analysis

June 25 - 28, 2025

Trondheim , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
917
Total Downloads

Downloads (Last 12 months)116
Downloads (Last 6 weeks)11

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Liu S(2011)Automatic Specification-Based TestingProceedings of the 2011 Fifth International Conference on Theoretical Aspects of Software Engineering10.1109/TASE.2011.36(5-8)Online publication date: 29-Aug-2011
https://dl.acm.org/doi/10.1109/TASE.2011.36
Chi HJones ENicol DFujimoto R(2006)Computational investigations of quasirandom sequences in generating test cases for specification-based testsProceedings of the 38th conference on Winter simulation10.5555/1218112.1218291(975-980)Online publication date: 3-Dec-2006
https://dl.acm.org/doi/10.5555/1218112.1218291
Chi HJones E(2006)Computational Investigations of Quasirandom Sequences in Generating Test Cases for Specification-Based TestsProceedings of the 2006 Winter Simulation Conference10.1109/WSC.2006.323184(975-980)Online publication date: Dec-2006
https://doi.org/10.1109/WSC.2006.323184
Chi HJones EEvans DBrown M(2006)Generating test data for specification-based tests via quasirandom sequencesProceedings of the 6th international conference on Computational Science - Volume Part IV10.1007/11758549_104(773-780)Online publication date: 28-May-2006
https://dl.acm.org/doi/10.1007/11758549_104
Le Gall PArnould A(2005)Formal specifications and test: Correctness and oracleRecent Trends in Data Type Specification10.1007/3-540-61629-2_52(342-358)Online publication date: 1-Jun-2005
https://doi.org/10.1007/3-540-61629-2_52
Bowen J(2005)Select Z bibliographyZUM '95: The Z Formal Specification Notation10.1007/3-540-60271-2_143(526-560)Online publication date: 1-Jun-2005
https://doi.org/10.1007/3-540-60271-2_143
Paradkar A(2004)Plannable Test Selection Criteria for FSMs Extracted From Operational SpecificationsProceedings of the 15th International Symposium on Software Reliability Engineering10.1109/ISSRE.2004.28(173-184)Online publication date: 2-Nov-2004
https://dl.acm.org/doi/10.1109/ISSRE.2004.28
Li Tan Sokolsky OInsup Lee (2004)Specification-based testing with linear temporal logicProceedings of the 2004 IEEE International Conference on Information Reuse and Integration, 2004. IRI 2004.10.1109/IRI.2004.1431509(493-498)Online publication date: 2004
https://doi.org/10.1109/IRI.2004.1431509
Xu GYang Z(2004)JMLAutoTest: A Novel Automated Testing Framework Based on JML and JUnitFormal Approaches to Software Testing10.1007/978-3-540-24617-6_6(70-85)Online publication date: 2004
https://doi.org/10.1007/978-3-540-24617-6_6
Peters DParnas D(2002)Requirements-Based Monitors for Real-Time SystemsIEEE Transactions on Software Engineering10.1109/32.98849628:2(146-158)Online publication date: 1-Feb-2002
https://dl.acm.org/doi/10.1109/32.988496
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Test template framework: a specification-based testing case study

A language for test case refinement in the test template framework

A Test Class Framework for Generating Test Cases from Z Specifications