article

The (Im)maturity level of software testing

Author:

Antonia BertolinoAuthors Info & Claims

ACM SIGSOFT Software Engineering Notes, Volume 29, Issue 5

Pages 1 - 4

https://doi.org/10.1145/1022494.1022540

Published: 01 September 2004 Publication History

Abstract

A large gap exists between the state-of-the-art in software testing literature, and the state of software testing practice. Empirical research should (and could) play a first class role for bridging this gap. Empirical studies in software testing have focused mainly on the evaluation of techniques for test case selection. But effective selection of test cases by itself is not sufficient to warrant successful testing: we need also empirical studies to start collecting proven patterns that test practitioners can use to predictably solve software testing problems.

References

[1]

Bertolino, A. Software Testing Research and Practice, In Proc. of the 10th Int. Wksp on Abstract State Machines (ASM 2003) (Taormina, Italy, March 2003). LNCS 2589, Springer, 2003, 1--21.

Digital Library

[2]

Craggs I., Sardis M., and Heuillard T. AGEDIS Case Studies: Model-based Testing in Industry. Proc. 1st European Conf. on Model Driven Softw. Eng. (Nuremberg, Germany, Dec. 2003), imbus AG, 106--117.

[3]

Duran, J. W. and Ntafos, S. C. An Evaluation of Random Testing. IEEE Trans. Software Engineering. 10, 4 (1984) 438--444.

[4]

Gamma, E., et al., Design Patterns Elements of reusable Object-Oriented Software, Addison-Wesley, Reading, Mass., 1996.

Digital Library

[5]

Hutchins, M., et al. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proc. of the 16th Int. Conf. on Software Eng. (ICSE '94), (Sorrento, Italy, May 1994), 191--200.

Digital Library

[6]

ISSTA2002 Panel: Is ISSTA Research Relevant to Industrial Users?. In ACM Proc. of ISSTA 2002 (Roma, Italy, July 2002), 201--209.

Digital Library

[7]

Juristo, N., Moreno, A. M., and Vegas, S. Reviewing 25 Years of Testing Technique Experiments, Empirical Softw. Eng. J., 9, 1/2 (March 2004), 7--44.

Digital Library

[8]

Littlewood, B., et al. Modeling the Effects of Combining Diverse Software Fault Detection Techniques. IEEE Trans. Software Eng., 26, 12, 2000, 1157--1167.

Digital Library

[9]

Marick, B. Software Testing Patterns. On line at http://www.testing.com/test-patterns/index.html (accessed April 21, 2004).

[10]

Mohagheghi, P., et al. An Empirical Study of Software Reuse vs. Reliability and Stability. In Proc. of the 26th Int. Conf. on Softw. Eng. (ICSE'04) (Edinburgh, Scotland, UK, 23-28 May 2004).

Digital Library

[11]

Morasca, S. and Serra-Capizzano, S. On the Analytical Comparison of Testing Techniques. In Proc. of ACM ISSTA 2004, (Boston, Ma, USA, July 2004). ACM Press (to appear).

Digital Library

[12]

Ostrand, T. J., Weyuker, E. J. and Bell, R. M. Where the Bugs Are. In Proc. of ACM ISSTA 2004, (Boston, Ma, USA, July 2004). ACM Press (to appear).

Digital Library

[13]

Schmidt, D. C., Fayad, M. and Johnson, R. E., Software Patterns. Communications of the ACM, 39, 10 (Oct. 1996), 37--39.

Digital Library

[14]

Tichy, W. F. Hints for Reviewing Empirical Work in Software Engineering, Empirical Softw. Eng. J., 5, 4 (Dec. 2000), 309--312.

Digital Library

[15]

WERST 2004 Call for Papers, on line at http://www.sce.carleton.ca/squall/WERST2004/ ((accessed April 21, 2004).

[16]

Wood, M., et al. Comparing and Combining Software Defect Detection Techniques: A Replicated Empirical Study. In Proc. of ESEC/FSE (Zurich, Switzerland, 1997), LNCS 1301, Springer, 262--277.

Digital Library

Cited By

Yucesan OOzkil A(2020)Time Complexity Comparison of Stopping at First Failure and Completely Running the TestJournal of Electronic Testing10.1007/s10836-020-05884-336:3(409-417)Online publication date: 13-Jun-2020
https://doi.org/10.1007/s10836-020-05884-3
da Silva RCruz Cde S. Campos HMurta Lde Oliveira Neves VMachado ISouza RMaciel RSant'Anna C(2019)What is the adoption level of automated support for testing in open-source ecosystems?Proceedings of the IV Brazilian Symposium on Systematic and Automated Software Testing10.1145/3356317.3356325(80-89)Online publication date: 23-Sep-2019
https://dl.acm.org/doi/10.1145/3356317.3356325
Beller MGousios GPanichella AProksch SAmann SZaidman A(2019)Developer Testing in the IDEIEEE Transactions on Software Engineering10.1109/TSE.2017.277615245:3(261-284)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1109/TSE.2017.2776152
Show More Cited By

Index Terms

The (Im)maturity level of software testing
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Scan testing of micropipelines
VTS '95: Proceedings of the 13th IEEE VLSI Test Symposium

Abstract: The micropipeline approach to designing asynchronous VLSI circuits has successfully been used in the AMULET1 microprocessor. A method to design and test micropipelines is presented in this paper. The test strategy is based on the scan test ...
Reformatting Test Patterns for Testing Embedded Core Based System Using Test Access Mechanism (TAM) Switch
ASP-DAC '02: Proceedings of the 2002 Asia and South Pacific Design Automation Conference

In the present paper a new algorithm for reformatting the test vector of System On Chip (SOC) with Test Access Mechanism (TAM) has been proposed. Exhaustive experimentation has been done by employing random reformatted test vectors to a variety of SOCs, ...
Software Testing: High-impact Strategies - What You Need to Know Definitions, Adoptions, Impact, Benefits, Maturity, Vendors

Comments

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes

ACM SIGSOFT Software Engineering Notes Volume 29, Issue 5

September 2004

321 pages

ISSN:0163-5948

DOI:10.1145/1022494

Issue’s Table of Contents

Copyright © 2004 Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2004

Published in SIGSOFT Volume 29, Issue 5

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
1,167
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yucesan OOzkil A(2020)Time Complexity Comparison of Stopping at First Failure and Completely Running the TestJournal of Electronic Testing10.1007/s10836-020-05884-336:3(409-417)Online publication date: 13-Jun-2020
https://doi.org/10.1007/s10836-020-05884-3
da Silva RCruz Cde S. Campos HMurta Lde Oliveira Neves VMachado ISouza RMaciel RSant'Anna C(2019)What is the adoption level of automated support for testing in open-source ecosystems?Proceedings of the IV Brazilian Symposium on Systematic and Automated Software Testing10.1145/3356317.3356325(80-89)Online publication date: 23-Sep-2019
https://dl.acm.org/doi/10.1145/3356317.3356325
Beller MGousios GPanichella AProksch SAmann SZaidman A(2019)Developer Testing in the IDEIEEE Transactions on Software Engineering10.1109/TSE.2017.277615245:3(261-284)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1109/TSE.2017.2776152
Garousi VFelderer M(2017)Worlds Apart: Industrial and Academic Focus Areas in Software TestingIEEE Software10.1109/MS.2017.364111634:5(38-45)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1109/MS.2017.3641116
Carter K(2017)Francois Raynaud on DevSecOpsIEEE Software10.1109/MS.2017.357157834:5(93-96)Online publication date: 22-Sep-2017
https://dl.acm.org/doi/10.1109/MS.2017.3571578
Dias-Neto AMatalonga SSolari MRobiolo GTravassos G(2017)Toward the characterization of software testing practices in South AmericaSoftware Quality Journal10.1007/s11219-016-9329-325:4(1145-1183)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s11219-016-9329-3
Beszedes AVidacs L(2016)Academic and Industrial Software Testing Conferences: Survey and Synergies2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW.2016.30(240-249)Online publication date: Apr-2016
https://doi.org/10.1109/ICSTW.2016.30
Beller MGousios GPanichella AZaidman ADi Nitto EHarman MHeymans P(2015)When, how, and why developers (do not) test in their IDEsProceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering10.1145/2786805.2786843(179-190)Online publication date: 30-Aug-2015
https://dl.acm.org/doi/10.1145/2786805.2786843
Farooq SQuadri SFranch XMadhavji NPc AMiranskyy A(2014)Empirical evaluation of software testing techniques in an open source fashionProceedings of the 2nd International Workshop on Conducting Empirical Studies in Industry10.1145/2593690.2593693(21-24)Online publication date: 2-Jun-2014
https://dl.acm.org/doi/10.1145/2593690.2593693
Sirathienchai JSophatsathit PDechawatanapaisal D(2012)Using Test Employee Capability Maturity Model for Supporting Gaps Bridging in Software TestingJournal of Software Engineering and Applications10.4236/jsea.2012.5604805:06(417-428)Online publication date: 2012
https://doi.org/10.4236/jsea.2012.56048
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents