article

Open access

Applicability of Software Validation Techniques to Scientific Programs

Author:

W. E. HowdenAuthors Info & Claims

ACM Transactions on Programming Languages and Systems (TOPLAS), Volume 2, Issue 3

Pages 307 - 320

https://doi.org/10.1145/357103.357107

Published: 01 July 1980 Publication History

Abstract

Error analysis involves the examination of a collection of programs whose errors are known. Each error is analyzed and validation techniques which would discover the error are identified. The errors that were present in version five of a package of Fortran scientific subroutines and then later corrected in version six were analyzed. An integrated collection of static and dynamic analysis methods would have discovered the errors in version five before its release. An integrated approach to validation and the effectiveness of individual methods are discussed.

References

[1]

BAKER, F.T. Structured programming in a production programming environment. IEEE Trans. Softw. Eng. SE-1, 2(1975), 241-252.

Digital Library

[2]

BICERSKIS, J., ET AL. SMOTL--A system to construct samples for data processing program debugging. In Software Testing, vol. 2, A.E. Westley (Ed.), Infotech International, Maidenhead, England, 1979, pp. 13-23.

[3]

BOEHM, B.W., BROWN, J.R., AND LIPOW, M. Quantitative evaluation of software quality. In Proc. 2nd Int. Conf. Software Engineering, San Francisco, Calif., 1976, pp. 592-605.

Digital Library

[4]

BOEHM, B.W., MCLEAN, R.K., AND URFRIC, D.B. Some experience with automated aids to the design of large scale reliable software. IEEE Trans. Softw. Eng. SE-1, 1(1975), 125-133.

Digital Library

[5]

BOYER, R.S., ELSPAS, B., AND LEVITT, K.N. SELECT--A formal system for testing and debugging programs by symbolic execution. In Proc. 1975 Int. Conf. Reliable Software, Los Angeles, Calif., pp. 234-245.

Digital Library

[6]

BROWN, J.R., ET AL. Automated software quality assurance. In Program Test Methods, W.C. Hetzel (Ed.), Prentice-Hall, Englewood Cliffs, N.J., 1973, pp. 181-204.

[7]

BUDD, T.A., DE MZLLO, R.A., LIPTON, R.J., AND SAYWARD, F.G. The design of a prototype mutation system for program testing. In Proc. AFIPS 1978 NCC, AFIPS Press, Alexandria, Va., 1978, pp. 623-627.

[8]

CLARKE, L.A. A system to generate test data and symbolically execute programs. IEEE Trans. Softw. Eng. SE-2, 3(1976), 215-222.

Digital Library

[9]

DALY, E.G. Management of software development. IEEE Trans. Softw. Eng. SE-3, 3(1977), 230-232.

[10]

FAGAN, M.E. Design and code inspections to reduce errors in program development. IBM Syst. J 19, 3(1976), 182-211.

Digital Library

[11]

FuJii, M.S. Independent verification of highly reliable programs. In Proc. COMPSAC-77, Chicago, Ill., pp. 38-44.

[12]

GILB, T. Software Metrics. Winthrop, Cambridge, Mass., 1977.

[13]

GOODENOUOH, J., AND GERHART, S.L. Toward a theory of test data selection. IEEE Trans. Softw. Eng. SE-1, 2(1975), 156-173.

Digital Library

[14]

HAMLET, R.G. Testing programs with the aid of a compiler. IEEE Trans. Softw. Eng. SE-3, 4(1977), 279-289.

Digital Library

[15]

HETZEL, W.C. An experimental analysis of program verification methods. Ph.D. dissertation, Univ. of North Carolina, 1976.

Digital Library

[16]

HOLTHOUSE, M.A. Experience with automated testing analysis. In Digest, Workshop on Software Testing and Test Documentation, Fort Lauderdale, Fla., 1978, pp. 309-323.

[17]

HOWDEN, W.E. An evaluation of the effectiveness of symbolic testing and of testing on actual data. Softw. Pract. Exper. 8, 4(1978), 381-397.

[18]

HOWDEN, W.E. A survey of dynamic analysis methods. In Software Testing and Validation Techniques, E. Miller and W.E. Howden (Eds.), IEEE, Long Beach, Calif., 1978, pp. 184-206.

[19]

HOWDEN, W.E. Functional program testing. IEEE Trans. Softw. Eng SE-6, 3(1980).

[20]

HOWDEN, W.E. Functional testing and design abstractions. J. Syst. Softw. To appear.

Digital Library

[21]

HOWOEN, W.E. Methodology for the generation of program test data. IEEE Trans. Comput. C-24, 5(1975), 554-560.

[22]

HOWDEN, W.E. Symbolic testing and the DISSECT symbolic evaluation system. IEEE Trans. Softw. Eng. SE-3, 4(1977), 266-278.

Digital Library

[23]

HUANO, J.C. An approach to program testing. ACM Comput. Surv. 7, 3(Sept. 1975), 113-128.

Digital Library

[24]

HUANO, J.C. Program instrumentation. A tool for software testing. In Software Testing, vol. 2, A.E. Westley (Ed.), Infotech International, Maidenhead, England, 1979, pp. 147-160.

[25]

IMSL Library reference manual. International Mathematical and Statistical Libraries, Inc., Houston, Tex., 1978.

[26]

JACKSON, M.A. Principles of Prograrn Design. Academic Press, New York, 1975.

Digital Library

[27]

KINC, J.C. Symbolic execution and program testing. Commun. ACM 19, 7(July 1976), 385-394.

Digital Library

[28]

KRAUSE, K.W., SMITH, D.W., ANO GOODWIN, M.A. Optimal software test planning through automated network analysis. In Proc. IEEE Symp. Computer Software Reliabililty, New York, 1973, pp. 18-22.

[29]

MILLER, E., ET AL. Structurally based automatic program testing. In Proc. EASCON' 74, 1974.

[30]

MILLER, E.F., AND MELTON, R.A. Automated generation of test case data sets. In Proc. 1975 Int. Conf. Reliable Software, Los Angeles, Calif., 1975, pp. 51-58.

Digital Library

[31]

MIYAMOTO, I. Reliabilfity evaluation and management for an entire software life cycle. In Proc. 3rd Int. Conf. Software Engineering, Atlanta, Ga., 1978, pp. 46-55.

Digital Library

[32]

MYERS, G.J. A controlled experiment in program testing and code walkthroughs/inspections. Commun. ACM 21, 9(Sept. 1978), 760-768.

Digital Library

[33]

MYERS, G.J. The Art of Software Testing. Wiley-Interscience, New York, 1979.

Digital Library

[34]

OSTERWEIL, L.J., AND FOSDICK, L.D. DAVE--A validation error detection and documentation system for FORTRAN programs. Softw. Pract. Exper. 6, 4(1976), 473-486.

[35]

PANZL, D.J. Automatic software test drivers. Computer 11, 4(1978), 44-50.

Digital Library

[36]

PRO/TEST Data Generator. Synergetics Corp., Burlington, Mass.

[37]

RAMAMOORTHY, C.V., AND HO, S.F. Testing large software with automated software evaluation systems. IEEE Trans. Sofiw. Eng. SE-1, 1(1975), 46-58.

Digital Library

[38]

STUCKI, L.G. Automatic generation of self-metric software. In Proc. IEEE Symp. Computer Software Reliabilty, New York, 1973, pp. 94-100.

[39]

STUCKI, L.G. New directions in automated tools for improving software quality. In Current Trends in Programming Methodology, vol. 2, R.T. Yeh (Ed.), Prentice-Hall, Englewood Cliffs, N.J., 1977, pp. 80-111.

[40]

WHITE, L.J., AND COHEN, E.I. A domain strategy for program testing. In Software Testing, vol. 2, A.E. Westley (Ed.), Infotech International, Maidenhead, England, 1979, pp. 325-362.

[41]

WOODWARD, M.R., HENNEL, M.A., AND HEDLEY, G. Observations and experience of path analysis and testing of programs. In Digest, Workshop on Software Testing and Test Documentation, Fort Lauderdale, Fla., 1978, pp. 70-96.

Cited By

Sunwoo JKim HChoi DBae K(2020)Validation of “sasLM,” an R package for linear models with type III sum of squaresTranslational and Clinical Pharmacology10.12793/tcp.2020.28.e928:2(83)Online publication date: 2020
https://doi.org/10.12793/tcp.2020.28.e9
Frechtling MLeong P(2015)MCALIBACM Transactions on Programming Languages and Systems10.1145/266507337:2(1-25)Online publication date: 16-Apr-2015
https://dl.acm.org/doi/10.1145/2665073
Etiene TJonsson DRopinski TScheidegger CComba JNonato LKirby RYnnerman ASilva C(2014)Verifying Volume Rendering Using Discretization Error AnalysisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2013.9020:1(140-154)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1109/TVCG.2013.90
Show More Cited By

Index Terms

Applicability of Software Validation Techniques to Scientific Programs

Recommendations

Acknowledgments in scientific publications: Presence in Spanish science and text patterns across disciplines

The acknowledgments in scientific publications are an important feature in the scholarly communication process. This research analyzes funding acknowledgment presence in scientific publications and introduces a novel approach for discovering text ...
Read More
Scientometric analysis of Iraqi-Kurdistan universities' scientific productivity

Purpose - This purpose of this study is to examine research performance of Iraqi-Kurdistan universities, using the number of papers appearing in journals and proceedings, and the number of citations received by those papers as covered by Scopus, 1970-...
Read More
Disciplinary differences of software use and impact in scientific literature
Abstract
Software plays an important role in the advancement of science. Software developers, users, and funding agencies have deep interests in the impact of software on science. This study investigates the use and impact of software by examining how ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Programming Languages and Systems

ACM Transactions on Programming Languages and Systems Volume 2, Issue 3

July 1980

195 pages

ISSN:0164-0925

EISSN:1558-4593

DOI:10.1145/357103

Editor:
Susan L. Graham

Issue’s Table of Contents

Copyright © 1980 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 1980

Published in TOPLAS Volume 2, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
752
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

Sunwoo JKim HChoi DBae K(2020)Validation of “sasLM,” an R package for linear models with type III sum of squaresTranslational and Clinical Pharmacology10.12793/tcp.2020.28.e928:2(83)Online publication date: 2020
https://doi.org/10.12793/tcp.2020.28.e9
Frechtling MLeong P(2015)MCALIBACM Transactions on Programming Languages and Systems10.1145/266507337:2(1-25)Online publication date: 16-Apr-2015
https://dl.acm.org/doi/10.1145/2665073
Etiene TJonsson DRopinski TScheidegger CComba JNonato LKirby RYnnerman ASilva C(2014)Verifying Volume Rendering Using Discretization Error AnalysisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2013.9020:1(140-154)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1109/TVCG.2013.90
Selby R(2014)11.3.3 Enabling Measurement‐Driven System Development by Analyzing Testing Strategy TradeoffsINCOSE International Symposium10.1002/j.2334-5837.2006.tb02834.x16:1(1570-1584)Online publication date: 4-Nov-2014
https://doi.org/10.1002/j.2334-5837.2006.tb02834.x
Selby R(2012)Analyzing Testing Strategy Tradeoffs to Improve Systems Engineering Effectiveness and Efficiency46th AIAA Aerospace Sciences Meeting and Exhibit10.2514/6.2008-1125Online publication date: 19-Jun-2012
https://doi.org/10.2514/6.2008-1125
Selby R(2012)Team Testing Strategies for Error Detection in Software ComponentsSpace 2004 Conference and Exhibit10.2514/6.2004-6106Online publication date: 19-Jun-2012
https://doi.org/10.2514/6.2004-6106
Huang J(2008)BibliographySoftware Error Detection through Testing and Analysis10.1002/9780470464076.biblio(237-251)Online publication date: 28-Oct-2008
https://doi.org/10.1002/9780470464076.biblio
Taylor R(2006)An integrated verification and testing environmentSoftware: Practice and Experience10.1002/spe.438013080513:8(697-713)Online publication date: 30-Oct-2006
https://doi.org/10.1002/spe.4380130805
Basil VSelby R(2005)Comparing the Effectiveness of Software Testing StrategiesFoundations of Empirical Software Engineering10.1007/3-540-27662-9_20(300-338)Online publication date: 2005
https://doi.org/10.1007/3-540-27662-9_20
Howden W(1998)Good enough versus high assurance software testing and analysis methodsProceedings Third IEEE International High-Assurance Systems Engineering Symposium (Cat. No.98EX231)10.1109/HASE.1998.731609(166-175)Online publication date: 1998
https://doi.org/10.1109/HASE.1998.731609
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents