Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.5555/800099.803189acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
Article
Free access

Toward an effective software reliability evaluation

Published: 10 May 1978 Publication History
  • Get Citation Alerts
  • Abstract

    Effective software reliability evaluation requires theories of software reliability which define and deal with software reliability quantitatively, technologies for reliability data measurement and data analysis, techniques to estimate or predict software reliability, and practical reliability evaluation methodologies which effectively reflect the characteristics of software. This paper assesses the extents to which these requirements are currently met, and introduces improved approaches for an effective software reliability evaluation. Introduced are the methodologies for software reliability evaluation and the software reliability evaluation-aid tools.

    References

    [1]
    R.J. Rubey and R.D. Hartwick,"Quantitative measurement of program quality", Proc.ACM National Conference,1968,pp671-677
    [2]
    J.R. Brown and M.Lipow,"The quantitative measurement of software safety and reliability",TRW Report SDP-1776,1973
    [3]
    W.A. Wulf,"Programming methodology", Proc. Symp.on High Cost of Software, Sept. 1973
    [4]
    D.H. Abernathy,et al,"Survey of design goals for operating systems", GIT Report, GTIS-72-04
    [5]
    B.W. Boehm,et al,"Quantitative evaluation of software quality", Proc.2nd ICSE, Oct. 1976,pp592-605
    [6]
    J.D. Musa,"A theory of software reliability and its application", IEEE Tr. SE, Vol. SE-1,No.3,1975,pp312-327
    [7]
    B.W. Boehm,"Software Engineering", IEEE Tr.Computers, Vol.C-25,No.12,Dec.1976, pp1226-1241
    [8]
    R.A. Pikul and R.T.Wojcik,"Software effectiveness: A reliability growth approach", Proc.MRI Symp.Comp.Soft.Eng., Apr. 1976,pp531-546
    [9]
    A. Endres,"An analysis of errors and their causes in system programs", Proc. ICRS, April 1975,pp327-336
    [10]
    M.L. Shooman and M.I. Bolsky,"Types, distribution and test and correction times for programming errors", Proc.ICRS, April 1975,pp347-357
    [11]
    T.A. Thayer,et al,"Software reliability study", TRW Systems Report, SS-76-03,1976
    [12]
    T.A. Thayer,"Understanding software through analysis of empirical data", Proc. NCC 1975, pp335-341
    [13]
    B.W. Boehm,et al, "Structured programming:A quantitative assessment", IEEE Comp. June 1975,pp38-54
    [14]
    T.E. Bell and T.A. Thayer, "Software requirements: Are they really a problem?", Proc.2nd ICSE, Oct.1976,pp61-68
    [15]
    M.E. Fagan,"Design and code inspections to reduce errors in program development", IBM Sys.J. No.3,1976,pp182-211
    [16]
    F.Akiyama,"An example of software system debugging", Proc.IFIP 1971,pp359
    [17]
    J.D. Gannon and J.J. Horning,"The impact of language design on the production of reliable software", Proc.ICRS, Apr.1975, pp10-22
    [18]
    J.S. McGeachie,"Reliability of the Dartmouth Time Sharing System", IEEE Sym. Soft.Reliability, 1973, pp117-123
    [19]
    J.D. Musa,"An exploratory experiment with 'foreign' debugging of programs", MRI Symp.Comp.Soft.Eng.,Apr.1976,pp499-512
    [20]
    C.R. Litecky and G.B. Davis,"A study of errors, error-proneness, and error diagnosis in COBOL", CACM Jan.1976,Vol.19,No. 1,pp33-37
    [21]
    F.T. Baker,"System quality through structured programming", Proc.FJCC 1972, pp339-343
    [22]
    I.Miyamoto,"Software reliability in on line real time environment", Proc.ICRS, April 1975,pp194-203
    [23]
    G.M. Weinberg,"The psychology of computer programming", Van Nostrand Reinhold, New York, 1971
    [24]
    R.J. Fleischer and R.W. Spitler,"SIMON-A project management system for software development", MITRE MTP-169,Apr 1976
    [25]
    J.A. Clapp and J.E. Sullivan,"Automated monitoring of software quality", Proc NCC 1974,pp337-341
    [26]
    H. Bratman and T. Court,"Software Factory", Computer, May 1975,pp28-37
    [27]
    W.H. MacWilliams,"Reliability of large real-time control software systems", Proc Symp.Soft.Reliability, 1973,pp1-6
    [28]
    M.L. Shooman,"Operational testing and software reliability estimation during program development", IEEE Symp.Comp.Soft. Reliability, 1973,pp51-57
    [29]
    M.L.Shooman, "Probabilistic models for software reliability prediction", Statistical Computer Performance Evaluation, W.Freiberger, ed., N.Y. Academic Press, 1972,pp485-502
    [30]
    Z.Jelinski and P.B.Moranda, "Software reliability research", same source as 29
    [31]
    Z.Jelinski and P.B.Moranda, "Applications of a probability-based model to a code reading experiment", Proc. Symp.Comp. Soft.Reliability, 1973,pp78
    [32]
    N.F.Schneidewind, "An approach to software reliability prediction and quality control", Proc.FJCC 1972, pp837-847
    [33]
    B.Littlewood and J.L.Verrall, "A Bayesian reliability growth model for computer software", IEEE Symp.Comp.Soft.Rel. April 1973,pp70-77
    [34]
    A.K.Trivedi and M.L.Shooman, "A manystate Markov model for the estimation and prediction of computer software performance parameters", Proc.ICRS, April 1975,pp208-220
    [35]
    J.D.Musa, "Measuring software reliability", Proc.National Meeting, ORSA/TIMS, May 1977
    [36]
    G.J.Schick and R.W.Wolverton, "Assessment of software reliability", |llth Ann. Meeting,# German OR Society, Sept. 1972
    [37]
    E.C.Nelson, "A statistical basis for software reliability assessment", TRW Systems Report, March 1973
    [38]
    B.Littlewood, "A reliability model for Markov structured software", Proc.ICRS, April 1975,pp204-207
    [39]
    B.Littlewood, "A Semi-Markov model for software reliability with failure costs", MRI Symp.Comp.Soft.Eng. 1976, pp281-300
    [40]
    M.L.Shooman, et al, "Effect of manpower deployment and bug generation on software error models", MRI Symp.Comp.Soft. Eng. April 1976, pp155-170
    [41]
    M.L.Shooman, "Structural models for software reliability prediction", Proc. 2nd ICSE, Oct.1976,pp268-280
    [42]
    H.D.Mills, "On the statistical validation of computer programs", FSC-72-6015, IBM FSD, 1972
    [43]
    G.J.Myers, "Software reliability-Principles and practices", John Wiley & Sons 1976
    [44]
    M.H.Halstead, "Elements of software science", Elsevier Computer Sciences Lib, 1977
    [45]
    T.F. Green, et al, "Program structures, complexity and error characteristics", MRI Symp.Comp.Soft.Eng., April 1976 pp139-154
    [46]
    I.Miyamoto, "A test description language for test drivers and stubs", to appear
    [47]
    J.D.Musa, "Program for software reliability and system test schedule estimation—User's Guide", IEEE Computer Society Repository, No.R77-244
    [48]
    J.D.Musa and P.A.Hamilton, "Program for software reliability and system test schedule estimation—Program Documentation", IEEE Computer Society Repository, No.R77-243

    Cited By

    View all

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICSE '78: Proceedings of the 3rd international conference on Software engineering
    May 1978
    348 pages

    Sponsors

    Publisher

    IEEE Press

    Publication History

    Published: 10 May 1978

    Check for updates

    Author Tags

    1. Reliability data
    2. Reliability estimation
    3. Reliability measurement
    4. Reliability model
    5. Software error
    6. Software error management
    7. Software reliability
    8. Software reliability evaluation
    9. Software reliability management

    Qualifiers

    • Article

    Acceptance Rates

    Overall Acceptance Rate 276 of 1,856 submissions, 15%

    Upcoming Conference

    ICSE 2025

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)26
    • Downloads (Last 6 weeks)1

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media