Determining component reliability using a testing index
Pages 167 - 176
Abstract
Component-Based Software Engineering has the potential to provide reliable systems based on tested components quickly and economically, but these systems will only be as reliable as the components from which they are constructed. We propose a 6-point scale which can be used to rate the degree to which a component has been tested. This scale can be used by developers to assess the risk of using a third party component. Since a variety of test strategies are used, it is necessary to correlate testing strategies with our scale. In this paper, we examine the testing strategies specified in British Standard 7925-2 and show how they relate to the reliability levels that we propose. Since well-behaved use of resources is also a key factor in overall system reliability, we propose that an 'R' tag be added to the rated level when resource usage has been verified to be within reasonable bounds.
References
[1]
{ANSI/IEEE, 1987} ANSI/IEEE (1987). ANSI/IEEE standard 1008-97: IEEE Standard for software unit testing. IEEE.
[2]
{Binder, 2000} Binder, R. V. (2000). Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison-Wesley.
[3]
{Bundell et al., 2000a} Bundell, G. A., Lee, G., Morris, J., Hope, S., Parr, S., and Dromey, R. G. (2000a). Component Software: A White Paper: Part II. Technical Aspects. Software Engineering Australia (WA): http://ciips.ee.uwa.edu.au/Research/SCL/white6.pdf.
[4]
{Bundell et al., 2000b} Bundell, G. A., Lee, G., Morris, J., and Lam, P. (2000b). A software component verification tool. In Proceedings: International Conference on Software Methods and Tools. IEEE Computer Society Press / ACM Press.
[5]
{Defence, 1997} Defence (1997). Defence Standard 00-55: The Procurement of Safety Critical Software in Defence Equipment. HM Government, Ministry of Defence Directorate of Standardisation.
[6]
{Fenton and Neil, 1998} Fenton, N. E. and Neil, M. (1998). A strategy for improving safety related software engineering standards. IEEE Transactions on Software Engineering, 24(11):1002-1013.
[7]
{Horgan et al., 1994} Horgan, J. R., London, S., and Lyu, M. R. (1994). Achieving software quality with testing coverage measures. IEEE Computer, 27(9):60-69.
[8]
{Institution, 1998} Institution, B. S. (1998). Standard for Software Component Testing. BS7925-2.
[9]
{Lee, 2000} Lee, G. (2000). Symbolic Executor for the CTB: work in progress. Software Component Laboratory, CIIPS, University of Western Australia.
[10]
{Lee and Waters, 1999} Lee, G. and Waters, B. (1999). Assert for Java. http://www.verilib.sea.net.au/categories/Debugging.html.
[11]
{Ltd, 2000} Ltd, C. (2000). C-Cover. Codework Ltd. C/C++ coverage tool.
[12]
{Lyu et al., 1994} Lyu, M. R., Horgan, J. R., and London, S. (1994). A coverage analysis tool for the effectiveness of software testing. IEEE Transactions On Reliability, 43(4):527-535.
[13]
{Meyer, 1997} Meyer, B. (1997). Object-oriented Software Construction. Prentice Hall, New York, NY, second edition.
[14]
{Pfleeger et al., 1994} Pfleeger, S. L., Fenton, N., Page, S. (1994). Evaluating software engineering standards. Computer, 27(9):71-79.
[15]
{Rapps and Weyuker, 1985} Rapps, S. and Weyuker, E. J. (1985). Selecting software test data using flow information. IEEE Transactions on Software Engineering, 11(4):367-375.
[16]
{RTCA, 1992} RTCA (1992). Software Considerations in Airborne Systems and Equipment Certification: DO-178B. Radio Technical Commission for Aeronautics,(RTCA, Inc).
[17]
{Software Component Laboratory, 2000} Software Component Laboratory (2000). VeriLib: A Source of Reliable Components. http://www.verilib.sea.net.au.
[18]
{Weerahandi and Hausman, 1994} Weerahandi, S. and Hausman, R. E. (1994). Software quality measurement based on fault-detection data. IEEE Transactions on Software Engineering, 20(9):665-676.
Index Terms
- Determining component reliability using a testing index
Recommendations
Determining component reliability using a testing index
Component-Based Software Engineering has the potential to provide reliable systems based on tested components quickly and economically, but these systems will only be as reliable as the components from which they are constructed. We propose a 6-point ...
Testing Coverage Analysis for Software Component Validation
COMPSAC '05: Proceedings of the 29th Annual International Computer Software and Applications Conference - Volume 01Constructing component-based software using reusable components is becoming a widely used approach. Since the quality of a component-based system is highly dependent on the quality of its components, component quality validation becomes very critical to ...
Testing-based Process for Evaluating Component Replaceability
Replacing pieces of component-based systems carries a serious risk on the expected stability. Substitutability of components must then be carefully identified. With this intent, this paper presents a process to evaluate replacement components by ...
Comments
Information & Contributors
Information
Published In
Sponsors
- Australian Comp Soc: Australian Computer Society
- School of Computer Science and Software Engineering (CSSE), Monash University, Australia
- Department of Computer Science, University of Adelaide, Australia
- Faculty of Information Technology, Monash University, Australia
Publisher
Australian Computer Society, Inc.
Australia
Publication History
Published: 01 January 2002
Author Tags
Qualifiers
- Article
Conference
ACSC '02
Sponsor:
- Australian Comp Soc
Acceptance Rates
Overall Acceptance Rate 136 of 379 submissions, 36%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 888Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 03 Oct 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in