Article

Adaptive testing of software components

Authors:

Y. T. YuAuthors Info & Claims

SAC '05: Proceedings of the 2005 ACM symposium on Applied computing

Pages 1463 - 1469

https://doi.org/10.1145/1066677.1067011

Published: 13 March 2005 Publication History

Abstract

Software components are popular in nowadays software industries. However, how to test software components is a problem since the source code of the software component under test may not be available for the third-party user. In this paper we show that the software component should be tested in an adaptive manner in the sense that the software defect detection rates are estimated on-line by using testing data collected during testing to improve test case selections. In doing so, we use a recursive least squares estimation method to do on-line parameter estimations. This paper further justifies the advantages of the controlled Markov chain (CMC) approach to software testing in particular, and the practicality of the idea of software cybermetics in general.

References

[1]

A. W. Brown and K. C. Wallnau, "The Current State of CBSE", IEEE Software, Spetebmer/October 1998, pp. 37--46.

Digital Library

[2]

K. Goseva-Popstojanova and K. S. Trivedi, "Architecture-Based Approach to Reliability Assessment of Software Systems", Performance Evaluation, Vol. 45, 2001, pp. 179--204.

Digital Library

[3]

F. Siddiqui, "Component Based Software Engineering: A Look at Reusable Software Components", http://www.smb.uklinux.et/reusability

[4]

J. Voas, "Composing Software Component 'ilities"', IEEE Software, July/August 2001, pp. 16--17.

Digital Library

[5]

M. J. Harrold, D. Liang and S. Sinha, "An Approach to Analyzing and Testing Component-Based Systems", Proc. First ICSE International Workshop on Testing Distributed Component-Based Systems, Los Angeles, 1999.

Digital Library

[6]

D. S. Rosenblum, "Adequate Testing of Component-Based Software", Technical Report 97-34, ICS, University of California, Irvine, August 1997.

[7]

Y. Wu, D. Pan and M. H. Chen, "Techniques for Testing Component-Based Software", Proc. Seventh International Conference on Engineering of Complex Computer Systems, 2001.

Digital Library

[8]

E. J. Weyuker, "Testing Component-Based Software: A Cautionary Tale", IEEE Software, September/October 1998, pp. 54--59.

Digital Library

[9]

J. M. Voas, "Certifying Off-the-Shelf Software Components", Computer, June 1998, pp. 53--59.

Digital Library

[10]

K. Y. Cai, "Optimal Software Testing and Adaptive Software Testing in the Context of Software Cybernetics", Information and Software Technology, Vol. 44, 2002, pp. 841--855.

[11]

K. Y. Cai, Y. C. Li, W. Y. Ning, "Optimal Software Testing in the Setting of Controlled Markov Chains", European Journal of Operational Research, Vol. 162, No. 2, 2005, pp. 62--289.

[12]

K. Y. Cai, Y. C. Li, K. Liu, "Optimal and Adaptive Testing for Software Reliability Assessment", Information and Software Technology, Article in press, 2004.

[13]

H. Zhu, P. A. Hall and J. H. R. May, "Test Coverage and Adequacy", ACM Computing Surveys, Vol. 29, No. 4, 1997, pp. 366--427.

Digital Library

[14]

J. W. Cangussu, R. A. DeCarlo and A. P. Mathur, "A Formal Model for the Software Test Process", IEEE Transactions on Software Engineering, Vol. 28, No. 8, 2002, pp. 82--796.

Digital Library

[15]

T. Y. Chen, F. C. Kuo, R. G. Merkel, S. P. Ng, "Mirror Adaptive Random Testing", Proc, the 3rd International Conference on Quality Software, IEEE Computer Society Press, 2003, pp. 4--9.

Digital Library

[16]

K. Y. Cai, "On the Concepts of Total Systems, Total Dependability and Software Cybernetics", (unpublished manuscript), Centre for Software Reliability, City University, London, Draft version, October 1994; revised version, July 1995.

[17]

K. Y. Cai, T. Y. Chen, T. H. Tse, "Towards Research on Software Cybernetics", Proc. 7th IEEE International Symposium on High Assurance Systems Engineering, 2002, pp. 40--241.

Digital Library

[18]

K. Y. Cai, J. W. Cangussu, R. A. DeCarlo, A. P. Mathur, "An Overview of Software Cybernetics", Proc. the 11th International Workshop on Software Technology and Engineering Practice, 2003, IEEE Computer Society Press, 2004, pp. 7--86.

Digital Library

[19]

K. Y. Cai, "Towards a Conceptual Framework of Software Run Reliability Modeling", Information Sciences, Vol. 126, 2000, pp. 137--163.

Digital Library

[20]

C. Derman, Finite State Markovian Decision Processes, Academic Press, 1970.

Digital Library

[21]

O. Hernandez-Lerma, Adaptive Markov Control Processes, Springer-Verlag, 1989.

Digital Library

[22]

G. Rothermel, R. H. Untch, C. Chu and M. J. Harrold, "Prioritizing Test Cases for Regression Testing", IEEE Transactions on Software Engineering, Vol. 27, No. 10, 2001, pp. 929--948.

Digital Library

[23]

L. Ljung, System Identification - Theory For the User, 2nd ed, PTR Prentice Hall, Upper Saddle River, N.J., 1999.

Digital Library

Cited By

Ding JZhang X(2017)Comparison analysis of two test case prioritization approaches with the core idea of adaptive2017 29th Chinese Control And Decision Conference (CCDC)10.1109/CCDC.2017.7978795(1723-1730)Online publication date: May-2017
https://doi.org/10.1109/CCDC.2017.7978795
Alshanqiti AHeckel RCohen MGrunske LWhalen M(2015)Extracting visual contracts from Java programsProceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2015.63(104-114)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1109/ASE.2015.63
Nie CLeung HCai K(2013)Adaptive Combinatorial TestingProceedings of the 2013 13th International Conference on Quality Software10.1109/QSIC.2013.22(284-287)Online publication date: 29-Jul-2013
https://dl.acm.org/doi/10.1109/QSIC.2013.22
Show More Cited By

Recommendations

Optimal and adaptive testing with cost constraints
AST '06: Proceedings of the 2006 international workshop on Automation of software test

This paper generalizes our previous work on optimal and adaptive testing to consider a more general scenario of software testing resource constraints. The assumption is that software testing must be stopped once the allowed testing resources are used ...
Adaptive software testing with fixed-memory feedback

Adaptive software testing is the counterpart of adaptive control in software testing. It means that software testing strategy should be adjusted on-line by using the testing data collected during software testing as our understanding of the software ...
A Case Study of the Recursive Least Squares Estimation Approach to Adaptive Testing for Software Components
QSIC '05: Proceedings of the Fifth International Conference on Quality Software

The strategy used for testing a software system should not be fixed, because as time goes on we may have a better understanding of the software under test. A solution to this problem is to introduce control theory into software testing. We can use ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SAC '05: Proceedings of the 2005 ACM symposium on Applied computing

March 2005

1814 pages

ISBN:1581139640

DOI:10.1145/1066677

Conference Chair:
Hisham M. Haddad
Kennesaw State University
,
Editor:
Lorie M. Liebrock
New Mexico Institute of Mining and Technology, Socorro, NM
,
Program Chairs:
Andrea Omicini
Alma Mater Studiorum, Universita di Bologna, Italy
,
Roger L. Wainwright
Univerity of Tulsa, OK

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SAC05

Sponsor:

SIGAPP

SAC05: The 2005 ACM Symposium on Applied Computing

March 13 - 17, 2005

New Mexico, Santa Fe

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25

Sponsor:
sigapp

The 40th ACM/SIGAPP Symposium on Applied Computing

March 31 - April 4, 2025

Catania , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
1,345
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ding JZhang X(2017)Comparison analysis of two test case prioritization approaches with the core idea of adaptive2017 29th Chinese Control And Decision Conference (CCDC)10.1109/CCDC.2017.7978795(1723-1730)Online publication date: May-2017
https://doi.org/10.1109/CCDC.2017.7978795
Alshanqiti AHeckel RCohen MGrunske LWhalen M(2015)Extracting visual contracts from Java programsProceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2015.63(104-114)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1109/ASE.2015.63
Nie CLeung HCai K(2013)Adaptive Combinatorial TestingProceedings of the 2013 13th International Conference on Quality Software10.1109/QSIC.2013.22(284-287)Online publication date: 29-Jul-2013
https://dl.acm.org/doi/10.1109/QSIC.2013.22
Nie CChen SLeung HCai K(2013)A Case Study of Adaptive Combinatorial TestingProceedings of the 2013 IEEE 37th Annual Computer Software and Applications Conference Workshops10.1109/COMPSACW.2013.22(47-52)Online publication date: 22-Jul-2013
https://dl.acm.org/doi/10.1109/COMPSACW.2013.22
Potuzak TLipka RBrada PHerout P(2012)Testing a Component-Based Application for Road Traffic Crossroad Control Using the SimCo Simulation FrameworkProceedings of the 2012 38th Euromicro Conference on Software Engineering and Advanced Applications10.1109/SEAA.2012.18(175-182)Online publication date: 5-Sep-2012
https://dl.acm.org/doi/10.1109/SEAA.2012.18
Wang Chongwen Ding Gangyi Ma Rui Zhang Hongzhe (2010)All Digital Embedded Software Simulation Testing Environment based on component2010 International Conference On Computer Design and Applications10.1109/ICCDA.2010.5540922(V5-449-V5-453)Online publication date: Jun-2010
https://doi.org/10.1109/ICCDA.2010.5540922
Johnsen EOwe OTorjusen A(2008)Validating Behavioral Component Interfaces in Rewriting LogicFundamenta Informaticae10.5555/2365256.236525982:4(341-359)Online publication date: 1-Dec-2008
https://dl.acm.org/doi/10.5555/2365256.2365259
Johnsen EOwe OTorjusen A(2008)Validating Behavioral Component Interfaces in Rewriting LogicFundamenta Informaticae10.5555/1366982.136698582:4(341-359)Online publication date: 1-Feb-2008
https://dl.acm.org/doi/10.5555/1366982.1366985
Taipale OSmolander KTravassos GMaldonado JWohlin C(2006)Improving software testing by observing practiceProceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering10.1145/1159733.1159773(262-271)Online publication date: 21-Sep-2006
https://dl.acm.org/doi/10.1145/1159733.1159773
Hu HWong WJiang CCai K(2005)A Case Study of the Recursive Least Squares Estimation Approach to Adaptive Testing for Software ComponentsProceedings of the Fifth International Conference on Quality Software10.1109/QSIC.2005.1(135-141)Online publication date: 19-Sep-2005
https://dl.acm.org/doi/10.1109/QSIC.2005.1

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten