Article

Selecting an Efficient OO Integration Testing Strategy: An Experimental Comparison of Actual Strategies

Authors:

Jean-Marc JézéquelAuthors Info & Claims

ECOOP '01: Proceedings of the 15th European Conference on Object-Oriented Programming

Pages 381 - 401

Published: 18 June 2001 Publication History

Abstract

The normalization of semi-formal modeling methods, such as the UML, leads to re-visit the problem of early OO integration test planning. Integration is often conducted under some incremental steps. Integration test planning aims at ordering the components to be integrated and tested in relationships with the already tested part of the system. This paper presents a modeling of the test integration problem from a UML design, then details existing integration strategies and proposes two integration strategies: a deterministic one called Triskell and an original semi-random one, based on genetic algorithms called Genetic. Strategies are compared in detail (algorithmic cost and optimization choices) and a large part of the paper is dedicated to an experimental comparison of each strategy on 6 real-world case studies of various complexities (from a "small" telecommunication software to the Swing Java library). Results show that a good modeling of this optimization problem associated with well-chosen algorithms induce a significant gain in terms of testing effort and duration.

References

[1]

B. Beizer, "Software testing techniques," Van Norstrand Reinhold, 1990. ISBN 0-442- 20672-0.

[2]

Robert V. Binder, "Testing Object-Oriented Systems, Models, Parterns and Tools", Addison Wesley, First printing, October, 1999, ISBN 0-201-80938-9.

[3]

F. Bourdoncle, "Efficient Chaotic Iteration Strategies with Widenings", Proc. of the International Conference on Formal Methods in Programming and their Applications, Lecture Notes in Computer Science 735, Springer-Verlag (1993), 128-141, ISSN 0302- 9743.

[4]

Kuo Chung Tai and Fonda J. Daniels, "Interclass Test Order for Object-Oriented Software," Journal of Object-Oriented Programming (JOOP), v 12, n 4, July-August 1999, 18-35, ISSN: 0896-8438.

[5]

D. E. Goldberg, "Genetic Algorithms in Search, Optimization and Machine Learning", Addison Wesley, 1989. ISBN: 0-201-15767-5.

[6]

Mary Jean Harrold, John D. McGregor, and Kevin J. Fitzpatrick, "Incremental Testing of Object-oriented Class Structures," Proceedings, 14th International Conference on Software Engineering, May 1992. IEEE Computer Society Press, Los Alamitos, California. 68-80. ISBN 0-7695-0915-0.

[7]

Thierry Jéron, Jean-Marc Jézéquel, Yves Le Traon and Pierre Morel, "Efficient Strategies for Integration and Regression Testing of OO Systems", In proc. of the 10th International Symposium on Software Reliability Engineering (ISSRE'99), November 1999, Boca raton (Florida), 260-269, ISBN 0-7695-0807-3.

[8]

Jean-Marc Jézéquel, "Object Oriented Software Engineering with Eiffel," Addison-Wesley, mar 1996. ISBN 1-201-63381-7.

[9]

Paul C. Jorgensen and Carl Erickson, "Object-Oriented Integration Testing" Communications of the ACM, v 37, n 9, September 1994, 30-38, ISSN: 0001-0782.

[10]

David C. Kung, Gao, Jerry, Chen, Cris., "On Regression Testing of Object-Oriented Programs," The Journal of Systems and Software. v 32 n 1, Jan 1996, ISSN: 0164-1212.

[11]

Y. Labiche, P. Thévenod-Fosse, H Waeselynck and M.H. Durand, "Testing Levels for Object-Oriented Software". In proc of ICSE' 2000, June 2000, Limerick (Ireland) 138-145, ISBN 1-5811-3074-0.

[12]

Yves Le Traon, Thierry Jéron, Jean-Marc Jézéquel and Pierre Morel, "Efficient OO Integration and Regression Testing", IEEE Transactions on Reliability, v.49, n 1, March 2000, 12-25. ISSN 0018-9529.

[13]

John D. McGregor and Tim Korson, "Integrating Object-Oriented Testing and Development Processes," Communications of the ACM, v 37, n 9, September 1994, 59- 77, ISSN: 0001-0782.

[14]

S.M. Sait, H.Youssef, "Iterative Computer Algorithms with Applications in Engineering Solving Combinatorial Optimization Problems", IEEE COMPUTER SOCIETY 1999.

[15]

R. Tarjan, "Depth-first search and linear graph algorithms", SIAM J. Comput., v.1, n 2, June 1972, 146-160, ISSN 1064-8275.

[16]

James Rumbaugh and Ivar Jacobson and Grady Booch,"The Unified Modeling Language Reference Guide", Addison-Wesley, 1998, ISBN 0-201-3099-8.

Cited By

Zhang YJiang SWang XChen RZhang M(2019)An optimization algorithm applied to the class integration and test order problemSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-018-3077-123:12(4239-4253)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1007/s00500-018-3077-1
Clarke PPower JBabich DKing T(2012)A testing strategy for abstract classesSoftware Testing, Verification & Reliability10.1002/stvr.42922:3(147-169)Online publication date: 1-May-2012
https://dl.acm.org/doi/10.1002/stvr.429
Zhang WRyder BDas MGrossman D(2007)Discovering accurate interclass test dependencesProceedings of the 7th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering10.1145/1251535.1251545(55-62)Online publication date: 13-Jun-2007
https://dl.acm.org/doi/10.1145/1251535.1251545
Show More Cited By

Recommendations

An integration testing approach based on test patterns and MDA techniques
SugarLoafPLoP '10: Proceedings of the 8th Latin American Conference on Pattern Languages of Programs

Integration testing may demand a large number of test cases in order to cover different combinations of components usage. To handle this problem, test patterns can be used to guide the selection according to specific features of the system. In this ...
Composite metamorphic relations for integration testing
ICCTA '22: Proceedings of the 2022 8th International Conference on Computer Technology Applications

Metamorphic testing is a testing method for problems without test oracles. Integration testing allows for detecting errors in complex systems that may not be found during the testing of their components. In this paper, we propose a novel approach that ...
Integration testing for robotic systems
Abstract
Conventional approaches for the validation of robotic systems include simulations and functional software testing. Although these approaches are interesting, they do not offer coverage information to guide the testing activity. In this sense, the ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

ECOOP '01: Proceedings of the 15th European Conference on Object-Oriented Programming

June 2001

428 pages

ISBN:3540422064

Editor:
Jørgen Lindskov Knudsen

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 18 June 2001

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang YJiang SWang XChen RZhang M(2019)An optimization algorithm applied to the class integration and test order problemSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-018-3077-123:12(4239-4253)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1007/s00500-018-3077-1
Clarke PPower JBabich DKing T(2012)A testing strategy for abstract classesSoftware Testing, Verification & Reliability10.1002/stvr.42922:3(147-169)Online publication date: 1-May-2012
https://dl.acm.org/doi/10.1002/stvr.429
Zhang WRyder BDas MGrossman D(2007)Discovering accurate interclass test dependencesProceedings of the 7th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering10.1145/1251535.1251545(55-62)Online publication date: 13-Jun-2007
https://dl.acm.org/doi/10.1145/1251535.1251545
Ali SBriand LRehman MAsghar HIqbal MNadeem A(2007)A state-based approach to integration testing based on UML modelsInformation and Software Technology10.1016/j.infsof.2006.11.00249:11-12(1087-1106)Online publication date: 1-Nov-2007
https://dl.acm.org/doi/10.1016/j.infsof.2006.11.002
Briand LLabiche YWang Y(2003)An Investigation of Graph-Based Class Integration Test Order StrategiesIEEE Transactions on Software Engineering10.1109/TSE.2003.121432429:7(594-607)Online publication date: 1-Jul-2003
https://dl.acm.org/doi/10.1109/TSE.2003.1214324

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents