Article

Model-based system testing of software product families

Authors:

Sacha ReisAuthors Info & Claims

CAiSE'05: Proceedings of the 17th international conference on Advanced Information Systems Engineering

Pages 519 - 534

https://doi.org/10.1007/11431855_36

Published: 13 June 2005 Publication History

Abstract

In software product family engineering reusable artifacts are produced during domain engineering and applications are built from these artifacts during application engineering. Modeling variability of current and future applications is the key for enabling reuse. The proactive reuse leads to a reduction in development costs and a shorter time to market. Up to now, these benefits have been realized for the constructive development phases, but not for testing. This paper presents the ScenTED technique (Scenario based TEst case Derivation), which aims at reducing effort in product family testing. ScenTED is a model-based, reuse-oriented technique for test case derivation in the system test of software product families. Reuse of test cases is ensured by preserving variability during test case derivation. Thus, concepts known from model-based testing in single system engineering, e.g., coverage metrics, must be adapted. Experiences with our technique gained from an industrial case study are discussed and prototypical tool support is illustrated.

References

[1]

Beizer, B.; "Black box testing", Van Nostrand Reinold, New York, 1990.

[2]

Bertolino, A.; Gnesi, S.; "PLUTO: A Test Methodology for Product Families", 5th Intl. Workshop on Product Family Engineering (PFE-5), Siena, Italy, November 2003.

[3]

Binder, R.; "Testing Object-Oriented Systems: Models, Patterns, and Tools", Addison-Wesley, Reading, 2000.

Digital Library

[4]

Clemens, P.; Northrop, L.; "Software Product Lines: Practices and Patterns", Addison-Wesley, Reading, 2002.

[5]

Devanbu, P.; Karstu, S.; Melo, W.; Thomas, W.; "Analytical and Empirical Evaluation of Software Reuse Metrics", 18th Intl. Conference on Software Engineering (ICSE), pp. 189- 199, July 1995.

Digital Library

[6]

El-Far, I. K.; "Enjoying the Perks of Model-Based Testing", Software Testing, Analysis, and Review Conference (STARWEST 2001), 2001.

[7]

Geppert, B.; Li, J.; Roessler, F.; Weiss, D.; "Towards Generating Acceptance Tests for Product Lines", 8th Intl. Conference on Software Reuse 2004, Madrid, Spain, Springer, New York, pp. 35-48, 2004.

[8]

Halmans, G.; Pohl, K.: "Communicating the Variability of a Software Product Family to Customers", Software and Systems Modeling (SoSyM), Vol. 2, pp. 15-36, Springer, Hamburg, March 2003.

[9]

Hartmann, J.; Vieira, M.; Foster, H.; Ruder, A.; "TDE/UML: A UML-based Test Generator to Support System Testing"; 5th Annual International Software Testing Conference in India, 2005.

[10]

Hartmann, J.; Vieira, M.; Ruder, A.; "UML-based Approach for Validating Product Lines", Intl. Workshop on Software Product Line Testing (SPLiT), Avaya Labs Technical Report, pp. 58-64, Boston, USA, August 2004.

[11]

Hauber, R.; Ziegler, M.; Erskine, M.; Hilsenbeck, R.; "Modellbasiertes Testen", Objektspectrum, No 3, pp. 20 - 24, 2003 (in German).

[12]

Kamsties, E.; Pohl, K.; Reis, S.; Reuys, A.; "Testing Variabilities in Use Case Models", 5th Intl. Workshop on Product Family Engineering (PFE-5), Siena, Italy, November 2003.

[13]

McGregor, J.: "Testing a Software Product Line", Technical Report CMU/SEI-2001-TR- 022, December 2001.

[14]

McGregor, J.; Northrop, L.; Jarrad, S.; Pohl, K.; "Initiating Software Product Lines", IEEE Software, Vol. 19, No. 4, pp. 24-27, July/August 2002.

Digital Library

[15]

Myers G.; "The Art of Software Testing", Wiley, New York, 1979.

Digital Library

[16]

Nebut, C.; Fleurey, F.; Le Traon, Y.; Jézéquel, J.-M.; "A Requirement-based Approach to Test Product Families", 5th Intl. Workshop on Product Family Engineering (PFE-5), Siena, Italy, November 2003.

[17]

Offutt, J.; Abdurazik, A.; "Generating Tests from UML Specifications", 2nd Intl. Conference on UML'99, 1999.

Digital Library

[18]

Reuys, A.; Goetz, H.; Neumann, J.; Weingaertner, J.; "Medizintechnik bei Siemens AG Medical Solutions HS IM", In: Boeckle, G.; Knauber, P.; Pohl, K.; Schmid, K. (eds); "Software-Produktlinien: Methoden, Einführung und Praxis", pp. 247-259, dpunkt, Heidelberg, 2004 (in German).

[19]

Reuys, A.; Reis, S.; Kamsties, E.; Pohl, K.; "Derivation of Domain Test Scenarios from Activity Diagrams"; Intl. Workshop on Product Line Engineering The Early Steps: Planning, Modeling, and Managing (PLEES'03), Erfurt, Germany, September 2003.

[20]

Riebisch, M.; Boellert, K.; Streidtferdt, D.; Franczyk, B.; "Extending the UML to Model System Families", World Conference on Integrated Design and Process Technology (IDPT 2000), Dallas, USA, June 2000.

[21]

van der Linden, F.; "Software Product Families in Europe: The Esaps & Café Projects", IEEE Software, Vol. 19, No. 4, pp. 41-49, July/August 2002.

Digital Library

Cited By

Agh HAzamnouri AWagner S(2024)Software product line testing: a systematic literature reviewEmpirical Software Engineering10.1007/s10664-024-10516-x29:6Online publication date: 2-Sep-2024
https://doi.org/10.1007/s10664-024-10516-x
Fischer SRamler RAssunção WEgyed AGradl CAuberger S(2023)Model-based Testing for a Family of Mobile ApplicationsProceedings of the 27th ACM International Systems and Software Product Line Conference - Volume A10.1145/3579027.3608996(242-253)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1145/3579027.3608996
Fischer SMichelon GAssunção WRamler REgyed A(2023)Designing a Test Model for a Configurable System: An Exploratory Study of Preprocessor Directives and Feature TogglesProceedings of the 17th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3571788.3571795(31-39)Online publication date: 25-Jan-2023
https://dl.acm.org/doi/10.1145/3571788.3571795
Show More Cited By

Recommendations

Incremental model-based testing of delta-oriented software product lines
TAP'12: Proceedings of the 6th international conference on Tests and Proofs

Software product line (SPL) engineering provides a promising approach for developing variant-rich software systems. But, testing of every product variant in isolation to ensure its correctness is in general not feasible due to the large number of ...
Model-based testing for software product lines
Assessing Software Product Line Testing Via Model-Based Mutation: An Application to Similarity Testing
ICSTW '13: Proceedings of the 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops

Needs for mass customization and economies of scale have pushed engineers to develop Software Product Lines (SPLs). SPLs are families of products sharing commonalities and exhibiting differences, built by reusing software assets abstractly represented ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

CAiSE'05: Proceedings of the 17th international conference on Advanced Information Systems Engineering

June 2005

583 pages

ISBN:3540260951

Editors:
Oscar Pastor
Department of Information Systems and Computation, Technical University of Valencia, Camino de Vera s/n, Valencia, Spain
,
João Falcão e Cunha
Department of Information Systems and Computation, Faculdade de Engenharia da Universidade do Porto, Camino de Vera s/n, Porto, Portugal

Sponsors

FCT: Foundation for Science and Technology
Universidad Politécnica de Valencia, Spain
University of Porto
FEUP: Faculdade de Engenharia da Univ. do Porto
ERCIM: European Research Consortium for Informatics & Mathematics

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 13 June 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Agh HAzamnouri AWagner S(2024)Software product line testing: a systematic literature reviewEmpirical Software Engineering10.1007/s10664-024-10516-x29:6Online publication date: 2-Sep-2024
https://doi.org/10.1007/s10664-024-10516-x
Fischer SRamler RAssunção WEgyed AGradl CAuberger S(2023)Model-based Testing for a Family of Mobile ApplicationsProceedings of the 27th ACM International Systems and Software Product Line Conference - Volume A10.1145/3579027.3608996(242-253)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1145/3579027.3608996
Fischer SMichelon GAssunção WRamler REgyed A(2023)Designing a Test Model for a Configurable System: An Exploratory Study of Preprocessor Directives and Feature TogglesProceedings of the 17th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3571788.3571795(31-39)Online publication date: 25-Jan-2023
https://dl.acm.org/doi/10.1145/3571788.3571795
Eichhorn DPett TPrzigoda NKindsvater JSeidl CSchaefer I(2023)Coverage-Driven Test Automation for Highly-Configurable Railway SystemsProceedings of the 17th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3571788.3571794(23-30)Online publication date: 25-Jan-2023
https://dl.acm.org/doi/10.1145/3571788.3571794
Sion LVan Landuyt DJoosen Wde Jong GMei H(2016)Systematic quality trade-off support in the software product-line configuration processProceedings of the 20th International Systems and Software Product Line Conference10.1145/2934466.2934481(164-173)Online publication date: 16-Sep-2016
https://dl.acm.org/doi/10.1145/2934466.2934481
Basso FOliveira TFarias KCho YShin SKim SHung CHong J(2014)Extending JUnit 4 with Java annotations and reflection to test variant model transformation assetsProceedings of the 29th Annual ACM Symposium on Applied Computing10.1145/2554850.2555054(1601-1608)Online publication date: 24-Mar-2014
https://dl.acm.org/doi/10.1145/2554850.2555054
Lochau MPeldszus SKowal MSchaefer I(2014)Model-Based TestingAdvanced Lectures of the 14th International School on Formal Methods for Executable Software Models - Volume 848310.1007/978-3-319-07317-0_8(310-342)Online publication date: 16-Jun-2014
https://dl.acm.org/doi/10.1007/978-3-319-07317-0_8
Tiwari RGoel N(2013)ReuseACM SIGSOFT Software Engineering Notes10.1145/2439976.243998238:2(1-11)Online publication date: 23-Mar-2013
https://dl.acm.org/doi/10.1145/2439976.2439982
Asaithambi SJarzabek SLeavens G(2012)Generic adaptable test cases for software product line testingProceedings of the 3rd annual conference on Systems, programming, and applications: software for humanity10.1145/2384716.2384733(33-36)Online publication date: 19-Oct-2012
https://dl.acm.org/doi/10.1145/2384716.2384733
Heider WRabiser RGrünbacher PLettner DSantana de Almeida ESchwanninger CBenavides D(2012)Using regression testing to analyze the impact of changes to variability models on productsProceedings of the 16th International Software Product Line Conference - Volume 110.1145/2362536.2362563(196-205)Online publication date: 2-Sep-2012
https://dl.acm.org/doi/10.1145/2362536.2362563
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents