Article

Towards traceability of model-based testing artifacts

Authors:

Leila Naslavsky,

Debra J. RichardsonAuthors Info & Claims

A-MOST '07: Proceedings of the 3rd international workshop on Advances in model-based testing

Pages 105 - 114

https://doi.org/10.1145/1291535.1291546

Published: 09 July 2007 Publication History

Abstract

Practitioners regard software testing as the central means for ensuring that a system behaves as expected. Due to the recent widespread adoption of model-driven development (MDD), code is no longer the single source for selecting test cases. Testing against original expectations can be done with model-based testing that adopts high-level models as the basis for test generation. In addition to test generation, challenges to model-based testing include creation and maintenance of traceability information among test-related artifacts. Traceability is required to support activities such as result evaluation, regression testing and coverage analysis. MDD and model transformation solutions address the traceability problem by creating relationships among transformed artifacts throughout the transformation process. This paper proposes an approach that leverages model transformation traceability techniques to create fine-grained relationships among model-based testing artifacts. Relationships are created during the test generation process. Their fine granularity enables the support for result evaluation, coverage analysis and regression testing.

References

[1]

ADT: ATL Development Tools, http://www.eclipse.org/m2m/atl/.

[2]

Atlas Model Weaver (AMW), http://www.eclipse.org/gmt/amw/.

[3]

Eclipse - an open development platform.

[4]

Eclipse Modeling Framework Project (EMF), http://www.eclipse.org/modeling/emf/?project=emf.

[5]

JCL - Java Constraint Library, http://liawww.epfl.ch/JCL/.

[6]

Parasoft, http://www.parasoft.com.

[7]

MOF#8482; Query / Views / Transformations, OMG, 2005.

[8]

I. Alexander, Towards automatic traceability in the industrial practice, 1st international workshop on traceability in emerging forms of software engineering, Edinburgh, UK, 2002.

[9]

R. Balasubramaniam, Matthias, J., Toward Reference Models for Requirements Traceability, IEEE Press, 2001.

[10]

F. Basanieri, Bertolino, A., Marchetti, E., The Cow_Suite Approach to Planning and Deriving Test Suites in UML Projects, Proceedings of the 5th International Conference on The Unified Modeling Language, Springer-Verlag, 2002, pp. 383--397.

Digital Library

[11]

M. Benattou, Bruel, J. M., Hameurlain, N., Generating Test Data from OCL Specication, ECOOP 2002 Workshop on integration and transformation of UML models (WITUML'2002), Málaga, Spain, 2002.

[12]

R. V. Binder, Round-trip Scenario Test, Testing Object-Oriented Systems - Models, Patterns, and Tools, Addison-Wesley, 2000, pp. 579--591.

Digital Library

[13]

F. Bouquet, Jaffuel, E., Legeard, B., Peureux, F., Utting, M., Requirements Traceability in Automated Test Generation - Application to Smart Card Software Validation, ICSE Int. Workshop on Advances in Model-Based Software Testing (A-MOST'05), ACM Press, St. Louis, USA, 2005.

Digital Library

[14]

L. C. Briand, Labiche, Y., A UML-Based Approach to System Testing, 4th International Conference on the Unified Modeling Language (UML), Toronto, Canada, 2001, pp. 194--208.

Digital Library

[15]

C. Csallner, Smaragdakis, Y., JCrasher: An automatic robustness tester for Java, 2004, pp. 1025--1050.

Digital Library

[16]

J. Dick, Faivre, A., Automating the Generation and Sequencing of Test Cases from Model-Based Specifications, Springer-Verlag, 1993.

[17]

M. Didonet Del Fabro, Generating an ATL Execution Trace as a Traceability Weaving Model (ATL to Tracer), http://www.eclipse.org/gmt/amw/examples/#ATL2WTracer.

[18]

M. Didonet Del Fabro, Bézivin, J., Valduriez, P., Weaving Models with the Eclipse AMW plugin, Eclipse Modeling Symposium, Eclipse Summit Europe 2006, Esslingen, Germany, 2006.

[19]

T. T. Dinh-Trong, Ghosh, S., France, R. B., A Systematic Approach to Generate Inputs to Test UML Design Models, 17th International Symposium on Software Reliability Engineering (ISSRE'06), 2006, pp. 95--104.

Digital Library

[20]

A. Egyed, A scenario-driven approach to trace dependency analysis, IEEE Transactions on Software Engineering, 2003.

Digital Library

[21]

F. Fraikin, Leonhardt, T., SeDiTeC --- Testing Based on Sequence Diagrams, 17th IEEE International Conference on Automated Software Engineering, 2002, pp. 261--266.

Digital Library

[22]

V. Garousi, Briand, L. C., Labiche Y., Control Flow Analysis of UML 2.0 Sequence Diagrams, European Conference on Model Driven Architecture-Foundations and Applications (ECMDA-FA), 2005.

Digital Library

[23]

W. Grieskamp, Nachmanson, L., Tillmann, N., Veanes, M., Test Case Generation from AsmL Specifications - Tool Overview, 10th International Workshop on Abstract State Machines, Taormina, Italy, 2003.

Digital Library

[24]

A. Hartman, Nagin, K., The AGEDIS tools for model based testing, 2004 ACM SIGSOFT international symposium on Software testing and analysis, ACM Press, Boston, Massachusetts, USA, 2004, pp. 129--132.

Digital Library

[25]

W. Jeremiah, Frank, M., Using UML to Partially Automate Generation of Scenario-Based Test Drivers, 7th International Conference on Object Oriented Information Systems, 2001, pp. 303--306.

[26]

F. Jouault, Loosely Coupled Traceability for ATL, European Conference on Model Driven Architecture Workshop on Traceability, Nuremberg, Germany, 2005.

[27]

F. Jouault, Kurtev, I., On the Architectural Alignment of ATL and QVT, ACM Symposium on Applied Computing (SAC 06), ACM Press, Dijon, France, 2006, pp. 1188--1195.

Digital Library

[28]

M. Lindval, Sandahl, K., Practical Implications of Traceability, Software Practice and Experience, 1996, pp. 1161--1180.

Digital Library

[29]

L. Naslavsky, Alspaugh, T. A., Richardson, D. J., Ziv, H., Using Scenarios to Support Traceability, International Workshop on Traceability in Emerging Forms of Software Engineering, ACM Press, Long Beach, 2005, pp. 25--30.

Digital Library

[30]

C. Nebut, Fleurey, F., Traon, Y. L., Jézéquel, J., Automatic Test Generation: A Use Case Driven Approach, IEEE Transactions on Software Engineering, 32 (2006), pp. 140--155.

Digital Library

[31]

D. J. Richardson, TAOS: Testing with Analysis and Oracle Support, ACM Press, Seattle, Washington, United States, 1994.

[32]

D. J. Richardson, Aha, S. L., O'Malley, T. O., Specification-based test oracles for reactive systems, Proceedings of the 14th international conference on Software engineering, ACM Press, Melbourne, Australia, 1992, pp. 105--118.

Digital Library

[33]

A. Rountev, Kagan, S., Sawin, J., Coverage Criteria for Testing of Object Interactions in Sequence Diagrams, Fundamental Approaches to Software Engineering, Springer Berlin/Heidelberg, 2005, pp. 289--304.

Digital Library

[34]

G. Spanoudakis, Zisman, A., Software Traceability: A Roadmap, Advances in Software Engineering and Knowledge Engineering, World Scientific Publishing, 2005.

[35]

P. Stocks, Carrington, D., A Framework for Specification-Based Testing, IEEE Transactions on Software Engineering, 1996, pp. 777--793.

Digital Library

[36]

S. Uchitel, Chatley, R., Kramer, J., Magee, J., System Architecture: the Context for Scenario-based Model Synthesis, 12^th ACM SIGSOFT twelfth international symposium on Foundations of software engineering, 2004, pp. 33--42.

Digital Library

[37]

J. Wittevrongel, Maurer, F., SCENTOR: Scenario-Based Testing of E-Business Applications, Tenth IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, 2001, pp. 41--46.

Digital Library

[38]

T. Xie, Marinov, D., Notkin, D., Rostra: A Framework for Detecting Redundant Object-Oriented Unit Tests, 19th IEEE International Conference on Automated Software Engineering (ASE'04), 2004, pp. 196--205.

Digital Library

Cited By

Mustafa NLabiche Y(2017)The Need for Traceability in Heterogeneous Systems: A Systematic Literature Review2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC)10.1109/COMPSAC.2017.237(305-310)Online publication date: Jul-2017
https://doi.org/10.1109/COMPSAC.2017.237
Arora VBhatia RSingh M(2016)A systematic review of approaches for testing concurrent programsConcurrency and Computation: Practice & Experience10.1002/cpe.371128:5(1572-1611)Online publication date: 10-Apr-2016
https://dl.acm.org/doi/10.1002/cpe.3711
Lamancha BPolo MCaivano DPiattini MVisaggio G(2013)Automated generation of test oracles using a model-driven approachInformation and Software Technology10.1016/j.infsof.2012.08.00955:2(301-319)Online publication date: 1-Feb-2013
https://dl.acm.org/doi/10.1016/j.infsof.2012.08.009
Show More Cited By

Index Terms

Towards traceability of model-based testing artifacts
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

A subset of precise UML for model-based testing
A-MOST '07: Proceedings of the 3rd international workshop on Advances in model-based testing

This paper presents an original model-based testing approach that takes a UML behavioural view of the system under test and automatically generates test cases and executable test scripts according to model coverage criteria. This approach is embedded in ...
Using model transformation to support model-based test coverage measurement
AST '08: Proceedings of the 3rd international workshop on Automation of software test

Adoption of model-driven development is leading to increased use of models jointly with source code for software testing, by means of Model-Based Testing (MBT). MBT uses models to derive concrete test cases to test code. With MBT, test adequacy criteria ...
Using traceability to support model-based regression testing
ASE '07: Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering

Model-driven development is leading to increased use of models in conjunction with source code in software testing. Model-based testing, however, introduces new challenges for testing activities, which include creation and maintenance of traceability ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

A-MOST '07: Proceedings of the 3rd international workshop on Advances in model-based testing

July 2007

127 pages

ISBN:9781595938503

DOI:10.1145/1291535

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

SIGPLAN: ACM Special Interest Group on Programming Languages

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 July 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ISSTA07

Sponsor:

SIGSOFT

ISSTA07: International Symposium on Software Testing and Analysis

July 9 - 12, 2007

London, United Kingdom

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
1,142
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mustafa NLabiche Y(2017)The Need for Traceability in Heterogeneous Systems: A Systematic Literature Review2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC)10.1109/COMPSAC.2017.237(305-310)Online publication date: Jul-2017
https://doi.org/10.1109/COMPSAC.2017.237
Arora VBhatia RSingh M(2016)A systematic review of approaches for testing concurrent programsConcurrency and Computation: Practice & Experience10.1002/cpe.371128:5(1572-1611)Online publication date: 10-Apr-2016
https://dl.acm.org/doi/10.1002/cpe.3711
Lamancha BPolo MCaivano DPiattini MVisaggio G(2013)Automated generation of test oracles using a model-driven approachInformation and Software Technology10.1016/j.infsof.2012.08.00955:2(301-319)Online publication date: 1-Feb-2013
https://dl.acm.org/doi/10.1016/j.infsof.2012.08.009
Lamancha BReales PPolo MCaivano D(2013)Model-Driven Test Code GenerationEvaluation of Novel Approaches to Software Engineering10.1007/978-3-642-32341-6_11(155-168)Online publication date: 2013
https://doi.org/10.1007/978-3-642-32341-6_11
Slack J(2011)ModelTesterJournal of Computing Sciences in Colleges10.5555/2037151.203716227:1(37-46)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.5555/2037151.2037162
Grosch V(2011)Requirements Traceability within Model-Based TestingInternational Journal of Embedded and Real-Time Communication Systems10.4018/jertcs.20110401012:2(1-21)Online publication date: 1-Apr-2011
https://dl.acm.org/doi/10.4018/jertcs.2011040101
Tran HZdun UDustdar S(2011)VbTraceSoftware and Systems Modeling (SoSyM)10.1007/s10270-009-0137-010:1(5-29)Online publication date: 1-Feb-2011
https://dl.acm.org/doi/10.1007/s10270-009-0137-0
Pérez Lamancha BPolo Usaola MPiattini Velthius M(2011)A Model Based Testing Approach for Model-Driven Development and Software Product LinesEvaluation of Novel Approaches to Software Engineering10.1007/978-3-642-23391-3_14(193-208)Online publication date: 2011
https://doi.org/10.1007/978-3-642-23391-3_14
Naslavsky LZiv HRichardson D(2010)MbSRT2Proceedings of the 2010 Third International Conference on Software Testing, Verification and Validation10.1109/ICST.2010.61(89-98)Online publication date: 6-Apr-2010
https://dl.acm.org/doi/10.1109/ICST.2010.61
Seo KChoi E(2009)Traceability of UML Based Test Artifacts Using XMLThe KIPS Transactions:PartD10.3745/KIPSTD.2009.16-D.2.21316D:2(213-222)Online publication date: 30-Apr-2009
https://doi.org/10.3745/KIPSTD.2009.16-D.2.213
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents