article

Generation of test purposes from Use Case Maps

Authors:

Luigi Logrippo,

Michael WeissAuthors Info & Claims

Computer Networks: The International Journal of Computer and Telecommunications Networking, Volume 49, Issue 5

Pages 643 - 660

Published: 05 December 2005 Publication History

Abstract

The Use Case Map (UCM) scenario notation can be used to model service requirements and high-level designs for reactive and distributed systems. It is therefore a natural candidate for use in the process of generating requirements-directed test suites. We survey several approaches for deriving test purposes from UCM models. We distinguish three main approaches. The first approach is based on testing patterns, the second one on UCM scenario definitions, and the third one on transformations to formal specifications (such as Lotos). Several techniques will be briefly illustrated and compared in terms of quality of the test purposes obtained, ease of use, and tool support. We also identify challenges in refining these test purposes into test cases as well as opportunities for improving current UCM-based testing.

References

[1]

Buhr, R.J.A. and Casselman, R.S., Use Case Maps for Object-oriented Systems. 1996. Prentice Hall.

Digital Library

[2]

Buhr, R.J.A., Use case maps as architectural entities for complex systems. IEEE Transactions on Software Engineering. v24 i12. 1131-1155.

Digital Library

[3]

UCM User Group, UCMNav 2, 2004. Available from: <http://www.usecasemaps.org/tools/ucmnav/index.shtml>.

[4]

ITU-T-International Telecommunications Union, Recommendation Z.100 (08/02): Specification and description language (SDL), Geneva, Switzerland, 2002.

[5]

OMG-Object Management Group (2003), Unified Modeling Language Specification, Version 1.5. Available from: <http://www.omg.org/uml>.

[6]

J. Tretmans, A formal approach to conformance testing, in: O. Rafiq (Ed.), Protocol Test Systems, VI-Sixth International Workshop on Protocol Test systems (IWPTS), Pau, France, September 1993, pp. 257-276.

Digital Library

[7]

ITU-T-International Telecommunications Union, Recommendation Z.120 (04/04): Message sequence chart (MSC), Geneva, Switzerland, 2004.

[8]

Grabowski, J., Hogrefe, D. and Nahm, R., Test case generation with test purpose specification by MSCs. In: Faergemand, O., Sarma, A. (Eds.), SDL'93-Using Objects, North-Holland.

[9]

Alexander, C., Ishikawa, S. and Silverstein, M., A Pattern Language. 1977. Oxford University Press, New York, USA.

[10]

D. DeLano, L. Rising, System Test Pattern Language. Pattern Languages of Programs (PLoP'96), Allerton Park, Illinois, USA, 1996. Available from: <http://www.agcs.com/patterns/papers/systestp.htm>.

[11]

Binder, R.V., Testing Object-oriented Systems-models, Patterns, and Tools. 1999. Addison-Wesley.

Digital Library

[12]

D. Amyot, Specification and Validation of Telecommunications Systems with Use Case Maps and Lotos, Ph.D. thesis, SITE, University of Ottawa, Canada, September 2001. Available from: <http://www.usecasemaps.org/pub/da_phd.pdf>.

Digital Library

[13]

Myers, G.J., The Art of Software Testing. 1979. Wiley-Interscience, New-York, USA.

Digital Library

[14]

Calder, M., Kolberg, M., Magill, E.H. and Reiff-Marganiec, S., Feature interaction: a critical review and considered forecast. Computer Networks. v41 i1. 115-141.

Digital Library

[15]

ISO-International Organization for Standardization, Information Processing Systems, Open Systems Interconnection, Lotos-A Formal Description Technique Based on the Temporal Ordering of Observational Behaviour, IS 8807, Geneva, Switzerland, 1989.

[16]

S. Pavón, D. Larrabeiti, D., G. Rabay, Lola-User Manual, version 3.6, DIT, Universidad Politécnica de Madrid, Spain, Lola/N5/V10, 1995.

[17]

Amyot, D. and Logrippo, L., Structural coverage for lotos-A Probe Insertion Technique. In: Ural, H., Probert, R.L., Bochmann, G.V. (Eds.), Testing of Communicating Systems: Tools and Techniques (TestCom 2000), Kluwer Academic Publishers. pp. 19-34.

Digital Library

[18]

Amyot, D. and Logrippo, L., Use case maps and lotos for the prototyping and validation of a mobile group call system. Computer Communication. v23 i12. 1135-1157.

Digital Library

[19]

P.E. Black, V. Okun, Y. Yesha, Mutation Operators for Specifications, 15th Automated Software Engineering Conference (ASE2000), Grenoble, France, September 2000, IEEE Computer Society, pp. 81-88. Available from: <http://hissa.ncsl.nist.gov/~black/Papers/opers.ps>.

Digital Library

[20]

A. Miga, D. Amyot, F. Bordeleau, D. Cameron, M. Woodside, Deriving Message Sequence Charts from Use Case Maps Scenario Specifications, in: R. Reed, J. Reed (Eds.), SDL 2001: Meeting UML-10th International SDL Forum, Copenhagen, Denmark, Lecture Notes in Computer Science, Vol. 2078, Springer, pp. 268-287.

Digital Library

[21]

URN Focus Group, Draft Rec. Z.152-Use Case Map Notation (UCM). Geneva, Switzerland, September 2003. Available from: <http://www.UseCaseMaps.org/urn>.

[22]

ITU-T-International Telecommunications Union, Recommendation Z.150 (02/03): User Requirements Notation (URN)-Language requirements and framework, Geneva, Switzerland, 2003.

[23]

D. Amyot, D.Y. Cho, X. He, Y. He, Generating Scenarios from Use Case Map Specifications, Third International Conference on Quality Software (QSIC'03), Dallas, USA, November 2003. Available from: <http://www.usecasemaps.org/pub/QSIC03.pdf>.

Digital Library

[24]

D. Amyot, A. Echihabi, Y. He, UCMExporter: Supporting Scenario Transformations from Use Case Maps, Proc. of NOTERE'04, Saı¿dia, Morocco, June 2004.

[25]

UCM User Group, UCMExporter, 2003. Available from: <http://ucmexporter.sourceforge.net>.

[26]

ITU-T-International Telecommunications Union, Recommendation Z. 140 (04/03): Testing and Test Control Notation version 3 (TTCN-3): Core language, Geneva, Switzerland, 2003.

[27]

Amyot, D., Introduction to the user requirements notation: Learning by example. Computer Networks. v42 i3. 285-301.

Digital Library

[28]

Telelogic AB, Tau SDL Suite, 2004. Available from: <http://www.telelogic.com/products/tau/sdl/index.cfm>.

[29]

Y. He, D. Amyot, A. Williams, Synthesizing SDL from Use Case Maps: An Experiment, in: R. Reed and J. Reed (Eds.), SDL 2003: System Design-11th International SDL Forum, Stuttgart, Germany, Lecture Notes in Computer Science, Vol. 2708, Springer, 2003, pp. 117-136. Available from: <http://www.usecasemaps.org/pub/SDL03-UCM-SDL.pdf>.

Digital Library

[30]

B. Koch, J. Grabowski, D. Hogrefe, M. Schmitt, Autolink-A Tool for Automatic Test Generation from SDL Specifications, IEEE International Workshop on Industrial Strength Formal Specification Techniques (WIFT'98), Boca Raton, USA, 1998, pp. 114-126.

Digital Library

[31]

L. Charfi, Formal Modeling and Test Generation Automation with Use Case Maps and Lotos. M.Sc. thesis, SITE, University of Ottawa, Canada, February 2001. Available from: <http://www.usecasemaps.org/pub/lc_msc.pdf>.

[32]

J.-C. Fernandez, C. Jard, T. Jéron, C. Viho, Using On-the-fly Verification Techniques for the Generation of Test Suites. Computer Aided Verification (CAV'96), New Jersey, USA, 1996, pp. 348-359.

Digital Library

[33]

R. Guan, From Requirements to Scenarios through Specifications: A translation Procedure from Use Case Maps to Lotos, Master thesis, SITE, University of Ottawa, Canada, 2002. Available from: <http://lotos.csi.uottawa.ca/ftp/pub/Lotos/Theses/rg_msc.doc>.

[34]

Stepien, B. and Logrippo, L., Graphic visualization and animation of Lotos execution traces. Computer Networks. v40 i5. 665-681.

Digital Library

[35]

W.T. Tsai, X. Bai, R. Paul, W. Shao, V. Agarwal, End-To-End Integration Testing Design. COMPSAC 2001, Chicago, USA, October 2001, pp. 166-171. Available from: <http://asusrl.eas.asu.edu/Publications/E2EpaperCOMPSACFinal.pdf>.

Digital Library

[36]

X. Bai, C.P. Lam, H. Li, An Approach to Generate Thin-threads from UML Diagrams, Technical Report TR-03-12, Edith Cowan University, Australia, 2004. Available from: <http://www.scis.ecu.edu.au/research/se/docs/TR-03-12.pdf>.

[37]

Eshuis, R. and Wieringa, R.J., Tool support for verifying UML activity diagrams. IEEE Transactions on Software Engineering. v30 i7. 437-447.

Digital Library

[38]

A. Reuys, S. Reis, S., E. Kamsties, K. Pohl, Derivation of Domain Test Scenarios from Activity Diagrams, Workshop on Product Line Engineering-The Early Steps (PLEES-03), Erfurt, Germany, 2003. Available from: <http://www.plees.info/Plees03/Papers/PLEES_2003_Reuys.pdf>.

[39]

H. Neukirchen, Z.R. Dai, J. Grabowski, Communication Patterns for Expressing Real-Time Requirements Using MSC and their Application to Testing, in: R. Groz, R.M. Hierons (Eds.), Testing of Communicating Systems, 16th IFIP International Conference, TestCom 2004, Oxford, UK, March 2004, Lecture Notes in Computer Science, vol. 2978, Springer, pp. 144-159.

[40]

K.J. Turner, Formalising Graphical Behaviour Descriptions, in: C. Rattray, S. Maharaj, C. Shankland (Eds.), Algebraic Methodology and Software Technology, 10th International Conference, AMAST 2004, Stirling, Scotland, UK, Lecture Notes in Computer Science, vol. 3116, Springer, 2004, pp. 537-552.

[41]

Hassine, J., Dssouli, R. and Rilling, J., Applying reduction techniques to software functional requirement specifications. In: Amyot, D., Williams, A.W. (Eds.), Lecture Notes in Computer Science, vol. 3319. Springer. pp. 138-153.

[42]

M. Ebner, TTCN-3 Test Case Generation from Message Sequence Charts. ISSRE'04 Workshop on Integrated-reliability with Telecommunications and UML Languages (ISSRE04:WITUL), Rennes, France, November 2004.

[43]

A. Prinz, R. Reed, J. Reed (Eds.), 12th SDL Forum, Grimstad, Norway, Lecture Notes in Computer Science, vol. 3530, Springer, 2005, pp. 247-264.

[44]

Petriu, D.B., Amyot, D. and Woodside, M., Scenario-based performance engineering with UCMNav. In: Reed, R., Reed, J. (Eds.), Lecture Notes in Computer Science, vol. 2708. Springer. pp. 18-35.

Digital Library

Cited By

Vizovitin NNepomniaschy VStenenko A(2015)Verifying UCM Specifications of Distributed Systems Using Colored Petri NetsCybernetics and Systems Analysis10.1007/s10559-015-9714-051:2(213-222)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1007/s10559-015-9714-0
Boulet PAmyot DStepien B(2015)Towards the Generation of Tests in the Test Description Language from Use Case Map ModelsProceedings of the 17th International SDL Forum on SDL 2015: Model-Driven Engineering for Smart Cities - Volume 936910.1007/978-3-319-24912-4_14(193-201)Online publication date: 12-Oct-2015
https://dl.acm.org/doi/10.1007/978-3-319-24912-4_14
Baranov SKotlyarov VWeigert T(2011)Verifiable coverage criteria for automated testingProceedings of the 15th international conference on Integrating System and Software Modeling10.1007/978-3-642-25264-8_8(79-89)Online publication date: 5-Jul-2011
https://dl.acm.org/doi/10.1007/978-3-642-25264-8_8
Show More Cited By

Index Terms

Recommendations

Formal mutation testing for Circus

Context: The demand from industry for more dependable and scalable test-development mechanisms has fostered the use of formal models to guide the generation of tests. Despite many advancements having been obtained with state-based models, such as Finite ...
Towards the Generation of Tests in the Test Description Language from Use Case Map Models
Proceedings of the 17th International SDL Forum on SDL 2015: Model-Driven Engineering for Smart Cities - Volume 9369

The Test Description Language TDL is an emerging standard from the European Telecommunications Standards Institute ETSI that targets the abstract description of tests for communicating systems and other application domains. TDL is meant to be used as an ...
From use case maps to executable test procedures: a scenario-based approach

Testing embedded systems software has become a costly activity as these systems become more complex to fulfill rising needs. Testing processes should be both effective and affordable. An ideal testing process should begin with validated requirements and ...

Comments

Information & Contributors

Information

Published In

Copyright © Elsevier B.V. © 2005.

Publisher

Elsevier North-Holland, Inc.

United States

Publication History

Published: 05 December 2005

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vizovitin NNepomniaschy VStenenko A(2015)Verifying UCM Specifications of Distributed Systems Using Colored Petri NetsCybernetics and Systems Analysis10.1007/s10559-015-9714-051:2(213-222)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1007/s10559-015-9714-0
Boulet PAmyot DStepien B(2015)Towards the Generation of Tests in the Test Description Language from Use Case Map ModelsProceedings of the 17th International SDL Forum on SDL 2015: Model-Driven Engineering for Smart Cities - Volume 936910.1007/978-3-319-24912-4_14(193-201)Online publication date: 12-Oct-2015
https://dl.acm.org/doi/10.1007/978-3-319-24912-4_14
Baranov SKotlyarov VWeigert T(2011)Verifiable coverage criteria for automated testingProceedings of the 15th international conference on Integrating System and Software Modeling10.1007/978-3-642-25264-8_8(79-89)Online publication date: 5-Jul-2011
https://dl.acm.org/doi/10.1007/978-3-642-25264-8_8
Mussbacher GAmyot DWeiss M(2007)Visualizing early aspects with use case mapsTransactions on aspect-oriented software development III10.5555/1805812.1805817(105-143)Online publication date: 1-Jan-2007
https://dl.acm.org/doi/10.5555/1805812.1805817
Amyot DRoy JWeiss M(2005)UCM-Driven testing of web applicationsProceedings of the 12th international conference on Model Driven10.1007/11506843_18(247-264)Online publication date: 20-Jun-2005
https://dl.acm.org/doi/10.1007/11506843_18

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents