Article

Environment behavior models for scenario generation and testing automation

Authors:

Mikhail Auguston,

James Bret Michael, and

Man-Tak ShingAuthors Info & Claims

A-MOST '05: Proceedings of the 1st international workshop on Advances in model-based testing

May 2005

Pages 1 - 6

https://doi.org/10.1145/1083274.1083284

Published: 15 May 2005 Publication History

Abstract

This paper suggests an approach to automatic scenario generation from environment models for testing of real-time reactive systems. The behavior of the system is defined as a set of events (event trace) with two basic relations: precedence and inclusion. The attributed event grammar (AEG) specifies possible event traces and provides a uniform approach for automatically generating, executing, and analyzing test cases. The environment model includes a description of hazardous states in which the system may arrive and makes it possible to gather statistics for system safety assessment. The approach is supported by a generator that creates test cases from the AEG models. We demonstrate the approach with case studies of prototypes for the safety-critical computer-assisted resuscitation algorithm (CARA) software for a casualty intravenous fluid infusion pump and the Paderborn Shuttle System.

References

[1]

{AA} Alur, R., Arney, D., Gunter, E., Lee, I. Nam, W., and Zhou, J., Formal specifications and analysis of the computer assisted resuscitation algorithm (CARA) Infusion Pump Control System, J. Software Tools for Technology Transfer 5, 4 (2004), pp. 308--319.

Digital Library

[2]

{ABK} Alfonso, A., Braberman, V., Kicillof, N., and Olivero, A. Visual timed event scenarios, in Proc. 26th Int. Conf. on Software Engineering, ACM Press (Edinburgh, Scot., May 2004), pp. 168--177.

Digital Library

[3]

{A1} Auguston, M. A language for debugging automation, in Chang, S. K., ed., Proc. Sixth Int. Conf. on Software Engineering & Knowledge Engineering, Skokie, Ill., Knowledge Systems Inc., June 1994, pp. 108--115.

[4]

{A2} Auguston, M. Lightweight semantics models for program testing and debugging automation, in Proc. 7th Monterey Workshop: Modeling Software System Structures in a Fastly Moving Scenario, (Santa Margherita Ligure, Italy, June 2000), pp. 23--31.

[5]

{AJ} Auguston, M., Jeffery, C., and Underwood, S. A framework for automatic debugging, in Proc. 17th Int. Conf. on Automated Software Engineering, ACM Press (Edinburgh, Scot., Sept. 2002), pp. 217--222.

Digital Library

[6]

{AL} Atchison, B. M. and Lindsay, P. A safety validation of - embedded control software using Z animation, in Proc. 5th Int. Symposium on High Assurance Systems Engineering, IEEE (Albuquerque, N. M., Nov. 2000), pp. 228--237

[7]

{BK} Boyapati, C., Khurshid, S., and Marinov, D., Korat: Automated testing based on Java predicates, in Proc. Int. Symposium on Software Testing and Analysis, ACM Press (Rome, Italy, July 2002), pp. 123--133.

Digital Library

[8]

{B1} Blackburn, M. R. Using models for test generation and analysis, in Proc. 17th Digital Avionics Systems Conf., Vol. 1, IEEE (Bellevue, Wash., Oct., 1998), pp. C45/1-C45/8.

[9]

{CL} Crowley, J. L., Leathrum, J. F., and Liburdy, K. A. Issues in the full scale use of formal methods for automated testing, in Proc. ACM SIGSOFT Int. Symposium on Software Testing and Analysis, ACM SIGSOFT Software Engineering Notes 21, 3 (1996), pp. 71--77.

Digital Library

[10]

{DJ} Dalal, S. R., Jain, A., Karunanithi, N., Leaton, J. M., Lott, C. M., Patton, G. C., and Horowitz, B. M. Model-based testing in practice, in Proc. Int. Conf. on Software Engineering, (Los Angeles, Calif., May 1999), pp. 285--294.

Digital Library

[11]

{EC} ECRI. Hazard Report. Abbott PCA Plus II - Patient controlled analgesic pumps prone to misprogramming, resulting in narcotic overinfusions, J. Health Devices 26 (1997), pp. 389--391.

[12]

{HL} Hong, H. S. and Lee, I. Automatic test generation from specifications for control-flow and data-flow coverage criteria, in Proc. Monterey Workshop, Monterey, Calif.: Naval Postgraduate School (Monterey, Calif., June 2001), pp.230--246.

[13]

{HU} Hierons, R. M. and Ural, H. Concerning the ordering of adaptive test sequences, in Proc. 23rd IFIP Int. Conf. on Formal Techniques for Networked and Distributed Systems, (Berlin, Germany, Sept. 2003), Berlin: Springer, Lecture Notes in Computer Science, Vol. 2767, pp. 289--302.

[14]

{KA} Korel, B. and Al-Yami, A. M. Assertion-oriented automated test data generation, in Proc. 18th Int. Conf. on Software Engineering, IEEE (Berlin, Germany, Mar. 1996), pp. 71--80.

Digital Library

[15]

{KS} Kreiner, C., Steger, C., and Weiss, R. Improvement of control software for automatic logistic systems using executable environment models, in Proc. 24th Euromicro Conf., Vol. 2, IEEE (Vasteras Sweden, Aug. 1998), pp. 919--923.

Digital Library

[16]

{Ma} Maurer, P. Generating test data with enhanced context-free grammars, IEEE Software, July 1990, pp. 50--55

Digital Library

[17]

{MK} McKeeman, W. M. Differential testing for software, Digital Tech. J. 10, 1 (1998), pp. 100--107.

[18]

{Pa} Paakki, J. Attribute grammar paradigms - A high-level methodology in language implementation, ACM Computing Surveys 27, 2 (June 1995), pp. 196--255.

Digital Library

[19]

{PA} Paderborn Shuttle System Case Study at http://wwwcs.upb.de/cs/ag-schaefer/CaseStudies/ShuttleSystem/

[20]

{So} Software Safety, NASA Technical Standard. NASA-STD-8719.13A, Sept. 1997, http://satc.gsfc.nasa.gov/assure/nss8719_13.html.

[21]

{WI} WRAIR Dept. of Resuscitative Medicine, Narrative Description of the CARA software, proprietary document, WRAIR, Silver Spring, Md., Jan 2001.

[22]

{WP} Wang, Y. and Parnas, D. Simulating the behavior of software modules by trace rewriting, IEEE Transactions on Software Engineering 20, 10 (Oct. 1994), pp. 750--759.

Digital Library

Cited By

Dadeau FFourneret EBouchelaghem A(2019)Temporal property patterns for model-based testing from UML/OCLSoftware and Systems Modeling (SoSyM)10.1007/s10270-017-0635-418:2(865-888)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1007/s10270-017-0635-4
Wang CPastore FBriand L(2017)System Testing of Timing Requirements Based on Use Cases and Timed Automata2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST.2017.34(299-309)Online publication date: Mar-2017
https://doi.org/10.1109/ICST.2017.34
Castillos KDadeau FJulliand J(2014)Coverage Criteria for Model-Based Testing using Property PatternsElectronic Proceedings in Theoretical Computer Science10.4204/EPTCS.141.3141(29-43)Online publication date: 27-Mar-2014
https://doi.org/10.4204/EPTCS.141.3
Show More Cited By

Index Terms

Environment behavior models for scenario generation and testing automation
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Environment behavior models for scenario generation and testing automation

This paper suggests an approach to automatic scenario generation from environment models for testing of real-time reactive systems. The behavior of the system is defined as a set of events (event trace) with two basic relations: precedence and ...
Read More
An empirical comparison of model-based and capture and replay approaches for performance testing

A variety of testing tools has been developed to support and automate the software testing activity. Some of them may use different techniques such as Model-based Testing (MBT) or Capture and Replay (CR). Model-based Testing is a technique for automatic ...
Read More
Integrating techniques and tools for testing automation: Research Articles

This article presents two tools to generate test cases, one for Java programs and one for .NET programs, as well as a structured testing process whereby such tools can be used in order to help in process automation. The main innovation in this work is ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

A-MOST '05: Proceedings of the 1st international workshop on Advances in model-based testing

May 2005

136 pages

ISBN:1595931155

DOI:10.1145/1083274

ACM SIGSOFT Software Engineering Notes Volume 30, Issue 4
July 2005
1514 pages
ISSN:0163-5948
DOI:10.1145/1082983
Issue’s Table of Contents

Copyright © 2005 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 May 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
738
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Dadeau FFourneret EBouchelaghem A(2019)Temporal property patterns for model-based testing from UML/OCLSoftware and Systems Modeling (SoSyM)10.1007/s10270-017-0635-418:2(865-888)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1007/s10270-017-0635-4
Wang CPastore FBriand L(2017)System Testing of Timing Requirements Based on Use Cases and Timed Automata2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST.2017.34(299-309)Online publication date: Mar-2017
https://doi.org/10.1109/ICST.2017.34
Castillos KDadeau FJulliand J(2014)Coverage Criteria for Model-Based Testing using Property PatternsElectronic Proceedings in Theoretical Computer Science10.4204/EPTCS.141.3141(29-43)Online publication date: 27-Mar-2014
https://doi.org/10.4204/EPTCS.141.3
Dadeau FCastillos KTissot R(2012)Scenario-based testing using symbolic animation of B modelsSoftware Testing, Verification & Reliability10.1002/stvr.146722:6(407-434)Online publication date: 1-Sep-2012
https://dl.acm.org/doi/10.1002/stvr.1467
Castillos KDadeau FJulliand J(2011)Scenario-based testing from UML/OCL behavioral modelsInternational Journal on Software Tools for Technology Transfer (STTT)10.5555/3220907.322116013:5(431-448)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.5555/3220907.3221160
Castillos KBotella J(2011)Scenario Based Test Generation Using Test DesignerProceedings of the 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops10.1109/ICSTW.2011.93(79-88)Online publication date: 21-Mar-2011
https://dl.acm.org/doi/10.1109/ICSTW.2011.93
Castillos KDadeau FJulliand J(2011)Scenario-based testing from UML/OCL behavioral modelsInternational Journal on Software Tools for Technology Transfer10.1007/s10009-011-0189-713:5(431-448)Online publication date: 25-Feb-2011
https://doi.org/10.1007/s10009-011-0189-7
Yuan XMemon A(2010)Generating Event Sequence-Based Test Cases Using GUI Runtime State FeedbackIEEE Transactions on Software Engineering10.1109/TSE.2009.6836:1(81-95)Online publication date: 1-Jan-2010
https://dl.acm.org/doi/10.1109/TSE.2009.68
Auguston M(2009)Software architecture built from behavior modelsACM SIGSOFT Software Engineering Notes10.1145/1598732.159873334:5(1-15)Online publication date: 2-Oct-2009
https://dl.acm.org/doi/10.1145/1598732.1598733
Dadeau FTissot R(2009)jSynoPSys -- A Scenario-Based Testing Tool based on the Symbolic Animation of B MachinesElectronic Notes in Theoretical Computer Science (ENTCS)10.1016/j.entcs.2009.09.055253:2(117-132)Online publication date: 1-Oct-2009
https://dl.acm.org/doi/10.1016/j.entcs.2009.09.055
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents