short-paper

Lessons learned from making the transition to model-based GUI testing

Authors:

Thomas WetzlmaierAuthors Info & Claims

A-TEST 2019: Proceedings of the 10th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation

Pages 22 - 27

https://doi.org/10.1145/3340433.3342823

Published: 26 August 2019 Publication History

Abstract

Model-based testing (MBT) has been proposed as an effective and versatile approach for testing graphical user interfaces (GUIs) by automatically generating executable test cases from a model of the GUI. Model-based GUI testing has received increasing attention in research, but it is still rarely applied in practice. In this paper, we present our experiences and share the lessons we learned from successfully introducing MBT for GUI testing in three industry projects. We describe the underlying modeling approach, the development of tests models in joint workshops, the implementation of the test model in form of model programs, and the integration of MBT in the test automation architecture. The findings distilled from the three cases are summarized as lessons learned to support the adoption of a model-based approach for GUI testing in practice.

References

[1]

M. Vieira, J. Leduc, B. Hasling, R. Subramanyan, and J. Kazmeier. 2006. Automation of GUI Testing Using a Model-driven Approach, In Proceedings of the 2006 International Workshop on Automation of Software Test, 2006, pp. 9–14.

Digital Library

[2]

A. M. Memon. 2007. An Event-flow Model of GUI-based Applications for Testing: Research Articles, Softw. Test. Verif. Reliab., vol. 17, no. 3, pp. 137–157, Sept. 2007.

Digital Library

[3]

A. Kervinen, M. Maunumaa, T. Pääkkönen, and M. Katara. 2006. Model-Based Testing Through a GUI. In Proceedings of the 5th International Conference on Formal Approaches to Software Testing, 2006, pp. 16–31.

Digital Library

[4]

V. Entin, M. Winder, B. Zhang, and S. Christmann. 2012. Introducing Modelbased Testing in an Industrial Scrum Project. In Proceedings of the 7th International Workshop on Automation of Software Test, 2012, pp. 43–49.

Digital Library

[5]

V. Chinnapongse, I. Lee, O. Sokolsky, S. Wang, and P.L. Jones. 2009. Modelbased testing of GUI-driven applications. In IFIP International Workshop on Software Technolgies for Embedded and Ubiquitous Systems, 2009, pp. 203–214.

Digital Library

[6]

A. Kervinen, M. Maunumaa, T. Pääkkönen, and M. Katara. 2005. Model-based testing through a GUI. In International Workshop on Formal Approaches to Software Testing, Springer, Berlin, Heidelberg, 2005, pp. 16–31.

Digital Library

[7]

R. Ramler, G. Buchgeher, and C. Klammer. 2018. Adapting automated test generation to GUI testing of industry applications. Information and Software Technology, vo. 93, Jan. 2018, pp.248-263.

Digital Library

[8]

C. Klammer and R. Ramler. 2017. A Journey from Manual Testing to Automated Test Generation in an Industry Project. In IEEE International Conf. on Software Quality, Reliability and Security Companion (QRS-C), 2017, pp. 591–592.

[9]

R. Ramler, C. Klammer, and G. Buchgeher. 2018. Applying Automated Test Case Generation in Industry: A Retrospective. In IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2018, pp. 364–369.

[10]

I Banerjee. 2017. Advances in Model-Based Testing of GUI-Based Software. In Advances in Computers, vol. 105, Elsevier, pp. 45–78.

[11]

R. Yang, Z. Chen, Z. Zhang, and B. Xu. 2015. EFSM-Based Test Case Generation: Sequence, Data, and Oracle. International Journal of Software Engineering and Knowledge Engineering, vol. 25, no. 04, May 2015, pp. 633–667.

[12]

M. Utting and B. Legeard. 2007. Practical model-based testing: a tools approach. Elsevier/Morgan Kaufmann, 2007.

Digital Library

[13]

H. Robinson. 2003. Obstacles and opportunities for model-based testing in an industrial software environment. In Proceedings of the 1st European Conference on Model-Driven Software Engineering, pp. 118–127.

[14]

T. Kanstrén and O.-P. Puolitaival. 2012. Using Built-In Domain-Specific Modeling Support to Guide Model-Based Test Generation. In Electronic Proceedings in Theoretical Computer Science, vol. 80, Feb. 2012, pp. 58–72.

[15]

R. Ramler and C. Klammer. 2019. Enhancing Acceptance Test-Driven Development with Model-based Test Generation. In IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C), 2019, pp.503-504.

Cited By

Hnatkowska BWójcikowski K(2024)Functional Test Generation Based on Requirements Defined at GUI LevelRecent Challenges in Intelligent Information and Database Systems10.1007/978-981-97-5937-8_27(326-336)Online publication date: 13-Aug-2024
https://doi.org/10.1007/978-981-97-5937-8_27
Alba BGranda MParra O(2022)UI-Test: A Model-Based Framework for Visual UI Testing– Qualitative and Quantitative EvaluationEvaluation of Novel Approaches to Software Engineering10.1007/978-3-030-96648-5_15(328-355)Online publication date: 11-Feb-2022
https://doi.org/10.1007/978-3-030-96648-5_15

Index Terms

Lessons learned from making the transition to model-based GUI testing
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Automated model-based Android GUI testing using multi-level GUI comparison criteria
ASE '16: Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering

Automated Graphical User Interface (GUI) testing is one of the most widely used techniques to detect faults in mobile applications (apps) and to test functionality and usability. GUI testing exercises behaviors of an application under test (AUT) by ...
Comparing model-based and dynamic event-extraction based GUI testing techniques

HighlightsWe compare model-based and dynamic event-extraction based GUI testing techniques.We present a exible GUI testing framework that enables comparison of techniques.We show that nonexecutable events weaken effectiveness and increase costs of ...
GUI Interaction Testing: Incorporating Event Context

Graphical user interfaces (GUIs), due to their event-driven nature, present an enormous and potentially unbounded way for users to interact with software. During testing, it is important to “adequately cover” this interaction space. In this paper, we ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

A-TEST 2019: Proceedings of the 10th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation

August 2019

41 pages

ISBN:9781450368506

DOI:10.1145/3340433

General Chair:
Tanja E. J. Vos,
Program Chairs:
Wishnu Prasetya,
Sinem Getir

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 August 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Österreichische Forschungsförderungsgesellschaft

Conference

ESEC/FSE '19

Sponsor:

SIGSOFT

ESEC/FSE '19: 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

August 26 - 27, 2019

Tallinn, Estonia

Upcoming Conference

ISSTA '25

Sponsor:
sigsoft

34th ACM SIGSOFT International Symposium on Software Testing and Analysis

June 25 - 28, 2025

Trondheim , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
215
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hnatkowska BWójcikowski K(2024)Functional Test Generation Based on Requirements Defined at GUI LevelRecent Challenges in Intelligent Information and Database Systems10.1007/978-981-97-5937-8_27(326-336)Online publication date: 13-Aug-2024
https://doi.org/10.1007/978-981-97-5937-8_27
Alba BGranda MParra O(2022)UI-Test: A Model-Based Framework for Visual UI Testing– Qualitative and Quantitative EvaluationEvaluation of Novel Approaches to Software Engineering10.1007/978-3-030-96648-5_15(328-355)Online publication date: 11-Feb-2022
https://doi.org/10.1007/978-3-030-96648-5_15

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents