Automated translation of Android context-dependent gestures to visual GUI test instructions
Pages 17 - 24
Abstract
Layout-based (2nd Generation) and Visual (3rd Generation) GUI testing are two very common approaches for mobile application testing. The two techniques expose complementary advantages and drawbacks, and the literature on GUI Testing has highlighted the benefits of an approach based on a translation from one generation to the other.
The objective of this work is to provide an improvement to our prototype tool, TOGGLE, designed to translate 2nd Generation test suites, written with the Espresso framework, to 3rd Generation ones that can be run by the EyeAutomate and Sikuli tool.
We extended TOGGLE by adding (1) support for context-based gestures, performed through the scrollTo and onData commands, and (2) support for the combination of Layout-based locators with logical operators.
We evaluated the new version of the tool on five different experimental subjects. For each of the applications, 30 test cases were developed and automatically translated with TOGGLE+.
We observed an increase of 68% of translatable test cases when transitioning from the previous prototype to the current version of the tool. The generated Visual test cases also proved to have high robustness, with flakiness of just 2% (i.e., 98% correct executions).
References
[1]
Emil Alégroth, Zebao Gao, Rafael Oliveira, and Atif Memon. 2015. Conceptualization and evaluation of component-based testing unified with visual gui testing: an empirical study. In 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST). IEEE, 1-10.
[2]
Nadia Alshahwan, Xinbo Gao, Mark Harman, Yue Jia, Ke Mao, Alexander Mols, Taijin Tei, and Ilya Zorin. 2018. Deploying search based software engineering with Sapienz at Facebook. In International Symposium on Search Based Software Engineering. Springer, 3-45.
[3]
Luca Ardito, Riccardo Coppola, Maurizio Morisio, and Marco Torchiano. 2019. Espresso vs. eyeautomate: An experiment for the comparison of two generations of android gui testing. In Proceedings of the Evaluation and Assessment on Software Engineering. 13-22.
[4]
Luca Ardito, Riccardo Coppola, Marco Torchiano, and Emil Alégroth. 2018. Towards automated translation between generations of gui-based tests for mobile devices. In Companion Proceedings for the ISSTA/ECOOP 2018 Workshops. 46-53.
[5]
Riccardo Coppola, Luca Ardito, Marco Torchiano, and Emil Alégroth. 2021. Translation from layout-based to visual android test scripts: An empirical evaluation. Journal of Systems and Software 171 ( 2021 ), 110845.
[6]
Riccardo Coppola, Maurizio Morisio, and Marco Torchiano. 2018. Mobile gui testing fragility: A study on open-source android applications. IEEE Transactions on Reliability 68, 1 ( 2018 ), 67-90.
[7]
Muhammad Kamran, Junaid Rashid, and Muhammad Wasif Nisar. 2016. Android fragmentation classification, causes, problems and solutions. International Journal of Computer Science and Information Security 14, 9 ( 2016 ), 992.
[8]
Pavneet Singh Kochhar, Ferdian Thung, Nachiappan Nagappan, Thomas Zimmermann, and David Lo. 2015. Understanding the test automation culture of app developers. In 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST). IEEE, 1-10.
[9]
Yuanchun Li, Ziyue Yang, Yao Guo, and Xiangqun Chen. 2017. Droidbot: a lightweight ui-guided test input generator for android. In 2017 IEEE/ACM 39th International Conference on Software Engineering Companion ( ICSE-C). IEEE, 23-26.
[10]
Mario Linares-Vásquez, Kevin Moran, and Denys Poshyvanyk. 2017. Continuous, evolutionary and large-scale: A new perspective for automated mobile app testing. In 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, 399-410.
[11]
Leotta Maurizio, Stocco Andrea, Ricca Filippo, and Paolo Tonella. 2018. Pesto: Automated migration of DOM-based Web tests towards the visual approach. ( 2018 ).
[12]
Shiwangi Singh, Rucha Gadgil, and Ayushi Chudgor. 2014. Automated testing of mobile applications using scripting technique: A study on appium. International Journal of Current Engineering and Technology (IJCET) 4, 5 ( 2014 ), 3627-3630.
[13]
Jin-lei Sun, Shi-wen Zhang, Song Huang, and Zhan-wei Hui. 2018. Design and application of a Sikuli based capture-replay tool. In 2018 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C). IEEE, 42-44.
[14]
Denys Zelenchuk. 2019. Espresso and ui automator: the perfect tandem. In Android Espresso Revealed. Springer, 165-189.
Index Terms
- Automated translation of Android context-dependent gestures to visual GUI test instructions
Recommendations
Automated model-based Android GUI testing using multi-level GUI comparison criteria
ASE '16: Proceedings of the 31st IEEE/ACM International Conference on Automated Software EngineeringAutomated Graphical User Interface (GUI) testing is one of the most widely used techniques to detect faults in mobile applications (apps) and to test functionality and usability. GUI testing exercises behaviors of an application under test (AUT) by ...
Designing and comparing automated test oracles for GUI-based software applications
Test designers widely believe that the overall effectiveness and cost of software testing depends largely on the type and number of test cases executed on the software. This article shows that the test oracle, a mechanism that determines whether a ...
TestMig: migrating GUI test cases from iOS to Android
ISSTA 2019: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and AnalysisNowadays, Apple iOS and Android are two most popular platforms for mobile applications. To attract more users, many software companies and organizations are migrating their applications from one platform to the other, and besides source files, they also ...
Comments
Information & Contributors
Information
Published In
August 2021
40 pages
ISBN:9781450386234
DOI:10.1145/3472672
- General Chairs:
- Sinem Getir Yaman,
- Rui Prada,
- Program Chairs:
- Fitsum Meshesha Kifetew,
- Nicolás Cardozo
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 23 August 2021
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
ESEC/FSE '21
Sponsor:
ESEC/FSE '21: 29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
August 23 - 24, 2021
Athens, Greece
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 90Total Downloads
- Downloads (Last 12 months)18
- Downloads (Last 6 weeks)2
Reflects downloads up to
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in