Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3236454.3236488acmconferencesArticle/Chapter ViewAbstractPublication PagesisstaConference Proceedingsconference-collections
research-article

Towards automated translation between generations of GUI-based tests for mobile devices

Published: 16 July 2018 Publication History

Abstract

Market demands for faster delivery and higher software quality are progressively becoming more stringent. A key hindrance for software companies to meet such demands is how to test the software due to to the intrinsic costs of development, maintenance and evolution of testware. Especially since testware should be defined, and aligned, with all layers of system under test (SUT), including all graphical user interface (GUI) abstraction levels. These levels can be tested with different generations of GUI-based test approaches, where 2nd generation, or Layout-based, tests leverage GUI properties and 3rd generation, or Visual, tests make use of image recognition. The two approaches provide different benefits and drawbacks and are seldom used together because of the aforementioned costs, despite growing academic evidence of the complementary benefits.
In this work we propose the proof of concept of a novel two-step translation approach for Android GUI testing that we aim to implement, where a translator first creates a technology independent script with actions and elements of the GUI, and then translates it to a script with the syntax chosen by the user. The approach enables users to translate Layout-based to Visual scripts and vice versa, to gain the benefits (e.g. robustness, speed and ability to emulate the user) of both generations, whilst minimizing the drawbacks (e.g. development and maintenance costs). We outline our approach from a technical perspective, discuss some of the key challenges with the realization of our approach, evaluate the feasibility and the advantages provided by our approach on an open-source Android application, and discuss the potential industrial impact of this work.

References

[1]
Emil Alégroth and Robert Feldt. 2017. On the long-term use of visual gui testing in industrial practice: a case study. Empirical Software Engineering 22, 6 (2017), 2937--2971.
[2]
Emil Alégroth, Zebao Gao, Rafael Oliveira, and Atif Memon. 2015. Conceptualization and evaluation of component-based testing unified with visual gui testing: an empirical study. In Software Testing, Verification and Validation (ICST), 2015 IEEE 8th International Conference on. IEEE, 1--10.
[3]
Emil Alégroth, Michel Nass, and Helena H Olsson. 2013. JAutomate: A tool for system-and acceptance-test automation. In Software testing, verification and validation (icst), 2013 ieee sixth international conference on. IEEE, 439--446.
[4]
Haneen Anjum, Muhammad Imran Babar, Muhammad Jehanzeb, Maham Khan, Saima Chaudhry, Summiyah Sultana, Zainab Shahid, Furkh Zeshan, and Shahid Nazir Bhatti. 2017. A Comparative Analysis of Quality Assurance of Mobile Applications using Automated Testing Tools. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS 8, 7 (2017), 249--255.
[5]
Riccardo Coppola, Maurizio Morisio, and Marco Torchiano. 2017. Scripted GUI Testing of Android Apps: A Study on Diffusion, Evolution and Fragility. In Proceedings of the 13th International Conference on Predictive Models and Data Analytics in Software Engineering. ACM, 22--32.
[6]
Riccardo Coppola, Emanuele Raffero, and Marco Torchiano. 2016. Automated mobile UI test fragility: an exploratory assessment study on Android. In Proceedings of the 2nd International Workshop on User Interface Test Automation. ACM, 11--20.
[7]
Mattia Fazzini, Eduardo Noronha De A Freitas, Shauvik Roy Choudhary, and Alessandro Orso. 2017. Barista: A technique for recording, encoding, and running platform independent android tests. In Software Testing, Verification and Validation (ICST), 2017 IEEE International Conference on. IEEE, 149--160.
[8]
Juha Itkonen and Kristian Rautiainen. 2005. Exploratory testing: a multiple case study. In Empirical Software Engineering, 2005. 2005 International Symposium on. IEEE, 10--pp.
[9]
Thomas W Knych and Ashwin Baliga. 2014. Android application development and testability. In Proceedings ofthe 1st International Conference on Mobile Software Engineering and Systems. ACM, 37--40.
[10]
P. S. Kochhar, F. Thung, N. Nagappan, T. Zimmermann, and D. Lo. 2015. Understanding the Test Automation Culture of App Developers. In 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST). 1--10.
[11]
Martin Kropp and Pamela Morales. 2010. Automated GUI testing on the Android platform. Testing Software and Systems (2010), 67.
[12]
Maurizio Leotta, Diego Clerissi, Filippo Ricca, and Paolo Tonella. 2014. Visual vs. DOM-based web locators: An empirical study. In International Conference on Web Engineering. Springer, 322--340.
[13]
Mario Linares-Vásquez, Carlos Bernal-Cárdenas, Kevin Moran, and Denys Poshyvanyk. 2017. How do developers test android applications?. In Software Maintenance and Evolution (ICSME), 2017 IEEE International Conference on. IEEE, 613--622.
[14]
Atif M Memon. 2008. Automatically repairing event sequence-based GUI test suites for regression testing. ACM Transactions on Software Engineering and Methodology (TOSEM) 18, 2 (2008), 4.
[15]
Daniel Ståhl and Jan Bosch. 2014. Modeling continuous integration practice differences in industry software development. Journal of Systems and Software 87 (2014), 48--59.
[16]
Tom Yeh, Tsung-Hsiang Chang, and Robert C Miller. 2009. Sikuli: using GUI screenshots for search and automation. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. ACM, 183--192.
[17]
Sai Zhang, Hao Lü, and Michael D Ernst. 2013. Automatically repairing broken workflows for evolving GUI applications. In Proceedings of the 2013 International Symposium on Software Testing and Analysis. ACM, 45--55.

Cited By

View all
  • (2024)AI in GUI-Based Software Testing: Insights from a Survey with Industrial PractitionersQuality of Information and Communications Technology10.1007/978-3-031-70245-7_23(328-343)Online publication date: 11-Sep-2024
  • (2023)A systematic mapping study for graphical user interface testing on mobile appsIET Software10.1049/sfw2.1212317:3(249-267)Online publication date: 2-Mar-2023
  • (2021)Feature Matching-based Approaches to Improve the Robustness of Android Visual GUI TestingACM Transactions on Software Engineering and Methodology10.1145/347742731:2(1-32)Online publication date: 17-Nov-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ISSTA '18: Companion Proceedings for the ISSTA/ECOOP 2018 Workshops
July 2018
143 pages
ISBN:9781450359399
DOI:10.1145/3236454
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 July 2018

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

ISSTA '18

Acceptance Rates

Overall Acceptance Rate 58 of 213 submissions, 27%

Upcoming Conference

ISSTA '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)AI in GUI-Based Software Testing: Insights from a Survey with Industrial PractitionersQuality of Information and Communications Technology10.1007/978-3-031-70245-7_23(328-343)Online publication date: 11-Sep-2024
  • (2023)A systematic mapping study for graphical user interface testing on mobile appsIET Software10.1049/sfw2.1212317:3(249-267)Online publication date: 2-Mar-2023
  • (2021)Feature Matching-based Approaches to Improve the Robustness of Android Visual GUI TestingACM Transactions on Software Engineering and Methodology10.1145/347742731:2(1-32)Online publication date: 17-Nov-2021
  • (2021)Automated translation of Android context-dependent gestures to visual GUI test instructionsProceedings of the 12th International Workshop on Automating TEST Case Design, Selection, and Evaluation10.1145/3472672.3473954(17-24)Online publication date: 23-Aug-2021
  • (2020)GUI testing for mobile applications: objectives, approaches and challengesProceedings of the 12th Asia-Pacific Symposium on Internetware10.1145/3457913.3457931(51-60)Online publication date: 1-Nov-2020
  • (2020)Translation from Visual to Layout-based Android Test Cases: a Proof of Concept2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW50294.2020.00027(74-83)Online publication date: Oct-2020
  • (2019)Fragility of layout-based and visual GUI test scripts: an assessment study on a hybrid mobile applicationProceedings of the 10th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation10.1145/3340433.3342824(28-34)Online publication date: 26-Aug-2019
  • (2019)Espresso vs. EyeAutomateProceedings of the 23rd International Conference on Evaluation and Assessment in Software Engineering10.1145/3319008.3319022(13-22)Online publication date: 15-Apr-2019
  • (2019)Estimating Return on Investment for GUI Test Automation Frameworks2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE)10.1109/ISSRE.2019.00035(271-282)Online publication date: Oct-2019

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media