short-paper

GUICat: GUI testing as a service

Authors:

Lin Cheng,

Jialiang Chang,

Zijiang Yang,

Chao WangAuthors Info & Claims

ASE '16: Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering

Pages 858 - 863

https://doi.org/10.1145/2970276.2970294

Published: 25 August 2016 Publication History

Get Access

Abstract

GUIs are event-driven applications where the flow of the program is determined by user actions such as mouse clicks and key presses. GUI testing is a challenging task not only because of the combinatorial explosion in the number of event sequences, but also because of the difficulty to cover the large number of data values. We propose GUICat, the first cloud based GUI testing framework that simultaneously generates event sequences and data values. It is a white-box GUI testing tool that augments traditional sequence generation techniques with concolic execution. We also propose a cloudbased parallel algorithm for mitigating both event sequence explosion and data value explosion, by distributing the concolic execution tasks over public clouds such as Amazon EC2. We have evaluated the tool on standard GUI testing benchmarks and showed that GUICat significantly outperforms state-of-the-art GUI testing tools. The video demo URL is https://youtu.be/rfnnQOmZqj4.

References

[1]

ASM. http://asm.ow2.org/.

Google Scholar

[2]

JaCoCo. http://eclemma.org/jacoco/.

Google Scholar

[3]

Amazon. Amazon elastic compute cloud. http://aws. amazon.com/ec2/.

Google Scholar

[4]

S. Arlt, A. Podelski, C. Bertolini, M. Schäf, I. Banerjee, and A. M. Memon. Lightweight static analysis for GUI testing. In International Symposium on Software Reliability Engineering, 2012.

Digital Library

Google Scholar

[5]

S. Arlt, A. Podelski, and M. Wehrle. Reducing GUI test suites via program slicing. In International Symposium on Software Testing and Analysis, 2014.

Digital Library

Google Scholar

[6]

S. Ganov, C. Killmar, S. Khurshid, and D. E. Perry. Event listener analysis and symbolic execution for testing GUI applications. Formal Methods and Software Engineering, 2009.

Digital Library

Google Scholar

[7]

P. Maiya, R. Gupta, A. Kanade, and R. Majumdar. Partial order reduction for event-driven multi-threaded programs. In Tools and Algorithms for the Construction and Analysis of System, pages 680–697, 2016.

Digital Library

Google Scholar

[8]

P. Mehlitz, O. Tkachuk, and M. Ujma. JPF-AWT: Model checking GUI applications. ASE, 2011.

Digital Library

Google Scholar

[9]

A. Memon, I. Banerjee, N. Hashmi, and A. Nagarajan. DART: A framework for regression testing "nightly/daily builds" of GUI applications. In International Conference on Software Maintenance, 2003.

Digital Library

Google Scholar

[10]

B. N. Nguyen, B. Robbins, I. Banerjee, and A. Memon. GUITAR: an innovative tool for automated testing of GUI-driven software. Automated Software Engineering, 2014.

Digital Library

Google Scholar

[11]

R. K. Shehady and D. P. Siewiorek. A method to automate user interface testing using variable finite state machines. In International Symposium on Fault-Tolerant Computing, 1997.

Digital Library

Google Scholar

[12]

H. Tanno, X. Zhang, T. Hoshino, and K. Sen. TesMa and CATG: automated test generation tools for models of enterprise applications. International Conference on Software Engineering, 2015.

Digital Library

Google Scholar

[13]

L. White and H. Almezen. Generating test cases for GUI responsibilities using complete interaction sequences. In International Symposium on Software Reliability Engineering, 2000.

Digital Library

Google Scholar

[14]

Q. Xie and A. M. Memon. Using a pilot study to derive a GUI model for automated testing. ACM Trans. Softw. Eng. Methodol., 18(2):7:1–7:35, Nov. 2008.

Digital Library

Google Scholar

Cited By

View all

Kumar SNitin Yadav M(2023)GUI Testing Using Random Event-Based Test Cases2023 12th International Conference on System Modeling & Advancement in Research Trends (SMART)10.1109/SMART59791.2023.10428625(512-520)Online publication date: 22-Dec-2023
https://doi.org/10.1109/SMART59791.2023.10428625
de Ryckel XSluÿters AVanderdonckt J(2022)SnappView, a Software Development Kit for Supporting End-user Mobile Interface ReviewProceedings of the ACM on Human-Computer Interaction10.1145/35345276:EICS(1-38)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3534527
Mahmood RPennington JTsang DTran TBogle A(2022)A Framework for Automated API Fuzzing at Enterprise Scale2022 IEEE Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST53961.2022.00018(377-388)Online publication date: Apr-2022
https://doi.org/10.1109/ICST53961.2022.00018
Show More Cited By

Index Terms

GUICat: GUI testing as a service
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Coverage criteria for GUI testing

A widespread recognition of the usefulness of graphical user interfaces (GUIs) has established their importance as critical components of today's software. GUIs have characteristics different from traditional software, and conventional testing ...
Coverage criteria for GUI testing
ESEC/FSE-9: Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering

A widespread recognition of the usefulness of graphical user interfaces (GUIs) has established their importance as critical components of today's software. GUIs have characteristics different from traditional software, and conventional testing ...
GUI Interaction Testing: Incorporating Event Context

Graphical user interfaces (GUIs), due to their event-driven nature, present an enormous and potentially unbounded way for users to interact with software. During testing, it is important to “adequately cover” this interaction space. In this paper, we ...

Comments

Information & Contributors

Information

Published In

ASE '16: Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering

August 2016

899 pages

ISBN:9781450338455

DOI:10.1145/2970276

General Chair:
David Lo
Singapore Management University, Singapore
,
Program Chairs:
Sven Apel
University of Passau, Germany
,
Sarfraz Khurshid
University of Texas at Austin, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 August 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ASE'16

Sponsor:

SIGAI
SIGSOFT
IEEE-CS

ASE'16: ACM/IEEE International Conference on Automated Software Engineering

September 3 - 7, 2016

Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 82 of 337 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
237
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kumar SNitin Yadav M(2023)GUI Testing Using Random Event-Based Test Cases2023 12th International Conference on System Modeling & Advancement in Research Trends (SMART)10.1109/SMART59791.2023.10428625(512-520)Online publication date: 22-Dec-2023
https://doi.org/10.1109/SMART59791.2023.10428625
de Ryckel XSluÿters AVanderdonckt J(2022)SnappView, a Software Development Kit for Supporting End-user Mobile Interface ReviewProceedings of the ACM on Human-Computer Interaction10.1145/35345276:EICS(1-38)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3534527
Mahmood RPennington JTsang DTran TBogle A(2022)A Framework for Automated API Fuzzing at Enterprise Scale2022 IEEE Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST53961.2022.00018(377-388)Online publication date: Apr-2022
https://doi.org/10.1109/ICST53961.2022.00018
Vos TAho PPastor Ricos FRodriguez‐Valdes OMulders A(2021) testar – scriptless testing through graphical user interface Software Testing, Verification and Reliability10.1002/stvr.177131:3Online publication date: 25-Apr-2021
https://doi.org/10.1002/stvr.1771
Canny APalanque PNavarre D(2020)Model-Based Testing of GUI Applications Featuring Dynamic Instanciation of Widgets2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW50294.2020.00029(95-104)Online publication date: Oct-2020
https://doi.org/10.1109/ICSTW50294.2020.00029
Bertolino AAngelis GGallego MGarcía BGortázar FLonetti FMarchetti E(2019)A Systematic Review on Cloud TestingACM Computing Surveys10.1145/333144752:5(1-42)Online publication date: 13-Sep-2019
https://dl.acm.org/doi/10.1145/3331447
Pezzè MRondena PZuddas DDolby JHalfond WMishra A(2018)Automatic GUI testing of desktop applicationsCompanion Proceedings for the ISSTA/ECOOP 2018 Workshops10.1145/3236454.3236489(54-62)Online publication date: 16-Jul-2018
https://dl.acm.org/doi/10.1145/3236454.3236489
Wang JDou WGao CGao YWei J(2018)Context-Based Event Trace Reduction in Client-Side JavaScript Applications2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST.2018.00022(127-138)Online publication date: Apr-2018
https://doi.org/10.1109/ICST.2018.00022
Cheng LYang ZWang CRosu GDi Penta MNguyen T(2017)Systematic reduction of GUI test sequencesProceedings of the 32nd IEEE/ACM International Conference on Automated Software Engineering10.5555/3155562.3155668(849-860)Online publication date: 30-Oct-2017
https://dl.acm.org/doi/10.5555/3155562.3155668
Cheng LYang ZWang C(2017)Systematic reduction of GUI test sequences2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE)10.1109/ASE.2017.8115696(849-860)Online publication date: Oct-2017
https://doi.org/10.1109/ASE.2017.8115696
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Coverage criteria for GUI testing

Coverage criteria for GUI testing

GUI Interaction Testing: Incorporating Event Context

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations