short-paper

Crowdsourced requirements generation for automatic testing via knowledge graph

Authors:

Chao Guo,

Tieke He,

Wei Yuan,

Yue Guo,

Rui HaoAuthors Info & Claims

ISSTA 2020: Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis

Pages 545 - 548

https://doi.org/10.1145/3395363.3404363

Published: 18 July 2020 Publication History

Get Access

Abstract

Crowdsourced testing provides an effective way to deal with the problem of Android system fragmentation, as well as the application scenario diversity faced by Android testing. The generation of test requirements is a significant part of crowdsourced testing. However, manually generating crowdsourced testing requirements is tedious, which requires the issuers to have the domain knowledge of the Android application under test. To solve these problems, we have developed a tool named KARA, short for Knowledge Graph Aided Crowdsourced Requirements Generation for Android Testing. KARA first analyzes the result of automatic testing on the Android application, through which the operation sequences can be obtained. Then, the knowledge graph of the target application is constructed in a manner of pay-as-you-go. Finally, KARA utilizes knowledge graph and the automatic testing result to generate crowdsourced testing requirements with domain knowledge. Experiments prove that the test requirements generated by KARA are well understandable, and KARA can improve the quality of crowdsourced testing. The demo video can be found at https://youtu.be/kE-dOiekWWM.

References

[1]

Domenico Amalfitano, Anna Rita Fasolino, Porfirio Tramontana, Salvatore De Carmine, and Atif M Memon. 2012. Using GUI ripping for automated testing of Android applications. In ASE. ACM, 258-261.

Google Scholar

[2]

Yang Feng, Zhenyu Chen, James A Jones, Chunrong Fang, and Baowen Xu. 2015. Test report prioritization to assist crowdsourced testing. In ESEC/SIGSOFT FSE. 225-236.

Google Scholar

[3]

Shuai Hao, Bin Liu, Suman Nath, William GJ Halfond, and Ramesh Govindan. 2014. PUMA: programmable UI-automation for large-scale dynamic analysis of mobile apps. In MobiSys. ACM, 204-217.

Google Scholar

[4]

Steven Komarov, Katharina Reinecke, and Krzysztof Z Gajos. 2013. Crowdsourcing performance evaluations of user interfaces. In SigCHI. 207-216.

Google Scholar

[5]

Aravind Machiry, Rohan Tahiliani, and Mayur Naik. 2013. Dynodroid: An input generation system for android apps. In ESEC/SIGSOFT FSE. ACM, 224-234.

Google Scholar

[6]

Anmol Nayak, Vaibhav Kesri, and Rahul Kumar Dubey. 2020. Knowledge Graph based Automated Generation of Test Cases in Software Engineering. In Proceedings of the 7th ACM IKDD CoDS and 25th COMAD. 289-295.

Digital Library

Google Scholar

Cited By

View all

Yu SFang CDu MDing ZChen ZSu Z(2024)Practical, Automated Scenario-Based Mobile App TestingIEEE Transactions on Software Engineering10.1109/TSE.2024.341467250:7(1949-1966)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1109/TSE.2024.3414672
Sun XChen XLiu YGrundy JLi L(2023)Taming Android Fragmentation through Lightweight Crowdsourced TestingIEEE Transactions on Software Engineering10.1109/TSE.2023.3266324(1-17)Online publication date: 2023
https://doi.org/10.1109/TSE.2023.3266324
Ge XYu SFang CZhu QZhao Z(2023)Leveraging Android Automated Testing to Assist Crowdsourced TestingIEEE Transactions on Software Engineering10.1109/TSE.2022.321687949:4(2318-2336)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TSE.2022.3216879
Show More Cited By

Index Terms

Crowdsourced requirements generation for automatic testing via knowledge graph
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Automatic and lightweight grammar generation for fuzz testing

Blackbox fuzz testing can only test a small portion of code when rigorously checking the well-formedness of input values. To overcome this problem, blackbox fuzz testing is performed using a grammar that delineates the format information of input ...
Personas and redundancies in crowdsourced testing
ICGSE '17: Proceedings of the 12th International Conference on Global Software Engineering

Crowdsourced testing is gaining a lot of attention these days. Crowdsourced testing utilizes testers which subscribe to an external or internal crowdsourcing platform. Usually these testers are distributed across geographies. Thus, such testing can be ...
Construction and application of knowledge graph of domestic operating system testing
CSSE '21: Proceedings of the 4th International Conference on Computer Science and Software Engineering

Aiming at the problems of poor reusability of domestic operating system test cases and insufficient sharing of test case design experience at this stage, a method for constructing knowledge graphs in the field of domestic operating system testing is ...

Comments

Information & Contributors

Information

Published In

ISSTA 2020: Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis

July 2020

591 pages

ISBN:9781450380089

DOI:10.1145/3395363

General Chair:
Sarfraz Khurshid
University of Texas at Austin, USA
,
Program Chair:
Corina S. Păsăreanu
Carnegie Mellon University Silicon Valley / NASA Ames Research Center, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 July 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ISSTA '20

Sponsor:

SIGSOFT

ISSTA '20: 29th ACM SIGSOFT International Symposium on Software Testing and Analysis

July 18 - 22, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 58 of 213 submissions, 27%

Upcoming Conference

ISSTA '24

Sponsor:
sigsoft

33rd ACM SIGSOFT International Symposium on Software Testing and Analysis

September 16 - 20, 2024

Vienna , Austria

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
254
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)4

Reflects downloads up to 18 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yu SFang CDu MDing ZChen ZSu Z(2024)Practical, Automated Scenario-Based Mobile App TestingIEEE Transactions on Software Engineering10.1109/TSE.2024.341467250:7(1949-1966)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1109/TSE.2024.3414672
Sun XChen XLiu YGrundy JLi L(2023)Taming Android Fragmentation through Lightweight Crowdsourced TestingIEEE Transactions on Software Engineering10.1109/TSE.2023.3266324(1-17)Online publication date: 2023
https://doi.org/10.1109/TSE.2023.3266324
Ge XYu SFang CZhu QZhao Z(2023)Leveraging Android Automated Testing to Assist Crowdsourced TestingIEEE Transactions on Software Engineering10.1109/TSE.2022.321687949:4(2318-2336)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TSE.2022.3216879
Yang PChang CTang Y(2022)Crowdsourced Testing Task Assignment based on Knowledge Graphs2022 IEEE 22nd International Conference on Software Quality, Reliability and Security (QRS)10.1109/QRS57517.2022.00072(663-671)Online publication date: Dec-2022
https://doi.org/10.1109/QRS57517.2022.00072
Yang YChen X(2022)Crowdsourced Test Report Prioritization Based on Text ClassificationIEEE Access10.1109/ACCESS.2021.312872610(92692-92705)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2021.3128726
Wang QChen ZWang JFeng YWang QChen ZWang JFeng Y(2022)PreliminariesIntelligent Crowdsourced Testing10.1007/978-981-16-9643-5_2(9-23)Online publication date: 25-Apr-2022
https://doi.org/10.1007/978-981-16-9643-5_2
da Silva ASavić D(2021)Linguistic Patterns and Linguistic Styles for Requirements Specification: Focus on Data EntitiesApplied Sciences10.3390/app1109411911:9(4119)Online publication date: 30-Apr-2021
https://doi.org/10.3390/app11094119
Yu SFang CYun YFeng Y(2021)Layout and Image Recognition Driving Cross-Platform Automated Mobile TestingProceedings of the 43rd International Conference on Software Engineering10.1109/ICSE43902.2021.00139(1561-1571)Online publication date: 22-May-2021
https://dl.acm.org/doi/10.1109/ICSE43902.2021.00139

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Automatic and lightweight grammar generation for fuzz testing

Personas and redundancies in crowdsourced testing

Construction and application of knowledge graph of domestic operating system testing

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Automatic and lightweight grammar generation for fuzz testing

Personas and redundancies in crowdsourced testing

Construction and application of knowledge graph of domestic operating system testing

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations