short-paper

Open access

Fastbot: A Multi-Agent Model-Based Test Generation System Beijing Bytedance Network Technology Co., Ltd.

Authors:

Tianqin Cai,

Zhao Zhang,

Ping YangAuthors Info & Claims

AST '20: Proceedings of the IEEE/ACM 1st International Conference on Automation of Software Test

Pages 93 - 96

https://doi.org/10.1145/3387903.3389308

Published: 07 October 2020 Publication History

PDF eReader

Abstract

Model-based test (MBT) generation techniques for automated GUI testing are of great value for app testing. Existing GUI model-based testing tools may fall into cyclic operations and run out of resources, when applied to apps with industrial complexity and scalability. In this work, we present a multi-agent GUI MBT system named Fastbot. Fastbot performs model construction on the server end. It applies multi-agent collaboration mechanism to speed up the model construction procedure. The proposed approach was applied on more than 20 applications from Bytedance with more than 1500 million monthly active users. Higher code coverage in less testing time is achieved with comparison of three other automated testing tools including Droidbot, Humanoid and Android Monkey.

References

[1]

Ke Mao, Mark Harman, and Yue Jia. 2016. Sapienz: multi-objective automated testing for Android applications. In Proceedings of the 25th International Symposium on Software Testing and Analysis (ISSTA 2016). Association for Computing Machinery, New York, NY, USA, 94--105.

Digital Library

Google Scholar

[2]

Aravind Machiry, Rohan Tahiliani, and Mayur Naik. 2013. Dynodroid: an input generation system for Android apps. In Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering (ESEC/FSE 2013). Association for Computing Machinery, New York, NY, USA, 224--234.

Digital Library

Google Scholar

[3]

K. Jamrozik and A. Zeller, "DroidMate: A Robust and Extensible Test Generator for Android," 2016 IEEE/ACM International Conference on Mobile Software Engineering and Systems (MOBILESoft), Austin, TX, 2016, pp. 293--294.

Google Scholar

[4]

Yuanchun Li, Ziyue Yang, Yao Guo and Xiangqun Chen, "DroidBot: a lightweight UI-Guided test input generator for android," 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C), Buenos Aires, 2017, pp. 23--26.

Google Scholar

[5]

Li, Yuanchun, et al. "A Deep Learning based Approach to Automated Android App Testing." arXiv preprint arXiv:1901.02633 (2019).

Google Scholar

[6]

Carpentier, Alexandra & Lazaric, Alessandro & Ghavamzadeh, Mohammad & Munos, Remi & Auer, Peter. (2011). Upper-Confidence-Bound Algorithms for Active Learning in Multi-Armed Bandits. 6925. 189--203. 10.1007/978-3-642-24412-4_17.

Crossref

Google Scholar

[7]

Silver, D., Huang, A., Maddison, C. et al. Mastering the game of Go with deep neural networks and tree search. Nature 529, 484--489 (2016).

Google Scholar

Cited By

View all

Huang HQian JZhang D(2025)Filling Query-Type Text Inputs for Android Applications via Inner-App Mining and GPT RecommendationScience of Computer Programming10.1016/j.scico.2025.103266(103266)Online publication date: Jan-2025
https://doi.org/10.1016/j.scico.2025.103266
Guo YWang DWang LFang YWang CYang MLiu TWang H(2024)Beyond App Markets: Demystifying Underground Mobile App Distribution Via TelegramProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/37004328:3(1-25)Online publication date: 10-Dec-2024
https://dl.acm.org/doi/10.1145/3700432
Fan MShi JWang YYu LZhang XWang HJin WLiu TFilkov VRay BZhou M(2024)Giving without Notifying: Assessing Compliance of Data Transmission in Android AppsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695528(1595-1606)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695528
Show More Cited By

Index Terms

Fastbot: A Multi-Agent Model-Based Test Generation System Beijing Bytedance Network Technology Co., Ltd.
1. Software and its engineering
  1. Software creation and management
    1. Search-based software engineering
    2. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Towards a pattern language for model-based GUI testing
EuroPLoP '14: Proceedings of the 19th European Conference on Pattern Languages of Programs

Graphical user interfaces (GUIs) have become popular as they appear in everydays' software. GUIs have become an ideal way of interacting with computer programs, making the software friendlier to its users. GUIs have grown, and so has the usage of UI ...
PBGT tool: an integrated modeling and testing environment for pattern-based GUI testing
ASE '14: Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering

Pattern Based GUI Testing (PBGT) is a new methodology that aims at systematizing and automating the GUI testing process. It is supported by a Tool (PBGT Tool) which provides an integrated modeling and testing environment that supports the crafting of ...
H-SCAN: A high level alternative to full-scan testing with reduced area and test application overheads
VTS '96: Proceedings of the 14th IEEE VLSI Test Symposium

This paper presents H-SCAN, a practical testing methodology that can be easily applied to a high-level design specification. H-SCAN allows the use of combinational test patterns without the high area and test application time overheads associated with ...

Comments

Information & Contributors

Information

Published In

AST '20: Proceedings of the IEEE/ACM 1st International Conference on Automation of Software Test

October 2020

122 pages

ISBN:9781450379571

DOI:10.1145/3387903

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

AST '20

Sponsor:

SIGSOFT

AST '20: IEEE/ACM 15nd International Conference on Automation of Software Test

October 7 - 8, 2020

Seoul, Republic of Korea

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
1,318
Total Downloads

Downloads (Last 12 months)355
Downloads (Last 6 weeks)48

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Huang HQian JZhang D(2025)Filling Query-Type Text Inputs for Android Applications via Inner-App Mining and GPT RecommendationScience of Computer Programming10.1016/j.scico.2025.103266(103266)Online publication date: Jan-2025
https://doi.org/10.1016/j.scico.2025.103266
Guo YWang DWang LFang YWang CYang MLiu TWang H(2024)Beyond App Markets: Demystifying Underground Mobile App Distribution Via TelegramProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/37004328:3(1-25)Online publication date: 10-Dec-2024
https://dl.acm.org/doi/10.1145/3700432
Fan MShi JWang YYu LZhang XWang HJin WLiu TFilkov VRay BZhou M(2024)Giving without Notifying: Assessing Compliance of Data Transmission in Android AppsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695528(1595-1606)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695528
Fan YWang SFei ZQin YLi HLiu YFilkov VRay BZhou M(2024)Can Cooperative Multi-Agent Reinforcement Learning Boost Automatic Web Testing? An Exploratory StudyProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3694983(14-26)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3694983
Wang YFan MZhang XShi JQiu ZWang HLiu T(2024)LIReDroid: LLM-Enhanced Test Case Generation for Static Sensitive Behavior ReplicationProceedings of the 15th Asia-Pacific Symposium on Internetware10.1145/3671016.3671404(81-84)Online publication date: 24-Jul-2024
https://dl.acm.org/doi/10.1145/3671016.3671404
Hu HWang HDong RChen XChen C(2024)Enhancing GUI Exploration Coverage of Android Apps with Deep Link-Integrated MonkeyACM Transactions on Software Engineering and Methodology10.1145/366481033:6(1-31)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3664810
Tao ZGao YQi JPeng CWu QChen XYang Pd'Amorim M(2024)Neat: Mobile App Layout Similarity Comparison Based on Graph Convolutional NetworksCompanion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering10.1145/3663529.3663832(104-114)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3663529.3663832
Zhang YZhu QYan JLiu CZhang WZhao YHao DZhang LChristakis MPradel M(2024)Synthesis-Based Enhancement for GUI Test Case MigrationProceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3650212.3680327(869-881)Online publication date: 11-Sep-2024
https://dl.acm.org/doi/10.1145/3650212.3680327
Liu ZChen CWang JChen MWu BChe XWang DWang QRoychoudhury APaiva AAbreu RStorey M(2024)Make LLM a Testing Expert: Bringing Human-like Interaction to Mobile GUI Testing via Functionality-aware DecisionsProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639180(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639180
Liu ZChen CWang JChen MWu BTian ZHuang YHu JWang QRoychoudhury APaiva AAbreu RStorey M(2024)Testing the Limits: Unusual Text Inputs Generation for Mobile App Crash Detection with Large Language ModelProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639118(1-12)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639118
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Towards a pattern language for model-based GUI testing

PBGT tool: an integrated modeling and testing environment for pattern-based GUI testing

H-SCAN: A high level alternative to full-scan testing with reduced area and test application overheads

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Upcoming Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

PDF

eReader

Login options

Full Access

Abstract

References

Cited By

Index Terms

Recommendations

Towards a pattern language for model-based GUI testing

PBGT tool: an integrated modeling and testing environment for pattern-based GUI testing

H-SCAN: A high level alternative to full-scan testing with reduced area and test application overheads

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations