Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleDecember 2024
Technology adoption performance evaluation applied to testing industrial REST APIs
Automated Software Engineering (KLU-AUSE), Volume 32, Issue 1https://doi.org/10.1007/s10515-024-00477-2AbstractTesting is an important task within software development. To write test cases and integrate them into an automated test suite requires a significant amount of work. Given a set of requirements and specifications of a software, testing is needed to ...
- research-articleNovember 2024
Tool report: EvoMaster—black and white box search-based fuzzing for REST, GraphQL and RPC APIs
- Andrea Arcuri,
- Man Zhang,
- Susruthan Seran,
- Juan Pablo Galeotti,
- Amid Golmohammadi,
- Onur Duman,
- Agustina Aldasoro,
- Hernan Ghianni
Automated Software Engineering (KLU-AUSE), Volume 32, Issue 1https://doi.org/10.1007/s10515-024-00478-1AbstractIn this paper, we present the latest version 3.0.0 of EvoMaster, an open-source search-based fuzzer aimed at Web APIs. We discuss and present all its recent improvements, including advanced white-box heuristics, advanced search algorithms, support ...
- research-articleOctober 2024
Seeding and Mocking in White-Box Fuzzing Enterprise RPC APIs: An Industrial Case Study
ASE '24: Proceedings of the 39th IEEE/ACM International Conference on Automated Software EngineeringPages 2024–2034https://doi.org/10.1145/3691620.3695265Microservices is now becoming a promising architecture to build large-scale web services in industry. Due to the high complexity of enterprise microservices, industry has an urgent need to have a solution to enable automated testing of such systems. ...
- research-articleJune 2024
Advanced White-Box Heuristics for Search-Based Fuzzing of REST APIs
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 33, Issue 6Article No.: 142, Pages 1–36https://doi.org/10.1145/3652157Due to its importance and widespread use in industry, automated testing of REST APIs has attracted major interest from the research community in the last few years. However, most of the work in the literature has been focused on black-box fuzzing. ...
- research-articleJanuary 2024
Random Testing and Evolutionary Testing for Fuzzing GraphQL APIs
ACM Transactions on the Web (TWEB), Volume 18, Issue 1Article No.: 14, Pages 1–41https://doi.org/10.1145/3609427The Graph Query Language (GraphQL) is a powerful language for application programming interface (API) manipulation in web services. It has been recently introduced as an alternative solution for addressing the limitations of RESTful APIs. This article ...
-
- ArticleDecember 2023
On the Impact of Tool Evolution and Case Study Size on SBSE Experiments: A Replicated Study with EvoMaster
AbstractIn the dynamic landscape of Search-Based Software Engineering (SBSE), tools and algorithms are continually improved, possibly making past experimental insights outdated. This could happen if a newly designed technique has side-effects compared to ...
- research-articleSeptember 2023
Open Problems in Fuzzing RESTful APIs: A Comparison of Tools
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 32, Issue 6Article No.: 144, Pages 1–45https://doi.org/10.1145/3597205RESTful APIs are a type of web service that are widely used in industry. In the past few years, a lot of effort in the research community has been spent in designing novel techniques to automatically fuzz those APIs to find faults in them. Many real ...
- research-articleSeptember 2023
JavaScript SBST Heuristics to Enable Effective Fuzzing of NodeJS Web APIs
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 32, Issue 6Article No.: 139, Pages 1–29https://doi.org/10.1145/3593801JavaScript is one of the most popular programming languages. However, its dynamic nature poses several challenges to automated testing techniques. In this paper, we propose an approach and open-source tool support to enable white-box testing of JavaScript ...
- research-articleSeptember 2023
.NET/C# instrumentation for search-based software testing
Software Quality Journal (KLU-SQJO), Volume 31, Issue 4Pages 1439–1465https://doi.org/10.1007/s11219-023-09645-1AbstractC# is one of the most widely used programming languages. However, to the best of our knowledge, there has been no work in the literature aimed at enabling search-based software testing techniques for applications running on the .NET platform, like ...
- research-articleJuly 2023
White-Box Fuzzing RPC-Based APIs with EvoMaster: An Industrial Case Study
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 32, Issue 5Article No.: 122, Pages 1–38https://doi.org/10.1145/3585009Remote Procedure Call (RPC) is a communication protocol to support client-server interactions among services over a network. RPC is widely applied in industry for building large-scale distributed systems, such as Microservices. Modern RPC frameworks ...
- research-articleMarch 2023
Building an open-source system test generation tool: lessons learned and empirical analyses with EvoMaster
- Andrea Arcuri,
- Man Zhang,
- Asma Belhadi,
- Bogdan Marculescu,
- Amid Golmohammadi,
- Juan Pablo Galeotti,
- Susruthan Seran
Software Quality Journal (KLU-SQJO), Volume 31, Issue 3Pages 947–990https://doi.org/10.1007/s11219-023-09620-wAbstractResearch in software testing often involves the development of software prototypes. Like any piece of software, there are challenges in the development, use and verification of such tools. However, some challenges are rather specific to this ...
Selectively Combining Multiple Coverage Goals in Search-Based Unit Test Generation
ASE '22: Proceedings of the 37th IEEE/ACM International Conference on Automated Software EngineeringArticle No.: 91, Pages 1–12https://doi.org/10.1145/3551349.3556902Unit testing is a critical part of software development process, ensuring the correctness of basic programming units in a program (e.g., a method). Search-based software testing (SBST) is an automated approach to generating test cases. SBST generates ...
- ArticleOctober 2021
Enhancing Resource-Based Test Case Generation for RESTful APIs with SQL Handling
AbstractNowadays, many companies use RESTful web services to develop their enterprise applications. These web services typically interact with databases. In REST, resource handling is a fundamental concept, where resources are manipulated by exposing HTTP ...
- research-articleSeptember 2021
Enhancing Search-based Testing with Testability Transformations for Existing APIs
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 31, Issue 1Article No.: 1, Pages 1–34https://doi.org/10.1145/3477271Search-based software testing (SBST) has been shown to be an effective technique to generate test cases automatically. Its effectiveness strongly depends on the guidance of the fitness function. Unfortunately, a common issue in SBST is the so-called flag ...
- research-articleJuly 2020
Handling SQL Databases in Automated System Test Generation
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 29, Issue 4Article No.: 22, Pages 1–31https://doi.org/10.1145/3391533Automated system test generation for web/enterprise systems requires either a sequence of actions on a GUI (e.g., clicking on HTML links and form buttons) or direct HTTP calls when dealing with web services (e.g., REST and SOAP). When doing white-box ...
- research-articleJuly 2019
SQL data generation to enhance search-based system testing
GECCO '19: Proceedings of the Genetic and Evolutionary Computation ConferencePages 1390–1398https://doi.org/10.1145/3321707.3321732Automated system test generation for web/enterprise systems requires either a sequence of actions on a GUI (e.g., clicking on HTML links), or direct HTTP calls when dealing with web services (e.g., REST and SOAP). However, web/enterprise systems do ...
- research-articleMay 2019
The maturation of search-based software testing: successes and challenges
SBST '19: Proceedings of the 12th International Workshop on Search-Based Software TestingPages 13–14https://doi.org/10.1109/SBST.2019.00013In this paper we revisit the field of search-based software testing (SBST) in the context of its technological maturity. We highlight some successes with respect to tools, hybrid approaches, extensions and industry adoption. We then discuss some open ...
- tutorialMay 2018
Evaluating search-based techniques with statistical tests
SBST '18: Proceedings of the 11th International Workshop on Search-Based Software TestingPage 21https://doi.org/10.1145/3194718.3194732This tutorial covers the basics of how to use statistical tests to evaluate and compare search-algorithms, in particular when applied on software engineering problems. Search-algorithms like Hill Climbing and Genetic Algorithms are randomised. Running ...
- short-paperJuly 2017
Mapping hardness of automated software testing
ISSTA 2017: Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and AnalysisPages 440–443https://doi.org/10.1145/3092703.3098241Automated Test Case Generation (ATCG) is an important topic in Software Testing, with a wide range of techniques and tools being used in academia and industry. While their usefulness is widely recognized, due to the labor-intensive nature of the task, ...
- research-articleMay 2017
The evolutionary landscape of SBST: a 10 year perspective
SBST '17: Proceedings of the 10th International Workshop on Search-Based Software TestingPages 47–48A key indicator of the health and quality of any evolutionary algorithm is the landscape of its search. By analyzing the landscape one can determine the peaks (local maxima) where significant solutions exist. In this paper we examine the landscape for ...