research-article

Automatic feedback, control-based, stress and load testing

Authors:

Mohamad Bayan,

João W. CangussuAuthors Info & Claims

SAC '08: Proceedings of the 2008 ACM symposium on Applied computing

Pages 661 - 666

https://doi.org/10.1145/1363686.1363847

Published: 16 March 2008 Publication History

Get Access

Abstract

Stress and load testing are of special interest to many segments of the software industry. However, existing approaches present limitations with respect to automation and applicability. While some approaches present an automated solution, they lack in terms of applicability. A fully automated approach with high applicability is proposed here. The approach is based on the use of a PID controller to automatically drive the inputs and to achieve a pre-specified level of stress/load for resources of interest. The approach also allows for automatic identification of inputs impacting the resources. An experiment along with multiple simulation runs are presented as an indication of the applicability and accuracy of the proposed approach.

References

[1]

Loadrunner by mercury interactive. http://www.mercuryinteractive.com/products/loadrunner/.

Google Scholar

[2]

Software System Testing and Quality Assurance. Van Nostrand Reinhold, 1984.

Digital Library

Google Scholar

[3]

Testing Object-Oriented Systems - Models, Patterns, and Tools. Addison-Wesley, 1999.

Digital Library

Google Scholar

[4]

Alberto Avritzer and Brian Larson. Load testing software using deterministic state testing. In Proceeding of the International Symposium on Software Testing and Analysis, pages 82--88. ACM, June 1993.

Digital Library

Google Scholar

[5]

Mohamad Bayan and Joao W. Cangussu. Automatic stress and load testing for embedded systems. In 3rd International Workshop on Software Cybernetics - 30th Annual IEEE International Computer Software and Applications Conference(COMPSAC 2006), Chicago, IL, Sept. 18--21 2006. IEEE.

Digital Library

Google Scholar

[6]

Lionel C. Briand, Yvan Labiche, and Marwa Shousha. Stress testing real-time systems with genetic algorithms. In Proceedings of the Genetic And Evolutionary Computation Conference, pages 1021--1028, Washington, DC, June 2005. ACM.

Digital Library

Google Scholar

[7]

Concettina Del Grosso, Giuliano Antoniol, Massimiliano Di Penta, Philippe Galinier, and Ettore Merlo. Improving network applications security: a new heuristic to generate stress testing data. In Proceedings of the Genetic and evolutionary computation Conference, pages 1037--1043, Washington, DC, 2005. ACM.

Digital Library

Google Scholar

[8]

Jer-Nan Juang. Applied System Identification. Prentice Hall, Englewood Cliffs, New Jersey, first edition, 1993.

Digital Library

Google Scholar

[9]

Lennart Ljung. System Identification: Theory for the user. Prentice-Hall, Englewood Cliffs, New Jersey, 1987.

Digital Library

Google Scholar

[10]

David G. Luenberger. Introduction to Dynamic Systems: Theory, models and applications. John Wiley & Sons, New York, 1979.

Google Scholar

[11]

David Mosberger and Tai Jin. httperf a tool for measuring web server performance. SIGMETRICS Perform. Eval. Rev., 26(3):31--37, 1998.

Digital Library

Google Scholar

[12]

Cheer-Sun D. Yang and Lori L. Pollock. Towards a structural load testing tool. In Proceedings of the International Symposium on Software Testing and Analysis, pages 201--228, San Diego, CA, 1996.

Digital Library

Google Scholar

[13]

Jian Zhang and S. C. Cheung. Automated test case generation for the stress testing of multimedia systems. Software, Practice & Experience, 32(15):1411--1435, 2002.

Digital Library

Google Scholar

Cited By

View all

Apak ETosun A(2020)Finding Load Inducing Test Scenarios Using Genetic Algorithms and Tree Based EncodingProceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops10.1145/3387940.3392216(533-536)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3387940.3392216
Saumya CKoo JKulkarni MBagchi S(2019)XSTRESSOR : Automatic Generation of Large-Scale Worst-Case Test Inputs by Inferring Path Conditions2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST)10.1109/ICST.2019.00011(1-12)Online publication date: Apr-2019
https://doi.org/10.1109/ICST.2019.00011
Luo QNair AGrechanik MPoshyvanyk D(2017)FOREPOSTEmpirical Software Engineering10.1007/s10664-015-9413-522:1(6-56)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s10664-015-9413-5
Show More Cited By

Index Terms

Automatic feedback, control-based, stress and load testing
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

A feedback control mechanism for the automation of stress and load testing
Automatic Stress and Load Testing for Embedded Systems
COMPSAC '06: Proceedings of the 30th Annual International Computer Software and Applications Conference - Volume 02

Load and Stress testing are important to guarantee the system is able to support specified load conditions as well as properly recover from the excess use of resources. The generation of test cases to achieve levels of load and stress is a demanding ...
Automatic extraction of probabilistic workload specifications for load testing session-based application systems
VALUETOOLS '14: Proceedings of the 8th International Conference on Performance Evaluation Methodologies and Tools

Workload generation is essential to systematically evaluate performance properties of application systems under controlled conditions, e.g., in load tests or benchmarks. The definition of workload specifications that represent the real workload as ...

Comments

Information & Contributors

Information

Published In

SAC '08: Proceedings of the 2008 ACM symposium on Applied computing

March 2008

2586 pages

ISBN:9781595937537

DOI:10.1145/1363686

Conference Chairs:
Roger L. Wainwright
University of Tulsa
,
Hisham M. Haddad
Kennesaw State University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 March 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SAC '08

Sponsor:

SIGAPP

SAC '08: The 2008 ACM Symposium on Applied Computing

March 16 - 20, 2008

Fortaleza, Ceara, Brazil

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
468
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Apak ETosun A(2020)Finding Load Inducing Test Scenarios Using Genetic Algorithms and Tree Based EncodingProceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops10.1145/3387940.3392216(533-536)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3387940.3392216
Saumya CKoo JKulkarni MBagchi S(2019)XSTRESSOR : Automatic Generation of Large-Scale Worst-Case Test Inputs by Inferring Path Conditions2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST)10.1109/ICST.2019.00011(1-12)Online publication date: Apr-2019
https://doi.org/10.1109/ICST.2019.00011
Luo QNair AGrechanik MPoshyvanyk D(2017)FOREPOSTEmpirical Software Engineering10.1007/s10664-015-9413-522:1(6-56)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s10664-015-9413-5
Alesio SBriand LNejati SGotlieb A(2015)Combining Genetic Algorithms and Constraint Programming to Support Stress Testing of Task DeadlinesACM Transactions on Software Engineering and Methodology10.1145/281864025:1(1-37)Online publication date: 2-Dec-2015
https://dl.acm.org/doi/10.1145/2818640
Jiang ZHassan A(2015)A Survey on Load Testing of Large-Scale Software SystemsIEEE Transactions on Software Engineering10.1109/TSE.2015.244534041:11(1091-1118)Online publication date: 1-Nov-2015
https://doi.org/10.1109/TSE.2015.2445340
Zhou JZhou BLi S(2014)Automated Model-Based Performance Testing for PaaS Cloud ServicesProceedings of the 2014 IEEE 38th International Computer Software and Applications Conference Workshops10.1109/COMPSACW.2014.108(644-649)Online publication date: 21-Jul-2014
https://dl.acm.org/doi/10.1109/COMPSACW.2014.108
Maggio MHoffmann HSantambrogio MAgarwal ALeva A(2013)Power Optimization in Embedded Systems via Feedback Control of Resource AllocationIEEE Transactions on Control Systems Technology10.1109/TCST.2011.217749921:1(239-246)Online publication date: Jan-2013
https://doi.org/10.1109/TCST.2011.2177499
Zhang PElbaum SDwyer MHeimdahl MSu Z(2012)Compositional load test generation for software pipelinesProceedings of the 2012 International Symposium on Software Testing and Analysis10.1145/2338965.2336764(89-99)Online publication date: 15-Jul-2012
https://dl.acm.org/doi/10.1145/2338965.2336764
Lin RChen BXie YPeng XZhao W(2012)Learning-Based Multi-controller Coordination for Self-OptimizationProceedings of the 2012 IEEE 36th Annual Computer Software and Applications Conference Workshops10.1109/COMPSACW.2012.39(164-169)Online publication date: 16-Jul-2012
https://dl.acm.org/doi/10.1109/COMPSACW.2012.39
Zhang PElbaum SDwyer M(2011)Automatic generation of load testsProceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2011.6100093(43-52)Online publication date: 6-Nov-2011
https://dl.acm.org/doi/10.1109/ASE.2011.6100093
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A feedback control mechanism for the automation of stress and load testing

Automatic Stress and Load Testing for Embedded Systems

Automatic extraction of probabilistic workload specifications for load testing session-based application systems

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

A feedback control mechanism for the automation of stress and load testing

Automatic Stress and Load Testing for Embedded Systems

Automatic extraction of probabilistic workload specifications for load testing session-based application systems

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations