research-article

Exploration and analysis of regression test suite optimization

Authors:

Ali AhsanAuthors Info & Claims

ACM SIGSOFT Software Engineering Notes, Volume 39, Issue 1

Pages 1 - 5

https://doi.org/10.1145/2557833.2557841

Published: 11 February 2014 Publication History

Abstract

Regression Test Suite Optimization (RTO) is an active research area. A Regression Test Suite is always growing due to changes in software, which increases testing time. To save time and resources optimization of regression test suites is mandatory. Researchers have optimized test suites using conventional and Computational Intelligence based approaches and achieve optimization of regression test suites through selection techniques, minimization or reduction techniques and ranking or prioritization techniques. This paper surveys existing techniques for regression test suite optimization, various tools and mathematical models being used for RTO. During this survey we found many interesting facts about regression test suite optimization that will be shared in the conclusion.

References

[1]

Manoj Kumar, Arun Sharma and Rajesh Kumar, Optimization of Test Cases using Soft Computing Techniques: A Critical Review, WSEAS Transactions on Information Science and Applications, Issue 11, Volume 8, November 2011, pp 440--452.

[2]

A. A. Haider, S. Rafique and A. Nadeem, Test Suite Optimization using Fuzzy Logic, 8th International Conference of Emerging Techniques (ICET), 8th October 2012.

[3]

Gaurav Duggal, Bharti Suri,Understanding Regression Testing Techniques http://www.rimtengg.com/coit2008/proceedings/SW15.pdf

[4]

Todd L. Graves, Mary Jean Harrold, Jung-Min Kim, Adam Porter and Gregg Rothermel, ACM Transactions on Software Engineering and Methodology, Vol. 10, No. 2, April 2001, pp 184--208.

Digital Library

[5]

S. Yoo and M. Harman, Regression Testing Minimisation, Selection and Prioritisation: A Survey, Softw. Test. Verif. Reliab. 2007; 00:1--7, pp 1--60.

Digital Library

[6]

W. Eric Wong, J. R. Horgan, Saul London and Hira Agrawal, A Study of Effective Regression Testing in Practice, 8th IEEE International Symposium on Software Reliability Engineering (ISSRE'97), pp 264--274,Albuquerque,NM, November 1997.

Digital Library

[7]

Ruchika Malhotra, Arvinder Kaur and Yogesh Singh, A Regression Test Selection and Prioritization Technique, Journal of Information Processing Systems, Vol.6, No.2, June 2010, pp 235--252.

[8]

Saran Prasad, Mona Jain and Shradha Singh, Regression Optimizer A Multi Coverage Criteria Test Suite Minimization Technique, International Journal of Applied Information Systems (IJAIS) -- ISSN : 2249-0868, Foundation of Computer Science FCS, New York, USA Volume 1-- No.8, April 2012 -- www.ijais.org, pp 5--11.

[9]

Nanda, Agastya, Senthil Mani, Saurabh Sinha, Mary Jean Harrold, and Alessandro Orso. "Regression testing in the presence of noncode changes." In Software Testing, Verification and Validation (ICST), 2011 IEEE Fourth International Conference on, pp. 21--30.

Digital Library

[10]

Gregg Rothermel, Roland H. Untch, Chengyun Chu and Mary Jean Harrold, Test Case Prioritization: An Empirical Study, Proceedings of the International Conference on Software Maintenance, Oxford, UK, September, 1999.

Digital Library

[11]

Mansour, Nashat, and WaelStatieh. "Regression test selection for C# programs." Advances in Software Engineering 2009 (2009): 1.

Digital Library

[12]

Machani Siva Prasad, An Efficient Regression Testing By Computing Coverage Data For Software Evolution, International Journal of Computer Science & Informatics, Volume-I, Issue- II,2011, pp 76--79.

[13]

Jung-Min Kim and Adam Porter, A History-Based Test Prioritization Technique for Regression Testing in Resource Constrained Environments, 1CSE'02, May 19-25, 2002, Orlando, Florida, USA.

Digital Library

[14]

Alessandro Orso, Nanjuan Shi, and Mary Jean Harrold, Scaling Regression Testing to Large Software Systems, SIGSOFT'04 /FSE12, Oct. 31--Nov. 6, 2004, Newport Beach, CA, USA

Digital Library

[15]

Chittimalli, Pavan Kumar, and M-J. Harrold. "Recomputing coverage information to assist regression testing." Software Engineering, IEEE Transactions on 35, No. 4, 2009, pp 452--469.

Digital Library

[16]

Willmor, David, and Suzanne M. Embury. "A safe regression test selection technique for database-driven applications." In Software Maintenance, 2005. ICSM'05. Proceedings of the 21st IEEE International Conference, pp. 421--430.

Digital Library

[17]

Chang-ai Sun, A Constraint-based Test Suite Reduction Method for Conservative Regression Testing, Journal of Software, Vol. 6, No. 2, February 2011, pp 314--321.

[18]

Saran Prasad, Mona Jain and Shradha Singh, Regression Optimizer A Multi Coverage Criteria Test Suite Minimization Technique, International Journal of Applied Information Systems (IJAIS) -- ISSN : 2249-0868, Foundation of Computer Science FCS, New York, USA Volume 1-- No.8, April 2012 -- www.ijais.org, pp 5--11

[19]

Saeed Parsa and Alireza Khalilian, On the Optimization Approach towards Test Suite Minimization, International Journal of Software Engineering and Its Applications Vol. 4, No. 1, January 2010, pp 15--28.

[20]

Zheng Li, Mark Harman, and Robert M. Hierons, Search Algorithms for Regression Test Case Prioritization, IEEE Transactions on Software Engineering, Vol. 33, No. 4, April 2007.

Digital Library

[21]

Qian Zhongsheng, Test Case Generation and Optimization for User Session-based Web Application Testing, Journal of Computers, Vol. 5, No. 11, November 2010, pp 1655--1662.

[22]

S. Nachiyappan A. Vimaladevi and C.B. Selva Lakshmi, An Evolutionary Algorithm for Regression Test Suite Reduction, Proceedings of the International Conference on Communication and Computational Intelligence -- 2010,pp 503--508

[23]

Arvinder Kaur and Shubhra Goyal, A Genetic Algorithm for Fault based Regression Test Case Prioritization, International Journal of Computer Applications (0975 -- 8887) Volume 32-- No.8, October 2011, pp 30--37.

[24]

Arvinder Kaur, A Bee Colony Optimization Algorithm for Code Coverage Test Suite Prioritization, International Journal of Engineering Science and Technology (IJEST), Vol. 3 No. 4 April 2011, pp 2786--2795

[25]

Arvinder Kaur and Shubhra Goyal, A Genetic Algorithm for Regression Test Case Prioritization using Code Coverage, International Journal on Computer Science and Engineering (IJCSE), ISSN : 0975-3397 Vol. 3 No. 5 May 2011, pp 1839--1847.

[26]

Luciano S. de Souza, Pericles B. C. de Miranda, Ricardo B. C. Prudencio and Flavia de A. Barros, A Multi-Objective Particle Swarm Optimization for Test Case Selection Based on Functional Requirements Coverage and Execution Effort, 2011 23rd IEEE International Conference on Tools with Artificial Intelligence, pp 245--252.

Digital Library

[27]

Arvinder Kaur and Divya Bhatt, Hybrid Particle Swarm Optimization for Regression Testing, International Journal on Computer Science and Engineering (IJCSE) Vol. 3 No. 5 May 2011, pp 1815--1824.

[28]

Arvinder Kaur and Divya Bhatt, Particle Swarm Optimization with Cross-Over Operator for Prioritization in Regression Testing, International Journal of Computer Applications (0975 -- 8887) Volume 27-- No.10, August 2011, pp 27--34.

[29]

Xu, Zhiwei, KehanGao, and Taghi M. Khoshgoftaar. "Application of fuzzy expert system in test case selection for system regression test." Information Reuse and Integration, Conf, 2005. IRI-2005 IEEE International Conference IEEE, 2005.

[30]

Ali M. Alakeel, A Fuzzy Test Cases Prioritization Technique for Regression Testing Programs with Assertions, ADVCOMP 2012 : The Sixth International Conference on Advanced Engineering Computing and Applications in Sciences, pp 78--82.

[31]

Whyte, G. and Mulder, D.L. "Mitigating the Impact of Software Test Constraints on Software Testing Effectiveness" The Electronic Journal Information Systems Evaluation Volume 14 Issue 2 2011, pp 254--270.

[32]

Ashraf, E., A. Rauf, and K. Mahmood. "Value based Regression Test Case Prioritization." Proceedings of the World Congress on Engineering and Computer Science. Vol. 1. 2012.

[33]

Zeeshan Anwar and Ali Ahsan, Comparative Analysis of MOGA, NSGA-II and MOPSO for Regression Test Suite Optimization, International Journal of Software Engineering {Accepted for Publication}.

[34]

Shin Yoo and Mark Harman, Pareto Efficient MultiObjective Test Case Selection.

[35]

S. Yoo and M. Harman, Regression Testing Minimisation, Selection and Prioritisation: A Survey, Softw. Test. Verif. Reliab. 2007; 00:1--7, pp 1--60.

Digital Library

[36]

Harman, Mark. "Making the case for MORTO: Multi objective regression test optimization." Software Testing, Verification and Validation Workshops (ICSTW), 2011 IEEE Fourth International Conference on. IEEE, 2011.

Digital Library

[37]

Lin, Xuan. "Regression Testing in Research And Practice." Computer Science and Engineering Department University of Nebraska, Lincoln (2007): 1--402.

[38]

Taneja, Kunal, Tao Xie, Nikolai Tillmann, Jonathan De Halleux, and Wolfram Schulte. "Guided path exploration for regression test generation." In Software Engineering-Companion Volume, 2009. ICSE-Companion 2009. 31st International Conference on, pp. 311--314.

[39]

K.K. Aggarwal, and Y. Singh, "A book on software engineering", New Age International (P) Ltd.; Publishers, 4835/24, Ansari Road, Daryaganj, New Delhi, 2001.

[40]

http://pleuma.cc.gatech.edu/aristotle/Tools/subjects/

[41]

https://sites.google.com/site/asergrp/Home

Cited By

Sebastian ANaseem HCatal C(2024)Unsupervised Machine Learning Approaches for Test Suite ReductionApplied Artificial Intelligence10.1080/08839514.2024.232233638:1Online publication date: 4-Mar-2024
https://doi.org/10.1080/08839514.2024.2322336
Nithya BPrasanthi B(2023)Fuzzy and ANN based model for Test case prioritization for Regression testing2023 International Conference on Advances in Computing, Communication and Applied Informatics (ACCAI)10.1109/ACCAI58221.2023.10199547(1-9)Online publication date: 25-May-2023
https://doi.org/10.1109/ACCAI58221.2023.10199547
Anwar ZAfzal HBibi NAbbas HMohsin AArif O(2019)A hybrid-adaptive neuro-fuzzy inference system for multi-objective regression test suites optimizationNeural Computing and Applications10.1007/s00521-018-3560-831:11(7287-7301)Online publication date: 1-Nov-2019
https://dl.acm.org/doi/10.1007/s00521-018-3560-8
Show More Cited By

Index Terms

Exploration and analysis of regression test suite optimization
1. Hardware
  1. Hardware test
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

On the Fly Test Suite Optimization with FuzzyOptimizer
FIT '13: Proceedings of the 2013 11th International Conference on Frontiers of Information Technology

There occur frequent requirement changes in software systems even after the software has been developed. Regression testing is continuously performed to identify the undesired affects of these requirement changes on already tested system. Test suites ...
Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage

Software testing is particularly expensive for developers of high-assurance software, such as software that is produced for commercial airborne systems. One reason for this expense is the Federal Aviation Administration's requirement that test suites be ...
On test suite composition and cost-effective regression testing

Regression testing is an expensive testing process used to revalidate software as it evolves. Various methodologies for improving regression testing processes have been explored, but the cost-effectiveness of these methodologies has been shown to vary ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes

ACM SIGSOFT Software Engineering Notes Volume 39, Issue 1

January 2014

193 pages

ISSN:0163-5948

DOI:10.1145/2557833

Editor:
Will Tracz
Lockheed Martin IS&GS, Endicott, NY

Issue’s Table of Contents

Copyright © 2014 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 February 2014

Published in SIGSOFT Volume 39, Issue 1

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
412
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sebastian ANaseem HCatal C(2024)Unsupervised Machine Learning Approaches for Test Suite ReductionApplied Artificial Intelligence10.1080/08839514.2024.232233638:1Online publication date: 4-Mar-2024
https://doi.org/10.1080/08839514.2024.2322336
Nithya BPrasanthi B(2023)Fuzzy and ANN based model for Test case prioritization for Regression testing2023 International Conference on Advances in Computing, Communication and Applied Informatics (ACCAI)10.1109/ACCAI58221.2023.10199547(1-9)Online publication date: 25-May-2023
https://doi.org/10.1109/ACCAI58221.2023.10199547
Anwar ZAfzal HBibi NAbbas HMohsin AArif O(2019)A hybrid-adaptive neuro-fuzzy inference system for multi-objective regression test suites optimizationNeural Computing and Applications10.1007/s00521-018-3560-831:11(7287-7301)Online publication date: 1-Nov-2019
https://dl.acm.org/doi/10.1007/s00521-018-3560-8
Sujata Purohit G(2017)Classification model for test case prioritization techniques2017 International Conference on Computing, Communication and Automation (ICCCA)10.1109/CCAA.2017.8229925(919-924)Online publication date: May-2017
https://doi.org/10.1109/CCAA.2017.8229925
Prakash KPrasad SKrishna DPadmanabhuni SNambiar RDevanbu PRamanathan MSureka A(2015)Recommendation and Regression Test Suite Optimization Using Heuristic AlgorithmsProceedings of the 8th India Software Engineering Conference10.1145/2723742.2723765(202-203)Online publication date: 18-Feb-2015
https://dl.acm.org/doi/10.1145/2723742.2723765
Prasad DChacko SKanakadandi SDurbhaka G(2014)Automated Regression Test Suite Optimization Based on HeuristicsProceedings of the 2014 4th International Conference on Artificial Intelligence with Applications in Engineering and Technology10.1109/ICAIET.2014.18(48-53)Online publication date: 12-Mar-2014
https://dl.acm.org/doi/10.1109/ICAIET.2014.18
Anwar ZAhsan A(2013)Multi-objective regression test suite optimization with Fuzzy logicINMIC10.1109/INMIC.2013.6731331(95-100)Online publication date: Dec-2013
https://doi.org/10.1109/INMIC.2013.6731331

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents