Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
survey

Automated Regression Test Case Generation for Web Application: A Survey

Published: 22 August 2018 Publication History

Abstract

Testing is one of the most important phases in the development of any product or software. Various types of software testing exist that have to be done to meet the need of the software. Regression testing is one of the crucial phases of testing where testing of a program is done for the original test build along with the modifications. In this article, various studies proposed by the authors have been analysed focusing on test cases generation and their approach toward web application. A detailed study was conducted on Regression Test Case Generation and its approaches toward web application. From our detailed study, we have found that very few approaches and methodologies have been found that provide the real tool for test case generation. There is a need of an automated regression testing tool to generate the regression test cases directly based on user requirements. These test cases have to be generated and implemented by the tool so that the reduction in the overall effort and cost can be achieved. From our study, we have also found that regression testing for web applications was not investigated much, but in today's scenario web applications are an integral part of our daily life and so that needs to be tested for regression testing.

References

[1]
Aynur Abdurazik and Jeff Outt. 2000. Using UML collaboration diagrams for static checking and test generation. Proceedings of the 3rd International Conference on the Unified Modelling Language. 383--395
[2]
Aynur Abdurazik, Jeff Offutt, and Andrea Baldini. 2004. A controlled experimental evaluation of test cases generated from UML diagrams. Technical Report: ISE-TR-04-03, Dept of Info and Software Engineering, George Mason University.
[3]
Aynur Abdurazik, Jeff Offutt and Andrea Baldini. 2005. A comparative evaluation of tests generated from different UML diagrams: Diagrams and data. GMU Technical Report ISE-TR-05-04.
[4]
Hiralal Agrawal and Joseph Robert Horgan. 1990. Dynamic program slicing. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI’90). 246--256.
[5]
Aysh Alhroob, Keshav Dehal, and Alamgir Hossain. 2010. Automatic test cases generation from software specifications. E-info. Softw. Eng. J. 4, 1, 109--121.
[6]
Nadia Alshahwan and Mark Harman. 2008. Automated session data repair for web application regression testing. In Proceedings of the 1st International Conference on Software Testing, Verification, and Validation.
[7]
Saswat Ananda, Esmund Burkeb, Tsong Y. Chen, John Clark, and Myra B. Cohen. 2013. An orchestrated survey of methodologies for automated software test case generation. J. Syst. Softw. 86, 8, 1978--2001.
[8]
Ramya Bandaru and J. A. Mayan. 2016. Novel approach for whole test suite generation using metamorphic relations. Indian J. Sci. Technol. 9, 10.
[9]
Ghinwa Baradhi and Nashat Mansour. 1997. A comparative study of five regression testing algorithms. In Proceedings of the Australian Software Engineering Conference. 174.
[10]
Antonia Bertolino, Eda Marchetti, and H. Muccini. 2004. Introducing a reasonably complete and coherent approach for model-based testing. Electron. Notes Theoret. Comput. Sci. 116, 85--97.
[11]
David Binkley. 1995. Reducing the cost of regression testing by semantic guided test case selection. In Proceedings of IEEE International Conference on Software Maintenance. IEEE Computer Society Washington, DC, 251--260.
[12]
Pakinam N. Boghdady, Nagwa L. Badr, Mohamed Hashem, and Mohamed F. Tolba. 2011. A proposed test case generation technique based on activity diagrams. Int. J. Eng. Technol. 11, 03.
[13]
Gerardo Canfora, Aniello Cimitile, and Andrea De Lucia. 1998. Conditioned program slicing. Info. Softw. Technol. 40, 11, 595--607.
[14]
Emaruela G. Cartaxo, Francisco G. O. Neto, and Patricia D. L. Machado. 2007. Test case generation by means of UML sequence diagrams and labeled transition systems. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. 1292--1297.
[15]
Alessandra Cavarra, Thierry Jeron, and Alan Hartman. 2002. Using UML for automatic test generation. Proceedings of the International Symposium on Software Testing and Analysis (ISSTA’02).
[16]
Lin Chen, Ziyuan Wang, Lei Cu, Hongmin Lu, and Baowen Xu. 2010. Test case prioritization for web service regression testing. In Proceedings of the 5th IEEE International Symposium on Service Oriented System Engineering. IEEE Computer Society.
[17]
Yanping Chen, Robert L. Probert, and D. P. Sims. 2002. Specification based regression test selection with risk analysis. In Proceedings of Conference of IBM Center for Advanced Studies. IBM Press, 1--14.
[18]
Torgeir Dingsoyr and Casper Lassenius. 2016. Emerging themes in agile software development: Introduction to the special section on continuous value delivery. Info. Softw. Technol. ScienceDirect 77, 55--60.
[19]
Sebastian Elbaum, Gregg Rothermel, Srikanth Karre, and Marc Fisher. 2005. Leveraging user session data to support web application testing. IEEE Trans. Softw. Eng. 31, 3, 187--202.
[20]
Sebastian Elbaum, Praveen Kallakuri, Alexey G. Malishevsky, Gregg Rothermel, and Satya Kanduri. 2003. Understanding the effects of changes on the cost-effectiveness of regression testing techniques. J. Softw. Test. Verificat. Reliabil. 13, 2, 65--83.
[21]
W. Eric Wong, J. R. Horgan, Saul London, and Hira Agrawal. 1997. A study of effective regression testing in practice. In Proceedings of the 8th IEEE International Symposium on Software Reliability Engineering. 264--274.
[22]
Muhammad Fahad and Aamer Nadeem. 2008. A survey of UML based regression testing. In Proceedings of the International Conference on Intelligent Information Processing. Springer, Vol. 288. 200--210.
[23]
Stefania Gnesi, Diego Latella, and Mieke Massink. 2004. Formal test-case generation for UML statecharts. In Proceedings of the 9th IEEE International Conference on Engineering Complex Computer Systems Navigating Complexity in the e-Engineering. Vol. 42, No. 7, 75--84.
[24]
Todd L. Graves, Mary J. Harrold, Jung M. Kim, Adam Porte, and Gregg Rothermel. 2001. An empirical study of regression test selection techniques. ACM Trans. Softw. Eng. Methodol. 10, 2, 184--208.
[25]
Sumit Gupta, Sunil Indori, and Atishey Bansal. 2015. Automation beyond application test scripting. Proceedings of the 15th Annual International Software Testing Conference.
[26]
J. Hartmann, M. Vieira, H. Foster, and Axel Ruder. 2004. UML based Test generation and execution. Technical report, Siemens Corporate Research, Inc.
[27]
Douglas Hoffman. 1999. Cost benefits analysis of test automation. In Proceedings of the Software Testing Conference on Software Quality Methods (STARWEST’99).
[28]
Susan Horwitz, Thomas W. Reps, and David Binkley. 1990. Interprocedural slicing using dependence graphs. ACM Trans. Program. Lang. Syst. 12, 1, 26--60.
[29]
Seifedine Kadry. 2011. A new proposed technique to improve software regression testing cost. Int. J. Secur. Appl. 5, 3, 45--48.
[30]
P. Kandil, S. Moussa, and N. Badr. 2017. Cluster based test cases prioritization and selection technique for agile regression testing. J. Softw.: Evol. Process. 29, 6.
[31]
Sarbjot Kaur and Makul Mahajan. 2016. Re-usability of constraints for test case generation in different applications using genetic algorithm. Int. J. Comput. Sci. Netw. Secur. 16, 5, 113--117.
[32]
Monalisha Khandai, Arup A. Acharya, and Durga P. Mohapatra. 2011. A survey on test case generation from UML model. Int. J. Comput. Sci. Info. Technol. 2, 3, 1164--1171.
[33]
M. Khatibsyarbini, M. A. Isa, D. N. Jawawi, and R. Tumeng. 2017. Test case prioritization approaches in regression testing: A systematic literature review. Info. Softw. Technol. 93, 1, 74--93.
[34]
Hyungchoul Kim, Sungwon Kang, Jongmoon Baik, and Inyoung Ko. 2007. Test cases generation from UML activity diagrams. In Proceeding of 8th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing. 556--561.
[35]
Y. G. Kim, H. S. Hong, S. M. Cho, D. H. Bae, and S. D. Cha. 1999. Test case generation from UML state diagrams. IEE Proc. Softw. 146, 4, 187--192.
[36]
Bogdan Korel and Janusz W. Laski. 1988. Dynamic program slicing. Info. Process. Lett. 29, 3, 155--163.
[37]
Nikolai Kosmatov, Bruno Legeard, Fabien Peureux, and Mark Utting. 2004. Boundary coverage criteria for test generation from formal models. Proceedings of the 15th International Symposium on Software Reliability Engineering.
[38]
Debasish Kundu and D. Samanta. 2009. A novel approach to generate test cases from UML activity diagrams. J. Object Technol. 8, 3, 65--83.
[39]
David C. Kung, Chien H. Liu, and Pei Hsia. 2000. An object-oriented web test model for testing web applications. In Proceedings of the 1st Asia-Pacific Conference on Quality Software. IEEE Computer Society, 111--120.
[40]
Adriaan Labuschagn, Laural Inozemtseva, and Reid Holmes. 2017. Measuring the cost of regression testing in practice. In Proceedings of the 11th Joint meeting of the European Software Engineering Conference and the ACM SIGSOFT symposium on the foundations of Software Engineering. Retrieved from
[41]
Jaiprakash T. Lalchandani and Rajib Mall. 2008. Regression testing based-on slicing of component-based software architectures. Proceedings of the 1st India Software Engineering Conference. ACM New York, NY, 67--76.
[42]
Bikin Li and Pengcheng Zhang. 2016. Test case selection for data flow based regression testing of BPEL composite services. Proceedings of the 2016 IEEE International Conference on Services Computing.
[43]
Feng Lin, Michael Ruth, and Shengru Tu. 2006. Applying safe regression test selection techniques to java web services. In Proceedings of the International Conference on Next Generation Web Services Practices. IEEE Computer Society Washington, DC, 133--142.
[44]
Wang Linzhang, Yuan Jiesong, Yu Xiaofeng, Li Xuandong, and Zheng Guoliang. 2004. Generating test cases from UML activity diagram based on gray-box method. Technical Report No. NJU-SEG-2004-IC-002. In Proceedings of the 11th Asia-Pacific Software Engineering Conference. IEEE Computer Society Washington, DC, 284--291.
[45]
Wang Linzhang, Yuan Jiesong, Yu Xiaofeng, Li Xuandong, and Zheng Guoliang. 2004. Generating test cases from UML activity diagram based on gray-box method. In Proceedings of the 11th Asia Pacific Software Engineering Conference. IEEE Computer Society, 284--291.
[46]
Giuseppe A. Di Lucca, and Anna R. Fasolino. 2006. Testing web-based applications: The state of the art and future trends. In Proc. Info. Softw. Technol. 48, 12, 1172--1186.
[47]
Pranali Prakash Mahadik and D. M. Thakore. 2016. Survey on automatic test data generation tools and techniques for object-oriented code. Int. J. Innovat. Res. Comput. Commun. Eng. 4, 357--364.
[48]
Lijun Mei, W. K. Chan, T. H. Tse, Bo Jiang, and Ke Zhai. 2013. Preemptive regression testing of workflow-based web services. IEEE Trans. Serv. Comput. 8, 5, 740--754.
[49]
Durga P. Mohapatrab and Rajib Mall. 2010. Test case generation based on use case and sequence diagram. Int. J. Softw. Eng. 3, 2, 21--52.
[50]
Mohamed Monier and Mahmoud Mohamed El-mahdy. 2015. Evaluation of automated web testing tools. Int. J. Comput. Appl. Technol. Res. 4, 5, 405--408.
[51]
Agasarpa Mounica and Lokanadham Naidu Vadlamudi. 2016. Automated model-based testing for an web applications. Int. J. Sci. Eng. Technol. Res. 5, 5, 1551--1555.
[52]
Pedro L. M. Navarro, Diego S. Ruiz, and Gregorio M. Perez1. 2010. A proposal for automatic testing of GUIs based on annotated use cases. Adv. Softw. Eng.—Special Issue on Software Test Automation. 2010, 5.
[53]
Jeff Offutt and Aynur Abdurazik. 1999. Generating test cases from UML specifications. Technical Report, ISE-TR-99-09, Information and Software Engineering, George Mason University.
[54]
Supriya S. Patil and Prof. Pramod A. Jadhav. 2017. Functional test case generation based on model driven testing using FSM and UML activity diagram. Int. J. Adv. Res. Comput. Sci. 8, 5, 1527--1530.
[55]
M. Prasanna and K. R. Chandran. 2009. Automatic test case generation for UML object diagrams using genetic algorithm. IJA Soft Comput. Appl. 1, 1.
[56]
D. Qiu, B. Li, S. Ji, and H. Leung. 2015. Regression testing of web service: A systematic mapping study. ACM Comput. Surveys 47, 2, 21.
[57]
Matthias Riebisch, Ilka Philippow, and Marlo Gotze. 2003. UML-based statistical test case generation. Obj. Comp. Arch. Serv. Appl. Netw. World 2591, 394--411.
[58]
Gregg Rothermel and Mary J. Harrold. 1996. Analyzing regression test selection techniques. IEEE Trans. Softw. Eng. 22, 8, 529--551.
[59]
Gregg Rothermel, Sebastian Elbaum, Alexey Malishevsky, Praveen Kallakuri, and Brian Davia. 2001. The impact of test suite granularity on the cost-effectiveness of regression testing. In Proceedings of the 24th International Conference on Software Engineering. ACM New York, NY, 130--140.
[60]
Michael Ruth and Shengru Tu. 2007. Towards automating regression test selection for web services. In Proceedings of the 16th International Conference on World Wide Web (WWW’07). 729--736.
[61]
Rajesh Ku. Sahoo, Santosh Kumar Nanda, Durga Prasad Mohapatra, and Manas Ranjan Patra. 2017. Model driven test case optimization of UML combinational diagrams using hybrid bee colony algorithm. Int. J. Intell. Syst. Appl. 9, 6, 43--54.
[62]
Ahmad A. Saifan, Iyad Alazzam, Mohammed Akour, and Feras Hanandeh. 2016. Regression test-selection technique using component model-based modification: Code to test traceability. (IJACSA) Int. J. Adv. Comput. Sci. Appl. 7, 4, 88--92.
[63]
Philip Samuel and Rajib Mall. 2008. A novel test case design technique using dynamic slicing of UML sequence diagrams. E-info. Softw. Eng. J. 2, 1, 71--92.
[64]
Leus F. Sanz and Sanjay Misra. 2012. Practical application of UML activity diagrams for the generation of test cases. In Proc. Roman. Acad. Ser. A: Math. Phys. Techn. Sci. 13, 3, 251--260.
[65]
P. G. Sapna and Arun K. Balakrishnan. 2015. An approach for generating minimal test cases for regression testing. Proced. Comput. Sci. 47, 188--196.
[66]
Vinaya Sawant and Ketan Shah. 2011. Automatic generation of test cases from UML models. In Proceedings on International Conference on Technology Systems and Management. Vol. 2, No. 7, 7--10.
[67]
A. Schwartz and H. Do. 2016. Cost-effective regression testing through adaptive test prioritization strategies. J. Syst. Softw. 115, 61--81.
[68]
Syed Asad Ali Shah, Raja Khaim Shahzad, Syed Shafique Ali Bukhari, Nasir Mehmood Minhas, and Mamoona Humayun. 2015. A review of class-based test case generation techniques. J. Softw. 11, 5, 464--480.
[69]
A. V. K. Shanthi and G. Mohankumar. 2012. A novel approach for automated test path generation using tabu search algorithm. Int. J. Comput. Appl. 48, 13, 28--34.
[70]
Monika Sharma and Rigzin Angmo. 2014. Web based automation testing and tools. Int. J. Comput. Sci. Info. Technol. 5, 1, 908--912.
[71]
Vikas Suhag and Rajesh Bhatia. 2014. Model based test cases generation for web applications. Int. J. Comput. Appl. 92, 3.
[72]
Ranjita Swain, Vikas Panti, Prafulla K. Behra, and Durga P. Mohpotra. 2012. Automatic test case generation from UML state chart diagram. Int. J. Comput. Appl. 42, 7.
[73]
Santosh K. Swaina, Durga P. Mohapatrab, and R. Mall. 2010. Test case generation based on state and activity models. J. Object Technol. 9, 5, 1--27.
[74]
Abbas Tarhini, Hacene Fouchal, and Nashat Mansour. 2006. Regression testing web services-based applications. In Proceedings of the IEEE International Conference on Computer Systems and Applications. IEEE Computer Society Washington, DC, 163--170.
[75]
Hetal J. Thanki and S. M. Shinde. 2014. Test case generation and minimization using UML activity diagram in model driven environment. Int. J. Comput. Org. Trends 9, 1, 41--44.
[76]
Filip I. Vokolos and Phyllis. G. Frankl. 1997. Pythia: A regression test selection tool based on textual differencing. In Proceedings of the 3rd International Conference on Reliability, Quality and Safety of Software-Intensive Systems. Chapman 8 Hall, Ltd. London, UK, 3--21.
[77]
Yiwen Wang and Mao Zheng. 2012. Test case generation from UML models. In Proceedings of the 45th Annual Midwest Instructions and Computing Symposium.
[78]
Shin Yoo and Mark Harman. 2012. Regression testing minimisation, selection and prioritisation: A survey. Softw. Test. Verificat. Reliabil. 22, 2, 67--120.
[79]
Anis Zarrad. 2015. A systematic review on regression testing for web-based applications. J. Softw. 10, 8.
[80]
Qian Zhongsheng. 2010. Test case generation and optimization for user session-based web application testing. J. Comput. 5, 11.
[81]
Bin Zhu, Huaikou Miao, and Lizhi Cai. 2009. Testing a web application involving web browser interaction. In Proceedings of the 10th ACIS International Conference on Software Engineering, Artificial Intelligences Networking and Parallel/Distributed Computing.

Cited By

View all
  • (2024)A Case Study: To Discuss the Construction of the Finite State Machine and Markov-Chain OP Models for Test Case Generation2024 5th International Conference on Advancements in Computational Sciences (ICACS)10.1109/ICACS60934.2024.10473284(1-9)Online publication date: 19-Feb-2024
  • (2024)ESSENT: an arithmetic optimization algorithm with enhanced scatter search strategy for automated test case generationInformation Sciences10.1016/j.ins.2023.119915656(119915)Online publication date: Jan-2024
  • (2023)A UML Activity Flow Graph-Based Regression Testing ApproachApplied Sciences10.3390/app1309537913:9(5379)Online publication date: 25-Apr-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Computing Surveys
ACM Computing Surveys  Volume 51, Issue 4
July 2019
765 pages
ISSN:0360-0300
EISSN:1557-7341
DOI:10.1145/3236632
  • Editor:
  • Sartaj Sahni
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 August 2018
Accepted: 01 June 2018
Revised: 01 January 2018
Received: 01 June 2017
Published in CSUR Volume 51, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Regression testing
  2. Test Case Generation
  3. Test case Prioritization
  4. Web Application

Qualifiers

  • Survey
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)99
  • Downloads (Last 6 weeks)6
Reflects downloads up to 15 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)A Case Study: To Discuss the Construction of the Finite State Machine and Markov-Chain OP Models for Test Case Generation2024 5th International Conference on Advancements in Computational Sciences (ICACS)10.1109/ICACS60934.2024.10473284(1-9)Online publication date: 19-Feb-2024
  • (2024)ESSENT: an arithmetic optimization algorithm with enhanced scatter search strategy for automated test case generationInformation Sciences10.1016/j.ins.2023.119915656(119915)Online publication date: Jan-2024
  • (2023)A UML Activity Flow Graph-Based Regression Testing ApproachApplied Sciences10.3390/app1309537913:9(5379)Online publication date: 25-Apr-2023
  • (2023)Software Test Case Generation Tools and Techniques: A ReviewInternational Journal of Mathematical, Engineering and Management Sciences10.33889/IJMEMS.2023.8.2.0188:2(293-315)Online publication date: 1-Apr-2023
  • (2023)Test case prioritization for changed code using nature inspired optimizerJournal of Intelligent & Fuzzy Systems10.3233/JIFS-22243344:4(5711-5718)Online publication date: 3-Apr-2023
  • (2023)Active Chat Monitoring and Detection Over Internet2023 7th International Conference on Intelligent Computing and Control Systems (ICICCS)10.1109/ICICCS56967.2023.10142690(949-954)Online publication date: 17-May-2023
  • (2023)Sentiment Analysis: Current State and Future Research Perspectives2023 7th International Conference on Intelligent Computing and Control Systems (ICICCS)10.1109/ICICCS56967.2023.10142318(1115-1119)Online publication date: 17-May-2023
  • (2023)Shift left testing paradigm process implementation for quality of software based on fuzzySoft Computing10.1007/s00500-023-08741-5Online publication date: 3-Jul-2023
  • (2022)Integrating an Ensemble Surrogate Model’s Estimation into Test Data GenerationIEEE Transactions on Software Engineering10.1109/TSE.2020.301940648:4(1336-1350)Online publication date: 1-Apr-2022
  • (2022)An Integrated Framework for Fault Resolution in Business Processes2022 IEEE International Conference on Web Services (ICWS)10.1109/ICWS55610.2022.00048(266-275)Online publication date: Jul-2022
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media