research-article

A collaborative filtering recommender system for test case prioritization in web applications

Authors:

Hyunsook DoAuthors Info & Claims

SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

Pages 1560 - 1567

https://doi.org/10.1145/3167132.3167299

Published: 09 April 2018 Publication History

Abstract

The use of relevant metrics of software systems could improve various software engineering tasks, but identifying relationships among metrics is not simple and can be very time consuming. Recommender systems can help with this decision-making process; many applications have utilized these systems to improve the performance of their applications. To investigate the potential benefits of recommender systems in regression testing, we implemented an item-based collaborative filtering recommender system that uses user interaction data and application change history information to develop a test case prioritization technique. To evaluate our approach, we performed an empirical study using three web applications with multiple versions and compared four control techniques. Our results indicate that our recommender system can help improve the effectiveness of test prioritization.

References

[1]

hhttp://www.nopcommerce.com/. {Accessed: Jan. 26, 2017}.

[2]

http://www.coevery.com/. {Accessed: Jan. 26, 2017}.

[3]

J. Anderson, H. Do, and S. Salem. Customized regression testing using telemetry usage patterns. In Software Maintenance and Evolution (ICSME), 2016 IEEE International Conference on. IEEE, 2016.

[4]

J. Anvik, L. Hiew, and G. C. Murphy. Who should fix this bug?. In Proceedings of the 28th international conference on Software engineering, pages 361--370. IEEE-ACM, 2006.

Digital Library

[5]

Shawn A. Bohner. Extending software change impact analysis into cots components. In Proceedings of the 27th Annual NASA Goddard Software Engineering Workshop, page 175. IEEE-ACM, 2002.

Digital Library

[6]

P. A. Brooks and A. M. Memon. Automated gui testing guided by usage profiles. In. In Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering, pages 333--342. IEEE-ACM, 2007.

Digital Library

[7]

C. Catal and D. Mishra. Test case prioritization: A systematic mapping study. Software Quality Journal, 21:445--478, 2013.

Digital Library

[8]

A. Danylenko and W. Lowe. Context-aware recommender systems for nonfunctional requirements. In Proceedings of the Third International Workshop on Recommendation Systems for Software Engineering, pages 80--84. IEEE-ACM, 2012.

Digital Library

[9]

S. Elbaum, A. G. Malishevsky, and G. Rothermel. Test case prioritization: A family of empirical studies. IEEE Transactions on Software Engineering, 28(2):159--182, February 2002.

Digital Library

[10]

P. Frankl and E. Weyuker. Testing software to detect and reduce risk. In Journal of Systems and Software, 2000.

Digital Library

[11]

G. and A. Tuzhilin. Toward the next generation of recommender systems a survey of the state of the art and possible extensions. IEEE Transactions on knowledge and Data Engineering, 17(6):734--749, 2005.

Digital Library

[12]

M. Gethers, B. Dit, H. Kagdi, and D. Poshyvanyk. Integrated impact analysis for managing software changes. In Proceedings of the 34th International Conference on Software Engineering, pages 430--440. IEEE-ACM, 2012.

Digital Library

[13]

E. Giger, M. D'Amborce, M. Pinzger, and H. Gall. Method-level bug prediction. In ESEM, 2012.

Digital Library

[14]

C. Hettiarachchi, H. Do, and B. Choi. Effective regression testing using requirements and risks. In Eighth International Conference on Software Security and Reliability, pages 157--166. IEEE, 2014.

Digital Library

[15]

Y. Jiang, B. Cuki, T Menzies, and N Bartlow. Comparing design and code metrics for software quality prediction. In Proceedings of the 4th international workshop on Predictor models in software engineering, pages 11--18. ACM, 2008.

Digital Library

[16]

J. Kim and A. Porter. A history-based test prioritization technique for regression testing in resource constrained environments. In Proceedings of the International Conference on Software Engineering, May 2002.

Digital Library

[17]

T. Lee, J. Nam, D. Han, S. Kim, and H. Peter. Micro interaction metrics for defect prediction. In ESEC/FSE '11 Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering, pages 311--321. IEEE-ACM, 2011.

Digital Library

[18]

R. Moser, W. Pedrycz, and G. Succi. A comparative analysis of the efficiency of change metrics and static code attributes for defect prediction. In ICSE '08 Proceedings of the 30th international conference on Software engineering, pages 181--190. IEEE-ACM, 2008.

Digital Library

[19]

N. Murakami, H. Masuhara, and T. Aotani. Code recommendation based on a degree-of-interest model. In Proceedings of the 4th International Workshop on Recommendation Systems for Software Engineering, pages 28--29. IEEE-ACM, 2014.

Digital Library

[20]

N. Nagappan and T. Ball. Use of relative code churn measures to predict system defect density. In ICSE '05 Proceedings of the 27th international conference on Software engineering, pages 284--292. IEEE-ACM, 2005.

Digital Library

[21]

X. Qu, M.B. Cohen, and G. Rothermel. Configuration-aware regression testing: an empirical study of sampling and prioritization. In International Symposium on Software Testing and Analysis (ISSTA), pages 75--85. IEEE-ACM, 2008.

Digital Library

[22]

M. P. Robillard, W. Maalej, R. J. Walker, and T. Zimmermann. Recommendation Systems in Software Engineering. Springer, 2014.

[23]

G. Rothermel, R. Untch, C. Chu, and M. J. Harrold. Test case prioritization: An empirical study. In Proceedings of the IEEE International Conference on Software Maintenance, pages 179--188. IEEE-ACM, 1999.

Digital Library

[24]

G. Rothermel, R. Untch, C. Chu, and M. J. Harrold. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering, 27(10):929--948, October 2001.

Digital Library

[25]

S Sampath, R. C. Bryce, G. Viswanath, V. Kandimalla, and A. G. Koru. Prioritizing user-session-based test cases for web applications testing. In ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation, pages 141--150. IEEE-ACM, 2008.

Digital Library

[26]

B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th international conference on World Wide Web, pages 285--295. IEEE-ACM, 2001.

Digital Library

[27]

E. Shihab, A. E. Hassan, B. Adams, and Z. M. Jiang. An industrial study on the risk of software changes. In FSE '12 Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering, page 62. ACM, 2012.

Digital Library

[28]

S. Yoo and M. Harman. Regression testing minimization, selection and prioritization: a survey. Software Testing, Verification and Reliability, 22(2):67--120, 2012.

Cited By

Singh MChauhan NPopli R(2024)Test case reduction and SWOA optimization for distributed agile software development using regression testingMultimedia Tools and Applications10.1007/s11042-024-19148-1Online publication date: 23-Apr-2024
https://doi.org/10.1007/s11042-024-19148-1
Li SYang B(2023)Personalized Education Resource Recommendation Method Based on Deep Learning in Intelligent Educational Robot EnvironmentsInternational Journal of Information Technologies and Systems Approach10.4018/IJITSA.32113316:3(1-15)Online publication date: 7-Apr-2023
https://doi.org/10.4018/IJITSA.321133
Singh ASinghrova ABhatia RRattan D(2023)A Systematic Literature Review on Test Case Prioritization TechniquesAgile Software Development10.1002/9781119896838.ch7(101-159)Online publication date: 8-Feb-2023
https://doi.org/10.1002/9781119896838.ch7
Show More Cited By

A collaborative filtering recommender system for test case prioritization in web applications
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis

Recommendations

Combined Source Code Approach for Test Case Prioritization
ICISS '18: Proceedings of the 1st International Conference on Information Science and Systems

Regression testing is an activity in the software testing process to ensure the software is validated and verified after modification occurred on software. It is costly process procedure which has been expected to reach half cost of the software ...
An Improved Metric for Test Case Prioritization
WISA '11: Proceedings of the 2011 Eighth Web Information Systems and Applications Conference

Test case prioritization is an effective and practical technique of regression testing. To illustrate its effectiveness, many test metrics were proposed. In this paper, the physical meanings of these metrics were explained and their limitations were ...
Incorporating varying test costs and fault severities into test case prioritization
ICSE '01: Proceedings of the 23rd International Conference on Software Engineering

Test case prioritization techniques schedule test cases for regression testing in an order that increases their ability to meet some performance goal. One performance goal, rate of fault detection, measures how quickly faults are detected within the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

April 2018

2327 pages

ISBN:9781450351911

DOI:10.1145/3167132

Conference Chairs:
Hisham M. Haddad
Kennesaw State University
,
Roger L. Wainwright
University of Tulsa
,
Richard Chbeir
University of Pau & Pays Adour, France

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SAC 2018

Sponsor:

SIGAPP

SAC 2018: Symposium on Applied Computing

April 9 - 13, 2018

Pau, France

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
299
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)2

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Singh MChauhan NPopli R(2024)Test case reduction and SWOA optimization for distributed agile software development using regression testingMultimedia Tools and Applications10.1007/s11042-024-19148-1Online publication date: 23-Apr-2024
https://doi.org/10.1007/s11042-024-19148-1
Li SYang B(2023)Personalized Education Resource Recommendation Method Based on Deep Learning in Intelligent Educational Robot EnvironmentsInternational Journal of Information Technologies and Systems Approach10.4018/IJITSA.32113316:3(1-15)Online publication date: 7-Apr-2023
https://doi.org/10.4018/IJITSA.321133
Singh ASinghrova ABhatia RRattan D(2023)A Systematic Literature Review on Test Case Prioritization TechniquesAgile Software Development10.1002/9781119896838.ch7(101-159)Online publication date: 8-Feb-2023
https://doi.org/10.1002/9781119896838.ch7
Ali SHafeez YHumayun MJhanjhi NGhoniem R(2022)An Aspects Framework for Component-Based Requirements Prediction and Regression TestingSustainability10.3390/su14211456314:21(14563)Online publication date: 5-Nov-2022
https://doi.org/10.3390/su142114563
Chen LWu JYang HZhang K(2022)Does PageRank apply to service ranking in microservice regression testing?Software Quality Journal10.1007/s11219-021-09579-630:3(757-779)Online publication date: 24-Jan-2022
https://doi.org/10.1007/s11219-021-09579-6
Zawali ABoukhris I(2022)Academic Venue Recommendation Based on Refined Cross DomainIntelligent Systems Design and Applications10.1007/978-3-030-96308-8_110(1188-1197)Online publication date: 27-Mar-2022
https://doi.org/10.1007/978-3-030-96308-8_110
Chen LYu XWu JYang H(2021)CIPCMobile Information Systems10.1155/2021/29122402021Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1155/2021/2912240
Gokilavani NBharathi B(2021)Test case prioritization to examine software for fault detection using PCA extraction and K-means clustering with rankingSoft Computing10.1007/s00500-020-05517-zOnline publication date: 5-Jan-2021
https://doi.org/10.1007/s00500-020-05517-z
Mattis TRein PDürsch FHirschfeld R(2020)RTPTorrentProceedings of the 17th International Conference on Mining Software Repositories10.1145/3379597.3387458(385-396)Online publication date: 29-Jun-2020
https://dl.acm.org/doi/10.1145/3379597.3387458
Zawali ABoukhris I(2020)Cross Domain Collaborative Filtering Recommender System for Academic Venue Personalization based on References2020 IEEE Symposium Series on Computational Intelligence (SSCI)10.1109/SSCI47803.2020.9308377(2829-2835)Online publication date: 1-Dec-2020
https://doi.org/10.1109/SSCI47803.2020.9308377
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents