poster

Towards a mutation-based automatic framework for evaluating code clone detection tools

Authors:

Chanchal K. Roy and

James R. CordyAuthors Info & Claims

C3S2E '08: Proceedings of the 2008 C³S²E conference

May 2008

Pages 137 - 140

https://doi.org/10.1145/1370256.1370279

Published: 12 May 2008 Publication History

Abstract

In the last decade, a great many code clone detection tools have been proposed. Such a large number of tools calls for a quantitative comparison, and there have been several attempts to empirically evaluate and compare many of the state-of-the-art tools. However, a recent study shows that there are several factors that could influence the the validity of the results of such comparisons. In order to overcome the effects of such factors (at least in part), in this student poster paper we outline a mutation-based controlled frame-work for evaluating clone detection tools using edit-based mutation operators that model cloning actions. While the framework is not yet completely implemented and as yet we do not have experimental data, we anticipate that such a framework will provide a useful contribution to the community by providing a more solid objective foundation for tool evaluation.

References

[1]

J. H. Andrews, L. C. Briand and Y. Labiche. Is Mutation an Appropriate Tool for Testing Experiments? In ICSE, pp. 402--411, 2005.

Digital Library

[2]

B. S. Baker. Finding Clones with Dup: Analysis of an Experiment. IEEE TSE, Vol. 33(9):608--621, 2007.

Digital Library

[3]

B. Baker. On Finding Duplication and Near-Duplication in Large Software Systems. In WCRE, pp. 86--95, 1995.

Digital Library

[4]

S. Bellon, R. Koschke, G. Antoniol, J. Krinke and E. Merlo. Comparison and Evaluation of Clone Detection Tools. IEEE TSE, Vol. 33(9): 577--591. 2007.

Digital Library

[5]

M. Bruntink, A. Deursen, R. Engelen and T. Tourwe. On the Use of Clone Detection for Identifying Crosscutting Concern Code. IEEE TSE, 31(10): 804--818, 2005.

Digital Library

[6]

E. Burd and J. Bailey. Evaluating Clone Detection Tools for Use during Preventative Maintenance. In SCAM, pp. 36--43, 2002.

Digital Library

[7]

J. R. Cordy. The TXL source transformation language. Science of Computer Programming, 61(3):190--210, 2006.

Digital Library

[8]

J. Johnson. Visualizing Textual Redundancy in Legacy Source. In CASCON, pp. 171--183, 1994.

Digital Library

[9]

C. Kapser and M. Godfrey. "Cloning Considered Harmful" Considered Harmful. In WCRE, pp. 19--28, 2006.

Digital Library

[10]

M. Kim and G. Murphy. An Empirical Study of Code Clone Genealogies. In FSE, pp. 187--196, 2005.

Digital Library

[11]

R. Koschke, R. Falke and P. Frenzel. Clone Detection Using Abstract Syntax Suffix Trees. In WCRE, pp. 253--262, 2006.

Digital Library

[12]

Z. Li, S. Lu, S. Myagmar and Y. Zhou. CP-Miner: Finding Copy-Paste and Related Bugs in Large-Scale Software Code. IEEE TSE, 32(3):176--192, 2006.

Digital Library

[13]

C. K. Roy and J. R. Cordy. A Survey on Software Clone Detection Research. School of Computing TR 2007-541, Queen's University, 115 pp., 2007.

[14]

C. K. Roy and J. R. Cordy. Scenario-Based Comparison of Clone Detection Techniques. In ICPC, 10 pp., 2008 (to appear).

Digital Library

[15]

C. K. Roy and J. R. Cordy. NICAD: Accurate Detection of Near-Miss Intentional Clones Using Flexible Pretty-Printing and Code Normalization. In ICPC, 10 pp., 2008 (to appear).

Digital Library

[16]

F. V. Rysselberghe and S. Demeyer. Evaluating Clone Detection Techniques. In ELISA, 12pp., 2003.

Cited By

Khan FDavid IVarro DMcIntosh S(2023)Code Cloning in Smart Contracts on the Ethereum Platform: An Extended Replication StudyIEEE Transactions on Software Engineering10.1109/TSE.2022.320742849:4(2006-2019)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TSE.2022.3207428
Svajlenko JRoy C(2021)BigCloneBenchCode Clone Analysis10.1007/978-981-16-1927-4_7(93-105)Online publication date: 4-Aug-2021
https://doi.org/10.1007/978-981-16-1927-4_7
Svajlenko JRoy C(2019)The Mutation and Injection Framework: Evaluating Clone Detection Tools with Mutation AnalysisIEEE Transactions on Software Engineering10.1109/TSE.2019.2912962(1-1)Online publication date: 2019
https://doi.org/10.1109/TSE.2019.2912962
Show More Cited By

Index Terms

Towards a mutation-based automatic framework for evaluating code clone detection tools
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems
      1. Software management
        Software maintenance
2. Software and its engineering
  1. Software creation and management
    1. Software post-development issues
    2. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

A mutation analysis based benchmarking framework for clone detectors
IWSC '13: Proceedings of the 7th International Workshop on Software Clones

In recent years, an abundant number of clone detectors have been proposed in literature. However, most of the tool papers have lacked a solid performance evaluation of the subject tools. This is due both to the lack of an available and reliable ...
Read More
A Mutation/Injection-Based Automatic Framework for Evaluating Code Clone Detection Tools
ICSTW '09: Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation Workshops

In recent years many methods and tools for software clone detection have been proposed. While some work has been done on assessing and comparing performance of these tools, very little empirical evaluation has been done. In particular, accuracy measures ...
Read More
Evaluating Modern Clone Detection Tools
ICSME '14: Proceedings of the 2014 IEEE International Conference on Software Maintenance and Evolution

Many clone detection tools and techniques have been introduced in the literature, and these tools have been used to manage clones and study their effects on software maintenance and evolution. However, the performance of these modern tools is not well ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

C3S2E '08: Proceedings of the 2008 C³S²E conference

May 2008

240 pages

ISBN:9781605581019

DOI:10.1145/1370256

General Chair:
Bipin C. Desai
Concordia University

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

BytePress
Concordia University: Concordia University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 May 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

C3S2E '08

Sponsor:

Concordia University

C3S2E '08: Canadian Conference on Computer Science & Software Engineering

May 12 - 13, 2008

Quebec, Montreal, Canada

Acceptance Rates

Overall Acceptance Rate 12 of 42 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
241
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Khan FDavid IVarro DMcIntosh S(2023)Code Cloning in Smart Contracts on the Ethereum Platform: An Extended Replication StudyIEEE Transactions on Software Engineering10.1109/TSE.2022.320742849:4(2006-2019)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TSE.2022.3207428
Svajlenko JRoy C(2021)BigCloneBenchCode Clone Analysis10.1007/978-981-16-1927-4_7(93-105)Online publication date: 4-Aug-2021
https://doi.org/10.1007/978-981-16-1927-4_7
Svajlenko JRoy C(2019)The Mutation and Injection Framework: Evaluating Clone Detection Tools with Mutation AnalysisIEEE Transactions on Software Engineering10.1109/TSE.2019.2912962(1-1)Online publication date: 2019
https://doi.org/10.1109/TSE.2019.2912962
Roy CCordy J(2018)Benchmarks for software clone detection: A ten-year retrospective2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER)10.1109/SANER.2018.8330194(26-37)Online publication date: Mar-2018
https://doi.org/10.1109/SANER.2018.8330194
Svajlenko JRoy C(2015)Evaluating clone detection tools with BigCloneBenchProceedings of the 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME)10.1109/ICSM.2015.7332459(131-140)Online publication date: 29-Sep-2015
https://dl.acm.org/doi/10.1109/ICSM.2015.7332459
Svajlenko JRoy CDuszynski S(2013)ForkSim: Generating software forks for evaluating cross-project similarity analysis tools2013 IEEE 13th International Working Conference on Source Code Analysis and Manipulation (SCAM)10.1109/SCAM.2013.6648182(37-42)Online publication date: Sep-2013
https://doi.org/10.1109/SCAM.2013.6648182
Asaduzzaman MRoy CSchneider KPenta M(2013)LHDiffProceedings of the 2013 IEEE International Conference on Software Maintenance10.1109/ICSM.2013.34(230-239)Online publication date: 22-Sep-2013
https://dl.acm.org/doi/10.1109/ICSM.2013.34
Jia YHarman M(2011)An Analysis and Survey of the Development of Mutation TestingIEEE Transactions on Software Engineering10.1109/TSE.2010.6237:5(649-678)Online publication date: 1-Sep-2011
https://dl.acm.org/doi/10.1109/TSE.2010.62
Potthast MStein BBarrón-Cedeño ARosso PJoshi AHuang CJurafsky D(2010)An evaluation framework for plagiarism detectionProceedings of the 23rd International Conference on Computational Linguistics: Posters10.5555/1944566.1944681(997-1005)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1944566.1944681
Roy CCordy JKoschke R(2009)Comparison and evaluation of code clone detection techniques and toolsScience of Computer Programming10.1016/j.scico.2009.02.00774:7(470-495)Online publication date: 1-May-2009
https://dl.acm.org/doi/10.1016/j.scico.2009.02.007
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents