research-article

Experimental Evaluation of the SMartyCheck Techinique for Inspecting Defects in UML Component Diagrams

Authors:

Giovanna C. S. Bettin,

Ricardo Theis Geraldi,

Edson OliveiraJrAuthors Info & Claims

SBQS '18: Proceedings of the XVII Brazilian Symposium on Software Quality

Pages 101 - 110

https://doi.org/10.1145/3275245.3275256

Published: 17 October 2018 Publication History

Abstract

Software Product Line (LPS) is a paradigm that reuses software artifacts throughout a set of systems that have common and variable characteristics. To guarantee the quality of an SPL and, consequently, of its generated products, it is necessary to use verification and validation activities, such as software inspections. Thus, it is possible to detect defects in different artifacts from the earliest stages in a software development cycle. To support this activity there is a number of techniques, such as SMartyCheck, defined as a checklist-based reading technique, which allows inspection of SMarty UML diagrams. It is important to note that the SMartyCheck technique was previously evaluated in two empirical studies (one qualitative and one quantitative) taking into consideration UML use case diagrams and class diagrams. Both studies pointed out significant results in favor of SMartyCheck. SMartyCheck evolved encompassing UML component diagrams. In this sense, this paper presents initial evidence of the evaluation of SMartyCheck applied for defect detection in UML component diagram based on a controlled experiment carried out in the academy. SMartyCheck was compared to Ad Hoc inspection technique and had superior results for effectiveness and efficiency. Accuracy provided no significant difference between both techniques.

References

[1]

V. Basili, G. Caldiera, and H. Rombach. 1994. Goal Question Metric Approach. Encyclopedia of Software Engineering (1994).

[2]

M. H. G. Bera, E. OliveiraJr, and T. E Colanzi. 2015. Evidence-based SMarty Support for Variability Identification and Representation in Component Models. In Int. Conf. on Enterprise Information Systems. ScitePress, Barcelona, Spain, 295--302.

Digital Library

[3]

Rafael Cunha, Tayana U. Conte, Eduardo S. de Almeida, and José C. Maldonado. 2012. A Set of Inspection Technique on Software Product Line Models. In Int. Conf. on Software Engineering and Knowledge Engineering. KSI Research Inc. and Knowledge Systems Institute Graduate School, 657--662.

[4]

Rafael Maiani de Mello, Eldânae Nogueira Teixeira, Marcelo Schots, Cláudia Maria Lima Werner, and Guilherme Horta Travassos. 2014. Verification of Software Product Line Artifacts: a Checklist to Support Feature Model Inspections. Journal of Universal Computer Science 20, 5 (2014), 720--745.

[5]

M. E. Fagan. 1999. Design and Code Inspections to Reduce Errors in Program Development. IBM Systems Journal 38, 2/3 (1999), 258.

Digital Library

[6]

D. Falessi, N. Juristo, C. Wohlin, B. Turhan, J. Münch, A. Jedlitschka, and M. Oivo. 2018. Empirical Software Engineering Experts on the Use of Students and Professionals in Experiments. Empirical Software Engineering 23, 1 (2018), 452--489.

Digital Library

[7]

R. T. Geraldi, T. U. Conte, I. F. Steinmacher, and E. OliveiraJr. 2015. Checklist-based Inspection of SMarty Variability Models - Proposal and Empirical Feasibility Study. In Int. Conf. on Enterprise Information Systems. ScitePress, 268--275.

Digital Library

[8]

R. T. Geraldi and E. OliveiraJr. 2017. Defect Types and Software Inspection Techniques: a Systematic Mapping Study. Journal of Computer Science 13, 10 (2017), 470--495.

[9]

R. T. Geraldi and Edson OliveiraJr. 2017. Towards Initial Evidence of SMartyCheck for Defect Detection on Product-Line Use Case and Class Diagrams. Journal of Software 12 (2017), 379--392.

[10]

SEI Software Engineering Institute. 2017. Software Product Lines. http://www.sei.cmu.edu/productlines/

[11]

Charles W. Krueger. 1992. Software Reuse. ACM Comput. Surv. 24, 2 (1992), 131--183.

Digital Library

[12]

E. OliveiraJr, I. M. S. Gimenes, and José C. Maldonado. 2010. Systematic Management of Variability in UML-based Software Product Lines. Journal of Universal Computer Science 16, 17 (2010), 2374--2393.

[13]

OMG. 2015. Object Constraint Language - Version 2.4. http://www.omg.org/spec/OCL/2.4

[14]

K. Pohl, G. Böckle, and F.J van Der Linden. 2005. Software Product Line Engineering: Foundations, Principles and Techniques. Springer.

Digital Library

[15]

A. A. Porter, L. G. Votta, and V. R. Basili. 1995. Comparing Detection Methods for Software Requirements Inspections: a Replicated Experiment. IEEE Transactions on Software Engineering 21, 6 (June 1995), 563--575.

Digital Library

[16]

C. Spearman. 1987. The Proof and Measurement of Association Between Two Things. The American Journal of Psychology 100, 3/4 (1987), 441--471.

[17]

D. Szyperski, C.and Gruntz and S. Murer. 2002. Component Software: Beyond Object-Oriented Programming.

Digital Library

[18]

M. F. P. Vieira. 2017. SMartyCheck 3.0: uma Extensão da Técnica para Detec-ção de Defeitos em Diagramas UML do SMartyComponents. Technical Report. Universidade Estadual de Maringá, Maringá.

[19]

D. M Weiss and C. Lai. 1999. Software Product-Line Engineering: a Family-based Software Development Process. Vol. 12. Addison-Wesley Reading.

Digital Library

[20]

C. Wohlin, P. Runeson, M. Höst, M. C Ohlsson, B. Regnell, and A. Wesslén. 2012. Experimentation in Software Engineering. Springer Science & Business Media.

Digital Library

[21]

T. J. Young. 2005. Using Aspect to Build a Software Product Line for Mobile Devices. Ph.D. Dissertation. University of British Columbia.

[22]

Y. Zhu. 2016. Software Reading Techniques: Twenty Techniques for More Effective Software Review and Inspection. Apress.

Digital Library

[23]

T. Ziadi, Loïc Hélouët, and Jean-Marc Jézéquel. 2003. Towards a UML Profile for Software Product Lines. In Int. Workshop on Software Product-Family Engineering. Springer, SpringerLink, 129--139.

Cited By

Bettin GHerculani JMelo AAndrade LOliveiraJr E(2023)Efficacy, Efficiency and Effectiveness of SMarty-based Software Product Line Inspection Techniques: a Controlled Quasi-ExperimentProceedings of the 17th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3571788.3571792(40-49)Online publication date: 25-Jan-2023
https://dl.acm.org/doi/10.1145/3571788.3571792
Bettin GGeraldi ROliveiraJr E(2022)Model-Based Inspections of Software Product LinesUML-Based Software Product Line Engineering with SMarty10.1007/978-3-031-18556-4_7(121-153)Online publication date: 28-Sep-2022
https://doi.org/10.1007/978-3-031-18556-4_7
OliveiraJr EGimenes IMaldonado J(2022)The SMarty Approach for UML-Based Software Product LinesUML-Based Software Product Line Engineering with SMarty10.1007/978-3-031-18556-4_4(57-71)Online publication date: 28-Sep-2022
https://doi.org/10.1007/978-3-031-18556-4_4
Show More Cited By

Index Terms

Experimental Evaluation of the SMartyCheck Techinique for Inspecting Defects in UML Component Diagrams
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis

Recommendations

Checklist-based Inspection of SMarty Variability Models
ICEIS 2015: Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2

Software inspection is a particular type of software review applied to all life-cycle artifacts and follows a

rigorous and well-defined defect detection process. Existing literature defines several inspection techniques

for different domains. However, ...
SMartyModeling: an Environment for Engineering UML-based Software Product Lines
VaMoS '21: Proceedings of the 15th International Working Conference on Variability Modelling of Software-Intensive Systems

Software Product Line (SPL) has been successfully consolidated as an approach for systematic reuse. The adoption of the SPL approach aims at increasing the reuse of requirements and artifacts, thus reusing documents, source code and artifacts and ...
SMartyPerspective: a perspective-based inspection technique for software product lines
SBES '21: Proceedings of the XXXV Brazilian Symposium on Software Engineering

Software Product Line (SPL) is an approach for reusing software artifacts for a specific domain. To improve products quality, verification and validation activities for SPL artifacts are necessary, thus defects are not propagated to derived products. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SBQS '18: Proceedings of the XVII Brazilian Symposium on Software Quality

October 2018

384 pages

ISBN:9781450365659

DOI:10.1145/3275245

General Chairs:
Andreia Malucelli
PUCPR
,
Sheila Reinehr
PUCPR

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SBC: Brazilian Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

SBQS

SBQS: 17th Brazilian Symposium on Software Quality

October 17 - 19, 2018

Curitiba, Brazil

Acceptance Rates

Overall Acceptance Rate 35 of 99 submissions, 35%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
102
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bettin GHerculani JMelo AAndrade LOliveiraJr E(2023)Efficacy, Efficiency and Effectiveness of SMarty-based Software Product Line Inspection Techniques: a Controlled Quasi-ExperimentProceedings of the 17th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3571788.3571792(40-49)Online publication date: 25-Jan-2023
https://dl.acm.org/doi/10.1145/3571788.3571792
Bettin GGeraldi ROliveiraJr E(2022)Model-Based Inspections of Software Product LinesUML-Based Software Product Line Engineering with SMarty10.1007/978-3-031-18556-4_7(121-153)Online publication date: 28-Sep-2022
https://doi.org/10.1007/978-3-031-18556-4_7
OliveiraJr EGimenes IMaldonado J(2022)The SMarty Approach for UML-Based Software Product LinesUML-Based Software Product Line Engineering with SMarty10.1007/978-3-031-18556-4_4(57-71)Online publication date: 28-Sep-2022
https://doi.org/10.1007/978-3-031-18556-4_4
Bettin GOliveiraJr E(2021)SMartyPerspective: a perspective-based inspection technique for software product linesBrazilian Symposium on Software Engineering10.1145/3474624.3474626(90-94)Online publication date: 5-Oct-2021
https://doi.org/10.1145/3474624.3474626

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents