Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3422392.3422461acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbesConference Proceedingsconference-collections
research-article

Toward a Metamodel Quality Evaluation Framework: Requirements, Model, Measures, and Process

Published: 21 December 2020 Publication History
  • Get Citation Alerts
  • Abstract

    The quality of metamodel considerably affects the models and transformations that conform to it. Despite that, there is still little discussion about a comprehensive form to evaluate the quality of metamodels and its consequences in model-driven development processes. This paper proposes a metamodel quality evaluation framework called MQuaRE (Metamodel Quality Requirements and Evaluation). MQuaRE comprises metamodel quality requirements and measures, a quality model, and an evaluation process, with the evident influence of international standards for software product quality, such as ISO/IEC 25000 series. We present a simple use case of MQuaRE describing how requirements, measures, and the quality model should be used during the evaluation process of a metamodel for software patterns. Among other benefits, MQuaRE can help determine final metamodel quality, decide on the acceptance of a metamodel, and also assess the positive and negative aspects of a metamodel, contributing to its quality evolution.

    References

    [1]
    Markus Herrmannsdorfer and Guido Wachsmuth. 2014. Evolving Software Systems. Springer, Berlin, Heidelberg, Chapter Coupled Evolution of Software Metamodels and Models, 33--63.
    [2]
    ISO/IEC. 2001. ISO/IEC 9126-1:2001 Software engineering --- Product quality --- Part 1: Quality model. ISO/IEC 9126-1:2001 1 (2001), 1--25.
    [3]
    ISO/IEC. 2003. ISO/IEC TR 9126-3:2003 Software engineering --- Product quality --- Part 3: Internal metrics. ISO/IEC 9126-3:2003 2 (2003), 1--62.
    [4]
    ISO/IEC. 2014. ISO/IEC 25000:2014 Systems and software engineering --- Systems and software Quality Requirements and Evaluation (SQuaRE) --- Guide to SQuaRE. ISO/IEC 25000:2014 2 (2014), 1--27.
    [5]
    ISO/IEC. 2016. ISO/IEC 25023:2016 Systems and software engineering---Systems and software Quality Requirements and Evaluation (SQuaRE) --- Measurement of system and software product quality. ISO/IEC 25023:2016 1 (2016), 1--45.
    [6]
    Taciana Novo Kudo, Renato F. Bulcão Neto, and Auri M. R. Vincenzi. 2019. A Conceptual Metamodel to Bridging Requirement Patterns to Test Patterns. In Proceedings of the XXXIII Brazilian Symposium on Software Engineering. ACM, New York, NY, USA, 155--160. https://doi.org/10.1145/3350768.3351300
    [7]
    Taciana Novo Kudo, Renato F. Bulcão-Neto, and Auri M. R. Vincenzi. 2020. Metamodel Quality Requirements and Evaluation (MQuaRE). arXiv:2008.09459
    [8]
    Haohai Ma, Weizhong Shao, Lu Zhang, Zhiyi Ma, and Yanbing Jiang. 2004. Applying OO Metrics to Assess UML Meta-models. In UML 2004 --- The Unified Modeling Language. Modeling Languages and Applications, Thomas Baar, Alfred Strohmeier, Ana Moreira, and Stephen J. Mellor (Eds.). Springer, Berlin, Heidelberg, 12--26.
    [9]
    Zhiyi Ma, Xiao He, and Chao Liu. 2013. Assessing the quality of metamodels. Frontiers of Computer Science 7, 4, Article 558 (2013), 12 pages.
    [10]
    OMG. 2002. Meta Object Facility (MOF) Specification, Version 1.4. Object Management Group, Inc. (2002).
    [11]
    Juri Rocco, Davide Di Ruscio, Ludovico Iovino, and Alfonso Pierantonio. 2014. Mining metrics for understanding metamodel characteristics. In Proceedings of the 6th International Workshop on Modeling in Software Engineering (MiSE 2014). ACM, New York, NY, USA, 55--60.
    [12]
    Vjeran Strahonja. 2007. The Evaluation Criteria of Workflow Metamodels. In 29th International Conference on Information Technology Interfaces. IEEE, New York, NY, USA, 553--558.
    [13]
    Éric Vépa, Jean Bézivin, Hugo Bruneliere, and Frédéric Jouault. 2006. Measuring model repositories. In Model Size Metrics Workshop - a MODELS 2006 Satellite Event. Springer, Genoa, Italy, 1--5.
    [14]
    James Williams, Athanasios Zolotas, Nicholas Matragkas, Louis Rose, Dimitios Kolovos, Richard Paige, and Fiona Polack. 2013. What do metamodels really look like?. In Proceedings of the 3rd International Workshop on Experiences and Empirical Studies in Software Modeling. CEUR-WS, Miami, USA, 55--60.

    Cited By

    View all
    • (2024)An Ecore Metamodel for the W3C PROV Provenance Data ModelProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658274(1-10)Online publication date: 20-May-2024
    • (2022)Aligning requirements and testing through metamodeling and patterns: design and evaluationRequirements Engineering10.1007/s00766-022-00377-528:1(97-115)Online publication date: 1-Jun-2022

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    SBES '20: Proceedings of the XXXIV Brazilian Symposium on Software Engineering
    October 2020
    901 pages
    ISBN:9781450387538
    DOI:10.1145/3422392
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • SBC: Brazilian Computer Society

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 December 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Model-driven software engineering
    2. evaluation
    3. measure
    4. metamodeling
    5. model
    6. process
    7. quality
    8. requirement

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    SBES '20

    Acceptance Rates

    Overall Acceptance Rate 147 of 427 submissions, 34%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)21
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 12 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)An Ecore Metamodel for the W3C PROV Provenance Data ModelProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658274(1-10)Online publication date: 20-May-2024
    • (2022)Aligning requirements and testing through metamodeling and patterns: design and evaluationRequirements Engineering10.1007/s00766-022-00377-528:1(97-115)Online publication date: 1-Jun-2022

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media