Article

Comparison of Process Quality Characteristics Based on Change Request Data

Authors:

Holger Schackmann,

Horst LichterAuthors Info & Claims

IWSM/Metrikon/Mensura '08: Proceedings of the International Conferences on Software Process and Product Measurement

Pages 127 - 140

https://doi.org/10.1007/978-3-540-89403-2_12

Published: 18 November 2008 Publication History

Abstract

The evaluation of metrics on data available in change request management (CRM) systems offers valuable information for the assessment of process quality characteristics. The definition of appropriate metrics that consider the underlying change request workflow and address the information needs of an organization is an intricate task.

Furthermore CRM systems usually provide only a number of predefined metrics with limited adaptability. The tool BugzillaMetrics offers a more flexible approach that simplifies defining and adjusting new metrics. However a systematic approach for deriving an appropriate metric in a target-oriented way is needed. This paper describes a corresponding procedure on how to develop and validate metrics on CRM data applicable for the comparison of process quality characteristics.

References

[1]

Cook, J.E., Votta, L.G., Wolf, A.L.: Cost-Effective Analysis of In-Place Software Processes. IEEE Trans. on Software Engineering 24(8) (1998)

[2]

Grammel, L., Schackmann, H., Lichter, H.: BugzillaMetrics - Design of an adaptable tool for evaluating user-defined metric specifications on change requests. In: Büren, Bundschuh, Dumke (eds.) Tagungsband des DASMA Software Metrik Kongresses MetriKon 2007. Shaker Verlag, Aachen (2007)

[3]

BugzillaMetrics, http://www.bugzillametrics.org

[4]

Gall, H.C., Lanza, M.: Software evolution: analysis and visualization. In: Proc.of the 28th international Conference on Software Engineering (ICSE 2006). ACM, New York (2006)

[5]

Canfora, G., Cerulo, L.: Impact Analysis by Mining Software and Change Request Repositories. In: Proc. of the 11th IEEE International Software Metrics Symposium-METRICS 2005, Como, Italy. IEEE CS Press, Los Alamitos (2005)

[6]

Kagdi, H.H., Collard, M.L., Maletic, J.I.: A survey and taxonomy of approaches for mining software repositories in the context of software evolution. Journal of Software Maintenance 19(2), 77-131 (2007)

[7]

Sliwerski, J., Zimmermann, T., Zeller, A.: When do changes induce fixes? In: 2nd International Workshop on Mining Software Repositories (MSR 2005). ACM Press, New York (2005)

[8]

Koponen, T.: RaSOSS - Remote Analysis System for Open Source Software. In: The International Conference on Software Engineering Advances (ICSEA 2006). IEEE Press, Los Alamitos (2006)

[9]

Gasser, L., Ripoche, G.: Distributed Collective Practices and F/OSS Problem Management: Perspective and Methods. In: Conference on Cooperation, Innovation & Technology (CITE 2003), Troyes, France (2003)

[10]

ISO/IEC 15939. Systems and software engineering - Measurement Process. International Organization for Standardization - ISO, Geneva (2007)

[11]

Simon, F., Seng, O., Mohaupt, T.: Code-Quality Management. Dpunkt-Verlag, Heidelberg (2006)

[12]

Ebert, C., Dumke, R.: Software Measurement: Establish - Extract - Evaluate - Execute. Springer, Berlin (2007)

[13]

Gamma, E.: Agile, Open Source, Distributed, and On-Time - Inside the Eclipse Development Process. Keynote Talk, ICSE, St. Louis, Missouri (2005)

[14]

Basili, V., Caldiera, G., Rombach, H.D.: The Goal Question Metric Paradigm. In: Encyclopedia of Software Engineering, John Wiley & Sons, Chichester (1994)

[15]

ViPER - Visual Tooling Platform for Model-Based Engineering, http://www.viper.sc

[16]

Eclipse Bugs - Remove LATER and REMIND resolutions, https://bugs.eclipse. org/178923

[17]

Chillarege, R., Bhandari, I.S., Chaar, J.K., Halliday, M.J., Moebus, D.S., Ray, B.K., Wong, M.: Orthogonal Defect Classification - A Concept for In-Process Measurements. IEEE Trans. Software Eng. 18(11), 943-956 (1992)

[18]

Makris, K., Ryu, K.D.: Scmbug: policy-based integration of software configuration management with bug-tracking. In: USENIX Annual Technical Conference. USENIX Association, Berkeley (2005)

Cited By

Cavalcanti Yda Mota Silveira Neto Pdo Carmo Machado Ide Almeida Ede Lemos Meira Sda Silva FJuristo NTravassos G(2013)Towards understanding software change request assignmentProceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering10.1145/2460999.2461028(195-206)Online publication date: 14-Apr-2013
https://dl.acm.org/doi/10.1145/2460999.2461028
Grammel LSchackmann HSchröter ATreude CStorey M(2010)Attracting the community's many eyesHuman Aspects of Software Engineering10.1145/1938595.1938601(1-6)Online publication date: 17-Oct-2010
https://dl.acm.org/doi/10.1145/1938595.1938601
Schackmann HLichter H(2009)Process assessment by evaluating configuration and change request management systemsProceedings of the Warm Up Workshop for ACM/IEEE ICSE 201010.1145/1527033.1527046(37-40)Online publication date: 1-Apr-2009
https://dl.acm.org/doi/10.1145/1527033.1527046

Recommendations

BugzillaMetrics: an adaptable tool for evaluating metric specifications on change requests
IWPSE '07: Ninth international workshop on Principles of software evolution: in conjunction with the 6th ESEC/FSE joint meeting

To manage the evolution of software processes and products, it is essential to evaluate their current state and how it evolved. This information can be obtained by analyzing the data available in change request management (CRM) systems like Bugzilla.

...
Evaluating Process Quality Based on Change Request Data --- An Empirical Study of the Eclipse Project
IWSM '09 /Mensura '09: Proceedings of the International Conferences on Software Process and Product Measurement

The information routinely collected in change request management systems contains valuable information for monitoring of the process quality. However this data is currently utilized in a very limited way. This paper presents an empirical study of the ...
BugzillaMetrics: an adaptable tool for evaluating metric specifications on change requests
IWPSE '07: Ninth international workshop on Principles of software evolution: in conjunction with the 6th ESEC/FSE joint meeting

To manage the evolution of software processes and products, it is essential to evaluate their current state and how it evolved. This information can be obtained by analyzing the data available in change request management (CRM) systems like Bugzilla.

...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

IWSM/Metrikon/Mensura '08: Proceedings of the International Conferences on Software Process and Product Measurement

November 2008

361 pages

ISBN:9783540894025

Editors:
Reiner R. Dumke
Institute for Distributed Systems, University of Magdeburg, Magdeburg, Germany 39106
,
René Braungarten
Fakultät für Informatik, Institut für Verteilte Systeme, AG Softwaretechnik, Otto-von-Guericke-Universität Magdeburg, Magdeburg, Germany 39106
,
Günter Büren
Büren & Partner Software-Design GbR, Nüürnberg, Germany
,
Alain Abran
Département de génie logiciel et des TI, École de technologie supérieure, Université du Québec, Montréal, Canada H3C 1K3
,
Juan J. Cuadrado-Gallego
University of Alcalá, Autovia A-2 km 33.6, 28871, Alcalá de Henares, Madrid, Spain

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 18 November 2008

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cavalcanti Yda Mota Silveira Neto Pdo Carmo Machado Ide Almeida Ede Lemos Meira Sda Silva FJuristo NTravassos G(2013)Towards understanding software change request assignmentProceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering10.1145/2460999.2461028(195-206)Online publication date: 14-Apr-2013
https://dl.acm.org/doi/10.1145/2460999.2461028
Grammel LSchackmann HSchröter ATreude CStorey M(2010)Attracting the community's many eyesHuman Aspects of Software Engineering10.1145/1938595.1938601(1-6)Online publication date: 17-Oct-2010
https://dl.acm.org/doi/10.1145/1938595.1938601
Schackmann HLichter H(2009)Process assessment by evaluating configuration and change request management systemsProceedings of the Warm Up Workshop for ACM/IEEE ICSE 201010.1145/1527033.1527046(37-40)Online publication date: 1-Apr-2009
https://dl.acm.org/doi/10.1145/1527033.1527046

View Options

View options

Figures

Tables

Media

View Table of Conten