Abstract
Understanding and controlling software development processes have gained increasing importance. In this sense experimentation is an accepted approach toward scientific disciplines, including the software development community. It enables us to establish and validate measures that give comprehensive and accurate quantitative description of the characteristics of these systems.
However, individual experimental studies tend to yield different results and draw different conclusions on the same phenomena. One way to make sense of the vast number of accumulated study findings is to apply meta-analysis to the results of individual studies.
The intent of this paper is to review the principles of meta-analytic methods and techniques, their applications in different sciences and software engineering, and present results achieved in these fields. Particular attention is paid to object-oriented software measures and their numeric characterization.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Light R.J., D.B. Pillemar. Summing Up: The Science of reviewing research. Harvard University Press, Cambridge, Massachusetts, and London, England, 1984
Hunter J.E., F.L Schmidt. Methods of Meta-Analysis — Correcting Error and Bias in Research Findings. Newbury Park: Sage Publications, 1995
Hedges L.V., I. Olkin. Statistical methods for meta-analysis, Orlando: Academic Press, 1984
Brooks A. Meta Analysis — A Silver Bullet — for Meta-Analysis. Empirical Software Engineering 1997; 2: 333 – 338
Cook T.D., H. Cooper, D.S. Cordray, H. Hartmann, L.V. Hedges, R.J. Light, T.A. Louis, F. Mosteller. Meta-Analysis for explanation — A casebook, 1994
Liao Yuen-Kuang Cliff. Effects on hypermedia versus traditional instruction on students’ achievement: A meta-analysis. J Res Comput Educ 1998; 30: 341
Belanger Scott E. Literature Review and Analysis of Biological Complexity in Model Stream Ecosystems: Influence of Size and Experimental Design. Ecotox Environ Safe 1997; 36: 1 – 16
Sohn S.Y. Meta Analysis of Classification Algorithms for Pattern Recognition, IEEE T Pattern Anal 1999; 21: 1137 – 1144
Hayes W. Research Synthesis in Software Engineering: A Case for Meta-Analysis. Proceedings of the Sixth IEEE International Symposium on Software Metrics, 2000
Miller J. Can results from Software Engineering experiments be safely combined? Proceedings of the Sixth IEEE International Symposium on Software Metrics 2000
Pickard L.M., B.A. Kitchenham, P.W. Jones Combining empirical results in software engineering. Inform Software Tech 1998; 40: 811 – 821
Hu Q. Evaluating Alternative Software Production Functions. IEEE T Software Eng 1997; 23
Chidamber S.R, D.P. Darcy, C.F. Kemerer. Towards a Metrics suite for Object Oriented Design. OOPSLA 1991: 197–211
Chidamber S.R, C.F. Kemerer. A metrics suite for object-oriented design. IEEE T Software Eng 1994; 20: 476 – 493
Basili V.R., L.C. Briand, W.L. Melo. A Validation of Object-Oriented Design Metrics as Quality Indicators. IEEE T Software Eng 1996; 22: 751 – 761
El Emam K., S. Benlarbi, N. Goel. The Confounding Effect of Class Size on the Validity of Object-Oriented Metrics. Technical Report, NRC/ERB-1062, September 1999. NRC 43606
Briand L.C., J. Wüst. The impact of Design on Development Cost in Object-Oriented Systems. ISERN Technical Report 99–16
Li W., S. Henry. Object-Oriented Metrics that Predict Maintainability. J Syst Software 1993; 23: 111 – 122
Chidamber S.R, D.P. Darcy, C.F. Kemerer. Managerial Use of Metrics for Object-Oriented Software: An Exploratoiy Analysis. IEEE T Software Eng 1998; 24: 629 – 639
Belsley D.A. Conditioning diagnostics: Collinearity and Weak Data in Regression. J. Wiley, New York, 1991
Aron A., E.N. Aron. Statistics for the behavioral and social sciences. Prentice Hall, 1997
Succi G., L. Benedicenti, C. Bonamico, T. Vernazza. The Webmetrics Project — Exploiting Software Tools on Demand. World Multiconference on Systemics, Cybernetics, and Informatics 1998, Orlando, FL
Cohen J. Statistical power analysis for the behavioral sciences, New York: Academic Press, 1977
Greene W.H. Econometric analysis, New York: Macmillan; London: Collier Macmillan, 2000
Schmidt P. Estimation of Seemingly Unrelated Regressions with Unequal Numbers of Observations. J Econometrics 1977, 5:365–377
Im E. Unequal Numbers of Observations and Partial Efficiency Gain. Econ Lett 1994, 46:291–294
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag London Limited
About this paper
Cite this paper
Djokic, S., Succi, G., Pedrycz, W., Mintchev, M. (2001). Meta Analysis — a Method of Combining Empirical Results and its Application in Object-Oriented Software Systems. In: Wang, X., Johnston, R., Patel, S. (eds) OOIS 2001. Springer, London. https://doi.org/10.1007/978-1-4471-0719-4_12
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0719-4_12
Publisher Name: Springer, London
Print ISBN: 978-1-85233-546-5
Online ISBN: 978-1-4471-0719-4
eBook Packages: Springer Book Archive