Product Metrics For Software
Product Metrics For Software
Product Metrics For Software
6/e
Chapter 15
Product Metrics for Software
copyright © 1996, 2001, 2005
R.S. Pressman & Associates, Inc.
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 1
McCall’s Triangle of Quality
Maintainability Portability
Flexibility Reusability
Testability Interoperability
PRODUCT REVISION PRODUCT TRANSITION
PRODUCT OPERATION
Correctness Usability Efficiency
Reliability Integrity
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 2
A Comment
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 3
Measures, Metrics and Indicators
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 4
Measurement Principles
The objectives of measurement should be established before data
collection begins;
Each technical metric should be defined in an unambiguous
manner;
Metrics should be derived based on a theory that is valid for the
domain of application (e.g., metrics for design should draw upon
basic design concepts and principles and attempt to provide an
indication of the presence of an attribute that is deemed
desirable);
Metrics should be tailored to best accommodate specific products
and processes [BAS84]
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 5
Measurement Process
Formulation. The derivation of software measures and metrics appropriate for the
representation of the software that is being considered.
Collection. The mechanism used to accumulate data required to derive the formulated
metrics.
Analysis. The computation of metrics and the application of mathematical tools.
Interpretation. The evaluation of metrics results in an effort to gain insight into the
quality of the representation.
Feedback. Recommendations derived from the interpretation of product metrics
transmitted to the software team.
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 6
Goal-Oriented Software Measurement
The Goal/Question/Metric Paradigm
(1) establish an explicit measurement goal that is specific to the process activity
or product characteristic that is to be assessed
(2) define a set of questions that must be answered in order to achieve the goal,
and
(3) identify well-formulated metrics
metrics that help to answer these questions.
Goal definition template
Analyze {the name of activity or attribute to be measured}
for the purpose of {the overall objective of the analysis}
with respect to {the aspect of the activity or attribute that is considered}
from the viewpoint of {the people who have an interest in the measurement}
in the context of {the environment in which the measurement takes place}.
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 7
Metrics Attributes
simple and computable. It should be relatively easy to learn how to derive the
metric, and its computation should not demand inordinate effort or time
empirically and intuitively persuasive. The metric should satisfy the engineer’s
intuitive notions about the product attribute under consideration
consistent and objective. The metric should always yield results that are
unambiguous.
consistent in its use of units and dimensions . The mathematical computation of the
metric should use measures that do not lead to bizarre combinations of unit.
programming language independent. Metrics should be based on the analysis
model, the design model, or the structure of the program itself.
an effective mechanism for quality feedback . That is, the metric should provide a
software engineer with information that can lead to a higher quality end product
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 8
Collection and Analysis Principles
Whenever possible, data collection and analysis should
be automated;
Valid statistical techniques should be applied to establish
relationship between internal product attributes and
external quality characteristics
Interpretative guidelines and recommendations should
be established for each metric
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 9
Analysis Metrics
Function-based metrics: use the function point as a
normalizing factor or as a measure of the “size” of the
specification
Specification metrics: used as an indication of quality by
measuring number of requirements by type
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 10
Function-Based Metrics
The function point metric (FP), first proposed by Albrecht [ALB79], can be used
effectively as a means for measuring the functionality delivered by a system.
Function points are derived using an empirical relationship based on countable
(direct) measures of software's information domain and assessments of software
complexity
Information domain values are defined in the following manner:
number of external inputs (EIs)
number of external outputs (EOs)
number of external inquiries (EQs)
number of internal logical files (ILFs)
Number of external interface files (EIFs)
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 11
Function Points
Information Weighting factor
Domain Value Count simple average complex
3 5 7 10 =
External Interface Files ( EIFs)
Count total
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 12
Architectural Design Metrics
Architectural design metrics
Structural complexity = g(fan-out)
Data complexity = f(input & output variables, fan-out)
System complexity = h(structural & data complexity)
HK metric: architectural complexity as a function of fan-
in and fan-out
Morphology metrics: a function of the number of
modules and the number of interfaces between modules
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 13
Metrics for OO Design-I
Whitmire [WHI97] describes nine distinct and measurable characteristics
of an OO design:
Size
Size is defined in terms of four views: population, volume, length, and functionality
Complexity
How classes of an OO design are interrelated to one another
Coupling
The physical connections between elements of the OO design
Sufficiency
“the degree to which an abstraction possesses the features required of it, or the degree
to which a design component possesses features in its abstraction, from the point of
view of the current application.”
Completeness
An indirect implication about the degree to which the abstraction or design
component can be reused
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 14
Metrics for OO Design-II
Cohesion
The degree to which all operations working together to achieve a
single, well-defined purpose
Primitiveness
Applied to both operations and classes, the degree to which an
operation is atomic
Similarity
The degree to which two or more classes are similar in terms of
their structure, function, behavior, or purpose
Volatility
Measures the likelihood that a change will occur
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 15
Distinguishing Characteristics
Berard [BER95] argues that the following characteristics require
that special OO metrics be developed:
Localization—the way in which information is concentrated in a program
Encapsulation—the packaging of data and processing
Information hiding—the way in which information about operational
details is hidden by a secure interface
Inheritance—the manner in which the responsibilities of one class are
propagated to another
Abstraction—the mechanism that allows a design to focus on essential
details
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 16
Class-Oriented Metrics
Proposed by Chidamber and Kemerer:
weighted methods per class
depth of the inheritance tree
number of children
coupling between object classes
response for a class
lack of cohesion in methods
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 17
Class-Oriented Metrics
Proposed by Lorenz and Kidd [LOR94]:
class size
number of operations overridden by a subclass
number of operations added by a subclass
specialization index
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 18
Class-Oriented Metrics
The MOOD Metrics Suite
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 19
Operation-Oriented Metrics
Proposed by Lorenz and Kidd [LOR94]:
average operation size
operation complexity
average number of parameters per operation
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 20
Component-Level Design Metrics
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 21
Interface Design Metrics
Layout appropriateness: a function of layout entities, the
geographic position and the “cost” of making transitions
among entities
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 22
Code Metrics
Halstead’s Software Science: a comprehensive collection
of metrics all predicated on the number (count and
occurrence) of operators and operands within a
component or program
It should be noted that Halstead’s “laws” have generated
substantial controversy, and many believe that the underlying
theory has flaws. However, experimental verification for
selected programming languages has been performed (e.g.
[FEL89]).
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 23
Metrics for Testing
Testing effort can also be estimated using metrics
derived from Halstead measures
Binder [BIN94] suggests a broad array of design metrics
that have a direct influence on the “testability” of an OO
system.
Lack of cohesion in methods (LCOM).
Percent public and protected (PAP).
Public access to data members (PAD).
Number of root classes (NOR).
Fan-in (FIN).
Number of children (NOC) and depth of the inheritance tree
(DIT).
These courseware materials are to be used in conjunction with Software Engineering: A Practitioner’s Approach, 6/e and are provided with
permission by R.S. Pressman & Associates, Inc., copyright © 1996, 2001, 2005 24