Spanos Metrics
Spanos Metrics
Spanos Metrics
Nicholas Spanos
Principal, Solutions Consulting
Nick_spanos@compaid.com
Overview
The mission of an IT organization is to provide an information processing capability that benefits the
business. In order to fulfill this mission IT must provide the following services while managing costs and
prioritizing requests to optimize value:
Operate and support the infrastructure required to process, store, secure, and communicate
information.
Operate and support the business applications that process information
Provide technology consulting, training, and planning services
Employ, train, and deploy staff required to provide these services
Plan, develop/purchase, test, and implement new infrastructure or software to fix problems or
This document identifies data elements for measuring IT performance by related categories. Some of the
metrics represent averages while others are reported in the form of a graph. By reporting these metrics on a
regular basis (monthly is the minimum recommended reporting period), trends can be observed across the
reporting periods. In many cases the trends are more important than the actual value.
Averages can hide significant problems. Some of the data elements are designed to identify significant
problems that may go unnoticed by simply reporting averages. Example: If a critical application was down
for 24 hours, this is a significant event that should be reported even though the overall average availability
for all applications was within an acceptable range.
One hundred data elements is more than a typical CIO would review. The CIOs management team should be
tracking and managing to these metrics. The highlighted metrics should be reviewed by a CIO on a regular
basis.
The following general objectives have been identified for all TI organizations. The recommended metrics are
organized according to the supported objectives. Some of the metrics are described in general terms and
must be interpreted by each organization. The intent of the metrics is more important then the specific
terminology used to describe the metric.
Recommended Metrics
Goal: Ensure the availability of existing Processing Capabilities
The first priority of an IT organization is to ensure the business has access to the existing processing
capability. The CIO should have access to performance and cost information for the operation and
support of existing Infrastructure and Applications.
Infrastructure Operations and Support
Infrastructure Incidents
Evaluate the number of non-desktop problems that affect more than a single user and
resolution time. Includes hardware and system software. Requires a consistent
definition for severity.
1.
2.
3.
4.
5.
6.
Graph by Type
% Downtime
% Infrastructure downtime (by type) during peak and non-peak business hours?
Exclude scheduled downtime.
8.
Slow response time and high utilization percentages indicate insufficient capacity. Low
utilization indicates too much capacity.
Performance
9.
In most systems, the login function consumes significant resources. An increase in the
average login time indicates possible system capacity issues across the system.
Average response time has little value except as a trend. A gradual increase may
indicate under-capacity while a gradual decrease may indicate too much capacity.
System utilization is highest during peak hours and poor response time
Trend Graph showing total space available vs. utilized. Rapid increases in utilization
should be investigated.
Graph the disk space utilized by the application priority. Investigate low priority
applications with high disk utilization.
Identifies severe/complex incidents that should receive extra attention to make sure
they do not re-occur.
Increasing trend shows the average severity of problems is increasing. If lower severity
problems are being eliminated, this may be an acceptable trend.
Graph the % of downtime for peak and non-peak hours by application priority.
Graph average users by internal and external users. Apps with a low number of users
should be investigated and possibly retired.
Graph the turnover for the year by the type of position. Increased turnover is an
indication of management problems
The group is over-staffed if SLAs are being met by the smaller staff for an extended
duration.
Hours
by
Graph by type
Graph by type
Graph by type
46. % Late
51. Average
request
Scope
Changes
per
Problem Fixes
53. Total Infrastructure Changes
Enhancements
58. Total Enhancement Changes
Projects
60. Total Project Changes
Change Quality
62. Total Defects Introduced from
Changes
66. % Re-Work
Operations
69. Annual Budget
Planned Value
Identify the budget area that has the largest $ variance from the budgeted amount
Application Support
76. Annual Budget
79. % Variance
Graph the % costs to resolve problems vs. total support costs by application priority.
High priority applications should have low problem costs and high enhancement costs.
Projects
83. Planned Value
Estimated Cost
Delivering Value
The following metrics are based on customer surveys
Customer Satisfaction
90. Infrastructure
Availability/Reliability
93. Projects
Business Alignment
94. % of Hours by Business Priority
Continuous Improvement
97. Anticipating future benefits from
technical investments
Graph the hours applied to projects that anticipate new requirements. Sample benefits
of technical innovations include: Identification of new customers, implementing
technology that attracts customers, improving external customer satisfaction, managing
costs to fund innovation, etc.
Total cost of value added services (enhancements vs. cost of other types of support
10