Develo 1
Develo 1
Develo 1
April, 2020
1
Chapter I: Basic Concepts
2
1.1. The Project Concept
Definition: What is a Project?
Different organizations and authors provide different
definitions for the concept project.
4
Generally, a project is:-
An investment activity which lends itself to planning,
financing and implementation as a unit;
Expressed in terms of definite location, time and target
group or beneficiaries;
Expected to generate specific output(benefit) after its
completion;
Managed by a separate administrative structure or
operated through the existing structure
5
Basic characteristics of a project
1. A project involves the investment of scarce resources in the
expectation of future benefits.
Projects have specific lifetime, with a specific start and end time.
with accuracy.
production activities
The more diverse the types of resources are mobilized, the more
10
The need for project planning, preparation and study emanates
from:
A. The quest for change: dissatisfaction with the present
and/or pressure or incentive for improvement in the future
12
G. Decision-making is not simple and perfect as it is assumed in
orthodox economics.
These features of investment decisions constitute:
13
Types of Projects
14
1.3. The Project Cycle
• Project cycle is the different stages, phases, levels, steps,
events or sequences that a project follows.
15
PROJECT CYCLE (W.C BAUM)
Identification
Implementation Appraisal
UNIDO P.C. Model
Identification
Post-evaluation Pre-feasibility
Implementation Feasibility
Appraisal
Alternatively, we can categorize project cycle in to three
1. Pre-investment phase
A. Identification/opportunity study/
C. Feasibility study
D. Support study;
E. Appraisal study
18
2. Investment phase
B. Engineering design;
C. Construction;
D. Procurement
19
3. Operation phase
C. Replacement/rehabilitation
D. Expansion/innovation
20
1. Identification (Opportunity studies)
21
At the macro level, project ideas emerge from:
22
4. Constraints on the development process due to shortage
of essential infrastructure facilities, problems in the balance
of payments, etc.;
23
6. A possible external threat that necessitates projects aiming at
achieving, for example, self sufficiency in basic materials,
energy, transportation, etc;
24
In addition individual/entrepreneurial/ inspiration, institutions,
25
4. The initiative of private or public enterprises in response to
incentives provided by the government.
26
2. Preparation and Analysis
Once project ideas have been identified and selected, the process
of project preparation and analysis starts.
28
B. The input – output relationship
This aspect may include the works of engineers, soil
scientists and agronomists in case of, say, agricultural
projects.
The technical analysis is concerned with the project’s
inputs (supplies) and outputs of real goods and services and
the technology of production and processing.
This is crucial because the rest of the project analysis cannot
be conducted without information from the technical study.
29
In general the technical analysis is primarily concerned with
30
B. Institutional-Organizational-Managerial Aspects
Does the project takes into account the cultural setup and
31
To have a chance of being carried out, a project must be
related properly to the institutional structure of the country
or region where the project is to be carried out.
Examples include: the land tenure system, use of local
institutions such as Idir etc.
Similarly, managerial issues are critical for successful
completion of projects.
Thus, the project analyst must examine the ability of
available staff to carry out the managerial needs of the
project.
32
Organization and Manning
33
Plant organization and management
Organization is the means by which the operational
functions and activities of the enterprise are structured and
assigned to organizational units.
This represents managerial staff, supervisors and workforce,
with the objective of coordinating and controlling the
performance of the enterprises and the achievement of its
business targets.
The organizational structure of an enterprise indicates the
assignment of responsibilities and delegation of authorities to
the various functional units of the company.
The organizational functions are the building blocks of the
company.
34
They may be grouped into the following organizational units
in line with the specific requirements of the individual
company:
General Management
Finance, financial control and accounting
Personnel administration
Marketing, sales and distribution
Supplies, transport, storage
Production:
Main plant
Service plants
Quality assurance
Maintenance and repair
35
The organizational structure of the company can also take a
Top management
Supervisory management
36
C. Social Aspects
This aspect is more important to public projects.
On the output side, careful analysis of the proposed market for the
What share of the total market will the proposed project supply?
Does the proposed project produce the grade or quality that the
market demands?
What financing arrangements will be necessary to market the
output?
What special provisions need to be made in the project to finance
marketing?
40
On the input side-appropriate arrangements must be made so as to
What about financing for the suppliers of inputs and credit for the
43
There are three important distinctions between the two types of
analyses
1. Treatments of taxes and subsidies: these items are treated as
transfers in the economic analysis while in financial analysis taxes
are usually treated as cost and subsides as a return/income.
2. Use of Prices: in the financial analysis we will use actual market
prices.
In economic analysis the market prices are adjusted to accurately
reflect social and/or economic values.
The latter prices are termed as ‘shadow prices’ or ‘economic
accounting prices’.
44
3. Treatment of interest on capital: in economic analysis
interest on capital is never separated and deducted from the
gross return.
45
G. Environmental/Ecological/ analysis
Ecological analysis should be done particularly for major projects,
which have significant ecological implications like:
power plants
irrigation schemes
etc.
The appraisal process builds on the project plan, but it may involve
48
4. Implementation
First, the better and more realistic a project plan is, the more
likely it is that the plan can be carried out and the expected
benefit realized.
49
Second, project implementation must be flexible.
50
Even as project implementation is under way, project managers
up its production.
Usually the project life is keyed to the normal life of the major
asset.
25-30 years.
53
The extent to which the objectives of a project are being
realized provides the primary criterion for an evaluation.
54
Were the financial aspects carefully worked out on the basis
future.
55
Review Questions
Answer the following questions.
1. What is project?
2. What is the importance of project plan?
3. Explain the reasons that makes project risky.
56
CHAPTER -TWO
FINANCIAL ANALYSIS AND
APPRAISAL OF PROJECTS
57
2.1. Scope and Rationale for Financial Analysis of
Projects
2.1.1.What is financial analysis?
It is concerned with assessing the feasibility of a new project
from the point of view of its financial results.
Financial analysis helps to determine the financial
profitability of a project.
It will be worthwhile to carry out a financial analysis if the
output of the project can be sold in the market or can be valued
using market prices.
The project’s direct benefits and costs are, therefore, calculated
in financial terms at the prevailing (expected) market prices.
58
This analysis is applied to appraise the soundness and acceptability
of a single project as well as to rank projects on the basis of their
profitability.
In other words, financial analysis is all about the assessment,
analysis and evaluation of the required project inputs, the outputs
to be produced and the future net benefits, with the aim of
determining the viability of a project to the private investor or the
executing public body.
The financial analysis deals with two issues:
1. Investment profitability analysis, with different methods of
analysis;
a. Simple methods of analysis of rate of return/static methods/ non-
discounted techniques/.
This include:
Simple rate of return;
Pay-back period;
59
b. Discounted-cash-flow methods/dynamic methods
a. Liquidity analysis;
60
The investment profitability analysis is an assessment of the
61
2.1.2 Why one undertakes Financial Analysis? or When to
undertake financial analysis?
Financial analysis applies to private and public investments.
62
Even non-commercially oriented government organizations
may sometimes wish to choose between alternative facilities
on the basis of essentially financial objectives.
In the case of a hospital service, the management of the
hospital maybe required to provide the cheapest services.
Under such circumstances a cost minimization or cost
effectiveness exercise will be undertaken.
Financial profitability analysis is the first step in the
economic appraisal of a project.
A comprehensive financial analysis provides the basic data
needed for the economic evaluation of the project and is the
starting point for such evaluation.
63
In fact, economic analysis mainly involves adjustments of the
information used in financial analysis and of a few additional
ones.
The procedure and methodology in financial analysis is
basically the same with that of economic analysis.
Yet one has to recognize and realize the differences between
the two.
It has to be noted that the financial analyst should be able to
communicate and know what to ask from the different team
members to collect relevant information on:
1. Revenue, both forecasted sales and selling price
2. Initial investment costs distributed over the implementation of
the project;
3. Operating costs of the envisaged operational unit/firm/ over
64 its operating life.
The issues and concerns of financial analysis are:
the period of time over which he/she decides to control and manage
his/her project-related business activities, or for which he/she
formulates his/her investment or business development plan.
The planning horizon must consider the life time of a project.
the life cycle of the product and of the industry involved, and
68
Objectives and the Identification of Costs and Benefits
69
But this is only one of his/her objectives.
70
For a private business firm or government corporations, a
major objective is to maximize net income.
71
Example:
income distribution,
Any of these may lead to the choice of a project that is not the
alternative that would contribute most to national income which is
narrowly defined.
No formal analytical technique could possibly take into account all
the various objectives of every participant in a project.
72 Some selection will have to be made.
Mostly, the maximization of income is taken as the dominant
objective of the firm.
Because, the single most important objective of an individual
economic agent is to increase income and increased
national income is the most important objective of national
economic policy.
Thus, anything that reduces national income is a cost and
anything that increases national income is a benefit.
73
Quantification:
Once costs and benefits are listed, the next step is accurate
prediction of the future benefits and costs which then
be quantified in monetary units/Birr/.
Thus, quantification involves the quantitative assessment
of both physical quantities and prices over the life span of
the project.
74
2.4.Classification of Cost
There are alternative ways of classifying costs and benefits of a
project.
One is to categorize both costs and benefits into:
Tangible and
Intangible once.
Another classification is in terms of:
1. Total investment costs;
2. Operational/running costs;
75
Another classification:
1. Total investment costs including:
a. Initial investment costs;
• Fixed investment costs;
• Pre-Production expenditures;
b. Investment required during plant operation / rehabilitation and
replacement investment costs/
c. Net working capital
2. Operating costs/costs of goods sold
76
Tangible costs of a project
In almost all project analysis, costs are easier to identify (and
value) than benefits.
The prices that the project actually pays for inputs are the
appropriate prices to use to estimate the project’s financial
costs.
Some of the project costs are tangible and quantifiable while
many more are intangible and non quantifiable.
The costs of a project depend on the exact project formulation,
location, resource availability, or objective of the project.
In general, the cost of a project would be the sum of the total
outlays.
These include:
77
Initial Fixed Investment costs
The initial fixed investments constitute the major resources
required for constructing and equipping an investment project.
These include the following tangible initial fixed investments.
1. The cost of land and site development
Land charges
Payment for lease
Cost of leveling and development
Cost of laying approach roads and internal roads
Cost of gates
etc.
78
2. The cost of buildings and civil works
Buildings for the main plant and equipments
79
3. Plant and machinery
Cost of imported machinery which might include the FOB
value, shipping freight and insurance costs, import duty,
clearing, loading, unloading, and transportation costs
Cost of local or indigenous machinery
Cost of stores and spares
Foundation and installation charges
80
Pre-production Expenditures
Another component of the initial investment cost which
includes both tangible and intangible costs is the pre-
production expenditures.
In every project, certain expenditures are incurred prior
to commercial production.
This includes the following investment cost items.
Insurance charges
Miscellaneous expenses
83
Plant and Equipment Replacement Costs
Every machinery and equipment does not have equal
economic life.
There are machineries and equipments that productively be
operated for many years.
On the other hand there are equipments, machinery
components and parts which need to be regularly replaced for
smooth operation of the same technology.
So, sound project planning work should adequately
provide for replacement of components and parts.
Thus, it is necessary to identify such items and then estimate
the costs for replacement and then the same should be reflected
in the financial and economic analysis.
84
Terminal Values/End-of-Life Costs/Salvage Costs/
Though firms may be institutionally organized to live and
operate for unlimited period of time and hence unlimited age,
technologies, machineries and equipment do have limited
operational/economic/ life.
During the end of the economic life of a good/machinery,
equipment, building, etc) there is some salvaged value and the
salvation may involve incurring of costs.
The costs associated with the decommissioning of fixed assets
at the end of the project life, minus any revenues from the sale
of the assets, are end-of-life costs.
Major costs are the costs of dismantling, disposal and land
reclamation.
85
Net Working Capital
Net working capital is part of the total investment outlays.
86
The gross working capital consists of all the current assets,
including:
a. raw materials;
b. stores and spares;
c. work-in-process;
d. finished goods inventory;
e. Debtors/accounts receivable/;
f. Cash and bank balance.
Net working capital is defined as gross working capital
less current liabilities.
For the purpose of financial analysis and even financial
management of operational firms, it is net working capital
which is the center of decision makers.
87
Costs of Goods Sold/Operating costs
Once the project idea has been accepted and the project is
being implemented, the cost of production may be worked out.
For instance, for an agricultural project the following may be
necessary:
Material cost- this comprises the cost of raw materials,
chemicals, components, fertilizer and pesticides for increasing
agricultural production, concrete for irrigation canal
construction, material for the construction of homes etc and
consumable stores required for production.
It is not the identification that is difficult in this case but the
problem of finding out how much is needed from each.
88
Utilities- consisting of power, water, and fuel are also
important cost components.
Labor: this is the cost of all manpower employed in the
enterprise.
Factory Overhead: the expense on repairs and maintenance,
rent, taxes, insurance on factory assets, etc. are collectively
referred to as factory overheads.
Land-is the cost incurred for the land to be used for the
project.
89
Contingency allowances- are usually included as a regular
part of the project cost.
Sound project planning takes into consideration in advance for
possible adverse changes in physical conditions or prices that
would add to the baseline cost.
Contingency allowances may be divided into physical
contingencies and price contingencies.
Price contingencies comprises two categories-relative changes
in price and general inflation.
Physical contingency allowances and price contingency
allowances for relative changes in price are expected and form
part of the cost base when measures of project worth are
calculated.
90
To avoid the problem of inflation on the other hand it is
advisable to work with constant prices instead of current
prices.
This approach assumes that all prices will be affected equally
by any rise in the general price level.
So contingency allowances for inflation will not be included
among the costs in project accounts other than the financing
plan.
Taxes: payment of taxes including tariffs and duties is treated
as a cost to the project implementer in financial analysis.
Debt service: the payment of interest and the repayment of
capital.
Both are treated as an outflow in financial analysis.
91
Sunk costs
Sunk costs are those incurred in the past and upon which the
proposed new investment will be based.
Such costs cannot be avoided.
92
Tangible Benefits
Tangible benefits can arise either from increased
production or from reduced costs.
In general the following benefits can be expected:
Increased production
Quality improvement
Changes in time of sale
Changes in location of sale
Changes in product form (grading and processing)
Cost reduction through technological advancement
Reduced transport costs
Looses avoided
Other kinds of tangible benefits
93
Secondary Costs and Benefits
Projects can lead to benefits created or costs incurred outside
the project itself.
Incorporating secondary costs or benefits in project analysis
can be viewed as an analytical device to account for the value
added that arises outside the project but is a result of the
project investment.
If a project has a substantial effect on the quantity other
producers are able to sell in imperfect markets-and most
markets are imperfect-there may be gains or losses not
accurately accounted for.
Benefits:
Reduction in cost of transport due to improved road/rail
technological spillover or technological externalities
Multiplier effect
94
Cost:
Example: Adverse ecological effects
pollution
95
Intangible Costs and Benefits
Almost every agricultural project has costs and benefits that
are intangible.
These may include creation of new job opportunities, better
health and reduced infant mortality as a result of more rural
clinics, better nutrition, reduced incidence of waterborne
disease as a result of improved rural water supplies etc
Such intangible benefits are real and reflect true values.
96
For example:
97
Again, although valuation is impossible, intangible costs
should be carefully identified and if possible quantified.
In general, every project decision will have to take intangible
factors into account through a subjective evaluation.
Because, intangible costs can be significant and because
intangible benefits can make an important contribution to
many of the objectives of a project or beyond.
98
The valuation of financial costs and benefits
This is an issue of pricing/valuing/ of the project’s inputs and
outputs.
The inputs and outputs of a project appear in physical form
and prices are used to express them in value terms in order to
obtain common denominator.
For the purpose of the feasibility study, prices should reflect
the real economic values of project inputs and outputs for the
entire planning horizon of the decision makers.
The financial benefits of a project are the revenues
received and the financial costs are the expenditures that
are actually incurred.
99
In financial analysis, all these receipts and expenditures are
valued as they appear in the financial balance sheet of the
project, and are therefore, measured in market prices.
Market prices are just the prices in the local economy, and
include all applicable taxes, tariffs, trade mark-ups and
commissions.
Since the project implementers will have to pay market prices
for the inputs and will receive market prices for the outputs
they produce, the financial costs and benefits of the project are
measured in these market prices.
The financial benefit from a project is measured in terms of the
market value of the project’s output, net of any sales taxes.
100
Prices may be defined in various ways, depending on whether
they are:
1. Market/explicit/ or shadow/imputed/ prices;
2. Absolute or relative prices;
3. Current or constant prices.
Market/Shadow prices:
Market or explicit prices are those present in the market, no
matter whether they are determined by supply and demand or
by the government.
They are the prices at which the firm will buy the inputs and
sell the outputs.
In financial analysis market prices are applied.
101
In economic analysis we raise the question whether market
prices reflect real economic value of project inputs and
outputs.
In economic analysis, if the market prices are distorted, then
shadow or imputed prices will have to be used for economic
analysis.
Absolute/relative prices:
Absolute prices- reflect the value of a single product in an
absolute amount of money
Relative prices- express the value of one product in terms of
another.
For instance, the absolute price of 1 tone of coal may be 100
monetary units and an equivalent quantity of oil may be 300
monetary units.
102
In this case the relative price of coal in terms of oil would be
0.33, meaning that the relative price of oil is three times the
price of coal.
The level of absolute prices may vary over the lifetime of the
project because of inflation or productivity changes.
Only when relative prices change and project input prices grow
faster (or slower) than output prices, or vice versa, then the
corresponding impacts on net cash flows and profits must be
included in the financial analysis.
If inflation impacts are negligible, the planner may use either current
or constant prices.
104
The Treatment of Transfer Payments in Financial Analysis
Some entries in financial accounts represent shifts in claims to
goods and services from one entity in the society to another
and do not reflect changes in national income.
These payments are called direct transfer payments.
105
A tax does not represent real resource flow; it represents
only the transfer of a claim to real resource flows.
107
If a firm is able to purchase an input at a subsidized price, it
will reduce its costs and thereby increase its net benefit.
But, the cost of the input in the use of the society’s real
resources remains the same.
Read!!
Why we need to use discounted measures
and how to discount costs and benefits in
project profitability analysis.
115
116
IRR= =0
117
118
NPV and Decision Rule for Independent Projects
Independent projects are projects that are not in any way
substitutes for each other.
In such cases the decision rule is to accept the project if the
NPV > 0.
If two projects have positive NPV and there is no budget
constraint both should be accepted and you do not need to
choose the one with higher NPV.
For example, if two independent projects road and fisheries
development projects in different locations are being
considered and both have a positive NPV, then both should
be undertaken.
Both will increase community’s welfare if they were
undertaken and hence both should be undertaken.
119
Decision Rule for Mutually Exclusive Projects
120
Decision rule for independent projects
121
The IRR and Mutually Exclusive Projects
If the residual cash flow’s internal rate of return exceeds the target
discount rate, which could only occur if the larger project has a
higher NPV, then the larger project should be undertaken.
124
2.6. Sensitivity Analysis
Another method popularly used for analysis of risk is what
is called sensitivity analysis.
This consists varying key parameters (individually or in a
combination) and assessing the impact of such changes or
manipulation on the project’s net present value.
125
Exercise
Given r=10%, find payback period, NPV, BCR and IRR of the
hypothetical project(use three decimal number).
Cash Flow Projection for Discounting
Descriptio
n/years
0 1 2 3 4 5 6 7 8 9 10
Total - 2,822,400 3,018,528 3,228,838 3,454,493 3,696,660 3,956,340 4,235,028 4,534,056 4,854,920 4,854,920
Revenue
Inflow - 2,822,400 3,018,528 3,228,838 3,454,493 3,696,660 3,956,340 4,235,028 4,534,056 4,854,920 4,854,920
operation
Total Cost 3,040,000 2,310,183 2,468,898 2,638,570 2,820,084 3,014,327 3,243,064 3,465,430 3,703,437 3,958,224 3,973,819
Increase 3,040,000 - - - - - - - - - -
in fixed
assets
Operating - 2,195,912 2,330,174 2,473,657 2,627,094 2,791,224 2,966,685 3,154,415 3,355,258 3,570,157 3,589,841
costs
Income(co - 114,271 138,724 164,913 192,989 223,102 276,379 311,015 348,179 388,067 383,978
rporate)ta
x
Net cash (3,040,000 512,217 549,630 590,267 634,409 682,333 713,276 769,598 830,619 896,696 881,101
flow(PRO )
FIT)
126
CHAPTER – THREE
ECONOMIC ANALYSIS OF PROJECTS
127
In financial analysis, the analyst is concerned with the
profitability of the project from an individual point of view
(firm’s profitability).
The main objective here is to maximize the income of the firm
or to analyze the budgetary impacts.
The financial analysis is done by applying market prices.
128
Thus, the project analyst must not only be sure that a proposed
project will be profitable enough to attract investment interest
but also that the project will contribute sufficiently to the
growth of national income.
129
3.1. The Rationale for Economic Analysis
The objective of any legitimate government is promotion of
community welfare.
Governments are more concerned with their public work
programs to promote community welfare than they merely
maximize financial profits at distorted local prices.
Prices could be distorted because of failures of markets, the
absence of perfect knowledge, and the existence of
externalities, consumer and producers surplus, government and
public goods, etc.
As a result, it is not possible to use market prices to assess the
economic worth of projects.
So, governments must choose projects on the basis of an
economic analysis if they wish to promote the community’s
130
welfare.
The major conditions under which it is impossible to use
market prices to assess the economic worth of projects can be
grouped under the following major headings:
1.Intervention in and failures of goods markets including the
markets for internationally traded goods.
2.Intervention in and failure of factor markets including the
market for labor, capital, and foreign exchange.
3.The existence of externalities, public goods and consumer and
producers surplus.
4.Imperfect knowledge, which the neoclassical model assumes
that consumers and producers have full knowledge about all
aspects of the economy relevant to their choice of operations.
This is unrealistic because of poor transport and
communication and low education levels.
131
Government Interventions and/or Failure of Goods Markets
A. Failure of domestic goods markets
The true economic value of a good produced by a project,
(marginal social benefit), is in general measured by what
people are willing to pay for that good.
Traditionally this is reflected by the market price of the
commodity.
But the market price of that commodity will not measure what
people are willing to pay for it unless the following three
conditions are met:
1.There is no rationing of scales or price controls in the market
for the good.
That is, QD must equal QS and the price of the good must be
its competitive demand price.
132
2.There is no consumer’s surplus from the consumption of the
good.
If people are willing to pay more than they actually have to pay
for a project output, then these market prices do not reflect the
true value of the good produced by the project.
3.There is no monopsony buyer who is large enough to force the
project to sell its output below the price that the monopsonist is
really willing to pay.
Unless these conditions are met, the good’s market price will
not reflect people’s true willingness to pay for the good and
will not be a good measure of the welfare or utility that people
will obtain from consuming the project’s output.
If any of these market imperfections exist, it will be necessary
to use corrective measures (shadow prices).
Alternatively, governments may enforce compulsory deliveries
of goods and services at artificially low controlled prices.
133
B. Trade protection and intervention in the markets for
internationally traded goods
Governments frequently intervene in import markets by
imposing quotas and tariffs to protect infant industries or
activities that are internationally competitive.
Tariffs and quotas will cause a divergence between local
market prices and the world prices of internationally traded
goods.
The extent of this divergence may vary from industry to
industry.
An import quota will push the domestic market cost of the
input well above the foreign exchange cost to the economy of
importing the input (world price).
Such import quota overvalue the social cost of the traded input
used by the project.
134
2. Failures of/or Intervention in Factor Markets
The true economic cost to an economy of a project’s input, its
marginal social cost, will be measured by its economic
opportunity cost to suppliers.
The market price of an input will equal to its opportunity cost
of production if the following conditions are met:
1.There are no rationing, price controls or taxes in factor
markets, such as fixed minimum wages, controlled interest
rates, price controls on raw materials or taxes on labor, savings
and profits, raw materials, equipment or other project inputs.
2.There is no producer’s surplus in the market price of the input
3.There are no monopsony buyers who are in a position to force
the factor’s market price below their marginal revenue product
and hence the price they would be willing to pay for it.
135
A. Intervention in the market for labor
Labor markets are frequently regulated with fixed minimum wage
rates or centrally fixed wages rates for formal sector jobs.
If these wage rates are set above the market clearing levels, there is
likely to open unemployment or disguised unemployment.
This is particularly true for unskilled labor.
In the case of skilled labor, fixed wage rates may actually be set
below market clearing levels causing an artificial shortage of skilled
labor.
In such situations, wage rate may not reflect the true social cost of
labor.
Thus, a project analyst should adjust wage rates until they reflect the
true social cost of labor in the country, the shadow wage rate.
136
B. Intervention in/or failure of capital market
In order to encourage investment, interest rates are often kept low.
The interest rate paid for investible funds may be held well below
the equilibrium interest rate.
As more people wish to borrow than to save at this low interest rate,
there will be an excess demand for capital funds.
This will lead to ration the available credit to preferred borrowers.
140
Some costs and benefits do not appear among its inputs and
outputs when it is analyzed from the enterprises or individual’s
viewpoint and thus do not enter into the financial NPV and
IRR.
These items are considered as external to the enterprise but are
internal when they are considered from the economy’s angle.
Somebody pays for the external costs and someone receives
these external benefits even if this is not the enterprise.
141
B. The existence of public goods
Public goods are goods and services whose use by one person
does not reduce their availability to others.
That is; they are neither rival nor excludable.
Example:
Defense forces
143
3.2. The Essential Elements of an Economic Analysis
The economic analysis of a project has many features in
common with financial analysis.
These include:
144
But an economic analysis goes beyond a financial analysis.
That is; the essential elements of economic analysis include:
A. The elimination (deduction) of transfer payments
within the economy from the project’s cash flow.
Examples:
Taxes-Personal and company income taxes, VAT, indirect
taxes, excise and stamp duties.
Subsidies ---- Including those given via price support
schemes.
Tariffs on imports and exports subsidies and taxes .
Producer surplus - gains received by a supplier
Credit transactions - loans received and repayment of
Interest and principal
145
B. The estimation of economic or shadow prices for project
outputs and produced inputs (including internationally
traded and non-traded goods) to correct for any distortions
in their market prices.
Since we use different prices, different economic and financial
NPV and IRR are obtained even if the inputs and outputs are
identical in physical terms.
C. The estimation of economic prices for non produced
project inputs (including labor, natural resources and land)
to correct for any distortions in their market prices.
D. The valuation and inclusion of any externalities created
by the project in economic analysis
E. The valuation and inclusion of any un-priced outputs or
146
inputs such as public goods or social services.
3.3. Determining economic values
Due to social, political, historical, and economic, etc reasons,
markets are distorted.
As a result, the market prices are also distorted and do not
reflect marginal productivities and marginal utilities.
Divergence between economic and market prices could be due
to market failure, government interventions, externalities,
public goods and distributional considerations.
Hence serious distortions exist in the market for labor, capital,
and foreign exchange and efforts are necessary to replace the
signals from these markets by more appropriate measures.
147
The key to understanding of economic analysis is the concept
of opportunity cost.
The opportunity cost is equal to the marginal value product
and the market price of the item in a relatively competitive
market.
Economic pricing involves making adjustments to market
prices to correct for distortions and to retake account of
consumer and producers surplus.
The adjusted price should then reflect the true opportunity cost
of an input or people’s willingness to pay for it.
So, we use Shadow Price which is also called the accounting
price.
The shadow price is what we call the economic price.
148
3.3.1. Adjustment for Transfer Payments
Transfer payments are defined as payments that are made
without receiving any good or service.
They involve the transfer of claims over real resources from
one person or entity in society to another, rather than payments
made for the use of or received from the sale of any good or
service.
So they do not reflect changes in the national economy.
150
B. Production Subsidies: are simply direct transfer payments
that flow in the opposite direction from taxes.
Subsidies do not increase or decrease national income.
It merely transfers control over resources from a taxpayer to
another individual.
But, subsidy increases the individual’s income, so it is revenue
for the receiver.
C. Credit Transactions: Loans received and payment of interest
and capital when these transactions occur between domestic
borrower and lenders are examples of such credit transactions.
The payment of interest and repayment of capital (debt
service) is treated as an outflow in financial analysis but
treated as transfer payments and are omitted from economic
accounts.
151
D. Charitable gift or welfare support services: are also
considered as transfer payments.
E. Producer surplus- gains received by an existing supplier of a
factor as a result of an increase in the price of that factor.
But in an economic analysis of a project, any change in
consumer surplus as a result of the project should be included
in the project’s economic cash flow, because these changes
represent real effects on peoples welfare.
152
3.3.2. Efficiency or Economic shadow Prices
In economic analysis of projects, inputs and outputs should be
valued at their contribution to the national economy, through
efficiency or shadow prices.
The application of shadow prices is based on the underlying
notion of opportunity cost.
From the national economic point of view, it is the alternative
production foregone or the cost of alternative supplies that
should be used to value project inputs and outputs.
An economic or shadow price reflects the increase in welfare
resulting from one more unit of an output or input being
available.
153
Definition of shadow (accounting) prices
Accounting or shadow prices are simply a set of prices that are
believed to better reflect the opportunity cost, i.e. the cost in
their best use, of goods and services.
It represents all none market prices.
It is the value used in economic analysis for a cost or a benefit
in a project when the market price is left to be a poor estimate
of economic value.
It implies a price that has been derived from a complex
mathematical model such as linear programming.
Efficiency shadow prices are border prices determined by
international trade.
The project inputs and outputs are thus valued on the basis of
international trade.
154
The basic assumption here is that international market is less
distorted than the domestic market and thus taking
international price is more realistic to value the true cost of
goods and services.
It is an estimate of efficiency prices.
156
The use of different numeraire to express opportunity costs
will not affect the relative value of project outputs and inputs.
Shadow price estimates can be made at two levels:
Economic analysis
Social analysis
157
3.3. Traded and Non Traded Goods
Goods and services produced by the project or that serves as project
inputs can be classified as:
Non-traded goods
Traded goods or
Non-Traded Goods
Non-traded goods are goods that do not enter into the international
trade because of their nature or physical characteristics.
So the non-traded inputs and outputs of a project cannot be valued
directly at border or world prices.
Some also consider goods which do not enter into trade because of
protection(trade barriers).
158
Example: Electricity is only rarely transmitted across frontiers.
Unskilled labor is also another example of non-traded
commodity
Inland transportation and cement.
cement is usually considered as non-traded goods.
When goods do not enter into trade by their very nature
decomposing is a pre-requisite to their valuation in terms of
world prices.
For some non-traded goods no reference border prices are
available. Example: Teff.
For other commodities the local supply price is below the CIF
price of potential imports but above the FOB price of potential
exports.
159
In both cases the non-traded inputs and outputs of the project
cannot be valued directly at border or world prices.
So the valuation of non traded goods at world prices consists
of a number of steps.
A. Net out taxes from the domestic market price of the
commodity.
B. The net of taxes price is decomposed into its traded and non-
traded cost elements.
For the traded components a border price is available by
definition and they are valued at this price.
The non -traded items are further decomposed into traded and
non traded and the procedure continues until in successive
rounds the original inputs or outputs is developed into traded
components and labor.
160
Example: consider the production of electricity from coal
161
After one or two rounds the non-traded components will be
valued at the domestic price and multiplied by a conversion
factor.
Traded components will be valued at border prices and labor at
the shadow wage rate.
If the output of a project is a non-traded good for which border
prices are however, known and if its domestic supply price is
below CIF but above the FOB, a convenient approximation is
to value it at the average of the two.
162
Traded Goods
Traded goods are defined as goods and services whose use or
production causes a change in the country’s net import or export
position.
Traded goods produced or used by a project do not actually need to
be imported or exported themselves, but must be capable of being
imported or exported.
Examples:
All kinds of manufacturing
Most agricultural goods
Intermediate goods
Raw materials
Some services such as tourism and consultancy services
163
Traded goods are either exportable or importable goods (or
services).
Exportable goods are those whose domestic cost of production
is below the FOB export price that local producers can earn
for the good on the international market.
Importable goods are goods whose landed CIF import cost is
less than the domestic cost of producing these goods.
164
3.3.4. Measurement of the economic value of
tradeables (Valuation of Tradeables)
The CIF price represents the direct foreign exchange cost of the
input up to the port or the border.
166
The international price paid for goods and services will be a
good measure of the increase in welfare created from
consuming the foreign exchange earned by producing a
particular tradeable goods or service.
Similarly an exportable good should be valued at a border
price or FOB export price.
The FOB price is the price that would be earned by the
exporter after paying any costs to get the good to the border,
but before any export subsidies or taxes were imposed.
167
The border price (FOB price) should be netted from handling,
transportation and marketing expenses to arrive at the project
site price or farm/factory gate price.
168
Import and Export substitutes
If the project output substitutes for imports, the relevant
accounting price is the CIF of the substituted import adjusted
for marketing expenses.
If a project uses as inputs a commodity that could otherwise
have been exported, we should value this input at the FOB
price adjusted for transportation cost, handling, marketing
margins, etc.
For traded goods shadow prices are based on prices on the
world market, with no reference to value in domestic use or
supply.
With suitable adjustments world prices provide a norm against
which to assess the costs of domestic production of traded
169
goods.
But finding an appropriate world price may be difficult since
export may go to different countries or imports may come from
many countries with differing imports or export prices.
Under such circumstances one approach is to take the lowest
import price and the highest export price (optimal approach).
Another approach may be to take an average.
170
3.3.5. Border Parity Pricing
World prices are normally measured as border prices
reflecting the value of a traded good at the border or port of
entry of a country.
Border price is the unit price of a traded good at a country’s
border (FOB for exports and CIF for imports).
However, values in project financial statements will normally
be at prices received by the project - ex - factory or farm gate
prices or paid by the project for inputs.
To move from market to shadow price analysis, shadow
prices must be in terms of prices to the project.
This means that for traded goods domestic margins, relating to
transport and distribution (including port handling) will have
to be added to prices at the border to obtain values at the
171
project level.
The decomposition of these margins is referred to as border
parity pricing.
172
Thus, for goods that are traded directly by a project, the
border parity price for the project output is the FOB price
minus the value of transport and distribution.
Similarly where a project imports an input, its border parity price
is the CIF price plus transport and distribution costs.
173
Importable Output
If the project’s output is an import substitute, it should be
valued at the CIF border price of the imported good for which
it is substituted.
This represents the savings in foreign exchange and the
economic value of the project to the country.
This CIF import price will not include any import tariffs or the
effect of quantitative restrictions such as quotas.
The economic cost of any marketing and transport services
necessary to get the imported good from the port to the local
market should be added to this CIF value.
In addition, the economic cost of any marketing and transport
cost incurred in getting the project’s locally produced output
should be subtracted from these economic benefits.
174
Exported Output
If a project produces goods for export, the economic benefit of
this good is world demand price, which is the FOB border
price that the project can earn for its export item.
The FOB border price is the free on board price of the export
at the port or airport.
This is the actual foreign exchange earned from exporting, the
export price minus any marketing margins and transport costs
to get the export item from the project to the border.
175
Imported Inputs
The full economic cost of an imported project input is the CIF
import price at the border, including the insurance and freight
costs to get the import to the project.
These foreign exchange costs and domestic costs represent the
true cost to the economy of using the imported input.
Any mark up on the cost of using the imported input due to
tariffs or quotas should not be included in the economic cost of
using these inputs.
176
Exportable Inputs
Exportable inputs that are inputs into the project are valued at
their FOB price at the border.
This is the foreign exchange that these goods could have
earned if they had not been used in the project.
This represents their opportunity cost, and hence their true
economic costs to the economy.
The economic cost of any marketing margin and transport
costs to get the input from its source to the border are
subtracted from this FOB price and the economic cost of any
transport and handling in getting the exportable to the project
should be added.
Thus if an input is exportable the FOB price must be adjusted
for the difference between transport and distribution costs in
177
moving the input to the project and to the port for export.
Potentially Traded Commodities
In some cases, the distortion in the trade regime is so great that
they can actually prevent the trade of goods that would
otherwise be tradeables.
Potentially traded goods includes all those goods and services
currently not traded by a country but would be traded if it
pursued optimum trade policies.
These are goods that would have been tradeables in the
absence of trade restrictions.
Many countries impose rigid import quotas, import embargos,
prohibitive import tariffs or export embargoes on at least some
imports and exports.
178
The group of potentially traded goods falls between the traded
and non-traded goods.
179
Potentially Traded Outputs
If a project output is potentially importable but not imported at
present because of high import tariffs and if the duties or
quotas are to be removed, the output should be treated as
traded.
If such removal cannot be foreseen, then it should be treated as
a non-traded commodity.
The same principle applies to project outputs that could be
exported if the trade barriers were removed.
180
Economic Export and Import Parity Price
Export Parity Price
CIF at point of import ( example Canada port)
Deduct-unloading at point of import
Deduct-freight to point of import
Deduct-insurance
Equals- FOB at point of export ( example A.A)
Convert foreign currency to domestic currency at official
exchange rate( L-M approach) or shadow exchange rate(
UNIDO approach)
Deduct-local port charges
Deduct- local transport and marketing( if not part of
project) at their market price and multiplied it by SCF in L-M
approach
Equals – Export Parity Price at project boundary
181
Contd---
Deduct-local storage, transport and marketing costs( if not
part of project cost) at their market price and multiplied it by
SCF in L-M approach
182
Import Parity Price
FOB price at point of export
Add-freight charges to point of import
Add-insurance charges
Add-unloading from ship to pier at port
CIF price at the harbor of importing countries
Convert foreign currency to domestic currency( multiplied by
OER) if we use L-M approach and SER if we use UNIDO
approach
Add-local port charges
Add-transport and marketing costs to relevant wholesale
market at market price and multiplied it by SCF in L-M
approach
183
Equals- price at wholesale market
Cont…
184
Conversion Factors
It has been already stated that all project inputs and outputs
should be valued at the world prices(border prices).
World prices are used to measure the opportunity cost to the
economy of goods and services which can be bought and sold
in the international market.
However, in practice, there are significant number of
commodities for which there will be no direct world price to
use as a measure of economic value.
Example: Teff
These commodities fall under the general heading of non-
traded goods.
Even when non-traded goods are decomposed there always
remain items that are non traded and for which there is only
domestic market.
185
Thus, some world price equivalent figure need to be derived
for these non-traded goods.
To estimate the accounting prices for all other non traded
goods (inputs and outputs) we use conversion factors.
A conversion factor is defined as the factor by which we
multiply the actual price in the domestic market of an input or
output to arrive at its accounting price.
The conversion factor is simply the ratio of the shadow price
of the item to its market price.
A conversion factor is estimated simply by taking the ratio of
border prices (world prices) to domestic market prices of the
good.
186
Since market distortions vary from commodity to commodity,
the conversion needed varies from case to case.
Therefore, it is possible to estimate commodity specific,
service specific, or sector specific like electricity,
transportation, construction etc., or for a basket of goods e.g.
consumption goods for a particular income group conversion
factors depending on the degree of aggregation desired.
Thus conversion factors can be calculated at different levels:
188
The question now is how many conversion factors do we need?
There is no definite answer to the question.
It all depends on the data availability, the variations of market
distortions, the time it takes to estimate conversion factors ,etc.
But at least we need one conversion factor to multiply all the
domestic market prices of all non-traded components of the
input and output of a project.
This parameter is called the standard conversion factor.
189
The Standard Conversion Factor
It is a summary measure to calculate accounting prices for non
traded commodities.
In the case of Ethiopia, the standard conversion factor is interpreted
as a summary and approximate quantification of the distorted
markets (domestic) as compared to the international market.
Therefore, it is the ratio of the value of imports and exports of a
country at border prices to their value at domestic prices.
The formula for computing the standard conversion factor is give
as:
191
National Parameters
There are some important parameters that have general applicability
in the sense that they are used in all projects.
These parameters should take the same value in all projects although
they can change from time to time.
That is; such parameters are national so that they apply to all
projects regardless of their sector, and they are economic because
they reflect the shadow price of the items concerned.
For instance, a typical list of national economic parameters may
cover conversion factors for:
Unskilled and skilled labor
Some of the main non-traded sectors
Some aggregate conversion factors such as consumption conversion
factor, a standard average conversion factor, the discount rate, etc.
192
A project analyst can apply these parameters directly to the
project under analysis.
They are called national parameters to distinguish them from
the project specific shadow prices.
They are estimated by the central planners and are taken as
given by the project analyst.
Some of the important national parameters include:
196
Basic Arguments for the Application of Social Cost benefit
Analysis
The basic arguments include:
Existence of externalities
Merit wants
197
3.5. Cost Effectiveness Analysis
Both cost - benefit analysis (CBA) and cost - effectiveness analysis
(CEA) are useful tools for program and project evaluation.
Cost - effectiveness analysis is a technique that relates the costs of a
program/project to its key outcomes or benefits.
Cost - benefit analysis takes that process one step further, attempting
to compare costs with the dollar value of all (or most) of a program ’
s many benefits.
These seemingly straightforward analyses can be applied anytime
before, after, or during a project/program implementation, and they
can greatly assist decision makers in assessing a projet ’ s efficiency.
However, the process of conducting a CBA or CEA is much more
complicated than it may sound from a summary description.
198
Cost - effectiveness analysis seeks to identify and place
dollars on the costs of a project.
It then relates these costs to specific measures of project
effectiveness.
Analysts can obtain a project ’ s cost - effectiveness (CE) ratio
by dividing costs by what we term units of effectiveness:
200
You could then compare this CE ratio to the CE ratios of other
transportation safety policies to determine which policy costs less
per unit of outcome (in this case lives saved).
Although it is typical to focus on one primary outcome in CEA, an
analyst could compute cost - effectiveness ratios for other outcomes
of interest as well.
201
Steps in Cost - Effectiveness and Cost - Benefit Analysis
1. Set the framework for the analysis
2. Decide whose costs and benefits should be recognized
3. Identify and categorize costs and benefits
4. Project costs and benefits over the life of the program, if
applicable
5. Monetize (place a dollar value on) costs
6. Quantify benefits in terms of units of effectiveness (for CEA), or
monetize benefits (for CBA)
7. Discount costs and benefits to obtain present values
8. Compute a cost - effectiveness ratio (for CEA) or a net present
value (for CBA)
9. Perform sensitivity analysis
10. Make a recommendation where appropriate
202
Review Questions
Answer the following questions in a precise way.
1. Assume a project is expected to export its product. Write the
procedures that we should follow so as to get economic
export parity price at project location.
2. Explain the objective of undertaking social-cost benefit
analysis of a project?
3. In economic analysis, the valuation of non-traded goods at
world prices has a number of steps. Write the necessary
valuation steps and procedures precisely.
4. How the existence of public good lead to market price
distortion?
203
CHAPTER-FOUR
204
Introduction: Monitoring and Evaluation- Some Basics
Nowadays, Monitoring and Evaluation has been given
economic development
Governments are increasingly being called upon to demonstrate
results
Stakeholders are no longer solely interested in organization
205
The results and sustainability of Program/project requires:
Collection of data/information and analysis in continuous
fashion.
For this, there is a need to establish a Monitoring and
Evaluation system.
That is; a system that
Establishes a data collection methods,
Defines data collection periods
Describes role of the actors in the system
Establishes accountability
Segregates report requirements of all the
stakeholders
Hence, we need to equip ourselves with the basic
Knowledge, Skill and Attitude of M&E.
206
Traditional Implementation-focused Monitoring And
Evaluation Systems Vs Result Based M&E
207
Shortcomings
Completing all of the activities and outputs is not the same
thing as achieving the desired outcomes.
The sum of all activities may or may not mean that desired
outcomes have resulted.
A list of tasks and activities does not measure results.
208
The implementation approach focuses on monitoring and
assessing how well a project, program, or policy is being
executed.
This approach does not provide policy makers, managers,
and stakeholders with an understanding of the success or
failure of the project, program or policy.
209
Result –Based M&E system
211
4.1. What is Monitoring and Evaluation?
Monitoring: is a continuous process of gathering, analyzing
and interpreting of information on the daily use of inputs and
their conversion into outputs.
This enables us to make timely adjustment or correction on
the development program/project when necessary.
212
MONITORING
Start Continuous function End
214
Process Monitoring helps to assess:
215
Impact monitoring helps to measure:
Changes brought as a result of the project/program intervention
while the project is still on progress.
This might be:
Economic aspect,
Social Aspect,
organizational,
technological,
217
Items to be considered during program/project
physical monitoring are:-
Activities executed & inputs utilization
Results of activities/project outputs/
Progress of project towards objectives
The way the project is managed (quality style of
work)
Problems encountered (variance)
Etc.
218
Progress Monitoring
To identify
Problems and
opportunities
222
activities performed and output attained.
Specific questions to be answered are:
223
The following must be measured periodically (in
most cases monthly & quarterly) for purposes of cost
monitoring and control:
Costs incurred to date
Budgeted costs to date
Value of work done to date
Cost over–run (under–run) to date
Costs incurred to date: this can be obtained by summing up
costs incurred in accomplishing various project activities
Budgeted costs to date: this can be readily obtained from
the cost projections made at the beginning.
224
Value of work done to date: when costs are measured, an
estimate should be made of the extent of work accomplished.
The value of work done can then be obtained as follows:
227
Evaluation
229
Evaluation criteria
230
Although it varies on the type of evaluation carried
among others, we have to assess:
Relevance of the project
Did the project address priority problems faced by
the target areas and communities?
Was the project consistent with policies of both
donors and recipient governments (or agencies)?
Effectiveness
Have outputs and outcomes been achieved?
Efficiency of resources (availability & utilization)
Were inputs (staff, time, money, equipment) used in
the best possible way to achieve outputs? Could
implementation been improved/ was there a better
231
way of doing things?
Sustainability factors
Have the necessary systems been put in place to ensure the
project itself and more particularly the project benefits continue
once the project and its (foreign) funding has ended?
Impact
What has been the contribution of the project to the
higher level development goals?
Did the project have any negative or unforeseen
consequences?
232
Types of Evaluation
It can be seen in two ways:
1. In periods/time of evaluation and
2. By persons involved in the evaluation process.
1 - Based on the Period / time
i. Ex-ante / start-up/ evaluation,
ii. On-going or mid-term /formative/
evaluation,
iii. Terminal /summative/ evaluation; and
iv. Ex-post/impact evaluation.
233
Ex-ante/start-up Evaluation:
It is an evaluation carried out before the implementation
of the program or project activity in order to determine:
The needs and potentials of the target group and its
environment
Assess the feasibility and potential effects and impacts
of proposed program or project
It can be considered as a “baseline” study in which the
situation of the project area , the target group and its
environment is described.
Hence, at a latter stage, the effects and impacts of the
program or project can be compared with this situation.
234
On-going/Mid-term/Formative Evaluation:
235
Major Issues To Be Seen During On-going Evaluation
Include:
Efficiency in resource utilization
237
Ex-post Evaluation
Often called impact evaluation/ impact assessment
Designed as in-depth study of the impact of a
project that has been already executed or an
intervention (support) given for certain development
activities.
Carried some time after the program/project activity
has been terminated (usually 6 months to 3 years
after project completion) in order to determine its
impact on the target group and the local area.
238
2. Evaluation Based on Evaluating Persons:
1. Internal Evaluation:
Performed by persons who have a direct role in the
program/project implementation
Can be done by the management team or persons assigned from
the implementing agency
2. External Evaluation:
It is carried out by persons / institutions from outside the
program/project implementers
In most cases, it is conducted by the funding /sponsoring/ agencies
with formally designated consultants/evaluators outside the project
at fixed points in time
Plan/re-plan Purpose
Program/project
Improvement of
M&E Assess Output
/Results
Practice Bench-
Marking Assess as the
targeted
beneficiaries are
reached
Enhance Identify
Accountability Gather Lessons for
Ensure Quality information for change and
Management early warning Improvement
240
Distinction between M & E
Themes Monitoring Evaluation
Purpose/objective Specific Broad
244
Steps in developing M&E system
246
Commonly Used M & E Tools
1. Logical Framework
2. Report
3. Questionnaires
4. Interview
5. Key Informant Interview
6. Review of Documents
7. Trend Analysis
8. etc
247
Review Questions
Answer the following questions.
1. Why we monitor and evaluate projects?
2.What is the importance of having a developed
monitoring and evaluation system?
3. Why we include monitoring and evaluation tools in
project proposals?
248
CHAPTER-FIVE
249
5.1. Impact Evaluation Basics
Impact evaluation is an effort to understand whether the
changes in well-being are indeed due to project or program
intervention.
Specifically, impact evaluation tries to determine whether it
is possible to identify the program effect and to what extent
the measured effect can be attributed to the program and not
to some other causes.
So, impact evaluation focuses on outcomes and impacts.
250
Since impact evaluation is time and resource intensive, it
should be applied selectively.
Policy makers may decide whether to carry out an impact
evaluation on the basis of the following criteria:
The program intervention is innovative and of strategic
importance.
The impact evaluation exercise contributes to the knowledge
gap of what works and what does not. (Data availability and
quality are fundamental requirements for this exercise.)
251
Why Should We Do Impact Evaluation?
The best way to undertake a particular impact evaluation
depends in part on its purpose and who its primary intended
users are.
Some common reasons for doing impact evaluation include:
252
2. To decide whether or not to continue or expand an
intervention.
3. To learn how to replicate or scale up a pilot.
4. To learn how to successfully adapt a successful intervention
to suit another context.
5. To reassure funders, including donors and taxpayers (upward
accountability), that money is being wisely invested.
6. To inform intended beneficiaries and communities
(downward accountability) about whether or not, and in what
ways, a program is benefiting the community.
253
Quantitative versus Qualitative Impact Assessments
Quantitative impact assessments use quantitative data and
approaches to determine the effectiveness of programs with
far-reaching goals such as lowering poverty or increasing
employment.
Qualitative impact assessments use qualitative information
such as understanding the local socio-cultural and institutional
context, as well as program and participant details which are
essential to undertake sound quantitative assessment.
254
But a qualitative assessment on its own cannot assess
outcomes against relevant alternatives or counterfactual
outcomes.
That is, it cannot really indicate what might happen in the
absence of the program.
Quantitative analysis is also important in addressing potential
statistical bias in program impacts.
A mixture of qualitative and quantitative methods (a mixed-
methods approach) might therefore be useful in gaining a
comprehensive view of the program’s effectiveness.
255
Quantitative Impact Assessment: Ex post versus Ex ante
Impact Evaluation
There are two types of quantitative impact evaluations: ex
post and ex ante.
An ex ante impact evaluation attempts to measure the
intended impacts of future programs and policies, given a
potentially targeted area’s current situation.
This may involve simulations based on assumptions about
how the economy works.
Many times, ex ante evaluations are based on structural
models of the economic environment facing potential
participants.
That is, using the structural models we predict program
256
impacts.
Ex post evaluations, in contrast, measure actual impacts
accrued by the beneficiaries that are attributable to program
intervention.
One form of this type of evaluation is the treatment effects
model.
Ex post evaluations have immediate benefits and reflect
reality.
These evaluations, however, sometimes miss the mechanisms
underlying the program’s impact on the population, which
structural models aim to capture and which can be very
important in understanding program effectiveness.
257
Ex post evaluations can also be much more costly than ex
ante evaluations because they require:
collecting data on actual outcomes for participant and
nonparticipant groups and
other accompanying social and economic factors that may
have determined the course of the intervention.
• An added cost in the ex post setting is the failure of the
intervention, which might have been predicted through ex
ante analysis.
258
The Problem of the Counterfactual
The main challenge of an impact evaluation is to determine
what would have happened to the beneficiaries if the program
had not existed.
That is, one has to determine the per capita household income
of beneficiaries in the absence of the intervention.
A beneficiary’s outcome in the absence of the intervention
would be its counterfactual.
A program or policy intervention seeks to alter changes in the
well-being of intended beneficiaries.
259
Ex post, one observes outcomes of this intervention on
intended beneficiaries, such as employment or expenditure.
Now , we have to ask:
261
But one cannot do so because at a given point in time a
household or an individual cannot have two simultaneous
existences.
That is; a household or an individual cannot be in the treated
and the control groups at the same time.
Finding an appropriate counterfactual constitutes the main
challenge of an impact evaluation.
262
5.2 Methodologies in impact evaluation
264
Assignment- this is a requirement to complete the course.
END
265