Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo
Professional
Certificate in Policy
Implementation and
Evaluation
Ian “Ren” Rennie
INTRODUCTION TO POLICY
EVALUATION
• Who Evaluates?
• Elites:
– Government Agencies, Think Tanks, National or
International Audit institutions, Regulators
• Interest Groups:
– Trade Associations, Business groups, Pressure groups,
Media
• Citizens:
– Complaints, Whistle Blower laws, Public Opinion, Voting
• Of course, some agencies may be shielded from
evaluations, some may have repeated evaluations
thrust upon them.
Politics of public policy evaluation
• Determine policy outcomes
• Identify policy strengths
• Identify and improve weaknesses
• Justify use of resources
• Increased emphasis on accountability
• Professional responsibility to show
effectiveness.
Why evaluate?

Recommended for you

Public Policy Formulation - Process and Tools
Public Policy Formulation - Process and ToolsPublic Policy Formulation - Process and Tools
Public Policy Formulation - Process and Tools

This document outlines the public policy formulation process. It begins with defining key concepts like policy and public policy. The public policy formulation process has four phases - initiation, generation, implementation, and evaluation. The initiation phase involves agenda-setting, identifying policy issues, and stakeholder engagement. The generation phase is when policies are formulated and drafted. Implementation involves enacting the policies. Evaluation is monitoring and assessing the policies. The document provides details on steps like policy analysis and stakeholder consultation that are part of the initiation and generation phases of the public policy formulation process.

policypolicy analysischarles cotter
policy analysis
policy analysispolicy analysis
policy analysis

This document provides an overview of policy analysis, outlining several key points: - It defines policy analysis and describes it as a process used to determine what a policy will or has achieved. Approaches include descriptive analysis of existing policies and prescriptive analysis to formulate new policies. - The importance of policy analysis is highlighted, such as assessing situations, seeking acceptance, providing opportunities for modification, and facilitating evidence-based decision making. - Several models of policy analysis are described, including process, substantive, eightfold path, logical-positivist, and participatory policy analysis. - The use of indicators and outcomes to evaluate policies is discussed, noting they can measure results at the population, agency

Public Policy Formulation and Analysis
 Public Policy Formulation and Analysis  Public Policy Formulation and Analysis
Public Policy Formulation and Analysis

Defines the policy,lists the main features of a policy , the step by step process of policy formulation and implementation,describes the criteria to judge the efficacy and chances of success of policy and lastly the weaknesses of policy formulation in a developing country like Pakistan

essential skillspublic policypolicy implementation
• Outcome
• Implementation
• Formative
• Summative.
Types of evaluation
• Summary process.
Evaluation
Identify
scope and
stakeholders
Analysis
Information
gathering
Identify
sources of
information
Team
Selection
Compare with:
business strategy
business case
Use the information for more effective business
operations
• Why are you doing the evaluation?
– mandatory?
– policy outcomes?
– policy improvement?
• What is the scope? How large will the effort be?
– large/small
– broad/narrow
• How complex is the proposed evaluation?
– many variables, many questions?
• What can you realistically accomplish?
Scope of evaluation
• There are a number of common challenges that
may be encountered
• the evaluation team need to be aware of these
• although they may not be able to solve them.
Common challenges

Recommended for you

Policy Making Process
Policy Making ProcessPolicy Making Process
Policy Making Process

This document discusses the policy making process. It begins by defining what a policy is, including that it guides decision making and translates vision into action. It then outlines the major steps in policy making - defining the policy issue, developing potential policy options to address it, and making a decision on the best option to implement. It emphasizes that the process should be informed by facts, include input from stakeholders, and involve public debate on alternatives. The goal is to select a policy that benefits the public while respecting individual rights.

policypolicy-makingpublic
ppt on understaing policy
ppt on understaing policyppt on understaing policy
ppt on understaing policy

- Public policy can be defined as "anything a government chooses to do or not to do" according to Thomas Dye. This definition emphasizes that governments are the primary actors in public policy and their decisions, whether to act or not act, constitute public policy. - Governments are uniquely able to make authoritative decisions on behalf of citizens, backed by legislation. Public policy also involves a series of interrelated decisions made across government to address problems. - Studying public policy allows us to scientifically understand the causes and consequences of policies, help solve practical problems, and make policy recommendations. It also allows us to learn what governments are doing in key areas, the causes of their decisions, and the impacts of their policies

Policy Implementation Process
Policy Implementation ProcessPolicy Implementation Process
Policy Implementation Process

The document discusses policy implementation, which involves carrying out the activities designed by the legislative branch to achieve its policy goals. This includes establishing and staffing new agencies or assigning new responsibilities to existing agencies. The implementing agencies then translate the legislative intent into operational rules and guidelines, and coordinate resources and personnel to achieve the intended goals.

• more than one organisation involved, no common standard
for measuring and recording benefits and costs
• lack of documentation
• inadequacy of baseline measures - measures of success can
only be made accurately by comparing the level of
performance before implementation
• sensitivities – examining performance may lead to feelings
of insecurity or grievance for those involved
• the organisation is too busy and it never gets it done (there
should be policies to ensure that it is normal practice)
• lack of cooperation by involved agencies.
Challenges:
• There is one most important question
• What is it that you want to know about your
policy?
• Once you have defined this make it
measurable
• Do not move forward if you cannot answer
this question!
Ensuring effective and efficient
monitoring
• What is the purpose?
• What should we measure to ensure that the policy:
• is producing the required products
• is being carried out to schedule and in accordance with its
resource and cost plans
• remains viable against its business case
• Monitoring activities facilitate the checking and
reporting on progress against the plan
• Control activities promote revisions to be made to the
plan in response to issues discovered during
monitoring.
Monitoring ... for control
• To benchmark is to compare performance against a
standard
• To improve the effectiveness of monitoring and
evaluation (M&E) in the policy cycle, benchmarking can
be useful in three ways
1. can help place an outcome in context - was the
achievement good, bad, or indifferent?
2. can help assess the reasonableness of targets that
may be set
3. can help identify specific regions or subgroups whose
exceptionally good or poor results hint at what factors
drive performance.
International comparisons and
benchmarking

Recommended for you

Policy Analysis Process by Willy Ruin
Policy Analysis Process by Willy RuinPolicy Analysis Process by Willy Ruin
Policy Analysis Process by Willy Ruin

The presentation will try to provide a framework for thinking about policy analysis and a discussion on the process for conducting policy analysis.

policy analysispolicy processpolicy review
622 6 pp_15_public_policy_process
622 6 pp_15_public_policy_process622 6 pp_15_public_policy_process
622 6 pp_15_public_policy_process

The lecture discusses the first stage of the policy process - problem delimitation and recognition. It defines what constitutes a problem, social problem, and policy problem. A social problem becomes a policy problem if it can be addressed through public policy. Problem delimitation in public policy involves structuring and specifying issues to help define the scope of potential solutions. Different problems have varying levels of agreement on values/knowledge, from well-structured to unstructured. The theory of agenda setting explains how issues rise on the agendas of public, policymakers and government. The stage model of the policy cycle is used to analyze the process, though it has limitations as policymaking is complex and non-linear.

policy proces
Public policy
Public policyPublic policy
Public policy

This document defines public policy and discusses its key subfields. Public policy is defined as a government's actions or inactions in response to public problems. There is no single agreed-upon definition, but generally it refers to the choices governments make and the outcomes of those decisions, backed by state authority. The main subfields of public policy are policy analysis, policy evaluation, and policy process. Policy analysis focuses on determining the best policy options, policy evaluation examines the consequences of policies, and policy process studies how and why policies are made.

policypublic policy
• Today, there is much online
availability of large
internationally comparable data
sets (such as those in the World
Bank’s Data Development
Platform)
• Plus widely available national
survey data
• It is now considerably easier to
use international data for
benchmarking exercises.
Benchmark with what?
Range of institutions
LINKING POLICY IMPLEMENTATION
AND POLICY EVALUATION
• Give an example of a performance indicator
for your area of responsibility ...
Exercise

Recommended for you

Process of public policy
Process of public policyProcess of public policy
Process of public policy

The document discusses the process of public policy. It defines policy and differentiates it from procedures and guidelines. It then outlines the key steps in the public policy process: problem identification, agenda setting, policy making, budgeting, implementation, and evaluation. It notes that key actors in agenda setting include think tanks, interest groups, media, and government officials. The document also discusses who the main players are in making economic policies, noting the roles of the prime minister, donor community, various ministries and constituencies. It provides guidelines for changing policies, emphasizing preparation, planning, personal contact, understanding community perspectives, positivism, participation, publicity, and persistence.

public policy process
POLICY MAKING PROCESS
POLICY MAKING PROCESSPOLICY MAKING PROCESS
POLICY MAKING PROCESS

The document outlines the key stages of the policy making process: 1) Issue identification where problems are publicized and gain government attention 2) Agenda setting where the government begins serious consideration of issues 3) Policy formulation where various alternatives are developed and considered 4) Policy adoption where policies are legitimized through official government statements and actions 5) Policy implementation which involves all activities that result from officially adopting a policy.

Models Approaches of Public Policy
Models Approaches  of Public PolicyModels Approaches  of Public Policy
Models Approaches of Public Policy

- Public policy is defined as actions or decisions by government to address public issues through laws, regulations, or programs. - Three main approaches to analyzing public policy are empirical, which examines facts and impacts; valuative, which determines the worth of policies; and normative, which recommends courses of action. - Key theories for studying public policy include political systems theory, which views policy as responses to demands on government; group theory, which sees policy as outcomes of group competition and influence; and elite theory, which posits that elites set the policy agenda to serve their own interests.

models of public policypolicy systemeaston system
• Consider these assumptions:
• Indicators will provide clear answers to
questions about policy efficiency and
effectiveness
• Indicators will help explain how decisions and
decision outcomes are linked
• Having the right indicators will result in better
decisions.
Performance indicators
• Political use – indicators used to support a
predetermined position
• Symbolic use – ritualistic assurance about appropriate
attitudes towards decision-making (“we even
developed indicators”)
• Tactical use – indicators and the process used as a
delaying tactic or substitute for action (“we will do it
later once we have indicators”)
• Conceptual use for enlightenment – change the
understanding of an issue
• Instrumental – direct relationship between indicators
and decision outcomes.
Possible motives
• Indicators play an important role in the policy cycle
and can serve a useful purpose
• They can
– Help assimilate and better understand stakeholder views
– Add to the process of governance
– Help guide and mould policy decisions
• Indicators are linked to the governance process ...
• “which can act like a magic bullet causing decision-
making to become instantly objective and scientific”.
Indicators in the Policy Cycle
• Saliency
– will anyone care?
• Legitimacy
– can people trust it?
• Credibility
– can people believe it?
• Usability
– can people understand it?
Observing agency outputs

Recommended for you

Public Policy
Public PolicyPublic Policy
Public Policy

This document provides an overview of public policy definitions, approaches, and processes. It begins by defining public policy as systems of laws, regulations, and actions by governmental entities to address public issues. The traditional views of public policy are discussed, including definitions that focus on the dichotomy between politics and administration. The document then examines several models of public policy analysis, including the institutional, process, group, elite, rational, incremental, game theory, public choice, and systems models. It discusses the importance of models in creating order, simplifying complexity, and identifying key elements in the policy process like institutions, stakeholders, formulation, and evaluation.

public policyphilippines
POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015
POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015
POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015

POLICY MAKING PROCESS Policy • a statement of intent for achieving an objective. • Deliberate statement aimed at achieving specific objective • policies are formulated by the Government in order to provide a guideline in attaining certain objectives for the benefit of the people. • Importance and objective of any policy • to solve existing challenges/problems in any society • used as a tool to safeguard and ensure better services to members of the society. • Reasons for formulating a Policy • Reforms (socio-economic, technological advancements, etc) within and outside the country.

policyhealth polivypolicy making process
Models of policy making and the concept of power in policy
Models of policy making and the concept of power in policyModels of policy making and the concept of power in policy
Models of policy making and the concept of power in policy

The document discusses different models of policy making and concepts of power in policy making. It describes four models: 1) The rational model which aims to make the best decision by defining problems, establishing goals, generating alternatives, and selecting the best option. 2) The bounded rationality model which aims for a satisfactory decision by analyzing problems and establishing criteria for acceptable solutions. 3) The incremental model which involves successive limited comparisons and trial-and-error adjustments. 4) The mixed scanning model which combines bounded rationality and incrementalism, using broad goals to guide incremental decisions. The document also discusses three dimensions of power: decision making power, agenda-setting power, and thought control power. It outlines three sources

Standards for an M&E Plan
• Utility
– serve practical information needs of intended
users
• Feasibility
– be realistic, prudent, diplomatic and frugal
• Propriety
– conducted legally, ethically, and with regard to
those involved in and affected by the evaluation
• Accuracy
– reveal and convey technically accurate
information.
Factors to Consider When
Setting Targets
• What can realistically be achieved given the
resources and the program context?
– Baseline levels
– Past trends
– Needs and gaps in services
– Capacity and logistics
– International benchmarking.
Approaches to Setting Targets
• Establish final target then plan progress in
between
• Establish intermediate targets
• Assess progress in attaining targets and
readjust, if necessary.
• Past trends
• Expert opinion
• Research findings
• What has been accomplished elsewhere
• Client expectations.
Useful Information for Setting Targets

Recommended for you

Public policy analysis_dunn
Public policy analysis_dunnPublic policy analysis_dunn
Public policy analysis_dunn

Hi NIDA Batch 19 friends, This is the slide for "Public Policy Analysis: An Introduction" By William Dunn. Best. B

Public policy-analysis
Public policy-analysisPublic policy-analysis
Public policy-analysis

This document provides an overview of public policy analysis. It discusses definitions of public policy, typologies of public policy, why governments intervene in markets, models of the policy process, and approaches to policy analysis. The key points are: 1) Public policy is defined in various ways but generally refers to courses of action by governments to address issues of public concern. 2) Public policy can be categorized in typologies such as patronage/promotional, regulatory, and redistributive policies. 3) Governments intervene in markets when societies desire certain goods like healthcare but the free market does not adequately provide them, or when markets fail due to issues like externalities, information problems, or barriers to entry.

Economic Policy
Economic Policy Economic Policy
Economic Policy

The document discusses India's economic policies, including fiscal policy, monetary policy, foreign exchange policy, and foreign investment policy. It provides an overview of the objectives and instruments of each policy area. Fiscal policy aims to achieve desirable price levels, employment, income distribution, and capital formation through public expenditure and taxation. Monetary policy operates through money supply, interest rates, and credit availability to influence spending and prices. Foreign exchange policy moved from control to management with the introduction of the Foreign Exchange Management Act in 1999. Foreign investment policy aims to attract long-term foreign direct investment and allows foreign investors to establish wholly owned subsidiaries in most sectors.

• Advocate for the need for M&E
• Understand program goals and objectives
• Identify user needs and perspectives
• Learn about existing data collection systems &
their quality
• Understand indicators that are being collected
and used (or not used)
• Determine capacity for collecting and using data.
Stakeholder Consultation
• Developing M&E framework
• Selecting indicators
• Setting targets
• Reviewing results
• Requires building consensus & commitment
and maintaining effective relationships with
intended users.
Stakeholder Participation
DEVELOP A DATA COLLECTION MATRIX FOR YOUR PROGRAM. CONSIDER
THE FOLLOWING ISSUES:
• Who will be responsible for data collection and its supervision?
• Who will be responsible for ensuring data quality at each stage?
• How will data quality be checked at every stage?
• How often will the data be collected, compiled, sent, and analyzed?
• What indicators will be derived from each data source?
• How will the data be sent (raw, summary)?
• What tools/forms will be used, if any?
• What resources (staff, office supplies, computers, transportation) will
be needed at each stage?
• Who will analyse the data? How often will analysis occur?
• How often will the results be compiled into reports?
• To whom and how often will the results be disseminated?
Data Collection Plan
Developing & Implementing an
M&E Plan: Logic Model
Inputs
•Human
resources
•Understanding
of the program
•Authority and
mandate
•Stakeholders
Processes
•Advocate
•Assess strategic
information needs
•Assess information
systems capabilities
•Achieve consensus
and commitment
•Develop
mechanism for M&E
plan review
•Prepare document
for final approval
Outcomes
Output
•M&E Plan
Document
Short-term
•M&E System for obtaining
Strategic Information
decision making
Long-term
•Evidence-based decisions
for improving programs
Impacts
•Policy delivery

Recommended for you

Economic survey 2016 - 17 highlights
Economic survey 2016 - 17 highlightsEconomic survey 2016 - 17 highlights
Economic survey 2016 - 17 highlights

Bharat IAS and KAS coaching institutes Admission started for IAS and KAS prelims 2016 batch For details contact Ph:- 9901006910 www.bharatias.com

daily current affairsbharat iasias
Union Budget 2016-17
Union Budget 2016-17Union Budget 2016-17
Union Budget 2016-17

Finance Minister Arun Jaitley presented the Union Budget for 2016-17 and reaffirmed that the economy is on the right track. The budget is aimed at strengthening India's firewalls by ensuring macroeconomic stability and prudent fiscal management; driving growth through domestic demand; and economic reforms and policy initiatives to change lives for the better. With measured focus on social sector reforms and recapitalising India's banking system, this Budget has an overarching focus on improving agriculture, and scaling infrastructure, all of which bode well for the country. The government is now planning to rationalise and channel subsidies to the poor by increasing the burden on the rich, and by increasing spending on public welfare through its own kitty. Mr. Jaitley said the Union Budget is aimed at improving rural infrastructure and increasing rural income, as the biggest challenge to the economy is agrarian distress. Applauding the budget presented by the Finance Minister, Prime Minister Narendra Modi said the Budget is pro-village, pro-poor and pro–farmers, and is focused on bringing about qualitative changes in the country through a slew of time-bound programmes. The attached note captures key highlights and summarises major announcements in the Budget. Please reach out to us should you wish to understand more about the Union Budget and its impact on your business

indiafinance minister2016
Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...
Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...
Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...

Contact: AJSH & Co. Chartered Accountants (New Delhi, India) The Modi government took charge at the Centre with a promise to bring about many changes in terms of governance. This created a wave of excitement among the people. The Narendra Modi government has put together an elaborate economic reforms package in sync with the party’s election manifesto. A "king among kings" is how Anil Ambani, one of India's leading industrialists, described Narendra Modi in January last year, long before the latter entered the race to become the country's next prime minister. After winning the Indian election comprehensively, the business community here is waiting with its arms wide open to embrace Mr Modi. They hope he will be their saviour at a time when the economic growth rate is flagging, investments are dwindling and consumer demand is dropping.

economyindiangovernment
• Start early
• Involve stakeholders at all stages in the process
• Assess strategic information needs for intended users
• Assess current capacity and use what is already available
• Avoid duplication of data collection and reporting
• Do not collect information that will not be used
• Review progress / results regularly and make adjustments
to M&E plan, if necessary.
Summary: The Basics
DIRECT VS INDIRECT POLICY
IMPACTS
Dandelion dilemma
• Case study 1
– Continuously troublesome students are excluded from
school to prevent disturbance of well behaved
students
• Case study 2
– in 18th- and 19th-century northern Europe, there was
a “window tax”
– a property tax whose amount depended upon the
number of windows in a house
– an explicit “income tax” was politically unpopular, so
the intention was to create an income tax without
explicitly taxing on the basis of income.
First order and second order
impacts

Recommended for you

India Strategic Overview
India Strategic OverviewIndia Strategic Overview
India Strategic Overview

The document provides an overview of strategic factors for firms considering investment in India. It analyzes the country environment including strong economic growth, large consumer market, and improving infrastructure. Government policy aims to increase foreign investment and competition. Local competitors have innovative low-cost products and access to rural consumers. The resources, capabilities, and objectives of multinational companies are also discussed, as well as key strategic choices around greenfield investment, acquisitions, and partnerships.

Dr.C.Muthuraja's views on 'Union Budget 2015-16'
Dr.C.Muthuraja's views on 'Union Budget 2015-16'Dr.C.Muthuraja's views on 'Union Budget 2015-16'
Dr.C.Muthuraja's views on 'Union Budget 2015-16'

Union Budget 2015-16, Economic Survey Highlights, Boon or Bane for Indian Business, Critical Evaluation, Request for New Generations

union budget 2015-16
Gst overview challenges and impact
Gst overview challenges and impactGst overview challenges and impact
Gst overview challenges and impact

This document provides an overview of the Goods and Services Tax (GST) that is being implemented in India, including the current state of indirect taxes, how GST will work, and Oracle's approach and roadmap. It discusses the key concepts of GST, including how it will replace existing taxes and function as a single, destination-based tax across India. The document also outlines some of the opportunities for Oracle in areas like GST roadmaps, advisory services, developing custom reporting/settlement solutions, and building capabilities around GST processes and configuration.

gstindiaindirect tax
• Unintended consequences arise because we
live in an interconnected and complex world
• Interconnectedness and complexity of the
world imply that a small change in one part of
a system can potentially generate far-reaching
effects in another part of the system
• Also policymakers may be unable to anticipate
or understand how their policies affect the
incentives of individuals within the system.
Complex systems
• public policy attempts to address social
problems, often without understanding
the policy’s effects on individuals’
incentives
• systematic consideration of a policy’s
intended and unintended effects is
imperative
• just because a policy could theoretically
affect individuals’ incentives doesn’t mean
that the policy actually will
• the extent to which individuals respond to
incentives is an empirical question, which
requires an empirical answer.
Empirical answers
POLICY EVALUATION
METHODOLOGIES
• The good evaluation of a project or a policy
needs on the one hand thorough application
of methodology up to the highest professional
standards ...
• and is on the other hand a creative thought
exercise: what do we really want to know and
how to find out.
Evaluation methodology

Recommended for you

India public expenditure recent
India public expenditure recentIndia public expenditure recent
India public expenditure recent

The document discusses different classifications of public expenditures. It outlines Mrs. Hicks' classification which separates expenditures into defense, civil, and development. Defense expenditure includes costs for defense equipment and wages for armed, navy, and air forces. Civil expenditure maintains law and order and administration of justice. Development expenditure promotes growth in agriculture, industry, trade, transport, and communication.

Public policy formulation, implementation & evaluation
Public policy formulation, implementation & evaluationPublic policy formulation, implementation & evaluation
Public policy formulation, implementation & evaluation

This document discusses the process of public policy formulation. It defines public policy as plans or actions undertaken by government to achieve broad goals affecting citizens. The policy process is described as cyclical, involving problem identification, assessment, solution development, implementation, and review. Key aspects of policy formulation discussed include setting the policy agenda, developing potential solutions, and constraints influencing decision making such as public opinion, economic factors, and political realities. The stages of policy implementation and potential gaps between policy design and real-world application are also outlined.

public policyimplementation of public policyevaluation of public policy
INDIAN BUDGET 2016
INDIAN BUDGET 2016INDIAN BUDGET 2016
INDIAN BUDGET 2016

The document summarizes key points from India's Budget for 2016-2017 presented by Kishan K Shenoy, Lester Max D souza, and Lathesh Kumar Shetty. It outlines economic growth of 7.6% in 2015-2016, challenges of global slowdown and increased fiscal burden. Allocations target agriculture, rural development, social sectors, education, healthcare, infrastructure, and job creation. Tax rates and slabs are adjusted, and certain deductions are proposed to phase out. Fiscal deficit is retained at 3.5% of GDP to balance growth and fiscal discipline.

• If policies are meant to improve on outcomes, they should not be
based on ideology or wishful thinking, but rather on proven
effectiveness
• But obtaining convincing evidence on the effects on specific policies
is not an easy task
• Relevant data on possible outcomes has to be gathered
• Showing a mere correlation between a specific policy or practice
and potential outcomes is not proof that the policy or practice
caused the outcome
• For policy purposes, mere correlations are irrelevant, and only
causation is important
• What would really happen if a specific policy is introduced – would
it really change any outcome that society cares about?
• Evidence-based policy require answers to causal questions.
Overview
• The need for evidence-based policy is increasingly
recognised (e.g., Commission of the European Communities
2007)
• Providing empirical evidence suitable for guiding policy is
not an easy task
• It refers to causal inferences that require special research
methods
• Not always easy to communicate due to technical
complexity
• Econometrics is a set of quantitative techniques that are
useful for making "economic decisions“
• Of course, economic decisions are not restricted to those
made by economists ...
Econometrics
• The decision of a student to stay an extra year at
university to earn a double degree
• The decision of a spice seller to open a shop in
this village, or another
• The decision of a bank to approve a loan
application
• The decision of a power company to start-up an
extra generator on a certain day
• The decision of a Government to introduce a
purchase tax in order to reduce income taxes.
Examples:
• The "efficient allocation of resources" is the subject
matter of economics
• The traditional role of econometricians is to "test"
alternative economic theories
• To confront theories with real data and to reject those
that are not compatible with reality
• It is what transformed economics from an "art" into a
"science“
• However, it only gave the econometrician an indirect
role as an economist's sidekick
• If economists didn't come up with new theories,
econometricians didn't have anything to do!
What is old?

Recommended for you

R12 Tax GST slides
R12 Tax GST slidesR12 Tax GST slides
R12 Tax GST slides

This document discusses the eBS R12 tax engine and its implementation for Australian GST. It provides an overview of the tax engine components and configuration steps for GST. It also addresses some challenges with the initial R12 upgrade and provides recommendations for custom reporting and reconciliations for GST purposes.

What is Public Policy?
What is Public Policy?What is Public Policy?
What is Public Policy?

This document provides an introduction to public policy. It defines public policy as actions taken by governments to address public issues through laws, regulations, funding, and programs. The document outlines the framework for developing public policy, including setting objectives and targets, identifying alternatives, designing and implementing programs, and evaluating impacts. It also discusses different analytical approaches to public policy, the stages of the policy process, challenges with implementation, and criteria for evaluating policies. Key topics covered include the roles of government, rationales for public policy, categories of policies, and steps for policy analysis.

cpprthink tankpublic policy
Ietp Session 2 June 28
Ietp Session   2 June 28Ietp Session   2 June 28
Ietp Session 2 June 28

This document provides an overview of the Indian economic and trade policy course structure and evaluation. It discusses key topics like the structure of the Indian economy, sector-specific issues, social sector development, external sector overview and trade policy. It analyzes India's economic growth performance across five-year plans and four phases of development. Some challenges discussed are structural transformation of the economy, employment growth, poverty reduction and the political economy implications of reforms.

• Regardless of what economists do, economic problems
persist in reality and decisions have to be made
• The modern role of an econometrician is therefore more
direct
• Econometricians extract information from the available
data in order to provide support for an economic decision
• The raw material that the econometrician uses is more
often real observed data, instead of economic theory
• In any specific problem if an economic theory that has been
validated by data exists, it will certainly be used
• If no such model exists, however, econometrics must still
make a statistical model for the data, and provide
intelligent support for the decision process.
What is new?
• In government decision-making there are always
competing priorities for funds
• The purpose of a CBA is to allow competing policy
priorities to be compared in a consistent way, and for
their economic, social and environmental impacts to be
assessed
• In all areas of policy, the function of the CBA is to assist
policymakers to identify the best way to deliver the
strategic objectives of governments
• And then to assist with the evaluation of the policy.
Cost Benefit Analysis (CBA)
1. needs to be future looking
2. needs to be objective
3. needs to consider implementation risks
4. to be easily understood so it can be subject to a
degree of contestability.
What does a good CBA look like?
1. establishing the base case – or the ‘no change’ policy
option
2. defining the policy options to be evaluated and
compared against the base case and against each
other
3. laying out the estimates and assumptions for external
factors affecting the policy outcomes
4. defining and estimating the costs of a policy proposal
5. defining and estimating the benefits of a policy
proposal
6. drawing a conclusion.
Key steps in a CBA

Recommended for you

2016 budget capital projects
2016 budget capital projects2016 budget capital projects
2016 budget capital projects

This is an analysis on the Capital Expenditure of the 2016 Budget – Appropriation Bill – with special focus on the Number of Capital Projects to be executed by Ministries, Departments and Agencies (MDAs).

nigeriacapital projectsmda
UPSC Economy Prelims 2016
UPSC Economy Prelims 2016UPSC Economy Prelims 2016
UPSC Economy Prelims 2016

This document provides an overview of topics related to the Indian economy that may be covered in the UPSC Prelims 2016 exam, including terms used in the Indian economy, planning, poverty and unemployment, economic reforms, inflation, and monetary policy. It defines key economic concepts and terms, describes India's various Five-Year Plans since 1951 and their objectives, outlines approaches to measuring and addressing poverty, and explains tools and objectives of monetary policy in India like the bank rate, cash reserve ratio, and statutory liquidity ratio.

upsc prelims 2016 economy
Sector highlights of the budget edelman
Sector highlights of the budget edelmanSector highlights of the budget edelman
Sector highlights of the budget edelman

The document gives highlights from key sectors – agriculture and rural development, banking, financial services and insurance, defence and aviation, e-commerce and retail, energy, FMCG, food & beverages, infrastructure and housing, manufacturing, railways, social welfare, steel and mining, and technology IT & telecom.

fmcge-commerce and retailbanking
• An initial question ‘what would happen if this investment
did not take place?’
• allows the CBA to compare two futures: the future with the
investment and that without the investment
• The base case does not mean ‘how things have been in the
past’ and should include any observed long term trends
• In particular, the base case needs to account for future
population and economic growth
• All forecasts contain an element of uncertainty
• In order to address this uncertainty, forecasters need to
develop different forecast scenarios (usually low, mid-range
and high scenarios).
1. Establishing the base case
• The purpose of any investment proposal is to achieve an
outcome that improves the wellbeing of the community
• In many instances there are multiple approaches that could
achieve the outcome
• Similar to the base case, the policy options in a CBA should
be clearly articulated and reasonable
• It is also important to consider whether there are any
policy options that may have been overlooked and not
included in the CBA
• A well thought-out CBA includes all the feasible options and
provides justification where options have not been covered
• Avoid “Goldilocks” analysis.
2. Defining the policy options
• Analysis will be built up from a range of estimates and assumptions
• Estimates are variables where there is existing evidence, preferably
from multiple sources
• Assumptions are variables where there is less robust data and the
team developing the CBA has had to use judgement
• Estimates are clearly preferable to assumptions
• A CBA, however, almost always includes assumptions because not
all of the information needed to perform the analysis is available
• Just because it is necessary to make some assumptions to conduct a
CBA does not mean it is not worth doing as all analysis involves
assumption about the future
• One strength of CBA is that it makes it clear what the key
assumptions are and allows for the systematic testing of
assumptions.
3. Estimates and assumptions
• What assumptions need to be made to conduct the
analysis?
• consider the impacts of a proposal across all sectors of
the economy by thinking about the inter-relationships
between sectors (economists term this ‘general
equilibrium analysis’)
• include all intangible costs and benefits where they can
be reliably estimated
• include all subsequent or contingent costs/investments
• analyse over the economic life of the underlying
proposal or assets, subject to a maximum of 20 years.
3. Estimates and assumptions

Recommended for you

Capital expenditure by the public-sector - 2016
Capital expenditure by the public-sector - 2016Capital expenditure by the public-sector - 2016
Capital expenditure by the public-sector - 2016

Recent data released by Stats SA show that public-sector capital expenditure has risen over the last five years, from a total of R203 billion in 2012 to R284 billion in 2016; an average rise of 8,7% per year. Over R1,2 trillion was spent during this five-year period. Eskom topped the list as the biggest capital spender of the 772 public-sector entities covered in the report. The power utility contributed 25,7% (R73,0 billion) to total capital expenditure, focusing mainly on the continued construction of the Kusile and the Medupi power stations, and the Ingula Pumped Storage Scheme. Transnet was the second biggest spender, focusing mainly on maintaining capacity in its port and rail divisions. For more on this, go to http://www.statssa.gov.za/?p=10252

capitalcapexspending
Economic Policy
Economic PolicyEconomic Policy
Economic Policy

The document discusses different economic goals, theories and policies of Democrats, Republicans and other groups. It covers various types of capitalism and economic systems, as well as the influence of corporations, interest groups and government institutions on policy creation. Key economic indicators and theories around supply and demand, laissez-faire, Keynesian and supply-side economics are also examined.

Public policies in India
Public policies in IndiaPublic policies in India
Public policies in India

Describes about the meaning of public policy, need and importance of public policies, recent public policies in india, weakness of public policies and remedies to overcome the public policy problems

economic policyfiscal policypublic policy
• Takes into account all the impacts of the policy
options that produce undesirable impacts
• A useful way of looking at costs is to identify which
individuals or groups in the community are worse-off
as a result i.e.
– Government
– Business
– The community
• The full range of costs in a CBA should be identified,
even those that may be difficult to measure -
understating or overlooking a cost that is difficult or
impossible to quantify is a common fault with CBAs
• Everything is relative to the base case – that is, the
costs that are additional to the base case.
4. Costs
• Helpful to ask, ‘who is made better off as a result of the investment?’ i.e.
– Government: time or money saved through more efficient programs or
processes
– Businesses: reduction in time or cost, particularly with respect to
administration, or improvements in efficiency, productivity and innovation
– The community: increase in welfare, safety, participation and/or connectivity
• Many CBAs will also look at benefits according to the ‘triple-bottom-line’
which covers the positive economic, environmental and social outcomes
of the investment
• While there is nothing wrong with classifying benefits under these
headings, it is crucial to avoid double-counting
• Like the cost side of the CBA, it is important to identify all the benefits
related to the policy options and measure them relative to the base case.
5. Benefits
• Finally calculate the value of each policy option taking into account
all future discounted benefits and all future discounted costs
• The final overall value is usually expressed in one of three ways:
– Net present value or Internal rate of return or Benefit-cost ratio
• In a CBA some options may be easier to value than others
• Although CBA places an emphasis on quantifying in financial terms
the impacts of potential options, the CBA should not be biased
towards an option just because it is easy to value
• This does not necessarily make it the best approach
• However, where difficult-to-value impacts are included, document
carefully and transparently the manner in which that has been
done.
6. Drawing a conclusion
• An important and often overlooked step, and
purpose is to:
– Identify whether the expected benefits of the
project have been realised
– Assess whether any aspects of the current project
require remedy
– What lessons can be learned from the project for
future investment projects.
Post implementation

Recommended for you

Modi govt
Modi govtModi govt
Modi govt

This document provides a SWOT analysis of the Modi government in India. It details the government's strengths such as minimum government and infrastructure initiatives. Weaknesses include being a single-man government and limited focus on farmers. Opportunities exist in using foreign exchange savings for employment and capitalizing on the large mandate. Threats include limited cash reserves and lack of numbers in the upper house of parliament. Global experts generally view Modi positively and see potential for further reforms leading to strong growth.

short & easy ppt
EMIS
EMIS EMIS
EMIS

The document discusses monitoring, evaluation, indicators, and data quality in the context of management information systems (MIS). It provides definitions and explanations of key concepts: Monitoring is the regular tracking of project inputs, activities, outputs, outcomes and impacts. Evaluation determines the relevance, effectiveness, efficiency and sustainability of a project. Good indicators for monitoring and evaluation should be useful, valid, reliable, and understandable. Both quantitative and qualitative data and methods can be used. Ensuring high quality data involves clear goals, training, checks and addressing errors. Together, monitoring, evaluation and quality data support effective project management through information systems.

m&eemisdata managmnet
Introducing Policy Implementation and Evaluation.
  Introducing Policy Implementation and Evaluation.  Introducing Policy Implementation and Evaluation.
Introducing Policy Implementation and Evaluation.

Presented at the Strategic Policy Planning, Implementation and Evaluation training workshop held at Source of the Nile Hotel, Jinja. Oct 1,2015

• Quantitative observations are made using scientific
tools and measurements
• The results can be measured or counted
• Any other person trying to quantitatively assess the
same situation should end up with the same results
• An example of a quantitative evaluation would be
"this year our government paid 4m citizens a pension
totalling $4,000m at an average of $1000 per
pensioner.“
Quantitative
• More subjective than quantitative evaluation, qualitative
observations are defined in science as any observation
made using the five senses
• Because people often reach different interpretations when
using only their senses, qualitative evaluation becomes
harder to reproduce with accuracy
• Two individuals evaluating the same thing may end up with
different or conflicting results
• In research and business, qualitative evaluations may
involve value judgments and emotional responses
• An example of a qualitative evaluation is "our government
provided a better pension arrangement last year than this
year."
Qualitative
• Both evaluation methods have their benefits, though one is usually
more appropriate than the other in any given situation
• Quantitative evaluation can help remove human bias from a
statistic, making it more of a reliable fact than any piece of
information gathered qualitatively
• Thus, accurate quantitative evaluations can be relied upon as truth
• Qualitative evaluations may also entail truths, but these truths are
harder to get at, and evaluators may not always agree
• Still, qualitative information is invaluable precisely because it
involves human interaction and interpretation
• Many fields need this interpretation in order to decide how to move
forward or to judge the value of past and future sources of data.
Benefits
• Individuals or groups are randomly assigned to
either the policy intervention or non-intervention
(control) group and the outcomes of interest are
compared
• There are many methods of randomisation from
field experiments to randomised control trials
• Random allocation design means that systematic
differences between groups are unlikely and so
any differences and changes in outcomes
between the two groups can be confidently
attributed to the policy intervention.
Control groups

Recommended for you

Evaluating Systems Change
Evaluating Systems ChangeEvaluating Systems Change
Evaluating Systems Change

Whole systems change across a neighbourhood How can we collaborate with people to help them build their resilience? Get under the skin of the culture and the lives people live. Identify people’s feelings and experiences of community and understand what people think is shaped by different values and by the environment and infrastructure around them. The future of collaboration could bring many opportunities but people find it more difficult to live and act together than before. How can we help people…and communities build their resilience? Understand people’s different situations and capabilities to develop pathways that help them build resilient relationships. Help people experience and practice change together. Help people grow everyday practices into sustainable projects. Turn people’s everyday motivations into design principles. Support infrastructure that connects different cultures of collaboration. Build relationships with people designing in collaboration for the future…now.

civiccommunitycoopcouncil
ADRP | Measurement of Success
ADRP | Measurement of SuccessADRP | Measurement of Success
ADRP | Measurement of Success

Metrics is a hot topic within all fundraising fields. Measurement models have been established for monitoring the work of frontline fundraisers in order to assess the variety of activities performed as well as the schedule, pace, and outcomes of those activities. With this information in hand, choices can be made about which fundraising activities are most effective in achieving the desired donor behavior, most obviously giving.

donor relationsdonor recognitiondonor stewardship
Organizational Capacity-Building Series - Session 6: Program Evaluation
Organizational Capacity-Building Series - Session 6: Program EvaluationOrganizational Capacity-Building Series - Session 6: Program Evaluation
Organizational Capacity-Building Series - Session 6: Program Evaluation

This document summarizes a presentation on program evaluation for NGO partner organizations. It defines program evaluation as the systematic process of collecting and analyzing information about a program to make necessary decisions. There are two main types of evaluations: process evaluations, which verify proper implementation, and outcome evaluations, which assess a program's effectiveness and impact. The presentation outlines key steps for developing an evaluation plan, including determining the purpose and audience, identifying evaluation questions, choosing a methodology, collecting and analyzing data, and reporting findings. It also discusses important considerations like the appropriate evaluator and presents an activity for participants to develop strategies, outcomes, and discuss an evaluation plan for one of their program objectives.

ngoagricultural extensionnonprofit
Random allocation design
• Increasing recognition that rigorous evaluation of public
interventions should feature in the policy decision making process
• Yet there is frequently a gap between the desire for information on
the effectiveness of programs and an understanding of the
potential and the limitations of evaluation tools
• What questions can evaluations answer?
• What administrative structures are required to implement them?
• What are the political and social factors surrounding the acceptance
of evaluations by target groups and the public?
• How much do evaluations cost?
• How long do they take to complete?
Cost-implications of different
methodologies
• For international aid programmes it is suggested that
the cost of an evaluation is between about 5 and 7
percent of the cost of the program being evaluated as a
rule of thumb (W. K. Kellogg Foundation, 1998)
• Other evidence suggests that there is very little
correlation between the cost of an impact evaluation
and the size of the program being evaluated.
Evaluation costs
• Objectives
– the policy questions to be addressed determine how complex
the study design must be and consequently how costly
– simpler is usually better
• Availability of representative socioeconomic data
– if national data exists, alternative methods of selecting a
comparison group can be considered which may be cheaper
than the ideal random assignment design
• Timeframe
– evaluators frequently do not have the luxury of months or years
for data collection
– this lack of time necessitates more creative use of data and
more complicated statistical techniques, potentially raising the
overall price of evaluation.
Cost factors

Recommended for you

Evaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation MethodsEvaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation Methods

The document discusses evaluability assessments (EAs) and how they can inform the choice of evaluation methods. Key points: - EAs examine a project's design, available information, and context to determine if and how an evaluation could be conducted. They help ensure evaluations are useful and feasible. - Common EA steps include reviewing documentation, engaging stakeholders, and making recommendations about a project's logic, monitoring systems, and potential evaluation approaches. - Choosing evaluation methods depends on the EA results as well as the evaluation's purpose, required credibility, complexity of the intervention, and available resources. Methods like experiments provide strong evidence of impact but are difficult to implement. - EAs improve evaluation quality by engaging

impact evaluation; methodology
ME_Katende (2).ppt
ME_Katende (2).pptME_Katende (2).ppt
ME_Katende (2).ppt

This document provides an overview of monitoring and evaluation concepts for designing M&E frameworks and plans. It discusses the key components of an M&E framework including objectives, indicators, data collection, responsibilities and frequency. Examples are provided of frameworks for different public health programs addressing problems like maternal mortality and fertility. Participants are guided through exercises to identify health problems, program objectives, and indicators for sample case studies. The document emphasizes establishing valid, reliable and timely indicators that are consistent with program design and aid management and evaluation of progress toward objectives. It also covers developing a full M&E framework with defined indicators, data sources and collection responsibilities.

Assessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.pptAssessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.ppt

This document provides an overview of monitoring and evaluation concepts for designing M&E frameworks and plans. It discusses the difference between program frameworks and M&E frameworks, and how to identify appropriate indicators. Participants are guided through exercises to develop a program logic model and select indicators for a sample public health case study. Key aspects of M&E frameworks like data sources, collection methods and responsibilities are reviewed. The document emphasizes setting realistic expectations and adapting the M&E plan if funding is reduced.

healthcaremeal
IMPACT ANALYSIS
• Conduct a gap analysis
• Determine whether the project
goals were achieved
• Determine the satisfaction of
stakeholders
• Determine the project's costs and
benefits
• Identify areas of further
development
• Report findings and
recommendations.
Questions for post-
implementation review
• An equality impact assessment (EIA) is a tool that helps
public authorities make sure their policies, and the ways
they carry out their functions, do what they are intended to
do and for everybody
• Carrying out an EIA involves systematically assessing the
likely (or actual) effects of policies on people in respect of
disability, gender, including gender identity, and racial
equality and, where you choose, wider equality areas
• This includes looking for opportunities to promote equality
that may have previously been missed or could be better
used, as well as negative or adverse impacts that can be
removed or mitigated, where possible.
What is an Equality Impact
Assessment
• In many countries, if any
negative or adverse impacts
amount to unlawful
discrimination, they must be
removed
• Typically there are four possible
outcomes and more than one
may apply to a single policy:
– No major change
– Adjust the policy
– Continue the policy (justification)
– Stop and remove the policy.
Possible Outcomes

Recommended for you

Needs Assessment
Needs AssessmentNeeds Assessment
Needs Assessment

This document provides guidance on conducting a needs assessment. It defines a needs assessment as a systematic process to determine gaps between current and desired conditions. It outlines the goals, types, techniques, and steps involved in needs assessment. This includes collecting both hard and soft data, using methods like questionnaires, focus groups, and secondary data. The document emphasizes obtaining institutional approval when needed and establishing a planning team to guide the process. The overall purpose is to learn about problems and design effective programs to address identified needs and gaps.

soft hard data institutional approval
Public policy and program implementation
Public policy and program implementationPublic policy and program implementation
Public policy and program implementation

Public policy implementation and programs are shaped by various factors including expertise, leadership, politics, and budgets. Programs operationalize public policy goals to address societal problems. The policymaking process involves legislative development of policies, administrative implementation through rulemaking and programs, and judicial/legislative review. Effective implementation requires planning, interpretation of legislative intent, and application of programs. Evaluation determines program success through data collection and analysis methods like before/after studies and controlled experiments. Evaluation results inform continuation, termination, or changes to policy and future planning.

Module 4.2 - Performance management
Module 4.2 - Performance managementModule 4.2 - Performance management
Module 4.2 - Performance management

Module 4.2 - Performance management The SENSES project co-funded by the European Union funds (ERDF and IPA) For more information check the official website: http://www.interreg-danube.eu/senses

• Statutory Equality Duties Guidance
• Competition Assessment
• Small Firms Impact Test
• Greenhouse Gas Impact Assessment
• Wider Environmental Impact Test
• Health and Well-Being
• Human Rights
• Justice Impact Test
• Rural Proofing
• Sustainable Development Impact Test.
Other impact tests include ...
• http://webarchive.nationalarchives.gov.uk/2
0100503135839/http://www.ogc.gov.uk/doc
uments/policy_to_delivery_A4_Guidance_P
1_(2)_(2).pdf
• https://www.gov.uk/government/uploads/sy
stem/uploads/attachment_data/file/220541
/green_book_complete.pdf
• https://www.gov.uk/government/uploads/sy
stem/uploads/attachment_data/file/220542
/magenta_book_combined.pdf
• http://webarchive.nationalarchives.gov.uk/2
0130129110402/http://www.hm-
treasury.gov.uk/d/orange_book.pdf
• http://webarchive.nationalarchives.gov.uk/2
0130129110402/http://www.hm-
treasury.gov.uk/d/riskmanagement_assessm
ent_framework220709.pdf
References
QUESTIONS AND CLOSE

More Related Content

What's hot

Public Policy Analysis
Public Policy AnalysisPublic Policy Analysis
Public Policy Analysis
Khemraj Subedi
 
Chapter 5 policy implementation
Chapter 5 policy implementationChapter 5 policy implementation
Chapter 5 policy implementation
Chiang Mai University School of Public Policy
 
Policy Implementation
Policy ImplementationPolicy Implementation
Policy Implementation
Maria Tiara Fatima Galang
 
Public Policy Formulation - Process and Tools
Public Policy Formulation - Process and ToolsPublic Policy Formulation - Process and Tools
Public Policy Formulation - Process and Tools
Charles Cotter, PhD
 
policy analysis
policy analysispolicy analysis
policy analysis
OlaAlomoush
 
Public Policy Formulation and Analysis
 Public Policy Formulation and Analysis  Public Policy Formulation and Analysis
Public Policy Formulation and Analysis
Shahid Hussain Raja
 
Policy Making Process
Policy Making ProcessPolicy Making Process
Policy Making Process
Shahid Imran Khan
 
ppt on understaing policy
ppt on understaing policyppt on understaing policy
ppt on understaing policy
nida19
 
Policy Implementation Process
Policy Implementation ProcessPolicy Implementation Process
Policy Implementation Process
Jed Abolencia
 
Policy Analysis Process by Willy Ruin
Policy Analysis Process by Willy RuinPolicy Analysis Process by Willy Ruin
Policy Analysis Process by Willy Ruin
Wilfredo Ruin
 
622 6 pp_15_public_policy_process
622 6 pp_15_public_policy_process622 6 pp_15_public_policy_process
622 6 pp_15_public_policy_process
dika smada
 
Public policy
Public policyPublic policy
Public policy
Anthony Duenas
 
Process of public policy
Process of public policyProcess of public policy
Process of public policy
M Ali Kemal
 
POLICY MAKING PROCESS
POLICY MAKING PROCESSPOLICY MAKING PROCESS
POLICY MAKING PROCESS
Yammie Daud
 
Models Approaches of Public Policy
Models Approaches  of Public PolicyModels Approaches  of Public Policy
Models Approaches of Public Policy
Agnes Montalbo
 
Public Policy
Public PolicyPublic Policy
Public Policy
Jo Balucanag - Bitonio
 
POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015
POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015
POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015
Abdiwali Abdullahi Abdiwali
 
Models of policy making and the concept of power in policy
Models of policy making and the concept of power in policyModels of policy making and the concept of power in policy
Models of policy making and the concept of power in policy
Nayyar Kazmi
 
Public policy analysis_dunn
Public policy analysis_dunnPublic policy analysis_dunn
Public policy analysis_dunn
nida19
 
Public policy-analysis
Public policy-analysisPublic policy-analysis
Public policy-analysis
manoharlaxmi
 

What's hot (20)

Public Policy Analysis
Public Policy AnalysisPublic Policy Analysis
Public Policy Analysis
 
Chapter 5 policy implementation
Chapter 5 policy implementationChapter 5 policy implementation
Chapter 5 policy implementation
 
Policy Implementation
Policy ImplementationPolicy Implementation
Policy Implementation
 
Public Policy Formulation - Process and Tools
Public Policy Formulation - Process and ToolsPublic Policy Formulation - Process and Tools
Public Policy Formulation - Process and Tools
 
policy analysis
policy analysispolicy analysis
policy analysis
 
Public Policy Formulation and Analysis
 Public Policy Formulation and Analysis  Public Policy Formulation and Analysis
Public Policy Formulation and Analysis
 
Policy Making Process
Policy Making ProcessPolicy Making Process
Policy Making Process
 
ppt on understaing policy
ppt on understaing policyppt on understaing policy
ppt on understaing policy
 
Policy Implementation Process
Policy Implementation ProcessPolicy Implementation Process
Policy Implementation Process
 
Policy Analysis Process by Willy Ruin
Policy Analysis Process by Willy RuinPolicy Analysis Process by Willy Ruin
Policy Analysis Process by Willy Ruin
 
622 6 pp_15_public_policy_process
622 6 pp_15_public_policy_process622 6 pp_15_public_policy_process
622 6 pp_15_public_policy_process
 
Public policy
Public policyPublic policy
Public policy
 
Process of public policy
Process of public policyProcess of public policy
Process of public policy
 
POLICY MAKING PROCESS
POLICY MAKING PROCESSPOLICY MAKING PROCESS
POLICY MAKING PROCESS
 
Models Approaches of Public Policy
Models Approaches  of Public PolicyModels Approaches  of Public Policy
Models Approaches of Public Policy
 
Public Policy
Public PolicyPublic Policy
Public Policy
 
POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015
POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015
POLICY MAKING PROCESS training policy influence appiah-kubi, 16 dec 2015
 
Models of policy making and the concept of power in policy
Models of policy making and the concept of power in policyModels of policy making and the concept of power in policy
Models of policy making and the concept of power in policy
 
Public policy analysis_dunn
Public policy analysis_dunnPublic policy analysis_dunn
Public policy analysis_dunn
 
Public policy-analysis
Public policy-analysisPublic policy-analysis
Public policy-analysis
 

Viewers also liked

Economic Policy
Economic Policy Economic Policy
Economic Policy
domsr
 
Economic survey 2016 - 17 highlights
Economic survey 2016 - 17 highlightsEconomic survey 2016 - 17 highlights
Economic survey 2016 - 17 highlights
Karthik Ragavan
 
Union Budget 2016-17
Union Budget 2016-17Union Budget 2016-17
Union Budget 2016-17
EdelmanIndiaPA
 
Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...
Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...
Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...
TIAG_Alliance
 
India Strategic Overview
India Strategic OverviewIndia Strategic Overview
India Strategic Overview
shabbirag
 
Dr.C.Muthuraja's views on 'Union Budget 2015-16'
Dr.C.Muthuraja's views on 'Union Budget 2015-16'Dr.C.Muthuraja's views on 'Union Budget 2015-16'
Dr.C.Muthuraja's views on 'Union Budget 2015-16'
Chinnasamy Muthuraja
 
Gst overview challenges and impact
Gst overview challenges and impactGst overview challenges and impact
Gst overview challenges and impact
Sathya Sundar
 
India public expenditure recent
India public expenditure recentIndia public expenditure recent
India public expenditure recent
Snehanka Kadge
 
Public policy formulation, implementation & evaluation
Public policy formulation, implementation & evaluationPublic policy formulation, implementation & evaluation
Public policy formulation, implementation & evaluation
Dr.Mothilal Lakavath
 
INDIAN BUDGET 2016
INDIAN BUDGET 2016INDIAN BUDGET 2016
INDIAN BUDGET 2016
Kishan K Shenoy
 
R12 Tax GST slides
R12 Tax GST slidesR12 Tax GST slides
R12 Tax GST slides
InSync Conference
 
What is Public Policy?
What is Public Policy?What is Public Policy?
What is Public Policy?
Dhanuraj D
 
Ietp Session 2 June 28
Ietp Session   2 June 28Ietp Session   2 June 28
Ietp Session 2 June 28
FNian
 
2016 budget capital projects
2016 budget capital projects2016 budget capital projects
2016 budget capital projects
statisense
 
UPSC Economy Prelims 2016
UPSC Economy Prelims 2016UPSC Economy Prelims 2016
UPSC Economy Prelims 2016
Lt Col (Dr) Satish Dhage
 
Sector highlights of the budget edelman
Sector highlights of the budget edelmanSector highlights of the budget edelman
Sector highlights of the budget edelman
EdelmanIndiaPA
 
Capital expenditure by the public-sector - 2016
Capital expenditure by the public-sector - 2016Capital expenditure by the public-sector - 2016
Capital expenditure by the public-sector - 2016
Statistics South Africa
 
Economic Policy
Economic PolicyEconomic Policy
Economic Policy
ldelzeitmcintyre
 
Public policies in India
Public policies in IndiaPublic policies in India
Public policies in India
shrinivas kulkarni
 
Modi govt
Modi govtModi govt
Modi govt
Chitransh Sahai
 

Viewers also liked (20)

Economic Policy
Economic Policy Economic Policy
Economic Policy
 
Economic survey 2016 - 17 highlights
Economic survey 2016 - 17 highlightsEconomic survey 2016 - 17 highlights
Economic survey 2016 - 17 highlights
 
Union Budget 2016-17
Union Budget 2016-17Union Budget 2016-17
Union Budget 2016-17
 
Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...
Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...
Modi Effect on the Indian Economy - AJSH & Co. Chartered Accountants (New Del...
 
India Strategic Overview
India Strategic OverviewIndia Strategic Overview
India Strategic Overview
 
Dr.C.Muthuraja's views on 'Union Budget 2015-16'
Dr.C.Muthuraja's views on 'Union Budget 2015-16'Dr.C.Muthuraja's views on 'Union Budget 2015-16'
Dr.C.Muthuraja's views on 'Union Budget 2015-16'
 
Gst overview challenges and impact
Gst overview challenges and impactGst overview challenges and impact
Gst overview challenges and impact
 
India public expenditure recent
India public expenditure recentIndia public expenditure recent
India public expenditure recent
 
Public policy formulation, implementation & evaluation
Public policy formulation, implementation & evaluationPublic policy formulation, implementation & evaluation
Public policy formulation, implementation & evaluation
 
INDIAN BUDGET 2016
INDIAN BUDGET 2016INDIAN BUDGET 2016
INDIAN BUDGET 2016
 
R12 Tax GST slides
R12 Tax GST slidesR12 Tax GST slides
R12 Tax GST slides
 
What is Public Policy?
What is Public Policy?What is Public Policy?
What is Public Policy?
 
Ietp Session 2 June 28
Ietp Session   2 June 28Ietp Session   2 June 28
Ietp Session 2 June 28
 
2016 budget capital projects
2016 budget capital projects2016 budget capital projects
2016 budget capital projects
 
UPSC Economy Prelims 2016
UPSC Economy Prelims 2016UPSC Economy Prelims 2016
UPSC Economy Prelims 2016
 
Sector highlights of the budget edelman
Sector highlights of the budget edelmanSector highlights of the budget edelman
Sector highlights of the budget edelman
 
Capital expenditure by the public-sector - 2016
Capital expenditure by the public-sector - 2016Capital expenditure by the public-sector - 2016
Capital expenditure by the public-sector - 2016
 
Economic Policy
Economic PolicyEconomic Policy
Economic Policy
 
Public policies in India
Public policies in IndiaPublic policies in India
Public policies in India
 
Modi govt
Modi govtModi govt
Modi govt
 

Similar to Introduction to Policy Evaluation

EMIS
EMIS EMIS
Introducing Policy Implementation and Evaluation.
  Introducing Policy Implementation and Evaluation.  Introducing Policy Implementation and Evaluation.
Introducing Policy Implementation and Evaluation.
pasicUganda
 
Evaluating Systems Change
Evaluating Systems ChangeEvaluating Systems Change
Evaluating Systems Change
Noel Hatch
 
ADRP | Measurement of Success
ADRP | Measurement of SuccessADRP | Measurement of Success
ADRP | Measurement of Success
Heurista, Co.
 
Organizational Capacity-Building Series - Session 6: Program Evaluation
Organizational Capacity-Building Series - Session 6: Program EvaluationOrganizational Capacity-Building Series - Session 6: Program Evaluation
Organizational Capacity-Building Series - Session 6: Program Evaluation
INGENAES
 
Evaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation MethodsEvaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation Methods
Debbie_at_IDS
 
ME_Katende (2).ppt
ME_Katende (2).pptME_Katende (2).ppt
ME_Katende (2).ppt
ShriAnveshaDasari
 
Assessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.pptAssessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.ppt
ShahidMahmood503398
 
Needs Assessment
Needs AssessmentNeeds Assessment
Needs Assessment
Leila Zaim
 
Public policy and program implementation
Public policy and program implementationPublic policy and program implementation
Public policy and program implementation
taratoot
 
Module 4.2 - Performance management
Module 4.2 - Performance managementModule 4.2 - Performance management
Module 4.2 - Performance management
szpinter
 
CSR Impact Measurement & Management
CSR Impact Measurement & ManagementCSR Impact Measurement & Management
CSR Impact Measurement & Management
Wayne Dunn
 
Evaluation of SME and entreprenuership programme - Jonathan Potter & Stuart T...
Evaluation of SME and entreprenuership programme - Jonathan Potter & Stuart T...Evaluation of SME and entreprenuership programme - Jonathan Potter & Stuart T...
Evaluation of SME and entreprenuership programme - Jonathan Potter & Stuart T...
OECD CFE
 
Importance of M&E
Importance of M&EImportance of M&E
Importance of M&E
clearsateam
 
DEFINING THE MARKETING RESEARCH PROBLEM AND DEVELOPING AN APPROACH
DEFINING THE MARKETING RESEARCH PROBLEM AND DEVELOPING AN APPROACHDEFINING THE MARKETING RESEARCH PROBLEM AND DEVELOPING AN APPROACH
DEFINING THE MARKETING RESEARCH PROBLEM AND DEVELOPING AN APPROACH
Shashank Kapoor
 
Analytics-Webinar-FINAL
Analytics-Webinar-FINALAnalytics-Webinar-FINAL
Analytics-Webinar-FINAL
KPD6529
 
How to Assess and Continuously Improve Maturity of Health Information Systems...
How to Assess and Continuously Improve Maturity of Health Information Systems...How to Assess and Continuously Improve Maturity of Health Information Systems...
How to Assess and Continuously Improve Maturity of Health Information Systems...
MEASURE Evaluation
 
Consumer Behavior Chap5
Consumer Behavior  Chap5Consumer Behavior  Chap5
Consumer Behavior Chap5
Najeebhemat Malikzia
 
evaluation
evaluationevaluation
Public policy and program implementation
Public policy and program implementationPublic policy and program implementation
Public policy and program implementation
taratoot
 

Similar to Introduction to Policy Evaluation (20)

EMIS
EMIS EMIS
EMIS
 
Introducing Policy Implementation and Evaluation.
  Introducing Policy Implementation and Evaluation.  Introducing Policy Implementation and Evaluation.
Introducing Policy Implementation and Evaluation.
 
Evaluating Systems Change
Evaluating Systems ChangeEvaluating Systems Change
Evaluating Systems Change
 
ADRP | Measurement of Success
ADRP | Measurement of SuccessADRP | Measurement of Success
ADRP | Measurement of Success
 
Organizational Capacity-Building Series - Session 6: Program Evaluation
Organizational Capacity-Building Series - Session 6: Program EvaluationOrganizational Capacity-Building Series - Session 6: Program Evaluation
Organizational Capacity-Building Series - Session 6: Program Evaluation
 
Evaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation MethodsEvaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation Methods
 
ME_Katende (2).ppt
ME_Katende (2).pptME_Katende (2).ppt
ME_Katende (2).ppt
 
Assessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.pptAssessment MEAL Frameworks in scientific field.ppt
Assessment MEAL Frameworks in scientific field.ppt
 
Needs Assessment
Needs AssessmentNeeds Assessment
Needs Assessment
 
Public policy and program implementation
Public policy and program implementationPublic policy and program implementation
Public policy and program implementation
 
Module 4.2 - Performance management
Module 4.2 - Performance managementModule 4.2 - Performance management
Module 4.2 - Performance management
 
CSR Impact Measurement & Management
CSR Impact Measurement & ManagementCSR Impact Measurement & Management
CSR Impact Measurement & Management
 
Evaluation of SME and entreprenuership programme - Jonathan Potter & Stuart T...
Evaluation of SME and entreprenuership programme - Jonathan Potter & Stuart T...Evaluation of SME and entreprenuership programme - Jonathan Potter & Stuart T...
Evaluation of SME and entreprenuership programme - Jonathan Potter & Stuart T...
 
Importance of M&E
Importance of M&EImportance of M&E
Importance of M&E
 
DEFINING THE MARKETING RESEARCH PROBLEM AND DEVELOPING AN APPROACH
DEFINING THE MARKETING RESEARCH PROBLEM AND DEVELOPING AN APPROACHDEFINING THE MARKETING RESEARCH PROBLEM AND DEVELOPING AN APPROACH
DEFINING THE MARKETING RESEARCH PROBLEM AND DEVELOPING AN APPROACH
 
Analytics-Webinar-FINAL
Analytics-Webinar-FINALAnalytics-Webinar-FINAL
Analytics-Webinar-FINAL
 
How to Assess and Continuously Improve Maturity of Health Information Systems...
How to Assess and Continuously Improve Maturity of Health Information Systems...How to Assess and Continuously Improve Maturity of Health Information Systems...
How to Assess and Continuously Improve Maturity of Health Information Systems...
 
Consumer Behavior Chap5
Consumer Behavior  Chap5Consumer Behavior  Chap5
Consumer Behavior Chap5
 
evaluation
evaluationevaluation
evaluation
 
Public policy and program implementation
Public policy and program implementationPublic policy and program implementation
Public policy and program implementation
 

More from pasicUganda

Flexible Evaluation
Flexible EvaluationFlexible Evaluation
Flexible Evaluation
pasicUganda
 
Policy instruments in practice.
Policy instruments in practice.Policy instruments in practice.
Policy instruments in practice.
pasicUganda
 
Introduction to policy_making_process
Introduction to policy_making_processIntroduction to policy_making_process
Introduction to policy_making_process
pasicUganda
 
Assigning responsibilities to agencies
Assigning responsibilities to  agenciesAssigning responsibilities to  agencies
Assigning responsibilities to agencies
pasicUganda
 
Art of negotiation_2
Art of negotiation_2Art of negotiation_2
Art of negotiation_2
pasicUganda
 
Art of negotiations 1
Art of negotiations 1Art of negotiations 1
Art of negotiations 1
pasicUganda
 
Rethinking policy kenya
Rethinking policy kenya Rethinking policy kenya
Rethinking policy kenya
pasicUganda
 
Public private partnerships
Public private partnershipsPublic private partnerships
Public private partnerships
pasicUganda
 
Monitoring and evaluation and the policy process
Monitoring and evaluation and the  policy process   Monitoring and evaluation and the  policy process
Monitoring and evaluation and the policy process
pasicUganda
 
Evidence based policy
Evidence based policy Evidence based policy
Evidence based policy
pasicUganda
 
Zip strategy-Mr. Edward Tanyima
Zip strategy-Mr. Edward TanyimaZip strategy-Mr. Edward Tanyima
Zip strategy-Mr. Edward Tanyima
pasicUganda
 
PASIC project -MAAIF Achievements by Simon peter Nsereko
PASIC project -MAAIF Achievements by Simon peter Nsereko PASIC project -MAAIF Achievements by Simon peter Nsereko
PASIC project -MAAIF Achievements by Simon peter Nsereko
pasicUganda
 
OVERVIEW OF THE PASIC PROJECT
OVERVIEW OF THE PASIC PROJECTOVERVIEW OF THE PASIC PROJECT
OVERVIEW OF THE PASIC PROJECT
pasicUganda
 
PASIC progress report -Pamela Pali.
PASIC  progress report -Pamela Pali.PASIC  progress report -Pamela Pali.
PASIC progress report -Pamela Pali.
pasicUganda
 

More from pasicUganda (14)

Flexible Evaluation
Flexible EvaluationFlexible Evaluation
Flexible Evaluation
 
Policy instruments in practice.
Policy instruments in practice.Policy instruments in practice.
Policy instruments in practice.
 
Introduction to policy_making_process
Introduction to policy_making_processIntroduction to policy_making_process
Introduction to policy_making_process
 
Assigning responsibilities to agencies
Assigning responsibilities to  agenciesAssigning responsibilities to  agencies
Assigning responsibilities to agencies
 
Art of negotiation_2
Art of negotiation_2Art of negotiation_2
Art of negotiation_2
 
Art of negotiations 1
Art of negotiations 1Art of negotiations 1
Art of negotiations 1
 
Rethinking policy kenya
Rethinking policy kenya Rethinking policy kenya
Rethinking policy kenya
 
Public private partnerships
Public private partnershipsPublic private partnerships
Public private partnerships
 
Monitoring and evaluation and the policy process
Monitoring and evaluation and the  policy process   Monitoring and evaluation and the  policy process
Monitoring and evaluation and the policy process
 
Evidence based policy
Evidence based policy Evidence based policy
Evidence based policy
 
Zip strategy-Mr. Edward Tanyima
Zip strategy-Mr. Edward TanyimaZip strategy-Mr. Edward Tanyima
Zip strategy-Mr. Edward Tanyima
 
PASIC project -MAAIF Achievements by Simon peter Nsereko
PASIC project -MAAIF Achievements by Simon peter Nsereko PASIC project -MAAIF Achievements by Simon peter Nsereko
PASIC project -MAAIF Achievements by Simon peter Nsereko
 
OVERVIEW OF THE PASIC PROJECT
OVERVIEW OF THE PASIC PROJECTOVERVIEW OF THE PASIC PROJECT
OVERVIEW OF THE PASIC PROJECT
 
PASIC progress report -Pamela Pali.
PASIC  progress report -Pamela Pali.PASIC  progress report -Pamela Pali.
PASIC progress report -Pamela Pali.
 

Recently uploaded

Government Stimulus Program for MSMEs
Government  Stimulus  Program  for MSMEsGovernment  Stimulus  Program  for MSMEs
Government Stimulus Program for MSMEs
Jo Balucanag - Bitonio
 
Aerocity @Call @Girls Whatsapp ❤ 9873777170 ❤ With High Profile Offer
Aerocity @Call @Girls Whatsapp ❤ 9873777170 ❤ With High Profile OfferAerocity @Call @Girls Whatsapp ❤ 9873777170 ❤ With High Profile Offer
Aerocity @Call @Girls Whatsapp ❤ 9873777170 ❤ With High Profile Offer
7804pale
 
In BLOEMFONTEIN ^%[+27633867063*Abortion Pills For Sale In BLOEMFONTEIN Mada...
In BLOEMFONTEIN  ^%[+27633867063*Abortion Pills For Sale In BLOEMFONTEIN Mada...In BLOEMFONTEIN  ^%[+27633867063*Abortion Pills For Sale In BLOEMFONTEIN Mada...
In BLOEMFONTEIN ^%[+27633867063*Abortion Pills For Sale In BLOEMFONTEIN Mada...
508tomato
 
@Call @Girls Indira Nagar Lucknow Lucknow phone 8630512678 You Are Serach A B...
@Call @Girls Indira Nagar Lucknow Lucknow phone 8630512678 You Are Serach A B...@Call @Girls Indira Nagar Lucknow Lucknow phone 8630512678 You Are Serach A B...
@Call @Girls Indira Nagar Lucknow Lucknow phone 8630512678 You Are Serach A B...
vishalbowli92
 
Alternative Ways to Provide Fuel Within the Department of Defense
Alternative Ways to Provide Fuel Within the Department of DefenseAlternative Ways to Provide Fuel Within the Department of Defense
Alternative Ways to Provide Fuel Within the Department of Defense
Congressional Budget Office
 
SDG Stocktake Georgia 2024 - SDGs Through the Eyes of Georgia's Business Sector
SDG Stocktake Georgia 2024 - SDGs Through the Eyes of Georgia's Business SectorSDG Stocktake Georgia 2024 - SDGs Through the Eyes of Georgia's Business Sector
SDG Stocktake Georgia 2024 - SDGs Through the Eyes of Georgia's Business Sector
UNGlobalCompactNetwo1
 
MPA 209 : PLAN FOR IMPLEMENTATION.pdf
MPA 209 :  PLAN  FOR  IMPLEMENTATION.pdfMPA 209 :  PLAN  FOR  IMPLEMENTATION.pdf
MPA 209 : PLAN FOR IMPLEMENTATION.pdf
Jo Balucanag - Bitonio
 
@Call @Girls Chennai Unlimited Fun With US
@Call @Girls Chennai Unlimited Fun With US@Call @Girls Chennai Unlimited Fun With US
@Call @Girls Chennai Unlimited Fun With US
Miss Khusi #V08
 
In Kempton Park ^%[+27633867063*Abortion Pills For Sale In Kempton Park MAPETLA
In Kempton Park  ^%[+27633867063*Abortion Pills For Sale In Kempton Park MAPETLAIn Kempton Park  ^%[+27633867063*Abortion Pills For Sale In Kempton Park MAPETLA
In Kempton Park ^%[+27633867063*Abortion Pills For Sale In Kempton Park MAPETLA
525nixie
 
MPA 210 : STRATEGIC QUALITY MANAGEMENT
MPA 210 : STRATEGIC  QUALITY  MANAGEMENTMPA 210 : STRATEGIC  QUALITY  MANAGEMENT
MPA 210 : STRATEGIC QUALITY MANAGEMENT
Jo Balucanag - Bitonio
 
In Oakmoor ^%[+27633867063*Abortion Pills For Sale In Oakmoor Mesina
In Oakmoor  ^%[+27633867063*Abortion Pills For Sale In Oakmoor MesinaIn Oakmoor  ^%[+27633867063*Abortion Pills For Sale In Oakmoor Mesina
In Oakmoor ^%[+27633867063*Abortion Pills For Sale In Oakmoor Mesina
magentamoselle
 
Winter Springs Florida FY2025 Proposed Budget Report
Winter Springs Florida FY2025 Proposed Budget ReportWinter Springs Florida FY2025 Proposed Budget Report
Winter Springs Florida FY2025 Proposed Budget Report
VictoriaColangelo
 
@Call @Girls Lower Parel phone 9920874524 You Are Serach A Beautyfull Dolle c...
@Call @Girls Lower Parel phone 9920874524 You Are Serach A Beautyfull Dolle c...@Call @Girls Lower Parel phone 9920874524 You Are Serach A Beautyfull Dolle c...
@Call @Girls Lower Parel phone 9920874524 You Are Serach A Beautyfull Dolle c...
RACHANA GUPTA
 
In Johannesburg ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
In Johannesburg  ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...In Johannesburg  ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
In Johannesburg ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
ivory3872
 
Lucknow ₹Call ₹Girls (Aishbagh Road ) Spend quality Time With Us Pari Singh 0...
Lucknow ₹Call ₹Girls (Aishbagh Road ) Spend quality Time With Us Pari Singh 0...Lucknow ₹Call ₹Girls (Aishbagh Road ) Spend quality Time With Us Pari Singh 0...
Lucknow ₹Call ₹Girls (Aishbagh Road ) Spend quality Time With Us Pari Singh 0...
sapna singh
 
20240619_Toasters Toasters Toasters_Pdf.pdf
20240619_Toasters Toasters Toasters_Pdf.pdf20240619_Toasters Toasters Toasters_Pdf.pdf
20240619_Toasters Toasters Toasters_Pdf.pdf
Madhura TBRC
 
Medicare’s Coverage of Telehealth: Considerations From the Congressional Budg...
Medicare’s Coverage of Telehealth: Considerations From the Congressional Budg...Medicare’s Coverage of Telehealth: Considerations From the Congressional Budg...
Medicare’s Coverage of Telehealth: Considerations From the Congressional Budg...
Congressional Budget Office
 
Political polarization: threat to international cooperation.
Political polarization:  threat to international cooperation.Political polarization:  threat to international cooperation.
Political polarization: threat to international cooperation.
aimantahira
 
INDUSTRY 5.0 STRATEGIC IMPLEMENTATION KEYNOTE
INDUSTRY 5.0 STRATEGIC IMPLEMENTATION KEYNOTEINDUSTRY 5.0 STRATEGIC IMPLEMENTATION KEYNOTE
INDUSTRY 5.0 STRATEGIC IMPLEMENTATION KEYNOTE
Michael Rada
 
TRUE BOOK OF LIFE VERSION 18 FROM TRUE JESUS CHRIST!!
TRUE BOOK OF LIFE VERSION 18 FROM TRUE JESUS CHRIST!!TRUE BOOK OF LIFE VERSION 18 FROM TRUE JESUS CHRIST!!
TRUE BOOK OF LIFE VERSION 18 FROM TRUE JESUS CHRIST!!
Cheong Man Keong
 

Recently uploaded (20)

Government Stimulus Program for MSMEs
Government  Stimulus  Program  for MSMEsGovernment  Stimulus  Program  for MSMEs
Government Stimulus Program for MSMEs
 
Aerocity @Call @Girls Whatsapp ❤ 9873777170 ❤ With High Profile Offer
Aerocity @Call @Girls Whatsapp ❤ 9873777170 ❤ With High Profile OfferAerocity @Call @Girls Whatsapp ❤ 9873777170 ❤ With High Profile Offer
Aerocity @Call @Girls Whatsapp ❤ 9873777170 ❤ With High Profile Offer
 
In BLOEMFONTEIN ^%[+27633867063*Abortion Pills For Sale In BLOEMFONTEIN Mada...
In BLOEMFONTEIN  ^%[+27633867063*Abortion Pills For Sale In BLOEMFONTEIN Mada...In BLOEMFONTEIN  ^%[+27633867063*Abortion Pills For Sale In BLOEMFONTEIN Mada...
In BLOEMFONTEIN ^%[+27633867063*Abortion Pills For Sale In BLOEMFONTEIN Mada...
 
@Call @Girls Indira Nagar Lucknow Lucknow phone 8630512678 You Are Serach A B...
@Call @Girls Indira Nagar Lucknow Lucknow phone 8630512678 You Are Serach A B...@Call @Girls Indira Nagar Lucknow Lucknow phone 8630512678 You Are Serach A B...
@Call @Girls Indira Nagar Lucknow Lucknow phone 8630512678 You Are Serach A B...
 
Alternative Ways to Provide Fuel Within the Department of Defense
Alternative Ways to Provide Fuel Within the Department of DefenseAlternative Ways to Provide Fuel Within the Department of Defense
Alternative Ways to Provide Fuel Within the Department of Defense
 
SDG Stocktake Georgia 2024 - SDGs Through the Eyes of Georgia's Business Sector
SDG Stocktake Georgia 2024 - SDGs Through the Eyes of Georgia's Business SectorSDG Stocktake Georgia 2024 - SDGs Through the Eyes of Georgia's Business Sector
SDG Stocktake Georgia 2024 - SDGs Through the Eyes of Georgia's Business Sector
 
MPA 209 : PLAN FOR IMPLEMENTATION.pdf
MPA 209 :  PLAN  FOR  IMPLEMENTATION.pdfMPA 209 :  PLAN  FOR  IMPLEMENTATION.pdf
MPA 209 : PLAN FOR IMPLEMENTATION.pdf
 
@Call @Girls Chennai Unlimited Fun With US
@Call @Girls Chennai Unlimited Fun With US@Call @Girls Chennai Unlimited Fun With US
@Call @Girls Chennai Unlimited Fun With US
 
In Kempton Park ^%[+27633867063*Abortion Pills For Sale In Kempton Park MAPETLA
In Kempton Park  ^%[+27633867063*Abortion Pills For Sale In Kempton Park MAPETLAIn Kempton Park  ^%[+27633867063*Abortion Pills For Sale In Kempton Park MAPETLA
In Kempton Park ^%[+27633867063*Abortion Pills For Sale In Kempton Park MAPETLA
 
MPA 210 : STRATEGIC QUALITY MANAGEMENT
MPA 210 : STRATEGIC  QUALITY  MANAGEMENTMPA 210 : STRATEGIC  QUALITY  MANAGEMENT
MPA 210 : STRATEGIC QUALITY MANAGEMENT
 
In Oakmoor ^%[+27633867063*Abortion Pills For Sale In Oakmoor Mesina
In Oakmoor  ^%[+27633867063*Abortion Pills For Sale In Oakmoor MesinaIn Oakmoor  ^%[+27633867063*Abortion Pills For Sale In Oakmoor Mesina
In Oakmoor ^%[+27633867063*Abortion Pills For Sale In Oakmoor Mesina
 
Winter Springs Florida FY2025 Proposed Budget Report
Winter Springs Florida FY2025 Proposed Budget ReportWinter Springs Florida FY2025 Proposed Budget Report
Winter Springs Florida FY2025 Proposed Budget Report
 
@Call @Girls Lower Parel phone 9920874524 You Are Serach A Beautyfull Dolle c...
@Call @Girls Lower Parel phone 9920874524 You Are Serach A Beautyfull Dolle c...@Call @Girls Lower Parel phone 9920874524 You Are Serach A Beautyfull Dolle c...
@Call @Girls Lower Parel phone 9920874524 You Are Serach A Beautyfull Dolle c...
 
In Johannesburg ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
In Johannesburg  ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...In Johannesburg  ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
In Johannesburg ^%[+27633867063*Abortion Pills For Sale In Johannesburg Hazy...
 
Lucknow ₹Call ₹Girls (Aishbagh Road ) Spend quality Time With Us Pari Singh 0...
Lucknow ₹Call ₹Girls (Aishbagh Road ) Spend quality Time With Us Pari Singh 0...Lucknow ₹Call ₹Girls (Aishbagh Road ) Spend quality Time With Us Pari Singh 0...
Lucknow ₹Call ₹Girls (Aishbagh Road ) Spend quality Time With Us Pari Singh 0...
 
20240619_Toasters Toasters Toasters_Pdf.pdf
20240619_Toasters Toasters Toasters_Pdf.pdf20240619_Toasters Toasters Toasters_Pdf.pdf
20240619_Toasters Toasters Toasters_Pdf.pdf
 
Medicare’s Coverage of Telehealth: Considerations From the Congressional Budg...
Medicare’s Coverage of Telehealth: Considerations From the Congressional Budg...Medicare’s Coverage of Telehealth: Considerations From the Congressional Budg...
Medicare’s Coverage of Telehealth: Considerations From the Congressional Budg...
 
Political polarization: threat to international cooperation.
Political polarization:  threat to international cooperation.Political polarization:  threat to international cooperation.
Political polarization: threat to international cooperation.
 
INDUSTRY 5.0 STRATEGIC IMPLEMENTATION KEYNOTE
INDUSTRY 5.0 STRATEGIC IMPLEMENTATION KEYNOTEINDUSTRY 5.0 STRATEGIC IMPLEMENTATION KEYNOTE
INDUSTRY 5.0 STRATEGIC IMPLEMENTATION KEYNOTE
 
TRUE BOOK OF LIFE VERSION 18 FROM TRUE JESUS CHRIST!!
TRUE BOOK OF LIFE VERSION 18 FROM TRUE JESUS CHRIST!!TRUE BOOK OF LIFE VERSION 18 FROM TRUE JESUS CHRIST!!
TRUE BOOK OF LIFE VERSION 18 FROM TRUE JESUS CHRIST!!
 

Introduction to Policy Evaluation

  • 1. Professional Certificate in Policy Implementation and Evaluation Ian “Ren” Rennie
  • 3. • Who Evaluates? • Elites: – Government Agencies, Think Tanks, National or International Audit institutions, Regulators • Interest Groups: – Trade Associations, Business groups, Pressure groups, Media • Citizens: – Complaints, Whistle Blower laws, Public Opinion, Voting • Of course, some agencies may be shielded from evaluations, some may have repeated evaluations thrust upon them. Politics of public policy evaluation
  • 4. • Determine policy outcomes • Identify policy strengths • Identify and improve weaknesses • Justify use of resources • Increased emphasis on accountability • Professional responsibility to show effectiveness. Why evaluate?
  • 5. • Outcome • Implementation • Formative • Summative. Types of evaluation
  • 6. • Summary process. Evaluation Identify scope and stakeholders Analysis Information gathering Identify sources of information Team Selection Compare with: business strategy business case Use the information for more effective business operations
  • 7. • Why are you doing the evaluation? – mandatory? – policy outcomes? – policy improvement? • What is the scope? How large will the effort be? – large/small – broad/narrow • How complex is the proposed evaluation? – many variables, many questions? • What can you realistically accomplish? Scope of evaluation
  • 8. • There are a number of common challenges that may be encountered • the evaluation team need to be aware of these • although they may not be able to solve them. Common challenges
  • 9. • more than one organisation involved, no common standard for measuring and recording benefits and costs • lack of documentation • inadequacy of baseline measures - measures of success can only be made accurately by comparing the level of performance before implementation • sensitivities – examining performance may lead to feelings of insecurity or grievance for those involved • the organisation is too busy and it never gets it done (there should be policies to ensure that it is normal practice) • lack of cooperation by involved agencies. Challenges:
  • 10. • There is one most important question • What is it that you want to know about your policy? • Once you have defined this make it measurable • Do not move forward if you cannot answer this question! Ensuring effective and efficient monitoring
  • 11. • What is the purpose? • What should we measure to ensure that the policy: • is producing the required products • is being carried out to schedule and in accordance with its resource and cost plans • remains viable against its business case • Monitoring activities facilitate the checking and reporting on progress against the plan • Control activities promote revisions to be made to the plan in response to issues discovered during monitoring. Monitoring ... for control
  • 12. • To benchmark is to compare performance against a standard • To improve the effectiveness of monitoring and evaluation (M&E) in the policy cycle, benchmarking can be useful in three ways 1. can help place an outcome in context - was the achievement good, bad, or indifferent? 2. can help assess the reasonableness of targets that may be set 3. can help identify specific regions or subgroups whose exceptionally good or poor results hint at what factors drive performance. International comparisons and benchmarking
  • 13. • Today, there is much online availability of large internationally comparable data sets (such as those in the World Bank’s Data Development Platform) • Plus widely available national survey data • It is now considerably easier to use international data for benchmarking exercises. Benchmark with what?
  • 16. • Give an example of a performance indicator for your area of responsibility ... Exercise
  • 17. • Consider these assumptions: • Indicators will provide clear answers to questions about policy efficiency and effectiveness • Indicators will help explain how decisions and decision outcomes are linked • Having the right indicators will result in better decisions. Performance indicators
  • 18. • Political use – indicators used to support a predetermined position • Symbolic use – ritualistic assurance about appropriate attitudes towards decision-making (“we even developed indicators”) • Tactical use – indicators and the process used as a delaying tactic or substitute for action (“we will do it later once we have indicators”) • Conceptual use for enlightenment – change the understanding of an issue • Instrumental – direct relationship between indicators and decision outcomes. Possible motives
  • 19. • Indicators play an important role in the policy cycle and can serve a useful purpose • They can – Help assimilate and better understand stakeholder views – Add to the process of governance – Help guide and mould policy decisions • Indicators are linked to the governance process ... • “which can act like a magic bullet causing decision- making to become instantly objective and scientific”. Indicators in the Policy Cycle
  • 20. • Saliency – will anyone care? • Legitimacy – can people trust it? • Credibility – can people believe it? • Usability – can people understand it? Observing agency outputs
  • 21. Standards for an M&E Plan • Utility – serve practical information needs of intended users • Feasibility – be realistic, prudent, diplomatic and frugal • Propriety – conducted legally, ethically, and with regard to those involved in and affected by the evaluation • Accuracy – reveal and convey technically accurate information.
  • 22. Factors to Consider When Setting Targets • What can realistically be achieved given the resources and the program context? – Baseline levels – Past trends – Needs and gaps in services – Capacity and logistics – International benchmarking.
  • 23. Approaches to Setting Targets • Establish final target then plan progress in between • Establish intermediate targets • Assess progress in attaining targets and readjust, if necessary.
  • 24. • Past trends • Expert opinion • Research findings • What has been accomplished elsewhere • Client expectations. Useful Information for Setting Targets
  • 25. • Advocate for the need for M&E • Understand program goals and objectives • Identify user needs and perspectives • Learn about existing data collection systems & their quality • Understand indicators that are being collected and used (or not used) • Determine capacity for collecting and using data. Stakeholder Consultation
  • 26. • Developing M&E framework • Selecting indicators • Setting targets • Reviewing results • Requires building consensus & commitment and maintaining effective relationships with intended users. Stakeholder Participation
  • 27. DEVELOP A DATA COLLECTION MATRIX FOR YOUR PROGRAM. CONSIDER THE FOLLOWING ISSUES: • Who will be responsible for data collection and its supervision? • Who will be responsible for ensuring data quality at each stage? • How will data quality be checked at every stage? • How often will the data be collected, compiled, sent, and analyzed? • What indicators will be derived from each data source? • How will the data be sent (raw, summary)? • What tools/forms will be used, if any? • What resources (staff, office supplies, computers, transportation) will be needed at each stage? • Who will analyse the data? How often will analysis occur? • How often will the results be compiled into reports? • To whom and how often will the results be disseminated? Data Collection Plan
  • 28. Developing & Implementing an M&E Plan: Logic Model Inputs •Human resources •Understanding of the program •Authority and mandate •Stakeholders Processes •Advocate •Assess strategic information needs •Assess information systems capabilities •Achieve consensus and commitment •Develop mechanism for M&E plan review •Prepare document for final approval Outcomes Output •M&E Plan Document Short-term •M&E System for obtaining Strategic Information decision making Long-term •Evidence-based decisions for improving programs Impacts •Policy delivery
  • 29. • Start early • Involve stakeholders at all stages in the process • Assess strategic information needs for intended users • Assess current capacity and use what is already available • Avoid duplication of data collection and reporting • Do not collect information that will not be used • Review progress / results regularly and make adjustments to M&E plan, if necessary. Summary: The Basics
  • 30. DIRECT VS INDIRECT POLICY IMPACTS
  • 32. • Case study 1 – Continuously troublesome students are excluded from school to prevent disturbance of well behaved students • Case study 2 – in 18th- and 19th-century northern Europe, there was a “window tax” – a property tax whose amount depended upon the number of windows in a house – an explicit “income tax” was politically unpopular, so the intention was to create an income tax without explicitly taxing on the basis of income. First order and second order impacts
  • 33. • Unintended consequences arise because we live in an interconnected and complex world • Interconnectedness and complexity of the world imply that a small change in one part of a system can potentially generate far-reaching effects in another part of the system • Also policymakers may be unable to anticipate or understand how their policies affect the incentives of individuals within the system. Complex systems
  • 34. • public policy attempts to address social problems, often without understanding the policy’s effects on individuals’ incentives • systematic consideration of a policy’s intended and unintended effects is imperative • just because a policy could theoretically affect individuals’ incentives doesn’t mean that the policy actually will • the extent to which individuals respond to incentives is an empirical question, which requires an empirical answer. Empirical answers
  • 36. • The good evaluation of a project or a policy needs on the one hand thorough application of methodology up to the highest professional standards ... • and is on the other hand a creative thought exercise: what do we really want to know and how to find out. Evaluation methodology
  • 37. • If policies are meant to improve on outcomes, they should not be based on ideology or wishful thinking, but rather on proven effectiveness • But obtaining convincing evidence on the effects on specific policies is not an easy task • Relevant data on possible outcomes has to be gathered • Showing a mere correlation between a specific policy or practice and potential outcomes is not proof that the policy or practice caused the outcome • For policy purposes, mere correlations are irrelevant, and only causation is important • What would really happen if a specific policy is introduced – would it really change any outcome that society cares about? • Evidence-based policy require answers to causal questions. Overview
  • 38. • The need for evidence-based policy is increasingly recognised (e.g., Commission of the European Communities 2007) • Providing empirical evidence suitable for guiding policy is not an easy task • It refers to causal inferences that require special research methods • Not always easy to communicate due to technical complexity • Econometrics is a set of quantitative techniques that are useful for making "economic decisions“ • Of course, economic decisions are not restricted to those made by economists ... Econometrics
  • 39. • The decision of a student to stay an extra year at university to earn a double degree • The decision of a spice seller to open a shop in this village, or another • The decision of a bank to approve a loan application • The decision of a power company to start-up an extra generator on a certain day • The decision of a Government to introduce a purchase tax in order to reduce income taxes. Examples:
  • 40. • The "efficient allocation of resources" is the subject matter of economics • The traditional role of econometricians is to "test" alternative economic theories • To confront theories with real data and to reject those that are not compatible with reality • It is what transformed economics from an "art" into a "science“ • However, it only gave the econometrician an indirect role as an economist's sidekick • If economists didn't come up with new theories, econometricians didn't have anything to do! What is old?
  • 41. • Regardless of what economists do, economic problems persist in reality and decisions have to be made • The modern role of an econometrician is therefore more direct • Econometricians extract information from the available data in order to provide support for an economic decision • The raw material that the econometrician uses is more often real observed data, instead of economic theory • In any specific problem if an economic theory that has been validated by data exists, it will certainly be used • If no such model exists, however, econometrics must still make a statistical model for the data, and provide intelligent support for the decision process. What is new?
  • 42. • In government decision-making there are always competing priorities for funds • The purpose of a CBA is to allow competing policy priorities to be compared in a consistent way, and for their economic, social and environmental impacts to be assessed • In all areas of policy, the function of the CBA is to assist policymakers to identify the best way to deliver the strategic objectives of governments • And then to assist with the evaluation of the policy. Cost Benefit Analysis (CBA)
  • 43. 1. needs to be future looking 2. needs to be objective 3. needs to consider implementation risks 4. to be easily understood so it can be subject to a degree of contestability. What does a good CBA look like?
  • 44. 1. establishing the base case – or the ‘no change’ policy option 2. defining the policy options to be evaluated and compared against the base case and against each other 3. laying out the estimates and assumptions for external factors affecting the policy outcomes 4. defining and estimating the costs of a policy proposal 5. defining and estimating the benefits of a policy proposal 6. drawing a conclusion. Key steps in a CBA
  • 45. • An initial question ‘what would happen if this investment did not take place?’ • allows the CBA to compare two futures: the future with the investment and that without the investment • The base case does not mean ‘how things have been in the past’ and should include any observed long term trends • In particular, the base case needs to account for future population and economic growth • All forecasts contain an element of uncertainty • In order to address this uncertainty, forecasters need to develop different forecast scenarios (usually low, mid-range and high scenarios). 1. Establishing the base case
  • 46. • The purpose of any investment proposal is to achieve an outcome that improves the wellbeing of the community • In many instances there are multiple approaches that could achieve the outcome • Similar to the base case, the policy options in a CBA should be clearly articulated and reasonable • It is also important to consider whether there are any policy options that may have been overlooked and not included in the CBA • A well thought-out CBA includes all the feasible options and provides justification where options have not been covered • Avoid “Goldilocks” analysis. 2. Defining the policy options
  • 47. • Analysis will be built up from a range of estimates and assumptions • Estimates are variables where there is existing evidence, preferably from multiple sources • Assumptions are variables where there is less robust data and the team developing the CBA has had to use judgement • Estimates are clearly preferable to assumptions • A CBA, however, almost always includes assumptions because not all of the information needed to perform the analysis is available • Just because it is necessary to make some assumptions to conduct a CBA does not mean it is not worth doing as all analysis involves assumption about the future • One strength of CBA is that it makes it clear what the key assumptions are and allows for the systematic testing of assumptions. 3. Estimates and assumptions
  • 48. • What assumptions need to be made to conduct the analysis? • consider the impacts of a proposal across all sectors of the economy by thinking about the inter-relationships between sectors (economists term this ‘general equilibrium analysis’) • include all intangible costs and benefits where they can be reliably estimated • include all subsequent or contingent costs/investments • analyse over the economic life of the underlying proposal or assets, subject to a maximum of 20 years. 3. Estimates and assumptions
  • 49. • Takes into account all the impacts of the policy options that produce undesirable impacts • A useful way of looking at costs is to identify which individuals or groups in the community are worse-off as a result i.e. – Government – Business – The community • The full range of costs in a CBA should be identified, even those that may be difficult to measure - understating or overlooking a cost that is difficult or impossible to quantify is a common fault with CBAs • Everything is relative to the base case – that is, the costs that are additional to the base case. 4. Costs
  • 50. • Helpful to ask, ‘who is made better off as a result of the investment?’ i.e. – Government: time or money saved through more efficient programs or processes – Businesses: reduction in time or cost, particularly with respect to administration, or improvements in efficiency, productivity and innovation – The community: increase in welfare, safety, participation and/or connectivity • Many CBAs will also look at benefits according to the ‘triple-bottom-line’ which covers the positive economic, environmental and social outcomes of the investment • While there is nothing wrong with classifying benefits under these headings, it is crucial to avoid double-counting • Like the cost side of the CBA, it is important to identify all the benefits related to the policy options and measure them relative to the base case. 5. Benefits
  • 51. • Finally calculate the value of each policy option taking into account all future discounted benefits and all future discounted costs • The final overall value is usually expressed in one of three ways: – Net present value or Internal rate of return or Benefit-cost ratio • In a CBA some options may be easier to value than others • Although CBA places an emphasis on quantifying in financial terms the impacts of potential options, the CBA should not be biased towards an option just because it is easy to value • This does not necessarily make it the best approach • However, where difficult-to-value impacts are included, document carefully and transparently the manner in which that has been done. 6. Drawing a conclusion
  • 52. • An important and often overlooked step, and purpose is to: – Identify whether the expected benefits of the project have been realised – Assess whether any aspects of the current project require remedy – What lessons can be learned from the project for future investment projects. Post implementation
  • 53. • Quantitative observations are made using scientific tools and measurements • The results can be measured or counted • Any other person trying to quantitatively assess the same situation should end up with the same results • An example of a quantitative evaluation would be "this year our government paid 4m citizens a pension totalling $4,000m at an average of $1000 per pensioner.“ Quantitative
  • 54. • More subjective than quantitative evaluation, qualitative observations are defined in science as any observation made using the five senses • Because people often reach different interpretations when using only their senses, qualitative evaluation becomes harder to reproduce with accuracy • Two individuals evaluating the same thing may end up with different or conflicting results • In research and business, qualitative evaluations may involve value judgments and emotional responses • An example of a qualitative evaluation is "our government provided a better pension arrangement last year than this year." Qualitative
  • 55. • Both evaluation methods have their benefits, though one is usually more appropriate than the other in any given situation • Quantitative evaluation can help remove human bias from a statistic, making it more of a reliable fact than any piece of information gathered qualitatively • Thus, accurate quantitative evaluations can be relied upon as truth • Qualitative evaluations may also entail truths, but these truths are harder to get at, and evaluators may not always agree • Still, qualitative information is invaluable precisely because it involves human interaction and interpretation • Many fields need this interpretation in order to decide how to move forward or to judge the value of past and future sources of data. Benefits
  • 56. • Individuals or groups are randomly assigned to either the policy intervention or non-intervention (control) group and the outcomes of interest are compared • There are many methods of randomisation from field experiments to randomised control trials • Random allocation design means that systematic differences between groups are unlikely and so any differences and changes in outcomes between the two groups can be confidently attributed to the policy intervention. Control groups
  • 58. • Increasing recognition that rigorous evaluation of public interventions should feature in the policy decision making process • Yet there is frequently a gap between the desire for information on the effectiveness of programs and an understanding of the potential and the limitations of evaluation tools • What questions can evaluations answer? • What administrative structures are required to implement them? • What are the political and social factors surrounding the acceptance of evaluations by target groups and the public? • How much do evaluations cost? • How long do they take to complete? Cost-implications of different methodologies
  • 59. • For international aid programmes it is suggested that the cost of an evaluation is between about 5 and 7 percent of the cost of the program being evaluated as a rule of thumb (W. K. Kellogg Foundation, 1998) • Other evidence suggests that there is very little correlation between the cost of an impact evaluation and the size of the program being evaluated. Evaluation costs
  • 60. • Objectives – the policy questions to be addressed determine how complex the study design must be and consequently how costly – simpler is usually better • Availability of representative socioeconomic data – if national data exists, alternative methods of selecting a comparison group can be considered which may be cheaper than the ideal random assignment design • Timeframe – evaluators frequently do not have the luxury of months or years for data collection – this lack of time necessitates more creative use of data and more complicated statistical techniques, potentially raising the overall price of evaluation. Cost factors
  • 62. • Conduct a gap analysis • Determine whether the project goals were achieved • Determine the satisfaction of stakeholders • Determine the project's costs and benefits • Identify areas of further development • Report findings and recommendations. Questions for post- implementation review
  • 63. • An equality impact assessment (EIA) is a tool that helps public authorities make sure their policies, and the ways they carry out their functions, do what they are intended to do and for everybody • Carrying out an EIA involves systematically assessing the likely (or actual) effects of policies on people in respect of disability, gender, including gender identity, and racial equality and, where you choose, wider equality areas • This includes looking for opportunities to promote equality that may have previously been missed or could be better used, as well as negative or adverse impacts that can be removed or mitigated, where possible. What is an Equality Impact Assessment
  • 64. • In many countries, if any negative or adverse impacts amount to unlawful discrimination, they must be removed • Typically there are four possible outcomes and more than one may apply to a single policy: – No major change – Adjust the policy – Continue the policy (justification) – Stop and remove the policy. Possible Outcomes
  • 65. • Statutory Equality Duties Guidance • Competition Assessment • Small Firms Impact Test • Greenhouse Gas Impact Assessment • Wider Environmental Impact Test • Health and Well-Being • Human Rights • Justice Impact Test • Rural Proofing • Sustainable Development Impact Test. Other impact tests include ...
  • 66. • http://webarchive.nationalarchives.gov.uk/2 0100503135839/http://www.ogc.gov.uk/doc uments/policy_to_delivery_A4_Guidance_P 1_(2)_(2).pdf • https://www.gov.uk/government/uploads/sy stem/uploads/attachment_data/file/220541 /green_book_complete.pdf • https://www.gov.uk/government/uploads/sy stem/uploads/attachment_data/file/220542 /magenta_book_combined.pdf • http://webarchive.nationalarchives.gov.uk/2 0130129110402/http://www.hm- treasury.gov.uk/d/orange_book.pdf • http://webarchive.nationalarchives.gov.uk/2 0130129110402/http://www.hm- treasury.gov.uk/d/riskmanagement_assessm ent_framework220709.pdf References