CBA EXAM

budsimpson
Chapter7.pdf

8/15/2017

1

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Chapter

Cost-Benefit Analysis Concepts and Practice

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

FOURTH EDITION

Dealing with

Uncertainty: Expected

Values and Sensitivity

Analysis

Seven

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Introduction

• CBA often requires us to predict the future.

• We are rarely able to make precise predictions about the

future.

• How can analysts reasonably take account of these

uncertainties in CBA?

8/15/2017

2

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

In this chapter we will consider:

 Expected value as a measure reflecting risks

 Sensitivity analysis as a way of investigating the

robustness of net benefit estimates to different

resolutions of uncertainty

Introduction

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected values take into account the dependence of

costs and benefits on the occurrence of specific

contingencies or “states of the world” to which analysts

are able to assign probabilities of occurrence.

Sensitivity analysis is a way of acknowledging

uncertainty about the values of important parameters

in our predictions – it should be a component of almost

any CBA.

Introduction

8/15/2017

3

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

In many situations, one might reasonably divide the future

into two contingencies: either it will or it will not rain

sufficiently to make the umbrella useful.

Other relevant contingencies can be imagined as well – it

will be a dry day. But if these additional contingencies are

very unlikely, it is often reasonable to leave them out of

one’s model in the future.

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Modeling the future as a set of relevant contingencies

involves yet another narrowing of uncertainty: How likely

are each of the contingencies?

In relative simple situations, risk can be readily

incorporated into CBA through expected value analysis.

8/15/2017

4

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Contingencies and Probabilities

Modeling uncertainty as risk begins with the specification of

a set of contingencies that, within the simplified model of

the world being employed, are exhaustive and mutually

exclusive.

Contingencies can be thought of as possible events,

outcomes, or states of the world such that one and only one

of the relevant set of probabilities will actually occur.

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Contingencies and Probabilities

Contingencies capture the full range of likely variation in net

benefits of the policy.

Contingencies represent the possible outcomes between

the extremes. Each contingency can be thought of as a

scenario, which is just a description of a possible future.

8/15/2017

5

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Contingencies and Probabilities

Figure 7-1 illustrates the representation of a continuous

scale with discrete contingencies

Horizontal axis – number of inches of summer rainfall in an

agricultural region

Vertical axis – the net benefits of a water storage system,

which increases as the amount of rainfall decreases

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Figure 7-1 Representativeness of Contingencies

8/15/2017

6

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Contingencies and Probabilities

Imagine that the analyst represents uncertainty about

rainfall with only two contingencies: excessive and deficient.

Excessive contingency – assumes 22 inches of rainfall,

which would yield zero net benefits from the storage system

Deficient contingency – assumes zero inches of rainfall,

which would yield $4.4 million in net benefits.

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Contingencies and Probabilities

If the relationship between rainfall and net benefits follows a

straight line labeled A, and all the rainfall amounts between

0 and 22 inches are equally likely, then the average of net

benefits over the full continuous range would be $2.2

million.

If the analyst assumed that each of the contingencies were

equally likely, then the average over the two contingencies

also be $2.2 million, so that using the two scenarios would

be adequately representative.

8/15/2017

7

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Contingencies and Probabilities

Now, imagine that the net benefits follow the curved line

labeled B. Again assume that all rainfall amounts between 0

and 22 inches are equally likely, the average of net benefits

over the full continuous range would only be $2.2 million, so

that using only two contingencies would grossly

overestimate net benefits from the storage system.

Adding “normal” as a contingency that assumes 11 inches

of rainfall and averaging net benefits over all three

contingencies yields net benefits of $0.6 million, which is

more representative than the average calculated with two

contingencies.

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Contingencies and Probabilities

Once a tractable but representative set of contingencies is

specified, the next task is to assign probabilities of

occurrence to each of them.

To be consistent and logical, that the contingencies are

exhaustive and mutually exclusive, the probabilities

assigned must each be nonnegative and sum to exactly 1.

Thus, if there are three contingencies, C1, C2, and C3,

assigned probabilities p1, p2, and p3 should sum up to 1,

such that p1+ p2 + p3 = 1

8/15/2017

8

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Contingencies and Probabilities

The probabilities may be based on historically observed

frequencies; on subjective assessments by clients,

analysts, or other experts based on a variety of information

and theory; or on both.

Example: The national weather service may be able to

provide data on average annual rainfall over the last century

that allows an analyst to estimate probabilities of the three

levels of precipitation (excessive, normal, deficient).

Analysts may have to base probabilities on expert opinion,

comparison with similar valleys in the region for which data

are available, or some other subjective assessment.

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Calculating Expected Value of Net Benefits

The specification of contingencies and their respective

probabilities allows us to calculate the expected net benefits

of a policy.

First, predicting the net benefits of the policy under each

contingency and then taking the weighted average of these

net benefits over all the contingencies, where the weights

are the respective probabilities that the contingencies occur.

8/15/2017

9

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Calculating Expected Value of Net Benefits

For n contingencies, let Bi be the benefits under

contingency i, Ci, be the costs under contingency i, and pi be the probability of contingency i occurring.

Then the expected net benefits, E[NB], are given by the

following formula:

E[NB] = p1(B1 – C1) + … + pn(Bn – Cn) (7.1)

which is the expected value of net benefits over the n

possible outcomes.

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Calculating Expected Value of Net Benefits

Table 7.1 shows the analysis of alternatives for planetary

defense against asteroid collisions.

The table shows hypothetical figures.

The three actions (alternatives) are shown.

The payoffs shown as present values of net costs over the

next century, range from $30 trillion (Earth is exposed to a

collision with an asteroid larger than one kilometer in

diameter in the absence of any asteroid defense) to $0

(Earth is not exposed to any collision with an asteroid larger

than 20 meters and no defense system is built)

8/15/2017

10

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Calculating Expected Value of Net Benefits

The last column of Table 7-1 shows expected values for each of

the three alternatives.

For example, the expected value of payoffs (present value of net

costs) for no asteroid defense is:

(0.001) ($30,000 billion) + (0.004) ($6,000 billion) + (0.995) (0) =

$54 billion

Similar calculations yield $69 billion and $38 billions for the other

two alternatives.

8/15/2017

11

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Calculating Expected Value of Net Benefits

As the maximization of expected benefits is equivalent to

minimizing expected net costs, the most efficient alternative is

near-Earth asteroid defense.

Treating expected values as if they were certain amounts implies

that the person making the comparison has preferences that are

risk neutral. That is, when he or she is indifferent between certain

amounts and lotteries with the same expected payoff.

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Expected Value Analysis

Calculating Expected Value of Net Benefits

In practice, treating expected values and certain amounts as commensurate (risk

neutral) is generally reasonable when either the pooling of risk over the collection

of policies, or the pooling of risk over the collection of persons affected by a

policy, will make the actually realized values of costs and benefits close to their

expected values.

For example, a policy that affects the probability of highway accidents involves

reasonable pooling of risk across many drivers (some will have accidents, others

will not) so that realized values will be close to expected values.

In contrast, a policy that affects the risk of asteroid collision does not involve

pooling across individuals (either everyone suffers from the global harm if there is

a collision or no one does if there is no collision), so that the realized value of

costs may be very far from their expected value.

Such unpooled risk may require an adjustment to expected benefits.

8/15/2017

12

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

• The purpose of sensitivity analysis is to acknowledge

uncertainty.

• It should convey how sensitive predicted net benefits are to

changes in assumptions.

• If the sign of net benefits does not change when we consider

the range of reasonable assumptions, then our results are

robust, and we can have greater confidence in them.

Two Approaches for Sensitivity Analysis

1. Partial Sensitivity Analysis

2. Worst- and Best-Case Analysis

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

Two Approaches for Sensitivity Analysis

1. Partial Sensitivity Analysis

How do net benefits change as we vary a single assumption while

holding other variables constant?

It is most appropriately applied to what the analyst believes to be

the most important and uncertain assumptions.

It can be used to find the values of numerical assumptions at

which net benefits equal to zero, or just break-even.

8/15/2017

13

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

Two Approaches for Sensitivity Analysis

2. Worst- and Best-Case Analysis

Does any combination of reasonable assumptions reverse the

sign of net benefits?

Analysts are generally most concerned about situations in

which their most estimates yield positive net benefits, but they

want to know what would happen in a worst case involving the

least favorable, or most conservative assumptions.

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

8/15/2017

14

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

TABLE 7-2 (continued) Base-Case Values for Vaccination Program CBA

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

Partial Sensitivity Analysis

In partial sensitivity analysis, you select one variable, change its value

while holding other variables constant, and see how much the CBA

results in response.

In Figure 7-3, the probability of the epidemic in the current year, p1, varies

from 0 to 0.5 by increments of 0.05.

The results are displayed as the line labeled L = $3 million.

The equation of net benefits were embedded in a spreadsheet on a

computer, so it was easy to generate the points needed to draw this line

by simply changing the values of p1.

As expected, this line is upward sloping: the higher the probability of the

epidemic, the larger the net benefits of the program.

8/15/2017

15

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Figure 7-3 Expected Net Benefits of Vaccination

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

Partial Sensitivity Analysis

In Figure 7-3, note that for values of p1 less than about 0.11, net

benefits become negative. If the probability of the epidemic in the

current year is less than 0.11, and we are willing to accept the other

base-case assumptions, then we should not implement the program.

The probability at which net benefits switch sign is called the

breakeven value.

Finding and reporting breakeven values for various parameters is

often a useful way to convey their importance.

8/15/2017

16

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

Worst- and Best-Case Analysis

Best-case and worst-case scenarios establish the upper (best-case) and

the lower (worst-case) boundaries of a cost-benefit study’s results.

It shows how a broad range of a program or policy’s possible outcomes

affect the bottom line.

To perform a best-case analysis, use all of the most favorable

assumptions about the program; for the worst-case scenario, use all the

least-favorable assumptions.

To project best and worst outcomes that are plausible, look at existing

research on similar programs. Keep in mind that best- and worst-case

scenarios are extreme cases; the odds of them happening are low.

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

Other Forms of Sensitivity Analysis

1. Discount rate

2. Wage rates used

3. The value of life, or risks associated with certain occupations

The researcher must determine how changes in these measures affect the

outcome of the CBA. A researcher may wish to perform additional sensitivity

analysis in any of these cases, especially if the result of the CBA is close to zero

(using NPV), or the benefit-cost ratio is close to one. Moreover, if certain

measures used are contentious sensitivity analysis may be required. Or if a

particular cost or benefit that accounts for a large proportion of the overall costs

or benefits associated with a project is calculated using a measure which is

subject to some sort of arbitrary value.

8/15/2017

17

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

Example: Testing Sensitivity by Varying the Discount Rate

Consider a construction project with initial costs of $1.5 million. Benefits arising

from this project are $100,000 at the end of year 1, $200,000 at the end of year 2,

$500,000 at the end of year 3, and $1 million at the end of year 4.

With a discount rate of 5% the NPV of the project is as follows:

$95,238.10 + $181,405.90 + $431,918.8 + $822,702.47

PV (B) = $1,531,265.30

NPV = $1,531,265.30 - $1.5 million

NPV = $31,265.30

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

Example: Testing Sensitivity by Varying the Discount Rate

With a discount rate of 10% however the NPV of the project is as follows:

$90,909.09 + $165,289.26 + $375,657.40 + $683,013.46

PV (B) = $1,314,869.20

NPV = $1,314,869.20 - $1.5 million

NPV = -$185,130.79

In this example, with a discount rate of 5% similarly there is justification for the

project to go ahead. However, with a higher discount rate of 10% the costs

outweigh the discounted benefits by almost $200,000, suggesting the project

should not go ahead. In this case the choice of discount rate could have a

significant impact on the viability of the construction project.

8/15/2017

18

Copyright ©2011 by Pearson Education, Inc.

Upper Saddle River, New Jersey 07458

All rights reserved.

Cost-Benefit Analysis: Concepts and Practice, Fourth Edition

Boardman • Greenberg • Vining • Weimer

Sensitivity Analysis

Example: Testing Sensitivity by Varying the Discount Rate

Partial Sensitivity Analysis

Plotting the various outcomes for different discount rates can allow a

researcher to arrive at the break even discount rate. This is the rate at which

the NPV is equal to zero.