Intervals

Statistical Intervals
Chapter 7 Stat 4570/5570

Material from Devores book (Ed 8), and Cengage
Confidence Intervals
The CLT tells us that as the sample size n increases, the
sample mean X is close to normally distributed with
expected value and standard deviation
Standardizing X by first subtracting its expected value

and then dividing by its standard deviation yields the
standard normal variable
How big does our sample need to be if the underlying

population is normally distributed? 2
Basic Properties of Confidence Intervals
Because the area under the standard normal curve
between 1.96 and 1.96 is .95, we know:
This is equivalent to:
which can be interpreted as the probability that the interval
includes the true mean is 95%.

3
The interval
is thus called the 95% confidence interval for the mean.
This interval varies from sample to sample, as the

sample mean varies.
So the interval itself is a random interval.

4
The CI interval is centered at the sample mean X and
extends 1.96 to each side of X.
The intervals width is 2 (1.96) , which is not

random; only the location of the interval (its midpoint X) is
random.
5
For a given sample, the CI can be expressed either as
or as
A concise expression for the interval is x 1.96 ,

where gives the left endpoint (lower limit) and + gives the
right endpoint (upper limit).
6
Interpreting a Confidence Level
We started with an event (that the random interval captures
the true value of ) whose probability was .95
It is tempting to say that lies within this fixed interval with

probability 0.95.
is a constant (unfortunately unknown to us). It is

therefore incorrect to write the statement
P( lies in (a, b)) = 0.95
-- since either is in (a,b) or isnt.
Basically, is not random (its a constant), so it cant have

a probability associated with its behavior. 7
Instead, a correct interpretation of 95% confidence relies
on the long-run relative frequency interpretation of
probability.
To say that an event A has probability .95 is to say that if

the same experiment is performed over and over again, in
the long run A will occur 95% of the time.
So the right interpretation is to say that in repeated

sampling, 95% of the confidence intervals obtained from all
samples will actually contain . The other 5% of the
intervals will not.
8
Example: the vertical line cuts the measurement axis at the
true (but unknown) value of .
One hundred 95% CIs (asterisks identify intervals that do not include ).
9
According to this interpretation, the confidence level is not
a statement about any particular interval, eg (79.3, 80.7).
Instead it pertains to what would happen if a very large

number of like intervals were to be constructed using the
same CI formula.
10
Other Levels of Confidence
Probability of 1 is achieved by using z/2 in place of 1.96
P(z/2 Z < z/2) = 1
11
Other Levels of Confidence
A 100(1 )% confidence interval for the mean when
the value of is known is given by
or, equivalently, by
The formula for the CI can also be expressed in words as

Point estimate (z critical value) (standard error).
12
Example
A sample of 40 units is selected and diameter measured for
each one. The sample mean diameter is 5.426 mm, and the
standard deviation of measurements is 0.1mm.
Lets calculate a confidence interval for true average hole

diameter using a confidence level of 90%. What is the width
of the interval?
What about the 99% confidence interval?
What are the advantages and disadvantages to a wider

confidence interval?
13
Sample size computation
For each desired confidence level and interval width, we
can determine the necessary sample size.
Example: A response time is normally distributed with

standard deviation 25 milliseconds. A new system has
been installed, and we wish to estimate the true average
response time for the new environment.
Assuming that response times are still normally distributed

with = 25, what sample size is necessary to ensure that
the resulting 95% CI has a width of (at most) 10?
14
Unknown mean and variance
We now have:
- a CI for the mean of a normal distribution
- a large-sample CI for for any distribution
with a confidence level of 100(1 )% is:
A practical difficulty is the value of , which will rarely be

known. Instead we work with the standardized variable
Where the sample standard deviation S has replaced .
15
Unknown mean and variance
Previously, there was randomness only in the numerator of
Z by virtue of , the estimator.
In the new standardized variable, both and S vary in

value from one sample to another.
Thus the distribution of this new variable should be wider

than the Normal to reflect the extra uncertainty. This is
indeed true when n is small.
However, for large n the subsititution of S for adds little

extra variability, so this variable also has approximately a
standard normal distribution.
16
A Large-Sample Interval for
Proposition
If n is sufficiently large, the standardized variable
has approximately a standard normal distribution. This

implies that
(7.8)
is a large-sample confidence interval for with
confidence level approximately 100(1 )%.
This formula is valid regardless of the population

distribution.
17
A Large-Sample Interval for
Generally speaking, n > 40 will be sufficient to justify the
use of this interval.
This is somewhat more conservative than the rule of thumb

for the CLT because of the additional variability introduced
by using S in place of .
18
Small sample intervals for the mean
The CLT cannot be invoked when n is small

Need to do something else when n<40
When n<40, we have to:
Make a specific assumption about the form of the
population distribution and
Derive a CI tailored to that assumption.
Example: Develop a CI for when the population is

described by a gamma distribution, another interval for the
case of a Weibull distribution, etc.
19
t Distributions
20
Intervals Based on a Normal Population Distribution
The result on which inferences are based introduces a new

family of probability distributions called t distributions.
When is the mean of a random sample of size n from a

normal distribution with mean , the rv
has a probability distribution called a t distribution with n 1

degrees of freedom (df).
21
Properties of t Distributions
Figure below illustrates some members of the t-family
22
Let t denote the t distribution with df.
1. Each t curve is bell-shaped and centered at 0.

2. Each t curve is more spread out than the standard
normal (z) curve.
3. As increases, the spread of the corresponding t curve
decreases.
4. As , the sequence of t curves approaches the
standard normal curve (so the z curve is the t curve with
df = ).
23
Let t, = the number on the measurement axis for which
the area under the t curve with df to the right of t, is ;
t, is called a t critical value.
For example, t.05,6 is the t critical value that captures an

upper-tail area of .05 under the t curve with 6 df
24
Tables of t Distributions
The probabilities of t curves are found in a similar way as
the normal curve.
Example: obtain t.05,15
25
The One-Sample t
Confidence Interval
26
The One-Sample t Confidence Interval
Let and s be the sample mean and sample standard

deviation computed from the results of a random sample
from a normal population with mean . Then a
100(1 )% confidence interval for is
or, more compactly
27
Example contd
A dataset on the modulus of material rupture (psi):
6807.99 7637.06 6663.28 6165.03 6991.41 6992.23

6981.46 7569.75 7437.88 6872.39 7663.18 6032.28
6906.04 6617.17 6984.12 7093.71 7659.50 7378.61
7295.54 6702.76 7440.17 8053.26 8284.75 7347.95
7422.69 7886.87 6316.67 7713.65 7503.33 7674.99
There are 30 observations.

The sample mean is 7203.191
The sample standard deviation is 543.5400.
28
Intervals Based on Nonnormal Population Distributions
The one-sample t CI for is robust to small or even

moderate departures from normality unless n is very small.
By this we mean that if a critical value for 95% confidence,

for example, is used in calculating the interval, the actual
confidence level will be reasonably close to the nominal 95%
level.
If, however, n is small and the population distribution is

non-normal, then the actual confidence level may be
considerably different from the one you think you are using
when you obtain a particular critical value from the t table.
29
A Confidence Interval for a
Population Proportion
30
A Confidence Interval for a Population Proportion
Let p denote the proportion of successes in a population.
A random sample of n individuals is to be selected, and X

is the number of successes in the sample.
X can be thought of as a sum of all Xis, where 1 is added
for every success that occurs and a 0 for every failure, so
X1 + . . . + Xn = X).
Thus, X can be regarded as a binomial rv with mean np

and
.
If both np 10 and n(1-p) 10, X has approximately a

normal distribution. 31
A Confidence Interval for a Population Proportion
The natural estimator of p is = X / n, fraction of successes.

Since is the sample mean, (X1 + . . . + Xn)/ n
has approximately a normal distribution. We know that,
E( ) = p (unbiasedness) and .
The standard deviation involves the unknown parameter

p. Standardizing by subtracting p and dividing by then
implies that
And the CI is
32
One-Sided Confidence Intervals
33
One-Sided Confidence Intervals (Confidence Bounds)
The confidence intervals discussed thus far give both a

lower confidence bound and an upper confidence bound for
the parameter being estimated.
In some circumstances, an investigator will want only one

of these two types of bounds.
For example, a psychologist may wish to calculate a 95%

upper confidence bound for true average reaction time to a
particular stimulus, or a reliability engineer may want only a
lower confidence bound for true average lifetime of
components of a certain type.
34
Because the cumulative area under the standard normal

curve to the left of 1.645 is .95,
Manipulating the inequality inside the parentheses to

isolate on one side and replacing rvs by calculated
values gives the inequality > 1.645s/
The expression on the right is the desired lower confidence

bound.
35
Starting with P(1.645 < Z) .95 and manipulating the

inequality results in the upper confidence bound. A similar
argument gives a one-sided bound associated with any
other confidence level.
Proposition
A large-sample upper confidence bound for is
and a large-sample lower confidence bound for is
36
Confidence Intervals for Variance
of a normal population
37
Confidence Intervals for the Variance of a Normal Population
Let X1, X2, , Xn be a random sample from a normal

distribution with parameters and 2. Then
has a chi-squared ( 2) probability distribution with n 1 df.
We know that the chi-squared distribution is a continuous

probability distribution with a single parameter v, called the
number of degrees of freedom, with possible values 1,
2, 3, . . . .
38
The graphs of several 2 probability density functions are
39
The chi-squared distribution is not symmetric, so tables

contain values of both for near 0 and 1
40
As a consequence
Or equivalently
Substituting the computed value s2 into the limits gives a CI

for 2
Taking square roots gives an interval for .
41
A 100(1 )% confidence interval for the variance 2 of

a normal population has lower limit
and upper limit
A confidence interval for has lower and upper limits that

are the square roots of the corresponding limits in the
interval for 2.
42
Example
The data on breakdown voltage of electrically stressed
circuits are:
breakdown voltage is
approximately normally
distributed.
43

Intervals

Uploaded by

Copyright:

Available Formats

Intervals

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Intervals

Uploaded by

Copyright:

Available Formats

Statistical Intervals

Chapter 7 Stat 4570/5570

Standardizing X by first subtracting its expected value

How big does our sample need to be if the underlying

This is equivalent to:

which can be interpreted as the probability that the interval

includes the true mean is 95%.

is thus called the 95% confidence interval for the mean.

This interval varies from sample to sample, as the

So the interval itself is a random interval.

The intervals width is 2 (1.96) , which is not

A concise expression for the interval is x 1.96 ,

It is tempting to say that lies within this fixed interval with

is a constant (unfortunately unknown to us). It is

-- since either is in (a,b) or isnt.

Basically, is not random (its a constant), so it cant have

To say that an event A has probability .95 is to say that if

So the right interpretation is to say that in repeated

Instead it pertains to what would happen if a very large

P(z/2 Z < z/2) = 1

The formula for the CI can also be expressed in words as

Lets calculate a confidence interval for true average hole

What about the 99% confidence interval?

What are the advantages and disadvantages to a wider

Example: A response time is normally distributed with

Assuming that response times are still normally distributed

A practical difficulty is the value of , which will rarely be

Where the sample standard deviation S has replaced .

In the new standardized variable, both and S vary in

Thus the distribution of this new variable should be wider

However, for large n the subsititution of S for adds little

has approximately a standard normal distribution. This

This formula is valid regardless of the population

This is somewhat more conservative than the rule of thumb

The CLT cannot be invoked when n is small

Example: Develop a CI for when the population is

The result on which inferences are based introduces a new

When is the mean of a random sample of size n from a

has a probability distribution called a t distribution with n 1

1. Each t curve is bell-shaped and centered at 0.

For example, t.05,6 is the t critical value that captures an

Example: obtain t.05,15

Let and s be the sample mean and sample standard

or, more compactly

A dataset on the modulus of material rupture (psi):

6807.99 7637.06 6663.28 6165.03 6991.41 6992.23

There are 30 observations.

The one-sample t CI for is robust to small or even

By this we mean that if a critical value for 95% confidence,

If, however, n is small and the population distribution is

Let p denote the proportion of successes in a population.

A random sample of n individuals is to be selected, and X

Thus, X can be regarded as a binomial rv with mean np

If both np 10 and n(1-p) 10, X has approximately a

The natural estimator of p is = X / n, fraction of successes.

The standard deviation involves the unknown parameter

The confidence intervals discussed thus far give both a

In some circumstances, an investigator will want only one