lesson6.pdf

ECO 321 Intermediate Business Statistics

Lesson 6 Sampling Distributions

And Confidence Interval Estimation

Lesson Topics

Estimation Process Point Estimates Interval Estimates

Sampling Distribution of the Mean

Properties of as an Estimate for Confidence Interval Estimation for the Mean ( Known)

X μ

σ

Lesson Topics

Confidence Interval Estimation for the Mean ( Unknown) Confidence Interval Estimation for the Proportion Determining Sample Size Confidence Interval Estimation and Ethical Issues

σ

(continued)

Population and Sample

Population Sample

Use parameters to summarize features

Use statistics to summarize features

Inference on the population from the sample

Estimation Process

Mean, μ, is unknown

Population Random Sample I conjecture

that the population

mean, μ, is 50

Sample

50X =

Point Estimates

Estimate Population Parameters …

with Sample Statistics

Mean

Proportion

Variance

Difference

μ π

1 2μ μ−

X p

2S

1 2X X−

Another Point Estimate

Here is a link to some of the most recent poll results

Drawback of Point Estimates

Q. What is the probability that a point estimate will equal to the true parameter that is being estimated? A. Zero. Theoretically, you will never obtain a point estimate that equals the unknown parameter.

Interval Estimation Process

Mean, μ, is unknown

Population Random Sample I am 95% confident that μ is between 40 &

60.

Sample

50X =

Interval Estimates

Provides Range of Values Take into consideration variation in sample statistics from sample to sample Based on observation from 1 sample Give Information about Closeness to Unknown Population Parameters Stated in terms of level of confidence

Never 100% sure

Why Study Sampling Distributions

Sample Statistics are Used to Estimate Population Parameters

E.g. estimates the population mean

Problems: Different Sample Provides Different Estimate

Large sample gives better estimate; large sample costs more How good is the estimate?

Approach to Solution: Theoretical Basis is Sampling Distribution

50X = Xμ

Sampling Distribution

Theoretical Probability Distribution of a Sample Statistic Sample Statistic is a Random Variable

Sample mean, sample proportion

Results from Taking All Possible Samples of the Same Size

When the Population is Normal

Central Tendency

Variation (Standard Error)

Sampling with Replacement

Population Distribution

Sampling Distributions

XXμ μ=

X X n

σ σ =

X16Xμ =

5 2.236X

n σ = =

25 1X

n σ = =

16Xμ =

5Xσ =

When the Population is Not Normal

Central Tendency

Sampling with Replacement

Population Distribution

Sampling Distributions

Xμ μ=

X n σ

σ =

X8.08Xμ =

5 2.782X

n σ = =

25 1.244X

n σ = =

8.08Xμ =

6.22Xσ =

Variation (Standard Error)

Central Limit Theorem

As Sample Size Gets Large Enough

Sampling Distribution Becomes Almost Normal Regardless of Shape of Population

X

Applet to Illustrate the CLT

Click here to access the applet that will illustrate the Central Limit Theorem in action.

How Large is Large Enough?

For Most Distributions, n>30

For Fairly Symmetric Distributions, n>15

For Normal Distribution, the Sampling Distribution of the Mean is Always Normally Distributed

This is a property of sampling from a normal population distribution and is NOT a result of the central limit theorem

The average of all possible estimates of equals

Unbiased Property of ( )

BiasedUnbiased

XμXμ X

XXμ μ= X

( )P X

Effect of Large Sample (Consistency )

Larger sample sizeSmaller

sample size

XXμ

For Sampling with Replacement: As n increases, decreasesXσ

X X n

σ σ =

( )P X

As the sample size increases, the variation of the estimator around the true parameter resulting from taking repeated samples decreases

Less Variability (Efficiency)

Sampling Distribution of Median Sampling

Distribution of Mean

Xμ X

Standard Error (Standard Deviation) of the Sampling Distribution of the sample mean is Less than the Standard Error of Other Unbiased Estimators

( )P X

The sample mean has the smallest variation than any other unbiased estimators in repeated sampling

Confidence Interval Estimates

Mean

σ Unknown

Confidence Intervals

Proportion

σ Known

Confidence Interval for ( Known)

Assumptions Population standard deviation is known Population is normally distributed If population is not normal, need large sample

Confidence Interval Estimate

is called the sampling error or

margin of error

μ σ

/ 2 / 2X Z X Z n n

α α σ σ

μ− ≤ ≤ +

/ 2e Z n

α σ

=

Standard error

critical value

Obtaining Confidence Interval in PHStat

PHStat | Confidence Interval | Estimates for the Mean, sigma known See PHStat Animation #15

Example

A random sample of 15 stocks traded on the NASDAQ market showed an average shares traded to be 215000. From past experience, it is believed that the population standard deviation of shares traded is 195000 and the shares traded are very closed to a normal distribution. Construct a 99% confidence interval for the average shares traded on the NASDAQ market. Interpret your result.

Confidence Interval Estimate for the Mean

Population Standard Deviation 195000 Sample Mean 215000 Sample Size 15 Confidence Level 99% Standard Error of the Mean 50348.7835 Z Value -2.57583451 Interval Half W idth 129690.1343 Interval Lower Limit 85309.86569 Interval Upper Limit 344690.1343

PHStat output

85309 344690μ< < The 99% CI for the population mean:

0

Sampling Distribution of the Mean

Interval and Level of Confidence

Confidence Intervals

Intervals extend from

to

of the intervals constructed contain ;

do not.

_

XX Zσ−

Xσ / 2α / 2α

X Xμ μ=

1 α−

XX Zσ+

( )1 100%α−

100 %α

/ 2 XZαμ σ+ / 2 XZαμ σ−

Z/ 2 . .u c Zα=/ 2. .l c Zα= −

μ

Applet to Illustrate the Confidence Interval

Click here to access the applet that will illustrate the Confidence Interval in action.

Example: Interpretation (continued)

If all possible samples of size 25 are taken and the corresponding 95% confidence intervals are constructed, 95% of the confidence intervals that are constructed will contain the true unknown population mean.

Using the confidence interval method on repeated sampling, the probability that we will have constructed a confidence interval that will have contained the unknown population mean is 95%.

Repeated Samples

Example: Interpretation (continued)

For this particular confidence interval [46.67, 53.50], the unknown population mean can either be in the interval or not in the interval. It is, therefore, incorrect to state that the probability is 95% that the unknown population mean will be in the interval [46.67, 53.50].

We are 95% confidence that the population average is between 46.67 and 53.50.

Single Sample

Assumptions Population standard deviation is unknown If population is normal, small sample can be used If population is not normal, use large sample

Use Student’s t Distribution Confidence Interval Estimate

Confidence Interval for ( Unknown)

μ σ

/ 2, 1 / 2, 1n n S S

X t X t n n

α αμ− −− ≤ ≤ +

Margin of Error Standard Error

Student’s t Distribution

Z t

0

t (df = 5)

t (df = 13)Bell-Shaped Symmetric

‘Fatter’ Tails

Standard Normal

Example

/ 2, 1 / 2, 1

8 8 50 2.0639 50 2.0639

25 25 46.69 53.30

n n S S

X t X t n n

α αμ

μ

μ

− −− ≤ ≤ +

− ≤ ≤ +

≤ ≤

A random sample of 25 has 50 and 8. Set up a 95% confidence interval estimate for

n X S μ

= = =

We are 95% confident that the unknown true population mean is somewhere between 46.69 and 53.30.

PHStat | Confidence Interval | Estimate for the Mean, sigma unknown Example in Excel Spreadsheet

Confidence Interval for ( Unknown) in PHStat

μ σ

Microsoft Excel Worksheet

Confidence Interval Estimate for the Mean

Data Sample Standard Deviation 8 Sample Mean 50 Sample Size 25 Confidence Level 95%

Standard Error of the Mean 1.6 Degrees of Freedom 24 t Value 2.063898137 Interval Half Width 3.302237019

Interval Lower Limit 46.70 Interval Upper Limit 53.30

Intermediate Calculations

Confidence Interval

Another Example

Data on the “Average Quiz Scores before Mid- term 1” and “Mid-term 1 Scores”

Microsoft Excel Worksheet

Confidence Interval Estimate for Proportion

Assumptions Two categorical outcomes Population follows Binomial distribution Normal approximation can be used if

and Confidence Interval Estimate

5nπ ≥ ( )1 5n π− ≥

( ) ( ) / 2 / 2

1 1p p p p p Z p Z

n nα α π

− − − ≤ ≤ +

Margin of Error Standard Error

Example

A random sample of 400 voters showed 32 preferred candidate A. Set up a 95% confidence interval estimate for p.

( ) ( )

( ) ( )

/ /

1 1

.08 1 .08 .08 1 .08 .08 1.96 .08 1.96

400 400 .053 .107

p p p p p Z p Z

n nα α π

π

π

2 2

− − − ≤ ≤ +

− − − ≤ ≤ +

≤ ≤ We are 95% confident that the proportion of voters who prefer candicate A is somewhere between 0.053 and 0.107.

Confidence Interval Estimate for Proportion in PHStat

PHStat | Confidence Interval | Estimate for the Proportion … Example in Excel Spreadsheet

Microsoft Excel Worksheet

Confidence Interval Estimate for the Mean

Data Sample Size 400 Number of Successes 32 Confidence Level 95%

Sample Proportion 0.08 Z Value -1.95996108 Standard Error of the Proportion 0.01356466 Interval Half Width 0.026586206

Interval Lower Limit 0.053413794 Interval Upper Limit 0.106586206

Intermediate Calculations

Confidence Interval

Elements of Confidence Interval Estimation

Level of Confidence Confidence in which the interval will contain the unknown population parameter

Precision (Sampling Error) Closeness to the unknown parameter

Cost (Sample Size) Cost required to obtain a sample of size n

( )1 100%α−

Level of Confidence

Denoted by A Relative Frequency Interpretation

In the long run, of all the confidence intervals that can be constructed will contain the unknown parameter

A Specific Interval Will Either Contain or Not Contain the Parameter

No probability involved in a specific interval

( )100 1 %α−

( )100 1 %α−

Factors Affecting Interval Width (Precision)

Data Variation Measured by

Sample Size

Level of Confidence

Intervals Extend from

© 1984-1994 T/Maker Co.

σ

X n σ

σ =

( )100 1 %α−

/ 2 / 2 to X XX Z X Zα ασ σ− + Sampling Error = / 2 XZα σ

Determining Sample Size (Cost)

Too Big:

• Requires too many resources

Too small:

• Won’t do the job

Determining Sample Size for Mean

What sample size will be needed for the confident interval estimate for the mean to be correct within ± 5 with a 90% level of confidence? A pilot study suggested that the standard deviation is 45.

Round Up

( )2 22 2 2 2

1.645 45 219.2 220

Error 5 Z

n σ

= = = ≅

Determining Sample Size for Proportion

Out of a population of 1,000, we randomly selected 100 of which 30 were defective. What sample size is needed for the confident interval estimate for proportion to be within ± 5% with 90% confidence?

Round Up

( ) ( )( )2 2 2 2

1 1.645 0.3 0.7 Error 0.05

227.3 228

Z n

π π− = =

= ≅

Obtaining Sample Size in PHStat

PHStat | Sample Size | Determination for the mean… PHStat | Sample Size | Determination for the proportion… Here’s an Excel spreadsheet that contains the result of the previous examples:

Microsoft Excel Worksheet

Ethical Issues

Confidence Interval (Reflects Sampling Error) Should Always be Reported Along with the Point Estimate The Level of Confidence Should Always be Reported The Sample Size Should be Reported An Interpretation of the Confidence Interval Estimate Should Also be Provided

Some Examples of Good and Bad Reporting

Here is a link to a really terrible reporting Here is a link to a really bad practice Here is a link to some not so bad practices Here is a link to a better practice

Lesson Summary

Illustrated Estimation Process Discussed Point Estimates Addressed Interval Estimates Discussed Sampling Distribution of the Sample Mean Addressed Properties of as an Estimate for Discussed Confidence Interval Estimation for the Mean ( Known)

X μ

σ

Lesson Summary

Discussed Confidence Interval Estimation for the Mean ( Known) Discussed Confidence Interval Estimation for the Mean ( Unknown) Addressed Determining Sample Size Discussed Confidence Interval Estimation and Ethical Issues

σ

σ