Business Economis
Chapter 8
Sampling Methods and the Central Limit Theorem
© McGraw-Hill Education. All rights reserved. Authorized only for instructor use in the classroom. No reproduction or further distribution permitted without the prior written consent of McGraw-Hill Education.
This chapter continues the study of probability distributions by examining continuous probability distributions. We learn about three continuous probability distributions: the uniform probability distribution, the normal probability distribution, and the exponential probability distribution.
1
Learning Objectives
8-1 Explain why populations are sampled and describe four methods to sample a population
8-2 Define sampling error
8-3 Demonstrate the construction of a sampling distribution of the sample mean
8-4 Recite the central limit theorem and define the mean and standard error of the sampling distribution of the sample mean
8-5 Apply the central limit theorem to calculate probabilities
© McGraw-Hill Education.
8-‹#›
Reasons for Sampling a Population
The results of a sample may adequately estimate the value of the population parameter, saving time and money
It may be too time-consuming to contact all members of the population
It may be impossible to check or locate all the members of the population
The cost of studying all the items in the population may be prohibitive
Often testing destroys the sampled item and it cannot be returned to the population
© McGraw-Hill Education.
8-‹#›
There are many practical reasons why we prefer to select portions or samples of a population to observe and measure when studying characteristics of a population.
3
Probability Sampling Methods
In a simple random sample, all members of the population have the same chance of being selected for the sample
In a systematic sample, a random starting point is selected, and then every kth item thereafter is selected for the sample
In a stratified sample, the population is divided into several groups, called strata, and then a random sample is selected from each stratum
In clustered sampling, the population is divided into primary units, then samples are drawn from the primary units
© McGraw-Hill Education.
8-‹#›
These are not the only methods of sampling available to a researcher. If you become involved in a major research project, consult books devoted to sample theory and sample design.
4
Simple Random Sampling (1 of 2)
The most widely used method of sampling is a simple random sample
SIMPLE RANDOM SAMPLE A sample selected so that each item or person in the population has the same chance of being selected.
© McGraw-Hill Education.
8-‹#›
In an unbiased sample, all members of the population have a chance of being selected for the sample. If the population is relatively small, one could place all the items of interest, say names, in a box and select the sample. For large samples like the one in this example, this is very time-consuming.
5
Simple Random Sampling (2 of 2)
Example
There were 750 Major League Baseball players at the end of the 2016 season. A committee of 10 players is to be formed to study the issue of concussions. To make sure every player has an equal chance of being selected, write each name on a piece of paper, place the names in a box and mix them up, then draw 10 names.
© McGraw-Hill Education.
8-‹#›
Using a Table of Random Numbers (1 of 2)
Suppose the population of interest is the 750 Major League Baseball players on the active rosters of the 30 teams at the end of the 2016 season. A committee of 10 players is to be formed to study the issue of concussions. To make sure every player has an equal chance of being selected, use a table of random numbers.
Prepare of list of all the players and number them 1 through 750
Randomly pick a starting place in the random number table
Select 10 three-digit numbers between 1 and 750
© McGraw-Hill Education.
8-‹#›
Other ways to select a sample are to use a table of random numbers like the one in Appendix B.4 or to use a statistical software program or Excel to select a simple random sample. This example shows how to select random numbers using a portion of a random number table. To choose a starting point, you could close your eyes and simply point at a number in the table. Another way is to randomly pick a column and a row. Suppose the time is 3:04; go to column three and down to row four. Here, the number is 03759, so we use the first three digits in the five digit number. To continue selecting, you could move in any direction, in this example, we move right. The next number is 44723, so we choose player 447, the next number is 961 and is too high so we skip it and we skip the next number, 784 because it is also too high. Then the next number is 18910, so we select player 189 and so on until we have a list of 10 players. The instructions on how to use Excel to select a random sample are in Appendix C.
7
Using a Table of Random Numbers (2 of 2)
In column 3: 037 (Starting point)
In column 4: 447 (Second player)
In column 7: 189 (Third player)
| 50525 | 57454 | 28455 | 68226 | 34656 | 38884 | 39018 |
| 72507 | 53380 | 53827 | 42486 | 54465 | 71819 | 91199 |
| 34986 | 74297 | 00144 | 38676 | 89967 | 98869 | 39744 |
| 68851 | 27305 | 03759 | 44723 | 96108 | 78489 | 18910 |
| 06738 | 62879 | 03910 | 17350 | 49169 | 03850 | 18910 |
| 11448 | 10734 | 05837 | 24397 | 10420 | 16712 | 94496 |
© McGraw-Hill Education.
8-‹#›
Systematic Random Sampling (1 of 2)
If you do not have a list of the entire population to begin with, you can use the systematic random sample
SYSTEMATIC RANDOM SAMPLE A random starting point is selected, and then every kth member of the population is selected.
© McGraw-Hill Education.
8-‹#›
Caution: If the population is in some order already, like invoices arranged in increasing dollar amounts, the systematic procedure should not be used.
9
Systematic Random Sampling (2 of 2)
Example
Stood’s Grocery Store wants to study the length of time customers spend in their store
Randomly select the days of the week, the times, and the starting point of the study, then systematically select the customers and measure the time each spends in the store
© McGraw-Hill Education.
8-‹#›
Stratified Random Sampling (1 of 2)
When the population can be divided into groups based on some characteristic, use stratified random sampling
STRATIFIED RANDOM SAMPLE A population is divided into subgroups, called strata, and a sample is randomly selected from each stratum.
Example
A study of 50 of the 352 largest US firms’ ad spending
Begin by identifying the strata, then use random sampling within each group based on relative frequencies to collect the sample
© McGraw-Hill Education.
8-‹#›
This example of stratified random sampling groups the firms by profitability, measured by the percent return on equity. The advantage of stratified random sampling is that this method may more accurately reflect the population characteristic since at least one firm will be selected from each strata, even those with low numbers; which might not happen when using random sampling or systematic random sampling.
11
Stratified Random Sampling (2 of 2)
| Stratum | Profitability (return on equity) | Number of Firms | Relative Frequency | Number Sampled |
| 1 | 30 percent and over | 8 | 0.02 | 1* |
| 2 | 20 up to 30 percent | 35 | 0.10 | 5* |
| 3 | 10 up to 20 percent | 189 | 0.54 | 27 |
| 4 | 0 up to 10 percent | 115 | 0.33 | 16 |
| 5 | Deficit | 5 | 0.01 | 1 |
| Total | 352 | 1.00 | 50 |
© McGraw-Hill Education.
8-‹#›
12
Cluster Sampling (1 of 2)
Cluster sampling is a common type of sampling, used to reduce the cost of sampling over large geographic areas
CLUSTER SAMPLING A population is divided into clusters using naturally occurring geographic or other boundaries. Then clusters are randomly selected and a sample is collected by randomly selecting from each cluster.
© McGraw-Hill Education.
8-‹#›
In this example, we wish to determine the views of residents in the greater Chicago area about state and federal environmental protection policies. Selecting a random sample of residents in the region and personally contacting each one would be time-consuming and expensive. Instead, let the counties serve as the primary unit and select a random sample of the counties and then each of the selected county’s residents. This is a combination of cluster sampling and simple random sampling.
13
Cluster Sampling (2 of 2)
Example
Suppose we wish to sample residents of the 12 counties in the greater Chicago area about government policy. Randomly select 3 counties and then select a random sample of the residents in each of the 3 counties.
© McGraw-Hill Education.
8-‹#›
Sampling Error (1 of 5)
It is unlikely the mean of a sample will be exactly equal to the mean of the population
SAMPLING ERROR The difference between a sample statistic and its corresponding population parameter.
Example
The Foxtrot Inn’s number of rooms rented in June. The mean number of rooms rented, μ, is 3.13
© McGraw-Hill Education.
8-‹#›
In this example, the population is the number of rooms rented each of the 30 days in the month of June. The sampling errors are 3.80 – 3.13 = .67; 3.40-3.13 = .27; 1.80 – 3.13 = -1.33. Notice, the sampling error may be a positive value or a negative value. Using the combination formula, we find there are 142,506 possible samples of size 5 possible with a population of 30 values. If you summed the sampling errors for all 142,506 samples, the result would equal 0. This is because the sample mean is an unbiased estimator of the population mean.
We can expect there to be sampling error between sample standard deviations and the corresponding population standard deviation as well.
15
Sampling Error (2 of 5)
Taking three random samples of size 5, we find sample means,
of 3.80, 3.40 and 1.80. The sampling
error is the difference between
each
© McGraw-Hill Education.
8-‹#›
Sampling Error (3 of 5)
| June | Rentals |
| 1 | 0 |
| 2 | 2 |
| 3 | 3 |
| 4 | 2 |
| 5 | 3 |
| 6 | 4 |
| 7 | 2 |
| 8 | 3 |
| 9 | 4 |
| 10 | 7 |
© McGraw-Hill Education.
8-‹#›
Sampling Error (4 of 5)
| June | Rentals |
| 11 | 3 |
| 12 | 4 |
| 13 | 4 |
| 14 | 4 |
| 15 | 7 |
| 16 | 0 |
| 17 | 5 |
| 18 | 3 |
| 19 | 6 |
| 20 | 2 |
© McGraw-Hill Education.
8-‹#›
Sampling Error (5 of 5)
| June | Rentals |
| 21 | 3 |
| 22 | 2 |
| 23 | 3 |
| 24 | 6 |
| 25 | 0 |
| 26 | 4 |
| 27 | 1 |
| 28 | 1 |
| 29 | 3 |
| 30 | 3 |
© McGraw-Hill Education.
8-‹#›
Sampling Distribution of the Sample Mean
How can we determine how accurate the sample mean is?
SAMPLING DISTRIBUTION OF THE SAMPLE MEAN A probability distribution of all possible sample means of a given sample size.
For a given sample size, the mean of all possible sample means selected from a population is equal to the population mean
There is less variation in the distribution of the sample mean than in the population distribution
The sampling distribution of the sample mean tends to become bell-shaped
© McGraw-Hill Education.
8-‹#›
In the next few slides, we’ll use the sampling distribution of the sample mean to help explain how we can rely on sample estimates.
20
Sampling Distribution Example (1 of 9)
Tartus Industries has seven production employees (the population). The hourly earnings of each employee is given in the table.
What is the population mean?
What is the sampling distribution of the sample mean for samples of size 2?
What is the mean of the sampling distribution?
What observations can be made about the population and the sampling distribution?
© McGraw-Hill Education.
8-‹#›
Here is an example using a small population of just 7 to highlight the relationship between the population mean and the various sample means.
21
Sampling Distribution Example (2 of 9)
| Employee | Hourly Earnings |
| Joe | $14 |
| Sam | 14 |
| Sue | 16 |
| Bob | 16 |
| Jan | 14 |
| Art | 16 |
| Ted | 18 |
© McGraw-Hill Education.
8-‹#›
22
Sampling Distribution Example (3 of 9)
Tartus Industries has seven production employees (the population). The hourly earnings of each employee is given in the table.
What is the population mean?
© McGraw-Hill Education.
8-‹#›
23
Sampling Distribution Example (4 of 9)
What is the sampling distribution of the sample mean for samples of size 2?
| Sample | Employees | Hourly Earnings | Sum | Mean |
| 1 | Joe, Sam | $14,$14 | $28 | $14 |
| 2 | Joe, Sue | 14,16 | 30 | 15 |
| 3 | Joe, Bob | 14,16 | 30 | 15 |
| 4 | Joe, Jan | 14,14 | 28 | 14 |
| 5 | Joe, Art | 14,16 | 30 | 15 |
| 6 | Joe, Ted | 14,18 | 32 | 16 |
© McGraw-Hill Education.
8-‹#›
This is Table 8-3 in the text and is a table of all samples of size 2 taken from the population of the 7 Tartus Industries production employees. There are 21 possible samples and the sample mean of hourly earnings has been calculated for each.
24
Sampling Distribution Example (5 of 9)
| Sample | Employees | Hourly Earnings | Sum | Mean |
| 7 | Sam, Sue | 14,16 | 30 | 15 |
| 8 | Sam, Bob | 14,16 | 30 | 15 |
| 9 | Sam, Jan | 14,14 | 28 | 14 |
| 10 | Sam, Art | 14,16 | 30 | 15 |
| 11 | Sam, Ted | 14,16 | 32 | 16 |
| 12 | Sue, Bob | 16,16 | 32 | 16 |
| 13 | Sue, Jan | 16,14 | 30 | 15 |
| 14 | Sue, Art | 16,16 | 32 | 16 |
© McGraw-Hill Education.
8-‹#›
Sampling Distribution Example (6 of 9)
| Sample | Employees | Hourly Earnings | Sum | Mean |
| 15 | Sue, Ted | 16,18 | 34 | 17 |
| 16 | Bob, Jan | 16,14 | 30 | 15 |
| 17 | Bob, Art | 16,16 | 32 | 16 |
| 18 | Bob, Ted | 16,18 | 34 | 17 |
| 19 | Jan, Art | 14,16 | 30 | 15 |
| 20 | Jan, Ted | 14,18 | 32 | 16 |
| 21 | Art, Ted | 16,18 | 34 | 17 |
© McGraw-Hill Education.
8-‹#›
Sampling Distribution Example (7 of 9)
Tartus Industries has seven production employees (the population).
What is the mean of the sampling distribution?
| Sample Mean | Number of Means | Probability |
| $14 | 3 | .1429 |
| 15 | 9 | .4285 |
| 16 | 6 | .2857 |
| 17 | 3 | .1429 |
| 21 | 1.0000 |
© McGraw-Hill Education.
8-‹#›
This is Table 8-4 in the textbook and is a probability distribution called the sampling distribution of the sample mean for n=2.
27
Sampling Distribution Example (8 of 9)
What observations can be made about the population and the sampling distribution?
The mean of the distribution of the sample mean ($15.43) is equal to the mean of the population,
The spread in the distribution of the sample mean is less than the spread in the population values
The shapes of the population and sample distributions are different
© McGraw-Hill Education.
8-‹#›
The mean of the population is exactly equal to the mean of the sample means. The sample means range from $14 to $17 while the population values range from $14 to $18. The shape of the sampling distribution of the sample mean and the shape of the frequency distribution of the population values are different; as wee see in this chart (8-2), the distribution of the sample mean tends to be more bell-shaped and approximate the normal distribution.
28
Sampling Distribution Example (9 of 9)
© McGraw-Hill Education.
8-‹#›
Central Limit Theorem (1 of 2)
THE CENTRAL LIMIT THEOREM If samples of a particular size are selected from any population, the sampling distribution of the sample mean is approximately a normal distribution. The approximation improves with larger samples.
If the population follows a normal probability distribution, then for any sample size the sampling distribution of the sample mean will also be normal
© McGraw-Hill Education.
8-‹#›
The Central Limit Theorem is one of the most useful conclusions in statistics and is true for all population distributions. This allows us to use the normal probability distribution to create confidence intervals for the population mean (chapter 9) and perform tests of hypothesis (chapter 10).
30
Central Limit Theorem (2 of 2)
If the population distribution is symmetrical, you will see the normal shape of the distribution of the sample mean emerge with samples as small as 10
If the distribution is skewed or has thick tails, it may require samples of 30 or more to observe the normality feature
© McGraw-Hill Education.
8-‹#›
Central Limit Theorem Results
© McGraw-Hill Education.
8-‹#›
This is Chart 8-3 from the textbook; at the top of the chart there are 4 different population distributions. Following each of these downward, we observe that the sample distributions appear more normal as sample size increases. In other words, we observe the convergence to a normal distribution regardless of the shape of the population distribution.
32
CLT Conclusions (1 of 2)
The mean of the distribution of sample means will be exactly equal to the population mean, if we select all possible samples of same size from the population
The standard deviation of the sampling distribution of the sample mean is also called the standard error of the mean
© McGraw-Hill Education.
8-‹#›
Even if we do not select all samples, we can expect the mean of the distribution of the samples means to be close to the population mean. If the population standard deviation is sigma, the standard deviation of the distribution of sample means is sigma divided by the square root of n. Note that when the sample size is increased, the standard error of the mean decreases.
33
CLT Conclusions (2 of 2)
There will be less dispersion in the sampling distribution of the sample mean,
than in the population σ
© McGraw-Hill Education.
8-‹#›
Normal Distribution (1 of 2)
If the population follows a normal distribution, the sampling distribution of the sample mean will also follow the normal distribution for samples of any size
If the population is not normally distributed, the sampling distribution of the sample mean will approach a normal distribution when the sample size is at least 30
© McGraw-Hill Education.
8-‹#›
Use this formula when the population standard deviation is known or is assumed to be known.
35
Normal Distribution (2 of 2)
Assume the population standard deviation is known
To determine the probability that a sample mean falls in a particular region, use the following formula
© McGraw-Hill Education.
8-‹#›
Using the Sampling Distribution Example (1 of 2)
The Quality Assurance Dept. for Cola, Inc. maintains records regarding the amount of cola in its jumbo bottle. The actual amount of cola in each bottle varies a small amount from one bottle to another. Records indicate the amounts of cola follow the normal distribution, the mean amount of cola in the bottles is 31.2 ounces, and the standard deviation is 0.4 ounces. At 8 a.m. today, the quality technician randomly selected 16 bottles from the filling line. The mean amount was 31.38 ounces. Is this an unlikely result? Is it a likely the process is putting too much soda in the bottle? Is the sampling error of 0.18 ounce unusual?
© McGraw-Hill Education.
8-‹#›
First we find z, then we use the table in Appendix B.3 or statistical software to determine probability. In this example, we find that it is unlikely, less than a 4% chance, we could select a sample of 16 observations from a normal population with a mean of 31.2 ounces and a population standard deviation of 0.4 ounce and find the sample mean equal to or greater than 31.38 ounces. We conclude the process is putting too much cola in the bottles. The quality technician should see the production supervisor about reducing the amount of soda in each bottle.
37
Using the Sampling Distribution Example (2 of 2)
We conclude that it is unlikely; there is less than a 4% chance. The process is putting too much soda in the bottles.
© McGraw-Hill Education.
8-‹#›
End of Presentation
© McGraw-Hill Education. All rights reserved. Authorized only for instructor use in the classroom. No reproduction or further distribution permitted without the prior written consent of McGraw-Hill Education.
8-‹#›
x
ì
and
x
$15.43
N
x
ì
=
å
=
$15.43
21
$324
samples
of
Number
Total
means
sample
all
of
Sum
ì
x
=
=
=
x
ì
ì
=
[
]
1
-
8
ó
ó
x
n
=
MEAN
THE
OF
ERROR
STANDARD
,
n
ó
n
ó
ì
x
z
-
=
1.80
16
0.4
31.20
31.38
n
ó
ì
x
z
=
-
=
-
=