The Central Limit Theorem

The Central Limit Theorem for Sample Means (Averages)

OpenStaxCollege

[latexpage]

Suppose X is a random variable with a distribution that may be known or unknown (it can be any distribution). Using a subscript that matches the random variable, suppose:

  1. μX = the mean of X
  2. σX = the standard deviation of X

If you draw random samples of size n, then as n increases, the random variable \(\overline{X}\) which consists of sample means, tends to be normally distributed and

\(\overline{X}\) ~ N\(\left({\mu }_{x}\text{, }\frac{\sigma x}{\sqrt{n}}\right)\).

The central limit theorem for sample means says that if you keep drawing larger and larger samples (such as rolling one, two, five, and finally, ten dice) and calculating their means, the sample means form their own normal distribution (the sampling distribution). The normal distribution has the same mean as the original distribution and a variance that equals the original variance divided by, the sample size. The variable n is the number of values that are averaged together, not the number of times the experiment is done.

To put it more formally, if you draw random samples of size n, the distribution of the random variable \(\overline{X}\), which consists of sample means, is called the sampling distribution of the mean. The sampling distribution of the mean approaches a normal distribution as n, the sample size, increases.

The random variable \(\overline{X}\) has a different z-score associated with it from that of the random variable X. The mean \(\overline{x}\) is the value of \(\overline{X}\) in one sample.

\(z=\frac{\overline{x}-{\mu }_{x}}{\left(\frac{{\sigma }_{x}}{\sqrt{n}}\right)}\)

μX is the average of both X and \(\overline{X}\).

\(\sigma \overline{x}\text{ = }\frac{\sigma x}{\sqrt{n}}\) = standard deviation of \(\overline{X}\) and is called the standard error of the mean.

To find probabilities for means on the calculator, follow these steps.

2nd DISTR

2:normalcdf

\(normalcdf\left(lower\text{ }value\text{ }of\text{ }the\text{ }area,\text{ }upper\text{ }value\text{ }of\text{ }the\text{ }area,\text{ }mean,\text{ }\frac{standard deviation}{\sqrt{sample size}}\right)\)

where:

mean is the mean of the original distribution
standard deviation is the standard deviation of the original distribution
sample size = n

An unknown distribution has a mean of 90 and a standard deviation of 15. Samples of size n = 25 are drawn randomly from the population.

a. Find the probability that the sample mean is between 85 and 92.

a. Let X = one value from the original unknown population. The probability question asks you to find a probability for the sample mean.

Let \(\overline{X}\) = the mean of a sample of size 25. Since μX = 90, σX = 15, and n = 25,

\(\overline{X}\) ~ N\(\left(90\text{, }\frac{15}{\sqrt{25}}\right)\).

Find P(85 < \(\overline{x}\) < 92). Draw a graph.

P(85 < \(\overline{x}\) < 92) = 0.6997

The probability that the sample mean is between 85 and 92 is 0.6997.

This is a normal distribution curve. The peak of the curve coincides with the point 90 on the horizontal axis. The points 85 and 92 are labeled on the axis. Vertical lines are drawn from these points to the curve and the area between the lines is shaded. The shaded region represents the probability that 85 < x < 92.

normalcdf(lower value, upper value, mean, standard error of the mean)

The parameter list is abbreviated (lower value, upper value, μ, \(\frac{\sigma }{\sqrt{n}}\))

normalcdf(85,92,90,\(\frac{15}{\sqrt{25}}\)) = 0.6997

b. Find the value that is two standard deviations above the expected value, 90, of the sample mean.

b. To find the value that is two standard deviations above the expected value 90, use the formula:

value = μx + (#ofTSDEVs)\(\left(\frac{{\sigma }_{x}}{\sqrt{n}}\right)\)

value = 90 + 2 \(\left(\frac{15}{\sqrt{25}}\right)\) = 96

The value that is two standard deviations above the expected value is 96.

The standard error of the mean is \(\frac{\sigma x}{\sqrt{n}}\) = \(\frac{15}{\sqrt{25}}\) = 3. Recall that the standard error of the mean is a description of how far (on average) that the sample mean will be from the population mean in repeated simple random samples of size n.

Try It

An unknown distribution has a mean of 45 and a standard deviation of eight. Samples of size n = 30 are drawn randomly from the population. Find the probability that the sample mean is between 42 and 50.

P(42 < \(\overline{x}\) < 50) = \(\left(\text{42,50,45,}\frac{8}{\sqrt{30}}\right)\) = 0.9797

The length of time, in hours, it takes an “over 40” group of people to play one soccer match is normally distributed with a mean of two hours and a standard deviation of 0.5 hours. A sample of size n = 50 is drawn randomly from the population. Find the probability that the sample mean is between 1.8 hours and 2.3 hours.

Let X = the time, in hours, it takes to play one soccer match.

The probability question asks you to find a probability for the sample mean time, in hours, it takes to play one soccer match.

Let \(\overline{X}\) = the mean time, in hours, it takes to play one soccer match.

If μX = _________, σX = __________, and n = ___________, then X ~ N(______, ______) by the central limit theorem for means.

μX = 2, σX = 0.5, n = 50, and X ~ N\(\left(\text{2, }\frac{0.5}{\sqrt{50}}\right)\)

Find P(1.8 < \(\overline{x}\) < 2.3). Draw a graph.

P(1.8 < \(\overline{x}\) < 2.3) = 0.9977

normalcdf\(\left(1.\text{8,2}\text{.3,2,}\frac{.5}{\sqrt{50}}\right)\) = 0.9977

The probability that the mean time is between 1.8 hours and 2.3 hours is 0.9977.

Try It

The length of time taken on the SAT for a group of students is normally distributed with a mean of 2.5 hours and a standard deviation of 0.25 hours. A sample size of n = 60 is drawn randomly from the population. Find the probability that the sample mean is between two hours and three hours.

P(2 < \(\overline{x}\) < 3) = normalcdf\(\left(\text{2, 3, 2}\text{.5, }\frac{0.25}{\sqrt{60}}\right)\) = 1

To find percentiles for means on the calculator, follow these steps.

2nd DIStR

3:invNorm

k = invNorm\(\left(\text{area to the left of }k\text{, mean,} \frac{standard deviation}{\sqrt{sample size}}\right)\)

where:

k = the kth percentile
mean is the mean of the original distribution
standard deviation is the standard deviation of the original distribution
sample size = n

In a recent study reported Oct. 29, 2012 on the Flurry Blog, the mean age of tablet users is 34 years. Suppose the standard deviation is 15 years. Take a sample of size n = 100.

  1. What are the mean and standard deviation for the sample mean ages of tablet users?
  2. What does the distribution look like?
  3. Find the probability that the sample mean age is more than 30 years (the reported mean age of tablet users in this particular study).
  4. Find the 95th percentile for the sample mean age (to one decimal place).
  1. Since the sample mean tends to target the population mean, we have μχ = μ = 34. The sample standard deviation is given by σχ = \(\frac{\sigma }{\sqrt{n}}\) = \(\frac{15}{\sqrt{100}}\) = \(\frac{15}{10}\) = 1.5
  2. The central limit theorem states that for large sample sizes(n), the sampling distribution will be approximately normal.
  3. The probability that the sample mean age is more than 30 is given by P(Χ > 30) = normalcdf(30,E99,34,1.5) = 0.9962
  4. Let k = the 95th percentile.

    k = invNorm\(\left(0.\text{95,34,}\frac{15}{\sqrt{100}}\right)\) = 36.5

Try It

In an article on Flurry Blog, a gaming marketing gap for men between the ages of 30 and 40 is identified. You are researching a startup game targeted at the 35-year-old demographic. Your idea is to develop a strategy game that can be played by men from their late 20s through their late 30s. Based on the article’s data, industry research shows that the average strategy player is 28 years old with a standard deviation of 4.8 years. You take a sample of 100 randomly selected gamers. If your target market is 29- to 35-year-olds, should you continue with your development strategy?

You need to determine the probability for men whose mean age is between 29 and 35 years of age wanting to play a strategy game.

P(29 < \(\overline{x}\) < 35) = normalcdf\(\left(\text{29,35,28,}\frac{4.8}{\sqrt{100}}\right)\) = 0.0186

You can conclude there is approximately a 1.9% chance that your game will be played by men whose mean age is between 29 and 35.

The mean number of minutes for app engagement by a tablet user is 8.2 minutes. Suppose the standard deviation is one minute. Take a sample of 60.

  1. What are the mean and standard deviation for the sample mean number of app engagement by a tablet user?
  2. What is the standard error of the mean?
  3. Find the 90th percentile for the sample mean time for app engagement for a tablet user. Interpret this value in a complete sentence.
  4. Find the probability that the sample mean is between eight minutes and 8.5 minutes.
  1. \({\mu }_{\overline{x}}=\mu =8.2\text{ }{\sigma }_{\overline{x}}=\frac{\sigma }{\sqrt{n}}=\frac{1}{\sqrt{60}}=0.13\)
  2. This allows us to calculate the probability of sample means of a particular distance from the mean, in repeated samples of size 60.
  3. Let k = the 90th percentile

    k = invNorm\(\left(0.\text{90,8}\text{.2,}\frac{1}{\sqrt{60}}\right)\) = 8.37. This values indicates that 90 percent of the average app engagement time for table users is less than 8.37 minutes.

  4. P(8 < \(\overline{x}\) < 8.5) = normalcdf\(\left(\text{8,8}\text{.5,8}\text{.2,}\frac{1}{\sqrt{60}}\right)\) = 0.9293
Try It

Cans of a cola beverage claim to contain 16 ounces. The amounts in a sample are measured and the statistics are n = 34, \(\overline{x}\) = 16.01 ounces. If the cans are filled so that μ = 16.00 ounces (as labeled) and σ = 0.143 ounces, find the probability that a sample of 34 cans will have an average amount greater than 16.01 ounces. Do the results suggest that cans are filled with an amount greater than 16 ounces?

We have P((\(\overline{x}\) > 16.01) = normalcdf\(\left(\text{16}\text{.01,E99,16,}\frac{0.143}{\sqrt{34}}\right)\) = 0.3417. Since there is a 34.17% probability that the average sample weight is greater than 16.01 ounces, we should be skeptical of the company’s claimed volume. If I am a consumer, I should be glad that I am probably receiving free cola. If I am the manufacturer, I need to determine if my bottling processes are outside of acceptable limits.

References

Baran, Daya. “20 Percent of Americans Have Never Used Email.”WebGuild, 2010. Available online at http://www.webguild.org/20080519/20-percent-of-americans-have-never-used-email (accessed May 17, 2013).

Data from The Flurry Blog, 2013. Available online at http://blog.flurry.com (accessed May 17, 2013).

Data from the United States Department of Agriculture.

Chapter Review

In a population whose distribution may be known or unknown, if the size (n) of samples is sufficiently large, the distribution of the sample means will be approximately normal. The mean of the sample means will equal the population mean. The standard deviation of the distribution of the sample means, called the standard error of the mean, is equal to the population standard deviation divided by the square root of the sample size (n).

Formula Review

The Central Limit Theorem for Sample Means: \(\overline{X}\) ~ N\(\left({\mu }_{x}\text{, }\frac{\sigma x}{\sqrt{n}}\right)\)

The Mean \(\overline{X}\): μx

Central Limit Theorem for Sample Means z-score and standard error of the mean: \(z=\frac{\overline{x}-{\mu }_{x}}{\left(\frac{{\sigma }_{x}}{\sqrt{n}}\right)}\)

Standard Error of the Mean (Standard Deviation (\(\overline{X}\))): \(\frac{{\sigma }_{x}}{\sqrt{n}}\)

Use the following information to answer the next six exercises: Yoonie is a personnel manager in a large corporation. Each month she must review 16 of the employees. From past experience, she has found that the reviews take her approximately four hours each to do with a population standard deviation of 1.2 hours. Let Χ be the random variable representing the time it takes her to complete one review. Assume Χ is normally distributed. Let \(\overline{X}\) be the random variable representing the mean time to complete the 16 reviews. Assume that the 16 reviews represent a random set of reviews.

What is the mean, standard deviation, and sample size?

mean = 4 hours; standard deviation = 1.2 hours; sample size = 16

Complete the distributions.

X ~ _____(_____,_____)
\(\overline{X}\) ~ _____(_____,_____)

<!– <solution id=”fs-idm6886848″>

X ~ N(4, 1.2).

X
¯

~ N

(

4, 

1.2

16

)

–>

Find the probability that one review will take Yoonie from 3.5 to 4.25 hours. Sketch the graph, labeling and scaling the horizontal axis. Shade the region corresponding to the probability.

This is a frequency curve for a normal distribution. It shows a single peak in the center with the curve tapering down to the horizontal axis on each side. The distribution is symmetrical. The horizontal axis represents the random variable X.
P(________ < x < ________) = _______

a. Check student’s solution.

b. 3.5, 4.25, 0.2441

Find the probability that the mean of a month’s reviews will take Yoonie from 3.5 to 4.25 hrs. Sketch the graph, labeling and scaling the horizontal axis. Shade the region corresponding to the probability.

This is a frequency curve for a normal distribution. It shows a single peak in the center with the curve tapering down to the horizontal axis on each side. The distribution is symmetrical. The horizontal axis represents the random variable X.
P(________________) = _______

<!– <solution id=”id18025798″>
b. 0.7499 –>

What causes the probabilities in [link] and [link] to be different?

The fact that the two distributions are different accounts for the different probabilities.

Find the 95th percentile for the mean time to complete one month’s reviews. Sketch the graph.

  1. This is a frequency curve for a normal distribution. It shows a single peak in the center with the curve tapering down to the horizontal axis on each side. The distribution is symmetrical. The horizontal axis represents the random variable X.
  2. The 95th Percentile =____________

<!– <solution id=”fs-idm40700112″>
P(3.5 <

x
¯

< 4.25) = invNorm

(

95,4,

1.2

16

)

= 4.49 –>

Homework

Previously, De Anza statistics students estimated that the amount of change daytime statistics students carry is exponentially distributed with a mean of 💲0.88. Suppose that we randomly pick 25 daytime statistics students.

  1. In words, Χ = ____________
  2. Χ ~ _____(_____,_____)
  3. In words, \(\overline{X}\) = ____________
  4. \(\overline{X}\) ~ ______ (______, ______)
  5. Find the probability that an individual had between 💲0.80 and 💲1.00. Graph the situation, and shade in the area to be determined.
  6. Find the probability that the average of the 25 students was between 💲0.80 and 💲1.00. Graph the situation, and shade in the area to be determined.
  7. Explain why there is a difference in part e and part f.
  1. Χ = amount of change students carry
  2. Χ ~ E(0.88, 0.88)
  3. \(\overline{X}\) = average amount of change carried by a sample of 25 sstudents.
  4. \(\overline{X}\) ~ N(0.88, 0.176)
  5. 0.0819
  6. 0.1882
  7. The distributions are different. Part a is exponential and part b is normal.

Suppose that the distance of fly balls hit to the outfield (in baseball) is normally distributed with a mean of 250 feet and a standard deviation of 50 feet. We randomly sample 49 fly balls.

  1. If \(\overline{X}\) = average distance in feet for 49 fly balls, then \(\overline{X}\) ~ _______(_______,_______)
  2. What is the probability that the 49 balls traveled an average of less than 240 feet? Sketch the graph. Scale the horizontal axis for \(\overline{X}\). Shade the region corresponding to the probability. Find the probability.
  3. Find the 80th percentile of the distribution of the average of 49 fly balls.

<!– <solution id=”id6274098″>
N

(

250, 

50

49

)

0.0808
256.01 feet –>

According to the Internal Revenue Service, the average length of time for an individual to complete (keep records for, learn, prepare, copy, assemble, and send) IRS Form 1040 is 10.53 hours (without any attached schedules). The distribution is unknown. Let us assume that the standard deviation is two hours. Suppose we randomly sample 36 taxpayers.

  1. In words, Χ = _____________
  2. In words, \(\overline{X}\) = _____________
  3. \(\overline{X}\) ~ _____(_____,_____)
  4. Would you be surprised if the 36 taxpayers finished their Form 1040s in an average of more than 12 hours? Explain why or why not in complete sentences.
  5. Would you be surprised if one taxpayer finished his or her Form 1040 in more than 12 hours? In a complete sentence, explain why.
  1. length of time for an individual to complete IRS form 1040, in hours.
  2. mean length of time for a sample of 36 taxpayers to complete IRS form 1040, in hours.
  3. N\(\left(\text{10}\text{.53, }\frac{1}{3}\right)\)
  4. Yes. I would be surprised, because the probability is almost 0.
  5. No. I would not be totally surprised because the probability is 0.2312

Suppose that a category of world-class runners are known to run a marathon (26 miles) in an average of 145 minutes with a standard deviation of 14 minutes. Consider 49 of the races. Let \(\overline{X}\) the average of the 49 races.

  1. \(\overline{X}\) ~ _____(_____,_____)
  2. Find the probability that the runner will average between 142 and 146 minutes in these 49 marathons.
  3. Find the 80th percentile for the average of these 49 marathons.
  4. Find the median of the average running times.

<!– <solution id=”id6533816″>

N

(

145, 

14

49

)

0.6247
146.68
145 minutes –>

The length of songs in a collector’s iTunes album collection is uniformly distributed from two to 3.5 minutes. Suppose we randomly pick five albums from the collection. There are a total of 43 songs on the five albums.

  1. In words, Χ = _________
  2. Χ ~ _____________
  3. In words, \(\overline{X}\) = _____________
  4. \(\overline{X}\) ~ _____(_____,_____)
  5. Find the first quartile for the average song length.
  6. The IQR(interquartile range) for the average song length is from _______–_______.
  1. the length of a song, in minutes, in the collection
  2. U(2, 3.5)
  3. the average length, in minutes, of the songs from a sample of five albums from the collection
  4. N(2.75, 0.0220)
  5. 2.74 minutes
  6. 0.03 minutes

In 1940 the average size of a U.S. farm was 174 acres. Let’s say that the standard deviation was 55 acres. Suppose we randomly survey 38 farmers from 1940.

  1. In words, Χ = _____________
  2. In words, \(\overline{X}\) = _____________
  3. \(\overline{X}\) ~ _____(_____,_____)
  4. The IQR for \(\overline{X}\) is from _______ acres to _______ acres.

<!– <solution id=”fs-idm55467904″>
the size of a U.S. farm in 1940
the average size of a U.S. farm, in acres
N

(

174, 

55

38

)

168.0, 180.0
–>

Determine which of the following are true and which are false. Then, in complete sentences, justify your answers.

  1. When the sample size is large, the mean of \(\overline{X}\) is approximately equal to the mean of Χ.
  2. When the sample size is large, \(\overline{X}\) is approximately normally distributed.
  3. When the sample size is large, the standard deviation of \(\overline{X}\) is approximately the same as the standard deviation of Χ.
  1. True. The mean of a sampling distribution of the means is approximately the mean of the data distribution.
  2. True. According to the Central Limit Theorem, the larger the sample, the closer the sampling distribution of the means becomes normal.
  3. The standard deviation of the sampling distribution of the means will decrease making it approximately the same as the standard deviation of X as the sample size increases.

The percent of fat calories that a person in America consumes each day is normally distributed with a mean of about 36 and a standard deviation of about ten. Suppose that 16 individuals are randomly chosen. Let \(\overline{X}\) = average percent of fat calories.

  1. \(\overline{X}\) ~ ______(______, ______)
  2. For the group of 16, find the probability that the average percent of fat calories consumed is more than five. Graph the situation and shade in the area to be determined.
  3. Find the first quartile for the average percent of fat calories.

<!– <solution id=”id6272525″>
N

(

36, 

10

16

)

1
34.31
–>

The distribution of income in some Third World countries is considered wedge shaped (many very poor people, very few middle income people, and even fewer wealthy people). Suppose we pick a country with a wedge shaped distribution. Let the average salary be 💲2,000 per year with a standard deviation of 💲8,000. We randomly survey 1,000 residents of that country.

  1. In words, Χ = _____________
  2. In words, \(\overline{X}\) = _____________
  3. \(\overline{X}\) ~ _____(_____,_____)
  4. How is it possible for the standard deviation to be greater than the average?
  5. Why is it more likely that the average of the 1,000 residents will be from 💲2,000 to 💲2,100 than from 💲2,100 to 💲2,200?
  1. X = the yearly income of someone in a third world country
  2. the average salary from samples of 1,000 residents of a third world country
  3. \(\overline{X}\) ∼ N\(\left(\text{2000, }\frac{\text{8000}}{\sqrt{\text{1000}}}\right)\)
  4. Very wide differences in data values can have averages smaller than standard deviations.
  5. The distribution of the sample mean will have higher probabilities closer to the population mean.

    P(2000 < \(\overline{X}\) < 2100) = 0.1537

    P(2100 < \(\overline{X}\) < 2200) = 0.1317

Which of the following is NOT TRUE about the distribution for averages?

  1. The mean, median, and mode are equal.
  2. The area under the curve is one.
  3. The curve never touches the x-axis.
  4. The curve is skewed to the right.

<!– <solution id=”id6538477″>
d
–>

The cost of unleaded gasoline in the Bay Area once followed an unknown distribution with a mean of 💲4.59 and a standard deviation of 💲0.10. Sixteen gas stations from the Bay Area are randomly chosen. We are interested in the average cost of gasoline for the 16 gas stations. The distribution to use for the average cost of gasoline for the 16 gas stations is:

\(\overline{X}\) ~ N(4.59, 0.10)
\(\overline{X}\) ~ N\(\left(\text{4}\text{.59, }\frac{0.10}{\sqrt{16}}\right)\)
\(\overline{X}\) ~ N\(\left(\text{4}\text{.59, }\frac{16}{0.10}\right)\)
\(\overline{X}\) ~ N\(\left(\text{4}\text{.59, }\frac{\sqrt{16}}{0.10}\right)\)

b

Glossary

Average
a number that describes the central tendency of the data; there are a number of specialized averages, including the arithmetic mean, weighted mean, median, mode, and geometric mean.
Central Limit Theorem
Given a random variable (RV) with known mean μ and known standard deviation, σ, we are sampling with size n, and we are interested in two new RVs: the sample mean, \(\overline{X}\), and the sample sum, ΣΧ. If the size (n) of the sample is sufficiently large, then \(\overline{X}\) ~ N(μ, \(\frac{\sigma }{\sqrt{n}}\)) and ΣΧ ~ N(nμ, (\(\sqrt{n}\))(σ)). If the size (n) of the sample is sufficiently large, then the distribution of the sample means and the distribution of the sample sums will approximate a normal distributions regardless of the shape of the population. The mean of the sample means will equal the population mean, and the mean of the sample sums will equal n times the population mean. The standard deviation of the distribution of the sample means, \(\frac{\sigma }{\sqrt{n}}\), is called the standard error of the mean.
Normal Distribution
a continuous random variable (RV) with pdf \(f\left(x\right)\text{ = }\frac{1}{\sigma \sqrt{2\pi }} {e}^{\frac{–{\text{(}x\text{ }–\text{ }\mu \right)}^{2}}{2{\sigma }^{2}}}\), where μ is the mean of the distribution and σ is the standard deviation; notation: Χ ~ N(μ, σ). If μ = 0 and σ = 1, the RV is called a standard normal distribution.
Standard Error of the Mean
the standard deviation of the distribution of the sample means, or \(\frac{\sigma }{\sqrt{n}}\).

License

Icon for the Creative Commons Attribution 4.0 International License

The Central Limit Theorem for Sample Means (Averages) Copyright © 2013 by OpenStaxCollege is licensed under a Creative Commons Attribution 4.0 International License, except where otherwise noted.