Unit 4, lesson 40

Spread, Outliers and Standard Deviation

How range and standard deviation measure how spread out data are, why an outlier widens both, and what adding a constant or multiplying every value does to the mean and the standard deviation.

  • Theory part 79
  • Practice part 80
  • Data and Probability

Theory, part 79

Practice, part 80

Two archers both average a score of 10 on five arrows. One lands every arrow between 8 and 12. The other scatters arrows from 2 to 18. Their means are identical, yet nobody would call them equally reliable. Center tells you where data sits, and spread tells you how tightly it clusters there. On the SAT you will rarely compute a standard deviation by hand, but you will often be asked which data set has the larger one, or how it changes when the data change.

Key terms

Spread

Definition The spread, or variability, of a data set describes how far its values tend to lie from one another and from the center. Two data sets can have the same center and very different spreads. Common measures of spread are the range, the interquartile range and the standard deviation. Each is a nonnegative number. The range and the standard deviation are 00 exactly when all the values are equal, while the interquartile range can be 00 even when they are not, as for 1,5,5,5,5,5,91, 5, 5, 5, 5, 5, 9.

In plain words Spread answers the question of how much the values differ. Tightly bunched values mean small spread.

Example The data sets A={8,9,10,11,12}A = \{8, 9, 10, 11, 12\} and B={2,6,10,14,18}B = \{2, 6, 10, 14, 18\} both have mean 1010 and median 1010. On dot plots drawn with the same scale, the dots of BB stretch four times as far from the middle as the dots of AA. Comparing displays only makes sense when their scales match.

Range

Definition The range of a data set is

range=maximum−minimum.\text{range} = \text{maximum} - \text{minimum}.

It depends only on the two most extreme values.

In plain words The range is the distance from the smallest value to the largest.

Example The range of AA is 12−8=412 - 8 = 4 and the range of BB is 18−2=1618 - 2 = 16. Because it uses only two values, the range can jump when a single value changes, as the outlier section below shows.

Mean and deviations

Definition The mean of nn values x1,…,xnx_1, \dots, x_n is

xˉ=x1+x2+⋯+xnn.\bar{x} = \frac{x_1 + x_2 + \dots + x_n}{n}.

The deviation of a value xix_i from the mean is xi−xˉx_i - \bar{x}. Deviations are positive for values above the mean and negative for values below it, and the deviations of any data set always add up to 00.

In plain words A deviation measures how far a value sits from the mean, and on which side. Since the positive and negative deviations cancel, their plain average is always zero and says nothing about spread.

Example For AA the deviations from the mean 1010 are −2,−1,0,1,2-2, -1, 0, 1, 2, which add to 00. For BB they are −8,−4,0,4,8-8, -4, 0, 4, 8, each four times as large.

Standard deviation

Definition For a whole population of nn values with mean μ\mu, the population standard deviation is

σ=∑i=1n(xi−μ)2n.\sigma = \sqrt{\frac{\sum_{i=1}^{n} (x_i - \mu)^2}{n}}.

For a sample of n≥2n \ge 2 values with mean xˉ\bar{x}, the sample standard deviation divides by n−1n - 1 instead,

s=∑i=1n(xi−xˉ)2n−1.s = \sqrt{\frac{\sum_{i=1}^{n} (x_i - \bar{x})^2}{n - 1}}.

Either way, standard deviation squares the deviations, averages them (dividing by nn or by n−1n - 1) and takes the square root. It is not the same as the mean absolute deviation, which averages ∣xi−xˉ∣\lvert x_i - \bar{x} \rvert without squaring, and the two usually give different numbers. In the Desmos graphing calculator, stdev applied to a list gives the sample version and stdevp gives the population version.

In plain words Standard deviation is a typical distance from the mean, with large distances counting extra because they are squared. Bigger means more spread out.

Example For AA the squared deviations are 4,1,0,1,44, 1, 0, 1, 4, with sum 1010. Treating AA as a whole population,

σA=105=2≈1.41.\sigma_A = \sqrt{\frac{10}{5}} = \sqrt{2} \approx 1.41.

For BB the squared deviations add to 160160, so σB=32≈5.66\sigma_B = \sqrt{32} \approx 5.66, exactly 44 times σA\sigma_A. The mean absolute deviation of AA is 6/5=1.26/5 = 1.2, which differs from 1.411.41. The sample standard deviation of AA would be 10/4≈1.58\sqrt{10/4} \approx 1.58.

Outliers and spread

Definition An outlier is a value that lies unusually far from the rest of the data. One common rule flags values below Q1−1.5⋅IQRQ_1 - 1.5 \cdot \text{IQR} or above Q3+1.5⋅IQRQ_3 + 1.5 \cdot \text{IQR}. Moving one value much farther from the others increases the range whenever that value becomes the new maximum or minimum, and it increases the standard deviation, since its squared deviation grows quickly. The median is much less affected, and in larger data sets so is the interquartile range.

In plain words One far away value stretches the range and inflates the standard deviation, while the median stays put.

Example Replace 1212 in AA with 3030, a value far from the others, giving 8,9,10,11,308, 9, 10, 11, 30. The range grows from 44 to 2222, the mean rises from 1010 to 13.613.6 and the population standard deviation jumps from about 1.411.41 to about 8.268.26. The median is still 1010. With so few values the quartiles move too. Using the quartile convention from Reading Data Displays, the new set has Q1=8.5Q_1 = 8.5 and Q3=20.5Q_3 = 20.5, so the upper cutoff is 20.5+1.5⋅12=38.520.5 + 1.5 \cdot 12 = 38.5 and the common rule does not flag 3030 as an outlier, even though it sits far from the other values.

Shift and shifted distributions

Definition Adding the same constant kk to every value of a data set shifts the distribution. The mean, the median and the quartiles all increase by kk, while the range, the interquartile range and the standard deviation do not change, because every deviation from the mean stays the same. Two distributions that differ only by such a shift have equal spread and different centers.

In plain words Sliding all the dots along the number line moves the center but keeps the shape and width exactly the same.

Example Add 55 to every value of AA to get 13,14,15,16,1713, 14, 15, 16, 17. The mean goes from 1010 to 1515, but the deviations are still −2,−1,0,1,2-2, -1, 0, 1, 2, so the range is still 44 and the standard deviation is still 2\sqrt{2}. If an SAT question shows two dot plots with the same shape in different places, their standard deviations are equal.

Scale

Definition Multiplying every value of a data set by a constant cc scales the distribution. The mean and the median are multiplied by cc, and every deviation is multiplied by cc, so the range, the interquartile range and the standard deviation are multiplied by ∣c∣\lvert c \rvert. If σ\sigma is the original standard deviation, the new one is

σnew=∣c∣ σ.\sigma_{\text{new}} = \lvert c \rvert \, \sigma.

Combining both moves, the values cxi+kcx_i + k have mean cxˉ+kc\bar{x} + k and standard deviation ∣c∣σ\lvert c \rvert \sigma.

In plain words Stretching the number line stretches the spread by the same factor. A negative factor also flips the data, but a distance is never negative, so the spread uses the absolute value.

Example Multiply every value of AA by 33 to get 24,27,30,33,3624, 27, 30, 33, 36. The mean becomes 3030, the range becomes 1212 and the standard deviation becomes 32≈4.243\sqrt{2} \approx 4.24. Multiplying by −2-2 instead gives a mean of −20-20 and a standard deviation of 22≈2.832\sqrt{2} \approx 2.83, not a negative number.

Check yourself

  1. Data set XX is 4,5,5,5,64, 5, 5, 5, 6 and data set YY is 1,3,5,7,91, 3, 5, 7, 9. Which statement is true? (A) The standard deviation of XX is greater than that of YY. (B) The standard deviation of YY is greater than that of XX. (C) The standard deviations are equal because the means are equal. (D) The standard deviations are equal because each set has five values.
Show the answer

The correct choice is (B). Both sets have mean 55, but the values of YY lie much farther from 55, with deviations up to 44 compared with at most 11 for XX. Choice (A) reverses the comparison. Choices (C) and (D) fail because neither the mean nor the number of values decides the spread.

  1. A data set has mean 5050 and standard deviation 66. Every value is multiplied by 22, and then 1010 is added to each result. What is the standard deviation of the new data set? (A) 66 (B) 1212 (C) 1616 (D) 2222
Show the answer

The correct choice is (B). Multiplying by 22 doubles every deviation, so the standard deviation becomes 1212, and adding 1010 shifts the data without changing the spread. Choice (D) wrongly adds 1010 to the spread, (C) adds 1010 to the original 66, and (A) ignores the doubling. The new mean is 2⋅50+10=1102 \cdot 50 + 10 = 110.

  1. The data set 10,12,14,16,1810, 12, 14, 16, 18 is changed by replacing 1818 with 4040. Which of the following must be true for the new data set? (A) The mean decreases. (B) The range stays the same. (C) The standard deviation increases. (D) The median increases.
Show the answer

The correct choice is (C). The value 4040 lies far from the rest, so the deviations grow and the population standard deviation rises from about 2.832.83 to about 10.9810.98. The mean increases from 1414 to 18.418.4, so (A) fails. The range grows from 88 to 3030, so (B) fails. The middle value is still 1414, so (D) fails.

How this lesson connects