Unit 9, lesson 107

Mathematical Induction

How to prove a statement for every integer from some starting point on by checking a first case and showing that each case implies the next, and why checking many cases is never a proof.

  • Theory part 213
  • Practice part 214
  • Induction and the Binomial Theorem

Picture a long row of dominoes. You do not need to watch every one of them fall to know that all of them will. It is enough to know that the first one falls and that each falling domino knocks over the next. Mathematical induction turns this picture into a way of proving a statement for every whole number at once, something that no amount of checking cases can do.

Key terms

Statement indexed by integers

Definition A statement indexed by integers is a family of statements P(n)P(n), one for each integer nn in a set such as {1,2,3,… }\{1, 2, 3, \dots\} or {n0,n0+1,n0+2,… }\{n_0, n_0 + 1, n_0 + 2, \dots\}. For each such nn the statement P(n)P(n) is a definite claim that is either true or false. Induction proves results that say P(n)P(n) is true for every integer n≥n0n \ge n_0.

In plain words One formula stands for an infinite list of claims, one claim for each whole number. Any single claim can be checked, but there are infinitely many of them.

Example Let P(n)P(n) be the claim that the first nn odd numbers add up to n2n^2,

1+3+5+⋯+(2n−1)=n2.1 + 3 + 5 + \cdots + (2n - 1) = n^2.

Then P(3)P(3) is the claim 1+3+5=91 + 3 + 5 = 9, which is true, and P(4)P(4) is the claim 1+3+5+7=161 + 3 + 5 + 7 = 16, which is also true. Each value of nn gives a different claim.

Principle of mathematical induction

Definition Let n0n_0 be an integer and let P(n)P(n) be a statement for each integer n≥n0n \ge n_0. Suppose that

  1. the statement P(n0)P(n_0) is true, and
  2. for every integer k≥n0k \ge n_0, if P(k)P(k) is true then P(k+1)P(k + 1) is true.

Then P(n)P(n) is true for every integer n≥n0n \ge n_0. Part 1 is the base case and part 2 is the inductive step. The reason is that the base case gives P(n0)P(n_0), the step with k=n0k = n_0 then gives P(n0+1)P(n_0 + 1), the step with k=n0+1k = n_0 + 1 gives P(n0+2)P(n_0 + 2), and no integer from n0n_0 on is ever skipped. This principle is a basic property of the integers. It is equivalent to the fact that every nonempty set of integers that are all at least n0n_0 has a smallest element.

In plain words Knock over the first domino, and make sure that every domino knocks over the next one. Then every domino falls.

Example Here is a complete proof that 1+3+⋯+(2n−1)=n21 + 3 + \cdots + (2n - 1) = n^2 for every integer n≥1n \ge 1. For the base case n=1n = 1 the left side is 11 and the right side is 12=11^2 = 1. For the inductive step, let k≥1k \ge 1 and assume that 1+3+⋯+(2k−1)=k21 + 3 + \cdots + (2k - 1) = k^2. The next odd number is 2(k+1)−1=2k+12(k + 1) - 1 = 2k + 1, so

1+3+⋯+(2k−1)+(2k+1)=k2+2k+1=(k+1)2,\begin{aligned} &1 + 3 + \cdots + (2k - 1) + (2k + 1) \\[0.4em] &\quad = k^2 + 2k + 1 \\[0.4em] &\quad = (k + 1)^2, \end{aligned}

which is the claim for n=k+1n = k + 1. By induction the formula holds for every n≥1n \ge 1.

Base case

Definition The base case is the proof of the first statement P(n0)P(n_0), usually by direct computation. It cannot be skipped. An inductive step on its own shows only that each statement implies the next one, and a chain of implications proves nothing unless its first link is true. Some proofs need two base cases. When the statement is about a sequence whose rule uses the two previous terms, as the Fibonacci rule does, the step usually shows that P(k)P(k) and P(k+1)P(k + 1) together give P(k+2)P(k + 2) for every k≥n0k \ge n_0. Then both P(n0)P(n_0) and P(n0+1)P(n_0 + 1) must be checked directly, and after that each case follows from the two before it.

In plain words The step makes sure the dominoes stand close enough together. The base case is the push that starts them falling, and without it nothing has to fall.

Example Consider the false claim that n2+nn^2 + n is odd for every n≥1n \ge 1. Its inductive step actually works. If k2+kk^2 + k is odd, then

(k+1)2+(k+1)=(k2+k)+2(k+1)\begin{aligned} &(k + 1)^2 + (k + 1) \\[0.4em] &\quad = (k^2 + k) + 2(k + 1) \end{aligned}

is an odd number plus an even number, so it is odd. But the base case fails, since 12+1=21^2 + 1 = 2 is even. In fact n2+n=n(n+1)n^2 + n = n(n + 1) is a product of two consecutive integers, one of which is even, so it is even for every nn. Only the base case catches the error.

Inductive hypothesis

Definition In the inductive step one fixes an arbitrary integer k≥n0k \ge n_0 and assumes that P(k)P(k) is true. This assumption is the inductive hypothesis, and the task is to deduce P(k+1)P(k + 1) from it. Since kk was arbitrary, this proves that P(k)P(k) implies P(k+1)P(k + 1) for every k≥n0k \ge n_0. The hypothesis is about one value kk only and never claims that P(n)P(n) holds for all nn, so the argument is not circular.

In plain words You do not assume what you want to prove. You assume one case and show that the next case follows from it.

Example Take the formula

1+2+⋯+n=n(n+1)2for n≥1.\begin{gathered} 1 + 2 + \cdots + n = \frac{n(n + 1)}{2} \\[0.8em] \text{for } n \ge 1. \end{gathered}

The base case is 1=1⋅221 = \frac{1 \cdot 2}{2}. Before doing anything else in the step, write down what you may assume and what you must reach. The hypothesis and the goal are

1+2+⋯+k=k(k+1)2and1+2+⋯+(k+1)=(k+1)(k+2)2.\begin{gathered} 1 + 2 + \cdots + k = \frac{k(k + 1)}{2} \\[0.8em] \text{and} \\[0.4em] \begin{aligned} &1 + 2 + \cdots + (k + 1) \\[0.4em] &\quad = \frac{(k + 1)(k + 2)}{2}. \end{aligned} \end{gathered}

The sum in the goal is the sum in the hypothesis plus one more term, so

1+2+⋯+k+(k+1)=k(k+1)2+(k+1)=(k+1)(k+2)2,\begin{aligned} &1 + 2 + \cdots + k + (k + 1) \\[0.4em] &\quad = \frac{k(k + 1)}{2} + (k + 1) \\[0.8em] &\quad = \frac{(k + 1)(k + 2)}{2}, \end{aligned}

which is the goal. The hypothesis was used at the first equals sign, where the sum of the first kk terms was replaced by k(k+1)2\frac{k(k + 1)}{2}.

Inductive step

Definition The inductive step is the proof that for every integer k≥n0k \ge n_0, the truth of P(k)P(k) implies the truth of P(k+1)P(k + 1). A typical step writes out P(k+1)P(k + 1), finds P(k)P(k) or a piece of it inside, replaces that piece using the inductive hypothesis, and simplifies until P(k+1)P(k + 1) appears. The step must work for every k≥n0k \ge n_0, with kk kept as a letter, and not just for a few numbers.

In plain words The step is a recipe that turns any true case into the next true case. You show that the recipe works in general.

Example Here is a proof that 4n−14^n - 1 is divisible by 33 for every integer n≥1n \ge 1. For n=1n = 1 the number is 33. Now let k≥1k \ge 1 and suppose that 4k−1=3m4^k - 1 = 3m for some integer mm. Then

4k+1−1=4⋅4k−1=4(4k−1)+3=4⋅3m+3=3(4m+1),\begin{aligned} 4^{k+1} - 1 &= 4 \cdot 4^k - 1 \\[0.4em] &= 4(4^k - 1) + 3 \\[0.4em] &= 4 \cdot 3m + 3 \\[0.4em] &= 3(4m + 1), \end{aligned}

and 4m+14m + 1 is an integer, so 4k+1−14^{k+1} - 1 is divisible by 33. The main move was to rewrite 4k+1−14^{k+1} - 1 so that the old number 4k−14^k - 1 appears inside it.

Starting index

Definition The starting index is the integer n0n_0 of the base case. It need not be 11. It can be 00, or any integer from which the statement is meant to hold. The base case is checked at n0n_0, and the inductive step may use the assumption k≥n0k \ge n_0. The conclusion then covers exactly the integers n≥n0n \ge n_0 and says nothing about smaller ones.

In plain words Start the dominoes where the statement starts being true. The step is allowed to use the fact that kk is at least that large, and often it needs to.

Example The inequality n!>2nn! > 2^n fails for small nn and then holds.

nn1122334455
n!n!1122662424120120
2n2^n22448816163232

So take n0=4n_0 = 4, where 24>1624 > 16. If k≥4k \ge 4 and k!>2kk! > 2^k, then

(k+1)!=(k+1)⋅k!>(k+1)⋅2k>2⋅2k=2k+1,\begin{aligned} (k + 1)! &= (k + 1) \cdot k! \\[0.4em] &> (k + 1) \cdot 2^k \\[0.4em] &> 2 \cdot 2^k \\[0.4em] &= 2^{k+1}, \end{aligned}

where the last step uses k+1>2k + 1 > 2. So n!>2nn! > 2^n for every integer n≥4n \ge 4.

Proof versus checking examples

Definition Checking P(n)P(n) for finitely many values of nn, however many, does not prove that P(n)P(n) holds for every nn. A pattern seen in examples is a conjecture. It becomes a theorem only through an argument that covers every nn at once, and induction is one such argument. On the other hand, a single value of nn for which P(n)P(n) is false, called a counterexample, is enough to show that the general claim is false.

In plain words Examples tell you what might be true. Only a proof tells you that it is true, while one counterexample shows that it is not.

Example The numbers n2+n+41n^2 + n + 41 for n=0,1,2,3,4,5n = 0, 1, 2, 3, 4, 5 are 41,43,47,53,61,7141, 43, 47, 53, 61, 71, and all of them are prime. In fact n2+n+41n^2 + n + 41 is prime for every nn from 00 to 3939, forty cases in a row. Yet for n=40n = 40 the value is

402+40+41=1681=412,40^2 + 40 + 41 = 1681 = 41^2,

which is not prime. Forty confirmations were not a proof.

Check yourself

  1. Prove that 1+2+4+⋯+2n−1=2n−11 + 2 + 4 + \cdots + 2^{n-1} = 2^n - 1 for every integer n≥1n \ge 1.
Show the answer

For n=1n = 1 both sides equal 11. Now assume that 1+2+⋯+2k−1=2k−11 + 2 + \cdots + 2^{k-1} = 2^k - 1 for some k≥1k \ge 1. Adding the next term 2k2^k gives

1+2+⋯+2k−1+2k=(2k−1)+2k=2k+1−1,\begin{aligned} &1 + 2 + \cdots + 2^{k-1} + 2^k \\[0.4em] &\quad = (2^k - 1) + 2^k \\[0.4em] &\quad = 2^{k+1} - 1, \end{aligned}

which is the formula for n=k+1n = k + 1. By induction it holds for every n≥1n \ge 1.

  1. Prove that 2n>n22^n > n^2 for every integer n≥5n \ge 5. Why can the proof not start at n=1n = 1?
Show the answer

For n=5n = 5 the inequality reads 32>2532 > 25. Now assume that 2k>k22^k > k^2 for some k≥5k \ge 5. Then 2k+1=2⋅2k>2k22^{k+1} = 2 \cdot 2^k > 2k^2, and

2k2−(k+1)2=k2−2k−1=(k−1)2−2>0for k≥3,\begin{aligned} 2k^2 - (k + 1)^2 &= k^2 - 2k - 1 \\[0.4em] &= (k - 1)^2 - 2 \\[0.4em] &> 0 \quad \text{for } k \ge 3, \end{aligned}

so 2k+1>2k2>(k+1)22^{k+1} > 2k^2 > (k + 1)^2. By induction the inequality holds for every n≥5n \ge 5. Starting lower fails because the inequality is true for n=1n = 1 but false for n=2,3,4n = 2, 3, 4, where the two sides are 44 and 44, then 88 and 99, then 1616 and 1616. So the claim for every n≥1n \ge 1 is false and has no proof. The chain breaks at the step from k=1k = 1 to k=2k = 2, which fits the fact that the algebra above needs k≥3k \ge 3. The smallest starting index from which every case is true is 55.

  1. Prove that the formula below holds for every integer n≥1n \ge 1.
12+22+⋯+n2=n(n+1)(2n+1)6\begin{aligned} &1^2 + 2^2 + \cdots + n^2 \\[0.4em] &\quad = \frac{n(n + 1)(2n + 1)}{6} \end{aligned}
Show the answer

For n=1n = 1 both sides equal 11. Assume the formula for some k≥1k \ge 1 and add the next term (k+1)2(k + 1)^2,

k(k+1)(2k+1)6+(k+1)2=(k+1)(k(2k+1)+6(k+1))6=(k+1)(k+2)(2k+3)6,\begin{aligned} &\frac{k(k + 1)(2k + 1)}{6} + (k + 1)^2 \\[0.8em] &\enspace = \frac{(k + 1)\bigl(k(2k + 1) + 6(k + 1)\bigr)}{6} \\[0.8em] &\enspace = \frac{(k + 1)(k + 2)(2k + 3)}{6}, \end{aligned}

since 2k2+7k+6=(k+2)(2k+3)2k^2 + 7k + 6 = (k + 2)(2k + 3). This is the formula for n=k+1n = k + 1, because 2(k+1)+1=2k+32(k + 1) + 1 = 2k + 3. By induction it holds for every n≥1n \ge 1.

How this lesson connects