Unit 7, lesson 105

Power Series Theorems

How to add, multiply, divide, substitute, differentiate and integrate power series, where each result is valid, and what happens at the endpoints, including Abel's theorem.

  • Theory part 209
  • Practice part 210
  • Power Series

Once you know that

11−x=1+x+x2+⋯for ∣x∣<1,\frac{1}{1 - x} = 1 + x + x^2 + \cdots \qquad \text{for } \lvert x \rvert < 1,

you can build many more series from it without computing a single derivative. Substitute, multiply, differentiate, integrate. Each move is legal inside a certain interval, and the main skill is knowing which interval that is. Below, every series has positive radius and is centered at the same point aa, often a=0a = 0.

Key terms

Addition

Definition Suppose f(x)=∑an(x−a)nf(x) = \sum a_n (x - a)^n for ∣x−a∣<R1\lvert x - a \rvert < R_1 and g(x)=∑bn(x−a)ng(x) = \sum b_n (x - a)^n for ∣x−a∣<R2\lvert x - a \rvert < R_2. Then for every constant kk and all xx with ∣x−a∣<min⁡(R1,R2)\lvert x - a \rvert < \min(R_1, R_2),

f(x)+g(x)=∑n=0∞(an+bn)(x−a)n,kf(x)=∑n=0∞kan(x−a)n.f(x) + g(x) = \sum_{n=0}^{\infty} (a_n + b_n)(x - a)^n, \qquad k f(x) = \sum_{n=0}^{\infty} k a_n (x - a)^n.

The radius of the sum is at least min⁡(R1,R2)\min(R_1, R_2) and can be larger.

In plain words Add the series term by term, matching powers. It works wherever both series work.

Example For ∣x∣<1\lvert x \rvert < 1,

11−x+11+x=∑n=0∞(1+(−1)n)xn=2+2x2+2x4+⋯ .\frac{1}{1 - x} + \frac{1}{1 + x} = \sum_{n=0}^{\infty} \bigl(1 + (-1)^n\bigr) x^n = 2 + 2x^2 + 2x^4 + \cdots.

The odd powers cancel, and the result agrees with 21−x2\frac{2}{1 - x^2}.

Multiplication

Definition With ff and gg as above, for ∣x−a∣<min⁡(R1,R2)\lvert x - a \rvert < \min(R_1, R_2) the product is the Cauchy product

f(x)g(x)=∑n=0∞cn(x−a)n,cn=∑k=0nakbn−k.f(x) g(x) = \sum_{n=0}^{\infty} c_n (x - a)^n, \qquad c_n = \sum_{k=0}^{n} a_k b_{n-k}.

This is valid because both series converge absolutely inside their radii.

In plain words Multiply as you would two long polynomials and collect all the ways to make each power.

Example Square ∑xn\sum x^n. Every aka_k and bkb_k is 11, so the coefficient cnc_n counts the n+1n + 1 terms a0bn,a1bn−1,…,anb0a_0 b_n, a_1 b_{n-1}, \ldots, a_n b_0. That gives cn=n+1c_n = n + 1 and

1(1−x)2=1+2x+3x2+4x3+⋯ ,∣x∣<1.\frac{1}{(1 - x)^2} = 1 + 2x + 3x^2 + 4x^3 + \cdots, \qquad \lvert x \rvert < 1.

Division where the denominator is nonzero

Definition Let ff and gg be given by power series about aa with positive radii, and suppose g(a)=b0≠0g(a) = b_0 \neq 0. Then there is an r>0r > 0 such that fg\frac{f}{g} equals a power series ∑qn(x−a)n\sum q_n (x - a)^n for ∣x−a∣<r\lvert x - a \rvert < r. Its coefficients are found from f=g⋅fgf = g \cdot \frac{f}{g} by matching powers,

an=∑k=0nbkqn−k,soqn=1b0(an−∑k=1nbkqn−k).a_n = \sum_{k=0}^{n} b_k q_{n-k}, \qquad \text{so} \qquad q_n = \frac{1}{b_0}\Bigl(a_n - \sum_{k=1}^{n} b_k q_{n-k}\Bigr).

The radius of the quotient can be smaller than both R1R_1 and R2R_2, because gg may vanish somewhere. If g(c)=0g(c) = 0 and f(c)≠0f(c) \neq 0 at a point cc inside both radii, the quotient series cannot converge beyond ∣c−a∣\lvert c - a \rvert. It can stop even sooner, because zeros of gg at complex numbers count too. For example 11+x2\frac{1}{1 + x^2} has radius 11 although 1+x21 + x^2 is never 00 on the real line.

In plain words Long division of series works near the center as long as the denominator does not start at zero. Expect the series to stop working by the time you reach a zero of the denominator, and possibly earlier.

Example Divide 11 by 1−x−x21 - x - x^2. Here b0=1b_0 = 1, b1=−1b_1 = -1, b2=−1b_2 = -1 and the rest are 00, so q0=1q_0 = 1, q1=q0=1q_1 = q_0 = 1 and qn=qn−1+qn−2q_n = q_{n-1} + q_{n-2} for n≥2n \ge 2.

11−x−x2=1+x+2x2+3x3+5x4+8x5+⋯ .\frac{1}{1 - x - x^2} = 1 + x + 2x^2 + 3x^3 + 5x^4 + 8x^5 + \cdots.

The denominator is 00 at x=5−12≈0.618x = \frac{\sqrt{5} - 1}{2} \approx 0.618, and the series converges only for ∣x∣<0.618…\lvert x \rvert < 0.618\ldots, well inside the infinite radius of 1−x−x21 - x - x^2.

Composition within convergence domains

Definition If f(u)=∑anunf(u) = \sum a_n u^n for ∣u∣<R\lvert u \rvert < R, and k≠0k \neq 0 and m≥1m \ge 1 is an integer, then

f(kxm)=∑n=0∞anknxmnwhenever ∣kxm∣<R.f(k x^m) = \sum_{n=0}^{\infty} a_n k^n x^{mn} \qquad \text{whenever } \lvert k x^m \rvert < R.

More generally, if g(x)=∑bnxng(x) = \sum b_n x^n with b0=0b_0 = 0, then f(g(x))f(g(x)) equals the series obtained by substituting and collecting powers for every xx with ∑∣bn∣∣x∣n<R\sum \lvert b_n \rvert \lvert x \rvert^n < R.

In plain words You may plug a series into a series, as long as the inner values stay inside the region where the outer series works.

Example Put u=−x2u = -x^2 into 11−u=∑un\frac{1}{1 - u} = \sum u^n, valid for ∣u∣<1\lvert u \rvert < 1.

11+x2=∑n=0∞(−1)nx2n,x2<1, that is ∣x∣<1.\frac{1}{1 + x^2} = \sum_{n=0}^{\infty} (-1)^n x^{2n}, \qquad x^2 < 1, \text{ that is } \lvert x \rvert < 1.

Term-by-term differentiation and integration

Definition If f(x)=∑cn(x−a)nf(x) = \sum c_n (x - a)^n has radius of convergence R>0R > 0, then ff is differentiable, hence continuous, on (a−R,a+R)(a - R, a + R), and there

f′(x)=∑n=1∞ncn(x−a)n−1,∫f(x) dx=C+∑n=0∞cn(x−a)n+1n+1.f'(x) = \sum_{n=1}^{\infty} n c_n (x - a)^{n-1}, \qquad \int f(x) \, dx = C + \sum_{n=0}^{\infty} c_n \frac{(x - a)^{n+1}}{n + 1}.

Both new series have the same radius RR. Repeating the argument shows ff has derivatives of all orders on (a−R,a+R)(a - R, a + R).

In plain words Inside the radius, a power series can be differentiated and integrated just like a polynomial, one term at a time.

Example Integrate 11+t=∑(−1)ntn\frac{1}{1 + t} = \sum (-1)^n t^n from 00 to xx, with ∣x∣<1\lvert x \rvert < 1.

ln⁡(1+x)=∑n=0∞(−1)nxn+1n+1=x−x22+x33−⋯ ,∣x∣<1.\ln(1 + x) = \sum_{n=0}^{\infty} (-1)^n \frac{x^{n+1}}{n + 1} = x - \frac{x^2}{2} + \frac{x^3}{3} - \cdots, \qquad \lvert x \rvert < 1.

The constant is 00 because both sides equal 00 at x=0x = 0.

Endpoint care

Definition Differentiation and integration keep the radius of convergence, but not necessarily the behavior at the endpoints x=a±Rx = a \pm R. Differentiating can lose endpoints and integrating can gain them, so each endpoint of the new series must be tested again.

In plain words The open interval stays the same. The ends have to be checked from scratch every time.

Example All three series below have R=1R = 1.

SeriesInterval of convergence
∑n=1∞xnn\sum_{n=1}^{\infty} \frac{x^n}{n}[−1,1)[-1, 1)
derivative ∑n=1∞xn−1\sum_{n=1}^{\infty} x^{n-1}(−1,1)(-1, 1)
antiderivative ∑n=1∞xn+1n(n+1)\sum_{n=1}^{\infty} \frac{x^{n+1}}{n(n + 1)}[−1,1][-1, 1]

Abel’s theorem

Definition Let f(x)=∑cn(x−a)nf(x) = \sum c_n (x - a)^n have radius RR with 0<R<∞0 < R < \infty. If the series converges at the endpoint x=a+Rx = a + R, then

lim⁡x→(a+R)−f(x)=∑n=0∞cnRn.\lim_{x \to (a + R)^-} f(x) = \sum_{n=0}^{\infty} c_n R^n.

The same holds at x=a−Rx = a - R with the limit from the right. So a power series is continuous on its whole interval of convergence, endpoints included.

In plain words If the series still converges at an edge, its value there is what the function approaches as you walk up to the edge.

Example The series for ln⁡(1+x)\ln(1 + x) converges at x=1x = 1 by the alternating series test, and ln⁡(1+x)\ln(1 + x) is continuous at 11. Abel’s theorem gives

1−12+13−14+⋯=lim⁡x→1−ln⁡(1+x)=ln⁡2.1 - \frac{1}{2} + \frac{1}{3} - \frac{1}{4} + \cdots = \lim_{x \to 1^-} \ln(1 + x) = \ln 2.

Check yourself

  1. Find a power series for 1(1+x)2\frac{1}{(1 + x)^2} and its interval of validity.
Show the answer

Differentiate 11+x=∑(−1)nxn\frac{1}{1 + x} = \sum (-1)^n x^n term by term to get

−1(1+x)2=∑n=1∞(−1)nnxn−1.-\frac{1}{(1 + x)^2} = \sum_{n=1}^{\infty} (-1)^n n x^{n-1}.

Changing the sign gives

1(1+x)2=1−2x+3x2−4x3+⋯for ∣x∣<1.\frac{1}{(1 + x)^2} = 1 - 2x + 3x^2 - 4x^3 + \cdots \qquad \text{for } \lvert x \rvert < 1.

At x=±1x = \pm 1 the terms do not tend to 00.

  1. Integrate the series for 11+x2\frac{1}{1 + x^2} to get a series for arctan⁡x\arctan x, then use Abel’s theorem at x=1x = 1.
Show the answer

Integrating from 00 to xx gives

arctan⁡x=∑n=0∞(−1)nx2n+12n+1for ∣x∣<1,\arctan x = \sum_{n=0}^{\infty} (-1)^n \frac{x^{2n+1}}{2n + 1} \qquad \text{for } \lvert x \rvert < 1,

with constant 00 since arctan⁡0=0\arctan 0 = 0. At x=1x = 1 the series 1−13+15−⋯1 - \frac{1}{3} + \frac{1}{5} - \cdots converges by the alternating series test, and arctan⁡\arctan is continuous at 11, so the sum is arctan⁡1=π4\arctan 1 = \frac{\pi}{4}.

  1. Find the coefficient of xnx^n in the Cauchy product of ∑xn\sum x^n and ∑2nxn\sum 2^n x^n, and say where the product equals 1(1−x)(1−2x)\frac{1}{(1 - x)(1 - 2x)}.
Show the answer

Here ak=1a_k = 1 and bk=2kb_k = 2^k, so the coefficient is

cn=∑k=0n1⋅2n−k=1+2+4+⋯+2n=2n+1−1.c_n = \sum_{k=0}^{n} 1 \cdot 2^{n-k} = 1 + 2 + 4 + \cdots + 2^n = 2^{n+1} - 1.

The two radii are 11 and 12\frac{1}{2}, so the product formula holds for ∣x∣<12\lvert x \rvert < \frac{1}{2}.

How this lesson connects

It also uses termwise operations.