Unit 4, lesson 21

Higher-Order Constant-Coefficient Equations

How the characteristic polynomial of an nth-order constant-coefficient equation and the multiplicity of its roots give n polynomial-exponential solutions, also for repeated complex roots, and how n initial values select one.

  • Video 21
  • Linear Theory and Constant Coefficients

The equation y′′′−3y′′+3y′−y=0y''' - 3y'' + 3y' - y = 0, with tt as the independent variable and y′=dy/dty' = dy/dt, involves three derivatives, so a starting value and a starting slope no longer fix a solution. Its characteristic polynomial is (r−1)3(r - 1)^3, which has only the root 11, yet the equation needs three independent solutions. Where do the other two come from? This lesson shows how the multiplicity of each root supplies the missing solutions as polynomials times exponentials, for real and complex roots alike, and how nn initial values select exactly one solution of an equation of order nn.

Key terms

Higher-order characteristic polynomial

Definition Let yy be a function of tt, with y′=dy/dty' = dy/dt and y(k)y^{(k)} its kkth derivative. A homogeneous linear equation of order nn with constant coefficients is

any(n)+an−1y(n−1)+⋯+a1y′+a0y=0,\begin{aligned} &a_ny^{(n)} + a_{n-1}y^{(n-1)} + \cdots \\[0.2em] &\quad + a_1y' + a_0y = 0, \end{aligned}

with real constants a0,…,ana_0, \ldots, a_n and an≠0a_n \ne 0. Write L[y]L[y] for its left side. For every constant rr, real or complex, substituting erte^{rt} gives L[ert]=P(r) ertL[e^{rt}] = P(r)\,e^{rt} with the characteristic polynomial

P(r)=anrn+an−1rn−1+⋯+a1r+a0.\begin{aligned} P(r) &= a_nr^n + a_{n-1}r^{n-1} \\[0.2em] &\quad + \cdots + a_1r + a_0. \end{aligned}

Since an≠0a_n \ne 0, the polynomial has degree exactly nn, and erte^{rt} is a solution exactly when P(r)=0P(r) = 0. By the fundamental theorem of algebra, PP has nn complex roots when each is counted as often as its multiplicity. Writing DD for differentiation with respect to tt, the equation reads P(D) y=0P(D)\,y = 0. Because the coefficients are constant, a factorization P(r)=an(r−r1)⋯(r−rn)P(r) = a_n(r - r_1)\cdots(r - r_n) over the complex numbers gives P(D)=an(D−r1)⋯(D−rn)P(D) = a_n(D - r_1)\cdots(D - r_n), and these factors can be applied in any order.

In plain words Each derivative of erte^{rt} brings out one more factor of rr, so an equation with nn derivatives becomes a polynomial equation of degree nn. The order of the equation and the degree of the polynomial are the same number, but they are different ideas, one about derivatives and one about powers of rr.

Example For y′′′−6y′′+11y′−6y=0y''' - 6y'' + 11y' - 6y = 0 the characteristic polynomial r3−6r2+11r−6r^3 - 6r^2 + 11r - 6 factors as

(r−1)(r−2)(r−3).(r - 1)(r - 2)(r - 3).

The roots 11, 22 and 33 are distinct, so ete^t, e2te^{2t} and e3te^{3t} are solutions, and every solution is C1et+C2e2t+C3e3tC_1e^t + C_2e^{2t} + C_3e^{3t}.

Root multiplicity

Definition A root r0r_0 of PP has multiplicity mm if

P(r)=(r−r0)m Q(r)P(r) = (r - r_0)^m\,Q(r)

for a polynomial QQ with Q(r0)≠0Q(r_0) \ne 0. Equivalently, P(r0)=P′(r0)=⋯=P(m−1)(r0)=0P(r_0) = P'(r_0) = \cdots = P^{(m-1)}(r_0) = 0 and P(m)(r0)≠0P^{(m)}(r_0) \ne 0. A root of multiplicity 11 is simple. Over the complex numbers the multiplicities of all the roots add up to the degree nn. Multiplicity is an exact property of the polynomial. Roots that are numerically close but not equal are different roots, each with its own multiplicity, however close they are.

In plain words The multiplicity counts how many times the factor r−r0r - r_0 appears in the polynomial. It also counts how many independent solutions that root has to supply, which is why a repeated root cannot be listed just once.

Example The polynomial (r−1)3=r3−3r2+3r−1(r - 1)^3 = r^3 - 3r^2 + 3r - 1 has the single root 11 with multiplicity 33, and indeed P(1)=P′(1)=P′′(1)=0P(1) = P'(1) = P''(1) = 0 while P′′′(1)=6P'''(1) = 6. The polynomial r4−2r3+r2=r2(r−1)2r^4 - 2r^3 + r^2 = r^2(r - 1)^2 has the roots 00 and 11, each of multiplicity 22, and 2+2=42 + 2 = 4 is its degree. By contrast, r2−2r+0.9999=(r−0.99)(r−1.01)r^2 - 2r + 0.9999 = (r - 0.99)(r - 1.01) has two simple roots. Its equation y′′−2y′+0.9999y=0y'' - 2y' + 0.9999y = 0 has the fundamental set e0.99te^{0.99t}, e1.01te^{1.01t} with no factor tt, and their Wronskian 0.02 e2t0.02\,e^{2t} is small but never zero.

Polynomial-exponential solutions

Definition Let r0r_0 be a root of PP of multiplicity mm. Then the mm polynomial-exponential functions

er0t, ter0t, …, tm−1er0te^{r_0t},\ te^{r_0t},\ \ldots,\ t^{m-1}e^{r_0t}

solve P(D) y=0P(D)\,y = 0. The reason is the shift identity

(D−r0)(er0tp)=er0tp′,(D - r_0)\bigl(e^{r_0t}p\bigr) = e^{r_0t}p',

valid for every differentiable function pp of tt, because the term r0er0tpr_0e^{r_0t}p from the product rule cancels. For a polynomial pp, applying D−r0D - r_0 a total of mm times gives er0tp(m)e^{r_0t}p^{(m)}, which is zero whenever pp has degree less than mm. Since P(D)=Q(D)(D−r0)mP(D) = Q(D)(D - r_0)^m, each tker0tt^ke^{r_0t} with k<mk < m is a solution. Collecting these functions over all the roots gives exactly nn functions, and they are linearly independent on every interval, so they form a fundamental set, also called a basis of solutions. For a single root the independence is clear, since dividing a vanishing combination by er0te^{r_0t} leaves a polynomial that is zero on a whole interval, so all its coefficients are zero. A root 00 of multiplicity mm contributes the powers 1,t,…,tm−11, t, \ldots, t^{m-1}. For a root that is not real these functions are complex-valued, and their real and imaginary parts give the real solutions described under repeated complex roots.

In plain words A root that appears mm times supplies mm solutions, the exponential itself and the exponential times tt, t2t^2 and so on up to tm−1t^{m-1}. The powers of tt make up exactly the solutions that a repeated root would otherwise lose.

Example The equation y(4)−2y′′′+y′′=0y^{(4)} - 2y''' + y'' = 0 has P(r)=r2(r−1)2P(r) = r^2(r - 1)^2. The double root 00 gives 11 and tt, and the double root 11 gives ete^t and tette^t, so every solution is

y=C1+C2t+(C3+C4t) et.\begin{aligned} y &= C_1 + C_2t \\[0.2em] &\quad + (C_3 + C_4t)\,e^t. \end{aligned}

Here P(D)=D2(D−1)2P(D) = D^2(D - 1)^2. The shift identity gives (D−1)(tet)=et(D - 1)(te^t) = e^t and then (D−1)2(tet)=0(D - 1)^2(te^t) = 0. One more power is too many. The function t2ett^2e^t is not a solution, since (D−1)2(t2et)=2et(D - 1)^2(t^2e^t) = 2e^t and D2(2et)=2et≠0D^2(2e^t) = 2e^t \ne 0.

Repeated complex roots

Definition Let the coefficients a0,…,ana_0, \ldots, a_n be real, and let α±iβ\alpha \pm i\beta with β>0\beta > 0 be a pair of complex conjugate roots of PP. For real coefficients both roots of the pair have the same multiplicity mm, and the pair contributes the 2m2m real solutions

tkeαtcos⁡βt,tkeαtsin⁡βt,k=0,1,…,m−1.\begin{gathered} t^ke^{\alpha t}\cos \beta t, \\[0.2em] t^ke^{\alpha t}\sin \beta t, \\[0.4em] k = 0, 1, \ldots, m - 1. \end{gathered}

They are the real and imaginary parts of the complex solutions tke(α+iβ)tt^ke^{(\alpha + i\beta)t}, and real and imaginary parts of a solution are solutions because the coefficients are real. Every power tkt^k with k<mk < m therefore appears with both the cosine and the sine. Replacing the 2m2m complex basis functions of the pair by these 2m2m real ones still gives a fundamental set.

In plain words Each repetition of a complex pair adds one more power of tt in front of both the cosine and the sine. A repeated pair ±iβ\pm i\beta on the imaginary axis therefore gives oscillations whose amplitude grows like a power of tt, even though the real part of the roots is zero.

Example The polynomial (r2+1)2=r4+2r2+1(r^2 + 1)^2 = r^4 + 2r^2 + 1 belongs to the equation y(4)+2y′′+y=0y^{(4)} + 2y'' + y = 0. Its roots ii and −i-i each have multiplicity 22, so the real basis is cos⁡t\cos t, sin⁡t\sin t, tcos⁡tt\cos t and tsin⁡tt\sin t. To check y=tcos⁡ty = t\cos t directly, its derivatives are y′′=−2sin⁡t−tcos⁡ty'' = -2\sin t - t\cos t and y(4)=4sin⁡t+tcos⁡ty^{(4)} = 4\sin t + t\cos t, so y(4)+2y′′+y=4sin⁡t+tcos⁡t−4sin⁡t−2tcos⁡t+tcos⁡t=0y^{(4)} + 2y'' + y = 4\sin t + t\cos t - 4\sin t - 2t\cos t + t\cos t = 0. This solution is unbounded although both roots have real part 00. The two constant-amplitude solutions cos⁡t\cos t and sin⁡t\sin t would not be enough, since the equation has order 44.

Initial data for an nth-order equation

Definition Consider an equation of order nn with real constant coefficients and an≠0a_n \ne 0. For every point t0t_0 and all real numbers k0,k1,…,kn−1k_0, k_1, \ldots, k_{n-1}, the initial-value problem with

y(j)(t0)=kj,j=0,1,…,n−1,\begin{gathered} y^{(j)}(t_0) = k_j, \\[0.4em] j = 0, 1, \ldots, n - 1, \end{gathered}

has exactly one solution, and it is defined for all real tt. For a linear equation of order nn with variable coefficients the same holds on each regular interval, where the leading coefficient is never zero and the normalized coefficients are continuous. Order nn calls for exactly nn conditions, the value and the first n−1n - 1 derivatives at one point. With a basis y1,…,yny_1, \ldots, y_n, the conditions become the nn linear equations

∑i=1nCi yi(j)(t0)=kj\sum_{i=1}^{n} C_i\,y_i^{(j)}(t_0) = k_j

for j=0,1,…,n−1j = 0, 1, \ldots, n - 1, and their determinant is the nn by nn Wronskian of the basis at t0t_0, which is not zero. The number of basis functions always matches the order, since each real root contributes its multiplicity, each complex conjugate pair contributes twice its multiplicity, and the total is nn.

In plain words An equation with three derivatives needs a starting value, a starting slope and a starting second derivative, and an equation of order nn needs nn such numbers. Fewer conditions leave a whole family of solutions, and the full set of nn conditions picks out one.

Example Solve y′′′−3y′′+3y′−y=0y''' - 3y'' + 3y' - y = 0 with y(0)=1y(0) = 1, y′(0)=0y'(0) = 0 and y′′(0)=0y''(0) = 0. The characteristic polynomial is (r−1)3(r - 1)^3, so

y=et(A+Bt+Ct2).y = e^t(A + Bt + Ct^2).

Differentiating the product gives y(0)=Ay(0) = A, y′(0)=A+By'(0) = A + B and y′′(0)=A+2B+2Cy''(0) = A + 2B + 2C. The data then give A=1A = 1, B=−1B = -1 and C=12C = \tfrac{1}{2}, so

y=et(1−t+12t2).y = e^t\left(1 - t + \tfrac{1}{2}t^2\right).

As a check, y′=12t2ety' = \tfrac{1}{2}t^2e^t and y′′=(t+12t2)ety'' = \left(t + \tfrac{1}{2}t^2\right)e^t both vanish at 00, and applying D−1D - 1 three times differentiates the quadratic factor three times and gives 00.

Check yourself

  1. Find the general solution of y′′′−4y′′+4y′=0y''' - 4y'' + 4y' = 0 and count its basis functions.
Show the answer

The characteristic polynomial is r3−4r2+4r=r(r−2)2r^3 - 4r^2 + 4r = r(r - 2)^2. The simple root 00 gives 11, and the double root 22 gives e2te^{2t} and te2tte^{2t}, so

y=C1+(C2+C3t) e2t.y = C_1 + (C_2 + C_3t)\,e^{2t}.

That is three basis functions for an equation of order 33. The family C1+C2e2tC_1 + C_2e^{2t} would miss te2tte^{2t} and could not meet every set of three initial values.

  1. Find the general solution of y(4)+8y′′+16y=0y^{(4)} + 8y'' + 16y = 0. Which solutions stay bounded as t→∞t \to \infty?
Show the answer

The characteristic polynomial is r4+8r2+16=(r2+4)2r^4 + 8r^2 + 16 = (r^2 + 4)^2, so the roots 2i2i and −2i-2i each have multiplicity 22, and every solution is y=u(t)+t v(t)y = u(t) + t\,v(t) with

u=C1cos⁡2t+C2sin⁡2t,v=C3cos⁡2t+C4sin⁡2t.\begin{gathered} u = C_1\cos 2t + C_2\sin 2t, \\[0.4em] v = C_3\cos 2t + C_4\sin 2t. \end{gathered}

The part uu is at most ∣C1∣+∣C2∣\lvert C_1 \rvert + \lvert C_2 \rvert in absolute value for every tt. If C3C_3 and C4C_4 are not both zero, write v=Rcos⁡(2t−φ)v = R\cos(2t - \varphi) with R>0R > 0. At the times t=φ/2+πjt = \varphi/2 + \pi j for whole numbers jj, the term t v(t)t\,v(t) equals RtRt, which grows without bound while uu stays bounded. So the bounded solutions are exactly those with C3=C4=0C_3 = C_4 = 0, even though every root has real part 00.

  1. For y′′′+y′=0y''' + y' = 0, show that y(0)=2y(0) = 2 and y′(0)=1y'(0) = 1 do not determine a solution. Then add y′′(0)=−1y''(0) = -1 and solve.
Show the answer

The characteristic polynomial is r3+r=r(r2+1)r^3 + r = r(r^2 + 1) with roots 00 and ±i\pm i, so y=C1+C2cos⁡t+C3sin⁡ty = C_1 + C_2\cos t + C_3\sin t. Then y(0)=C1+C2y(0) = C_1 + C_2, y′(0)=C3y'(0) = C_3 and y′′(0)=−C2y''(0) = -C_2. The first two conditions give C1+C2=2C_1 + C_2 = 2 and C3=1C_3 = 1, which leaves the whole family y=(2−C2)+C2cos⁡t+sin⁡ty = (2 - C_2) + C_2\cos t + \sin t, one solution for each value of C2C_2. The third condition gives C2=1C_2 = 1, so C1=1C_1 = 1 and

y=1+cos⁡t+sin⁡t.y = 1 + \cos t + \sin t.

An equation of order 33 needs all three values.

How this lesson connects