Unit 8, lesson 40

Polynomial Projectors and Diagonalizability

How the Euclidean algorithm and Bézout's identity turn coprime factors into polynomial projectors, why diagonalizability means a minimal polynomial with distinct linear factors, and when commuting operators share an eigenbasis.

  • Video 40
  • Polynomial Tools and Cyclic Structure

The matrix AA with rows (1,1)(1, 1) and (0,2)(0, 2) has eigenvalues 11 and 22. The matrix 2I−A2I - A sends every vector onto the eigenline for 11, the matrix A−IA - I sends every vector onto the eigenline for 22, and the two outputs add up to the original vector because (2I−A)+(A−I)=I(2I - A) + (A - I) = I, an evaluation of the scalar identity (2−t)+(t−1)=1(2 - t) + (t - 1) = 1. This lesson turns that observation into a method, using the Euclidean algorithm and Bézout’s identity to build projectors from any factorization of an annihilating polynomial into two coprime factors. The method gives an exact test for diagonalizability and a common eigenbasis for commuting diagonalizable operators. Throughout, F\mathbb{F} is R\mathbb{R} or C\mathbb{C}, VV is a nonzero finite-dimensional vector space over F\mathbb{F}, T∈Hom⁡(V,V)T \in \operatorname{Hom}(V, V), an n×nn \times n matrix over F\mathbb{F} stands for the operator on Fn\mathbb{F}^n given by multiplication by that matrix, and a tuple such as (1,1)(1, 1) stands for a column vector.

Key terms

Polynomial Euclidean algorithm

Definition Let a,b∈F[t]a, b \in \mathbb{F}[t], not both zero. A common divisor of aa and bb is a polynomial that divides both. The greatest common divisor gcd⁡(a,b)\gcd(a, b) is the monic common divisor that is divisible by every common divisor, and it is also the monic common divisor of largest degree. The Euclidean algorithm computes it when b≠0b \ne 0. Set r0=ar_0 = a and r1=br_1 = b, and as long as rk≠0r_k \ne 0 divide

rk−1=qk rk+rk+1,r_{k-1} = q_k\, r_k + r_{k+1},

with rk+1=0r_{k+1} = 0 or deg⁡rk+1<deg⁡rk\deg r_{k+1} < \deg r_k. The degrees of the nonzero remainders strictly decrease, so after finitely many steps rN+1=0r_{N+1} = 0 while rN≠0r_N \ne 0. Because rk+1=rk−1−qkrkr_{k+1} = r_{k-1} - q_k r_k, a polynomial divides both rk−1r_{k-1} and rkr_k exactly when it divides both rkr_k and rk+1r_{k+1}. Following the chain to the pair rN,0r_N, 0 shows that the common divisors of aa and bb are exactly the divisors of rNr_N. So gcd⁡(a,b)\gcd(a, b) exists and equals rNr_N divided by its leading coefficient. The algorithm uses only arithmetic with the coefficients, so for real polynomials it gives the same greatest common divisor over R\mathbb{R} as over C\mathbb{C}.

In plain words Divide, then divide the divisor by the remainder, and repeat. Each step replaces a pair of polynomials by a smaller pair with the same common divisors, and the last nonzero remainder, made monic, is the largest of them.

Example For a=t3−1a = t^3 - 1 and b=t2−1b = t^2 - 1,

t3−1=t (t2−1)+(t−1),t2−1=(t+1)(t−1)+0.\begin{aligned} t^3 - 1 &= t\,(t^2 - 1) + (t - 1), \\[0.4em] t^2 - 1 &= (t + 1)(t - 1) + 0. \end{aligned}

The last nonzero remainder t−1t - 1 is already monic, so gcd⁡(t3−1,t2−1)=t−1\gcd(t^3 - 1, t^2 - 1) = t - 1. Over C\mathbb{C} this matches the roots, since 11 is the only common root of the two polynomials.

Coprime polynomials

Definition Polynomials a,b∈F[t]a, b \in \mathbb{F}[t], not both zero, are coprime if gcd⁡(a,b)=1\gcd(a, b) = 1, that is, if their only common divisors are the nonzero constants. Over C\mathbb{C} two nonzero polynomials are coprime exactly when they have no common root. A common root λ\lambda gives the common factor t−λt - \lambda, and a nonconstant greatest common divisor has a complex root by the fundamental theorem of algebra. Since the greatest common divisor does not change from R\mathbb{R} to C\mathbb{C}, two real polynomials are coprime exactly when they have no common complex root. Comparing roots also shows that if f1,…,fsf_1, \dots, f_s are pairwise coprime, then f1f_1 is coprime to the product f2⋯fsf_2 \cdots f_s.

In plain words Coprime polynomials share no nonconstant factor. Over the complex numbers this simply means that they never vanish at the same point. Repeated factors inside one of the polynomials do not matter.

Example The polynomials (t−1)2(t - 1)^2 and t−2t - 2 are coprime, even though the first has a repeated factor. The polynomials t2+1t^2 + 1 and t3+t=t(t2+1)t^3 + t = t(t^2 + 1) have no common real root, because t2+1t^2 + 1 has no real roots at all, yet they are not coprime, because their greatest common divisor is t2+1t^2 + 1. A nonconstant polynomial, such as t−1t - 1, is never coprime to itself. This matters for the projectors below. For T=IT = I and a=b=t−1a = b = t - 1 the product a(T) b(T)a(T)\,b(T) is 00, yet ker⁡a(T)\ker a(T) and ker⁡b(T)\ker b(T) are both all of VV, so VV is not their direct sum.

Bézout’s identity

Definition Let a,b∈F[t]a, b \in \mathbb{F}[t], not both zero, and g=gcd⁡(a,b)g = \gcd(a, b). Bézout’s identity says that there are u,v∈F[t]u, v \in \mathbb{F}[t] with

u a+v b=g.u\,a + v\,b = g.

To find them, run the Euclidean algorithm. Each remainder rk+1=rk−1−qkrkr_{k+1} = r_{k-1} - q_k r_k is a combination of the two before it, so substituting backward expresses the last nonzero remainder rNr_N as a combination of r0=ar_0 = a and r1=br_1 = b, and dividing by its leading coefficient gives gg. In particular aa and bb are coprime if and only if ua+vb=1ua + vb = 1 for some u,v∈F[t]u, v \in \mathbb{F}[t]. The converse direction holds because a common divisor of aa and bb divides ua+vb=1ua + vb = 1 and so is constant. The pair u,vu, v is not unique. For coprime a,ba, b and every h∈F[t]h \in \mathbb{F}[t], the polynomials u+hbu + hb and v−hav - ha form a valid pair as well.

In plain words Bézout’s identity turns the absence of a common factor into an equation. Polynomial combinations of coprime aa and bb can produce exactly the constant 11, and that equation is what splits the space in the next card.

Example For a=t3a = t^3 and b=t2+1b = t^2 + 1 the algorithm runs

t3=t (t2+1)−t,t2+1=(−t)(−t)+1,−t=(−t)⋅1+0,\begin{aligned} t^3 &= t\,(t^2 + 1) - t, \\[0.4em] t^2 + 1 &= (-t)(-t) + 1, \\[0.4em] -t &= (-t) \cdot 1 + 0, \end{aligned}

so the greatest common divisor is 11. The second line gives 1=(t2+1)+t⋅(−t)1 = (t^2 + 1) + t \cdot (-t), and the first line gives −t=t3−t (t2+1)-t = t^3 - t\,(t^2 + 1). Substituting,

1=(t2+1)+t(t3−t (t2+1))=t⋅t3+(1−t2)(t2+1).\begin{aligned} 1 &= (t^2 + 1) + t\bigl(t^3 - t\,(t^2 + 1)\bigr) \\[0.4em] &= t \cdot t^3 + (1 - t^2)(t^2 + 1). \end{aligned}

So u=tu = t and v=1−t2v = 1 - t^2, and expanding confirms t4+(1−t4)=1t^4 + (1 - t^4) = 1.

Polynomial projector

Definition Let a,b∈F[t]a, b \in \mathbb{F}[t] be coprime with a(T) b(T)=0a(T)\,b(T) = 0, which holds for example when ab=μTab = \mu_T or ab=χTab = \chi_T. Choose u,vu, v with ua+vb=1ua + vb = 1 and set

P=v(T) b(T),Q=u(T) a(T).P = v(T)\,b(T), \qquad Q = u(T)\,a(T).

Then P+Q=IP + Q = I, P2=PP^2 = P, Q2=QQ^2 = Q and PQ=QP=0PQ = QP = 0, both commute with TT, and

im⁡P=ker⁡a(T),im⁡Q=ker⁡b(T),V=ker⁡a(T)⊕ker⁡b(T),\begin{gathered} \operatorname{im} P = \ker a(T), \\[0.4em] \operatorname{im} Q = \ker b(T), \\[0.4em] V = \ker a(T) \oplus \ker b(T), \end{gathered}

where both kernels are invariant under TT. So PP is the projection onto ker⁡a(T)\ker a(T) along ker⁡b(T)\ker b(T), and it does not depend on the choice of uu and vv. Evaluating ua+vb=1ua + vb = 1 at TT gives P+Q=IP + Q = I. Next a(T)P=v(T) a(T) b(T)=0a(T)P = v(T)\,a(T)\,b(T) = 0, so im⁡P⊆ker⁡a(T)\operatorname{im} P \subseteq \ker a(T), and for x∈ker⁡a(T)x \in \ker a(T) we get Qx=u(T) a(T) x=0Qx = u(T)\,a(T)\,x = 0, hence Px=xPx = x. So PP maps onto ker⁡a(T)\ker a(T) and fixes it, which gives P2=PP^2 = P. The same argument works for QQ. If zz lies in both kernels, then z=v(T) b(T) z+u(T) a(T) z=0z = v(T)\,b(T)\,z + u(T)\,a(T)\,z = 0, so the sum is direct, and x=Px+Qxx = Px + Qx shows that it is all of VV. The product PQPQ contains the factor a(T) b(T)a(T)\,b(T), so it is 00. A kernel ker⁡f(T)\ker f(T) is invariant because f(T) Tx=Tf(T) xf(T)\,Tx = T f(T)\,x. For pairwise coprime f1,…,fsf_1, \dots, f_s with (f1⋯fs)(T)=0(f_1 \cdots f_s)(T) = 0, splitting off one factor at a time gives

V=ker⁡f1(T)⊕⋯⊕ker⁡fs(T).V = \ker f_1(T) \oplus \cdots \oplus \ker f_s(T).

In plain words The projector onto the kernel of a(T)a(T) contains the other factor b(T)b(T), which kills the competing piece, and the Bézout weight v(T)v(T) undoes what b(T)b(T) does to the surviving piece, so that piece comes out unchanged. Nothing here involves orthogonality. A polynomial projector satisfies P2=PP^2 = P, and being an orthogonal projection would need an inner product and extra structure.

Example Let

A=[111011002],A = \begin{bmatrix} 1 & 1 & 1 \\ 0 & 1 & 1 \\ 0 & 0 & 2 \end{bmatrix},

with χA(t)=(t−1)2(t−2)\chi_A(t) = (t - 1)^2(t - 2), so (A−I)2(A−2I)=0(A - I)^2(A - 2I) = 0 by the Cayley-Hamilton theorem. Take a=(t−1)2a = (t - 1)^2 and b=t−2b = t - 2. Division gives (t−1)2=t(t−2)+1(t - 1)^2 = t(t - 2) + 1, so u=1u = 1 and v=−tv = -t. Then

P=−A(A−2I)=[10−201−1000],Q=(A−I)2=[002001001].\begin{aligned} P &= -A(A - 2I) = \begin{bmatrix} 1 & 0 & -2 \\ 0 & 1 & -1 \\ 0 & 0 & 0 \end{bmatrix}, \\[0.4em] Q &= (A - I)^2 = \begin{bmatrix} 0 & 0 & 2 \\ 0 & 0 & 1 \\ 0 & 0 & 1 \end{bmatrix}. \end{aligned}

The image of QQ is spanned by (2,1,1)(2, 1, 1), and A(2,1,1)=(4,2,2)A(2, 1, 1) = (4, 2, 2), an eigenvector for 22. The image of PP is the plane spanned by e1e_1 and e2e_2, which is ker⁡(A−I)2\ker (A - I)^2. For instance e3=(−2,−1,0)+(2,1,1)e_3 = (-2, -1, 0) + (2, 1, 1), and the first piece lies in ker⁡(A−I)2\ker (A - I)^2 without being an eigenvector, since A(−2,−1,0)=(−3,−1,0)A(-2, -1, 0) = (-3, -1, 0). Here the eigenvalue 11 has only the eigenline through e1e_1, so the kernel of the repeated factor is larger than the eigenspace.

Distinct-root criterion for diagonalizability

Definition The operator TT is diagonalizable over F\mathbb{F}, meaning that VV has a basis of eigenvectors of TT, if and only if

μT(t)=(t−λ1)(t−λ2)⋯(t−λs)\mu_T(t) = (t - \lambda_1)(t - \lambda_2) \cdots (t - \lambda_s)

for distinct λ1,…,λs∈F\lambda_1, \dots, \lambda_s \in \mathbb{F}. Then the λj\lambda_j are the distinct eigenvalues, V=Eλ1⊕⋯⊕EλsV = E_{\lambda_1} \oplus \cdots \oplus E_{\lambda_s} with Eλ=ker⁡(T−λI)E_\lambda = \ker(T - \lambda I), and the projection onto EλjE_{\lambda_j} along the other eigenspaces is

Pj=∏k≠jT−λkIλj−λk.P_j = \prod_{k \ne j} \frac{T - \lambda_k I}{\lambda_j - \lambda_k}.

To prove that the factorization implies diagonalizability, let Lj(t)=∏k≠j(t−λk)/(λj−λk)L_j(t) = \prod_{k \ne j} (t - \lambda_k)/(\lambda_j - \lambda_k), so that Lj(λi)L_j(\lambda_i) is 11 for i=ji = j and 00 otherwise. The polynomial L1+⋯+Ls−1L_1 + \cdots + L_s - 1 has degree at most s−1s - 1 and the ss distinct roots λ1,…,λs\lambda_1, \dots, \lambda_s, so it is zero, and evaluating at TT gives P1+⋯+Ps=IP_1 + \cdots + P_s = I. Moreover (t−λj)Lj(t)(t - \lambda_j)L_j(t) is a constant multiple of μT\mu_T, so (T−λjI)Pj=0(T - \lambda_j I)P_j = 0 and im⁡Pj⊆Eλj\operatorname{im} P_j \subseteq E_{\lambda_j}. Every v=P1v+⋯+Psvv = P_1 v + \cdots + P_s v is therefore a sum of vectors from the eigenspaces. Eigenspaces for distinct eigenvalues form a direct sum, so joining bases of the EλjE_{\lambda_j} gives an eigenbasis. The same splitting also follows from the decomposition into kernels in the previous card, because distinct linear factors t−λjt - \lambda_j are pairwise coprime. Conversely, if VV has an eigenbasis and λ1,…,λs\lambda_1, \dots, \lambda_s are its distinct eigenvalues, the polynomial p(t)=(t−λ1)⋯(t−λs)p(t) = (t - \lambda_1) \cdots (t - \lambda_s) satisfies p(T)v=p(λ)v=0p(T)v = p(\lambda)v = 0 for each basis vector vv with eigenvalue λ\lambda, so p(T)=0p(T) = 0 and μT∣p\mu_T \mid p. Every λj\lambda_j is a root of μT\mu_T, so μT=p\mu_T = p. Equivalently, TT is diagonalizable over F\mathbb{F} exactly when some product of distinct linear factors over F\mathbb{F} annihilates it.

In plain words A repeated eigenvalue does not by itself prevent diagonalization, but a repeated factor in the minimal polynomial does. Over R\mathbb{R} the factors must also be linear. The real quarter turn has minimal polynomial t2+1t^2 + 1, with no repeated roots, and still has no real eigenbasis, while over C\mathbb{C} the same polynomial splits as (t−i)(t+i)(t - i)(t + i).

Example Let BB have rows (4,1)(4, 1) and (2,3)(2, 3). Then χB(t)=t2−7t+10=(t−2)(t−5)\chi_B(t) = t^2 - 7t + 10 = (t - 2)(t - 5) has distinct roots, so μB=χB\mu_B = \chi_B and BB is diagonalizable. The projectors are

P5=B−2I5−2=13[2121],P2=B−5I2−5=13[1−1−22].\begin{aligned} P_5 &= \frac{B - 2I}{5 - 2} = \frac{1}{3}\begin{bmatrix} 2 & 1 \\ 2 & 1 \end{bmatrix}, \\[0.4em] P_2 &= \frac{B - 5I}{2 - 5} = \frac{1}{3}\begin{bmatrix} 1 & -1 \\ -2 & 2 \end{bmatrix}. \end{aligned}

They add up to II, and B=2P2+5P5B = 2P_2 + 5P_5. Their images are spanned by (1,1)(1, 1) and (1,−2)(1, -2), and indeed B(1,1)=(5,5)B(1, 1) = (5, 5) and B(1,−2)=(2,−4)B(1, -2) = (2, -4). The vector (3,0)(3, 0) splits as P5(3,0)+P2(3,0)=(2,2)+(1,−2)P_5(3, 0) + P_2(3, 0) = (2, 2) + (1, -2). The two eigenlines are not perpendicular for the dot product, so these are oblique projections.

Simultaneous diagonalization of commuting diagonalizable operators

Definition Let T1,…,Tk∈Hom⁡(V,V)T_1, \dots, T_k \in \operatorname{Hom}(V, V) be diagonalizable over F\mathbb{F} and pairwise commuting, TiTj=TjTiT_i T_j = T_j T_i. Then VV has a basis whose vectors are eigenvectors of every TiT_i. In matrix terms, commuting diagonalizable A1,…,Ak∈Fn×nA_1, \dots, A_k \in \mathbb{F}^{n \times n} have one invertible S∈Fn×nS \in \mathbb{F}^{n \times n} with every S−1AiSS^{-1}A_i S diagonal. Conversely, operators with a common eigenbasis commute, because diagonal matrices commute. The proof is by induction on kk, and k=1k = 1 is the definition. Let EE be an eigenspace of T1T_1 for the eigenvalue λ\lambda. For v∈Ev \in E,

T1(Tjv)=Tj(T1v)=λ Tjv,T_1(T_j v) = T_j(T_1 v) = \lambda\, T_j v,

so TjE⊆ET_j E \subseteq E. The polynomial μTj\mu_{T_j} annihilates the restriction Tj∣ET_j|_E, so the minimal polynomial of the restriction divides μTj\mu_{T_j} and is again a product of distinct linear factors over F\mathbb{F}. By the distinct-root criterion every Tj∣ET_j|_E is diagonalizable, and the restrictions of T2,…,TkT_2, \dots, T_k still commute. By induction EE has a basis of common eigenvectors of T2,…,TkT_2, \dots, T_k, and they are eigenvectors of T1T_1 too. Joining these bases over the eigenspaces of T1T_1, whose direct sum is VV, gives the common eigenbasis. The basis need not be orthonormal. That stronger conclusion holds for a commuting family of normal operators on a finite-dimensional complex inner product space, which has an orthonormal basis of common eigenvectors.

In plain words Commuting operators respect each other’s eigenspaces. Inside an eigenspace of the first operator, that operator acts as a scalar, so any basis suits it, and the freedom can be spent on diagonalizing the next operator.

Example Let T1T_1 be diagonal with entries 1,1,21, 1, 2 and let T2T_2 have rows (0,1,0)(0, 1, 0), (1,0,0)(1, 0, 0) and (0,0,5)(0, 0, 5). They commute, and μT2(t)=(t−1)(t+1)(t−5)\mu_{T_2}(t) = (t - 1)(t + 1)(t - 5), so T2T_2 is diagonalizable. The standard basis diagonalizes T1T_1 but not T2T_2, since T2e1=e2T_2 e_1 = e_2. Inside the eigenspace of T1T_1 spanned by e1e_1 and e2e_2, the operator T2T_2 swaps the two coordinates, with eigenvectors (1,1,0)(1, 1, 0) for 11 and (1,−1,0)(1, -1, 0) for −1-1. Adding e3e_3 gives

S=[1101−10001],S−1T1S=diag⁡(1,1,2),S−1T2S=diag⁡(1,−1,5).\begin{gathered} S = \begin{bmatrix} 1 & 1 & 0 \\ 1 & -1 & 0 \\ 0 & 0 & 1 \end{bmatrix}, \\[0.4em] S^{-1}T_1 S = \operatorname{diag}(1, 1, 2), \\[0.4em] S^{-1}T_2 S = \operatorname{diag}(1, -1, 5). \end{gathered}

For the warning about orthonormality, the matrix AA with rows (1,1)(1, 1) and (0,2)(0, 2) commutes with II, and both are diagonalizable. Every common eigenbasis consists of eigenvectors of AA, which lie on the lines through (1,0)(1, 0) and (1,1)(1, 1). Those lines are not perpendicular, so no common eigenbasis is orthonormal for the dot product.

Check yourself

  1. Use the Euclidean algorithm to find gcd⁡(t2−3t+2, t2−1)\gcd(t^2 - 3t + 2, \ t^2 - 1) and write it as a polynomial combination of the two. Are the polynomials coprime?
Show the answer

The first division gives

t2−3t+2=1⋅(t2−1)+(−3t+3),t^2 - 3t + 2 = 1 \cdot (t^2 - 1) + (-3t + 3),

and the second gives t2−1=−13(t+1)(−3t+3)+0t^2 - 1 = -\tfrac{1}{3}(t + 1)(-3t + 3) + 0. The last nonzero remainder is −3t+3-3t + 3, whose monic multiple is t−1t - 1. From the first line −3t+3=(t2−3t+2)−(t2−1)-3t + 3 = (t^2 - 3t + 2) - (t^2 - 1), so

t−1=13(t2−1)−13(t2−3t+2).t - 1 = \tfrac{1}{3}(t^2 - 1) - \tfrac{1}{3}(t^2 - 3t + 2).

The polynomials are not coprime. Both vanish at t=1t = 1, so every combination of them vanishes there too, and no combination equals 11.

  1. The diagonal matrix DD with entries 2,2,32, 2, 3 and the matrix CC with rows (2,1,0)(2, 1, 0), (0,2,0)(0, 2, 0) and (0,0,3)(0, 0, 3) have the same characteristic polynomial (t−2)2(t−3)(t - 2)^2(t - 3). Which of them is diagonalizable?
Show the answer

A repeated root of the characteristic polynomial decides nothing, so look at the minimal polynomials. For DD the product (D−2I)(D−3I)(D - 2I)(D - 3I) is 00, so μD(t)=(t−2)(t−3)\mu_D(t) = (t - 2)(t - 3) has distinct linear factors and DD is diagonalizable. For CC the product (C−2I)(C−3I)(C - 2I)(C - 3I) has a single nonzero entry −1-1 in row 11, column 22, so it is not zero. The minimal polynomial of CC has roots 22 and 33 and divides (t−2)2(t−3)(t - 2)^2(t - 3), so it must be (t−2)2(t−3)(t - 2)^2(t - 3). The repeated factor shows that CC is not diagonalizable. Directly, C−2IC - 2I has rank 22, so the eigenvalue 22 has only a line of eigenvectors, and the eigenvectors of CC span at most two dimensions.

  1. Let RR be the quarter turn with rows (0,−1)(0, -1) and (1,0)(1, 0). Is RR diagonalizable over R\mathbb{R}? Over C\mathbb{C}? If so, find the projectors onto its eigenspaces.
Show the answer

The matrix satisfies R2=−IR^2 = -I and is not a scalar matrix, so μR(t)=t2+1\mu_R(t) = t^2 + 1. Over R\mathbb{R} this polynomial has no linear factors, so RR has no real eigenvalues and is not diagonalizable over R\mathbb{R}. Over C\mathbb{C} it factors as (t−i)(t+i)(t - i)(t + i) with distinct roots, so RR is diagonalizable over C\mathbb{C}, with projectors

Pi=R+iI2i=12[1i−i1],P−i=R−iI−2i=12[1−ii1].\begin{aligned} P_i &= \frac{R + iI}{2i} = \frac{1}{2}\begin{bmatrix} 1 & i \\ -i & 1 \end{bmatrix}, \\[0.4em] P_{-i} &= \frac{R - iI}{-2i} = \frac{1}{2}\begin{bmatrix} 1 & -i \\ i & 1 \end{bmatrix}. \end{aligned}

They add up to II. The image of PiP_i is spanned by (1,−i)(1, -i), and R(1,−i)=(i,1)=i (1,−i)R(1, -i) = (i, 1) = i\,(1, -i). The image of P−iP_{-i} is spanned by (1,i)(1, i), and R(1,i)=(−i,1)=−i (1,i)R(1, i) = (-i, 1) = -i\,(1, i).

How this lesson connects