Unit 5, lesson 23

Schur Decomposition

Why every complex square matrix is upper triangular in some orthonormal basis, built from a unit eigenvector, a unitary matrix, a compression and induction on dimension, and how its diagonal gives the trace and determinant.

  • Video 23
  • Invariant Blocks and Schur Form

The shear with rows (1,1)(1, 1) and (0,1)(0, 1) has only one independent eigenvector, so no basis makes it diagonal. It is still upper triangular. Over the complex numbers that weaker form is always available, even if we insist on an orthonormal basis. This lesson proves Schur’s theorem by choosing a unit eigenvector, completing it to an orthonormal basis and repeating the argument on a smaller matrix, and then reads the trace and the determinant off the diagonal.

Key terms

Unitary matrix

Definition A square matrix Q∈Cn×nQ \in \mathbb{C}^{n \times n} is unitary if

Q∗Q=In,Q^{*}Q = I_n,

where Q∗=Q‾TQ^{*} = \overline{Q}^{\mathsf{T}} is the conjugate transpose. With the inner product ⟨x,y⟩=x∗y\langle x, y \rangle = x^{*}y on Cn\mathbb{C}^n, the entry in position (i,j)(i, j) of Q∗QQ^{*}Q is ⟨qi,qj⟩\langle q_i, q_j \rangle, so QQ is unitary exactly when its columns q1,…,qnq_1, \dots, q_n form an orthonormal basis of Cn\mathbb{C}^n. A unitary matrix is invertible with Q−1=Q∗Q^{-1} = Q^{*}, so QQ∗=InQQ^{*} = I_n as well, and it preserves inner products,

⟨Qx,Qy⟩=x∗Q∗Qy=⟨x,y⟩.\langle Qx, Qy \rangle = x^{*}Q^{*}Qy = \langle x, y \rangle.

Products of unitary matrices are unitary, because (Q1Q2)∗Q1Q2=Q2∗Q1∗Q1Q2=In(Q_1Q_2)^{*}Q_1Q_2 = Q_2^{*}Q_1^{*}Q_1Q_2 = I_n, and the inverse Q∗Q^{*} of a unitary matrix is unitary, because (Q∗)∗Q∗=QQ∗=In(Q^{*})^{*}Q^{*} = QQ^{*} = I_n. Every unitary matrix has ∣det⁡Q∣=1\lvert \det Q \rvert = 1, since ∣det⁡Q∣2=det⁡(Q∗)det⁡(Q)=det⁡(Q∗Q)=1\lvert \det Q \rvert^2 = \det(Q^{*})\det(Q) = \det(Q^{*}Q) = 1. A real unitary matrix is an orthogonal matrix, QTQ=InQ^{\mathsf{T}}Q = I_n. Squareness matters. A 3×23 \times 2 matrix with orthonormal columns satisfies Q∗Q=I2Q^{*}Q = I_2, but QQ∗QQ^{*} is a 3×33 \times 3 matrix of rank 22, not I3I_3. Two matrices AA and Q∗AQQ^{*}AQ with QQ unitary are called unitarily similar. They are similar, since Q∗=Q−1Q^{*} = Q^{-1}.

In plain words A unitary matrix changes coordinates from one orthonormal basis of Cn\mathbb{C}^n to another. It keeps every length and every inner product, so it is the complex counterpart of a real orthogonal matrix, such as a rotation or a reflection.

Example Tuples such as (1,−i)(1, -i) stand for column vectors. The matrix

Q=12[11−ii]Q = \frac{1}{\sqrt{2}}\begin{bmatrix} 1 & 1 \\ -i & i \end{bmatrix}

has columns q1=(1,−i)/2q_1 = (1, -i)/\sqrt{2} and q2=(1,i)/2q_2 = (1, i)/\sqrt{2}. Conjugating the first vector in each inner product,

⟨q1,q1⟩=12(1+i⋅(−i))=1,⟨q1,q2⟩=12(1+i⋅i)=0,\begin{aligned} \langle q_1, q_1 \rangle &= \tfrac{1}{2}\big(1 + i \cdot (-i)\big) = 1, \\[0.4em] \langle q_1, q_2 \rangle &= \tfrac{1}{2}(1 + i \cdot i) = 0, \end{aligned}

and ⟨q2,q2⟩=1\langle q_2, q_2 \rangle = 1 in the same way, so QQ is unitary. The conjugation matters. Without it, q1Tq1=12(1+(−i)2)=0q_1^{\mathsf{T}}q_1 = \tfrac{1}{2}\big(1 + (-i)^2\big) = 0 although q1q_1 is a unit vector. For the real quarter turn RR with rows (0,−1)(0, -1) and (1,0)(1, 0), this QQ gives Q∗RQ=diag⁡(i,−i)Q^{*}RQ = \operatorname{diag}(i, -i). A unitary change of basis diagonalizes a real matrix that no real basis can even make triangular.

Schur decomposition

Definition Schur’s theorem says the following. Let A∈Cn×nA \in \mathbb{C}^{n \times n} with n≥1n \ge 1. There exist a unitary matrix Q∈Cn×nQ \in \mathbb{C}^{n \times n} and an upper triangular matrix R∈Cn×nR \in \mathbb{C}^{n \times n} such that

A=QRQ∗,A = QRQ^{*},

or equivalently Q∗AQ=RQ^{*}AQ = R. Such a pair is a Schur decomposition of AA. The diagonal entries of RR are the eigenvalues of AA, each listed as often as its algebraic multiplicity, and the proof can place them in any chosen order. The decomposition is not unique. Since AQ=QRAQ = QR and column jj of RR has zeros below row jj, each AqjAq_j is a combination of q1,…,qjq_1, \dots, q_j. So for every kk the first kk columns of QQ span a kk-dimensional subspace that AA maps into itself. Only the first column of QQ is guaranteed to be an eigenvector. The theorem applies to real matrices too, with QQ and RR complex in general. If AA is real and all its eigenvalues are real, the same construction works with real vectors and gives a real orthogonal QQ and a real RR. The proof uses the fundamental theorem of algebra, taken here without proof, which says that every nonconstant polynomial with complex coefficients has a root in C\mathbb{C}. Applied to χA\chi_A, it supplies an eigenvalue.

In plain words Diagonalizing needs a basis of eigenvectors, which may not exist. Triangularizing needs only a nested chain of invariant subspaces, one of each dimension, and over C\mathbb{C} such a chain always exists with an orthonormal basis that follows it.

Example The real matrix

A=[1−213]A = \begin{bmatrix} 1 & -2 \\ 1 & 3 \end{bmatrix}

has χA(t)=t2−4t+5\chi_A(t) = t^2 - 4t + 5, with roots 2±i2 \pm i. An eigenvector for 2+i2 + i is (−1+i,1)(-1 + i, 1), of length 3\sqrt{3}. Normalizing it and completing it gives the orthonormal basis

q1=13[−1+i1],q2=13[11+i],\begin{aligned} q_1 &= \frac{1}{\sqrt{3}}\begin{bmatrix} -1 + i \\ 1 \end{bmatrix}, \\[0.4em] q_2 &= \frac{1}{\sqrt{3}}\begin{bmatrix} 1 \\ 1 + i \end{bmatrix}, \end{aligned}

and with Q=[q1q2]Q = \begin{bmatrix} q_1 & q_2 \end{bmatrix},

Q∗AQ=[2+i1+2i02−i].Q^{*}AQ = \begin{bmatrix} 2 + i & 1 + 2i \\ 0 & 2 - i \end{bmatrix}.

The entry 1+2i1 + 2i shows that q2q_2 is not an eigenvector. The matrix AA has two distinct eigenvalues, so it is diagonalizable, but its eigenvectors (−1+i,1)(-1 + i, 1) and (−1−i,1)(-1 - i, 1) have inner product 1+2i≠01 + 2i \ne 0. No orthonormal basis consists of eigenvectors of AA, and the Schur form keeps an orthonormal basis at the cost of one entry above the diagonal.

Compression of an operator

Definition Let VV be a finite-dimensional inner product space over F\mathbb{F}, where F\mathbb{F} is R\mathbb{R} or C\mathbb{C}, let T∈Hom⁡(V,V)T \in \operatorname{Hom}(V, V), let WW be a subspace of VV, and let PWP_W be the orthogonal projection onto WW. The compression of TT to WW is the operator on WW given by

w↦PW(Tw),w∈W.w \mapsto P_W(Tw), \qquad w \in W.

It is defined for every subspace WW, invariant or not. If (w1,…,wk)(w_1, \dots, w_k) is an orthonormal basis of WW, its matrix in that basis has entries ⟨wi,Twj⟩\langle w_i, Tw_j \rangle. The compression equals the restriction T∣WT|_W exactly when WW is TT-invariant, since then PW(Tw)=TwP_W(Tw) = Tw.

The compression appears in the first step of Schur’s theorem. Let A∈Cn×nA \in \mathbb{C}^{n \times n} with n≥2n \ge 2 and Aq1=λq1Aq_1 = \lambda q_1 for a unit vector q1q_1, and complete q1q_1 to an orthonormal basis (q1,…,qn)(q_1, \dots, q_n), the columns of a unitary Q0Q_0. Then

Q0∗AQ0=[λa∗0B],Q_0^{*}AQ_0 = \begin{bmatrix} \lambda & a^{*} \\ 0 & B \end{bmatrix},

with a∈Cn−1a \in \mathbb{C}^{n-1} and B∈C(n−1)×(n−1)B \in \mathbb{C}^{(n-1) \times (n-1)}. The first column is (λ,0,…,0)(\lambda, 0, \dots, 0) because Aq1=λq1Aq_1 = \lambda q_1, and BB, with entries ⟨qi,Aqj⟩\langle q_i, Aq_j \rangle for i,j≥2i, j \ge 2, is the matrix of the compression of AA to q1⊥q_1^{\perp} in the basis (q2,…,qn)(q_2, \dots, q_n). Similar matrices share their characteristic polynomial, and the block form gives

χA(t)=(t−λ) χB(t),\chi_A(t) = (t - \lambda)\,\chi_B(t),

so the eigenvalues of BB are those of AA with one copy of λ\lambda removed.

In plain words Apply the operator, then discard the component of the result that is orthogonal to WW. When WW is invariant nothing is discarded and the compression is the restriction. When it is not, the discarded part still matters, and in the first step of Schur’s theorem it is the row a∗a^{*} above the block BB.

Example Let AA be the real matrix with rows (2,1,0)(2, 1, 0), (0,3,0)(0, 3, 0), (0,0,4)(0, 0, 4) and W=span⁡{e2,e3}=e1⊥W = \operatorname{span}\{e_2, e_3\} = e_1^{\perp}. The plane WW is not invariant, since Ae2=e1+3e2Ae_2 = e_1 + 3e_2. The compression drops the e1e_1 component, so it sends e2e_2 to 3e23e_2 and e3e_3 to 4e34e_3, and its matrix in the basis (e2,e3)(e_2, e_3) is diag⁡(3,4)\operatorname{diag}(3, 4). Its eigenvalues 33 and 44 are the eigenvalues of AA left over after the eigenvalue 22 of the eigenvector e1e_1. The discarded component is the entry 11 in the first row of AA.

Induction on dimension

Definition Induction on dimension proves a statement S(n)S(n) for every n≥1n \ge 1 in two parts. The base case proves S(1)S(1), and the induction step proves, for every n≥2n \ge 2, that S(n−1)S(n - 1) implies S(n)S(n). The hypothesis S(n−1)S(n - 1) may be applied to any object of the smaller size, so the smaller object need not be a restriction of the original one. For Schur’s theorem, S(n)S(n) says that every matrix in Cn×n\mathbb{C}^{n \times n} has a Schur decomposition.

  1. The base case. A 1×11 \times 1 matrix is upper triangular, so Q=[1]Q = [1] and R=AR = A work.
  2. The first eigenvector. For n≥2n \ge 2 the polynomial χA\chi_A has degree nn, so by the fundamental theorem of algebra it has a root λ\lambda. Then A−λIA - \lambda I is singular, and a nonzero vector in its kernel, divided by its length, is a unit eigenvector q1q_1.
  3. The block form. Completing q1q_1 to an orthonormal basis gives a unitary Q0Q_0 for which Q0∗AQ0Q_0^{*}AQ_0 has first column (λ,0,…,0)(\lambda, 0, \dots, 0), first row (λ,a∗)(\lambda, a^{*}) and lower right block BB, the compression of AA to q1⊥q_1^{\perp}.
  4. The induction. The hypothesis S(n−1)S(n - 1) gives a unitary ZZ with Z∗BZ=RBZ^{*}BZ = R_B upper triangular. Extending ZZ by a 11 in the corner gives a unitary Q1Q_1, and Q=Q0Q1Q = Q_0Q_1 is unitary as a product of unitary matrices.

With these choices,

Q1=[100Z],Q∗AQ=Q1∗[λa∗0B]Q1=[λa∗Z0RB],\begin{aligned} Q_1 &= \begin{bmatrix} 1 & 0 \\ 0 & Z \end{bmatrix}, \\[0.4em] Q^{*}AQ &= Q_1^{*}\begin{bmatrix} \lambda & a^{*} \\ 0 & B \end{bmatrix}Q_1 \\[0.4em] &= \begin{bmatrix} \lambda & a^{*}Z \\ 0 & R_B \end{bmatrix}, \end{aligned}

which is upper triangular. The step is legitimate because S(n−1)S(n - 1) covers every (n−1)×(n−1)(n - 1) \times (n - 1) matrix and BB is one, even though q1⊥q_1^{\perp} need not be invariant. Since χB=χA/(t−λ)\chi_B = \chi_A / (t - \lambda), choosing λ\lambda freely at each step puts the eigenvalues on the diagonal in any order.

In plain words Peel off one unit eigenvector, which fixes the first column, and hand the rest of the matrix, a square matrix one size smaller, to the same argument. Repeating until size one is reached builds the whole triangular form.

Example Let

A=[2110120−14].A = \begin{bmatrix} 2 & 1 & 1 \\ 0 & 1 & 2 \\ 0 & -1 & 4 \end{bmatrix}.

Here Ae1=2e1Ae_1 = 2e_1, so q1=e1q_1 = e_1 and Q0=IQ_0 = I. The first row gives a∗=[11]a^{*} = \begin{bmatrix} 1 & 1 \end{bmatrix}, and

B=[12−14],χB(t)=(t−2)(t−3).\begin{aligned} B &= \begin{bmatrix} 1 & 2 \\ -1 & 4 \end{bmatrix}, \\[0.4em] \chi_B(t) &= (t - 2)(t - 3). \end{aligned}

A unit eigenvector of BB for 22 is (2,1)/5(2, 1)/\sqrt{5}, completed by (−1,2)/5(-1, 2)/\sqrt{5}. These are the columns of a real orthogonal ZZ, and

ZTBZ=[2303],a∗Z=[3515].\begin{aligned} Z^{\mathsf{T}}BZ &= \begin{bmatrix} 2 & 3 \\ 0 & 3 \end{bmatrix}, \\[0.4em] a^{*}Z &= \begin{bmatrix} \tfrac{3}{\sqrt{5}} & \tfrac{1}{\sqrt{5}} \end{bmatrix}. \end{aligned}

So Q=Q1Q = Q_1 and

Q=[100025−1501525],R=[23515023003].\begin{aligned} Q &= \begin{bmatrix} 1 & 0 & 0 \\ 0 & \tfrac{2}{\sqrt{5}} & -\tfrac{1}{\sqrt{5}} \\ 0 & \tfrac{1}{\sqrt{5}} & \tfrac{2}{\sqrt{5}} \end{bmatrix}, \\[0.4em] R &= \begin{bmatrix} 2 & \tfrac{3}{\sqrt{5}} & \tfrac{1}{\sqrt{5}} \\ 0 & 2 & 3 \\ 0 & 0 & 3 \end{bmatrix}. \end{aligned}

Algebraic multiplicity

Definition Let A∈Cn×nA \in \mathbb{C}^{n \times n} with n≥1n \ge 1. By the fundamental theorem of algebra the characteristic polynomial factors as

χA(t)=∏j=1k(t−λj)mj,\chi_A(t) = \prod_{j=1}^{k} (t - \lambda_j)^{m_j},

with distinct λ1,…,λk∈C\lambda_1, \dots, \lambda_k \in \mathbb{C} and m1+⋯+mk=nm_1 + \cdots + m_k = n. The exponent mjm_j is the algebraic multiplicity of the eigenvalue λj\lambda_j. The geometric multiplicity is gj=dim⁡ker⁡(A−λjI)g_j = \dim \ker(A - \lambda_j I), and

1≤gj≤mj.1 \le g_j \le m_j.

For a real matrix the same definitions use the complex roots of χA\chi_A. Similar matrices have the same characteristic polynomial and eigenspaces of equal dimension, so both multiplicities are unchanged by similarity. The characteristic polynomial of a triangular matrix is the product of the factors t−riit - r_{ii} over its diagonal entries, so in every Schur form, and in every triangular matrix similar to AA, the eigenvalue λj\lambda_j appears exactly mjm_j times on the diagonal. To see gj≤mjg_j \le m_j, extend a basis of the eigenspace of λj\lambda_j to a basis of Cn\mathbb{C}^n. The eigenspace is invariant, so the matrix in that basis is block upper triangular with upper left block λjIgj\lambda_j I_{g_j}, and (t−λj)gj(t - \lambda_j)^{g_j} divides χA\chi_A.

In plain words Algebraic multiplicity counts how often an eigenvalue occurs as a root, and geometric multiplicity counts how many independent eigenvectors it has. A complex square matrix is diagonalizable exactly when the two counts agree for every eigenvalue, and the diagonal of a Schur form always shows the algebraic count.

Example The matrix AA with rows (2,1,1)(2, 1, 1), (0,1,2)(0, 1, 2), (0,−1,4)(0, -1, 4) from the induction example has χA(t)=(t−2)2(t−3)\chi_A(t) = (t - 2)^2(t - 3). So the eigenvalue 22 has algebraic multiplicity 22 and the eigenvalue 33 has algebraic multiplicity 11. The matrix

A−2I=[0110−120−12]A - 2I = \begin{bmatrix} 0 & 1 & 1 \\ 0 & -1 & 2 \\ 0 & -1 & 2 \end{bmatrix}

has rank 22, so the eigenspace of 22 is the line through e1e_1 and its geometric multiplicity is 11. The triangular RR found above still shows 22 twice on its diagonal, and AA is not diagonalizable.

Trace and determinant from eigenvalues

Definition Let A∈Cn×nA \in \mathbb{C}^{n \times n} with n≥1n \ge 1, and let λ1,…,λn\lambda_1, \dots, \lambda_n be its eigenvalues listed with algebraic multiplicity. The trace is the sum and the determinant is the product of the eigenvalues,

tr⁡A=λ1+⋯+λn,det⁡A=λ1⋯λn.\begin{aligned} \operatorname{tr} A &= \lambda_1 + \cdots + \lambda_n, \\[0.4em] \det A &= \lambda_1 \cdots \lambda_n. \end{aligned}

No diagonalizability is needed, and for a real matrix the list includes its nonreal eigenvalues. For the proof, take a Schur decomposition Q∗AQ=RQ^{*}AQ = R. The determinant is multiplicative and det⁡(Q∗)det⁡(Q)=det⁡(Q∗Q)=1\det(Q^{*})\det(Q) = \det(Q^{*}Q) = 1, so det⁡A=det⁡R\det A = \det R. For the trace, whenever XX is m×nm \times n and YY is n×mn \times m,

tr⁡(XY)=∑i=1m∑j=1nxijyji=tr⁡(YX),\begin{aligned} \operatorname{tr}(XY) &= \sum_{i=1}^{m} \sum_{j=1}^{n} x_{ij}y_{ji} \\[0.4em] &= \operatorname{tr}(YX), \end{aligned}

so tr⁡(Q∗AQ)=tr⁡(AQQ∗)=tr⁡A\operatorname{tr}(Q^{*}AQ) = \operatorname{tr}(AQQ^{*}) = \operatorname{tr} A. The determinant of the triangular matrix RR is the product and its trace is the sum of its diagonal entries, which are λ1,…,λn\lambda_1, \dots, \lambda_n.

In plain words The trace and the determinant can be computed directly from the entries of a matrix, and they are also the sum and the product of eigenvalues that may be hard to find. A repeated eigenvalue counts as often as it repeats as a root, not as often as it has independent eigenvectors.

Example For the shear with rows (1,1)(1, 1) and (0,1)(0, 1), the eigenvalue 11 has algebraic multiplicity 22 but only a one-dimensional eigenspace. The formulas give trace 1+1=21 + 1 = 2 and determinant 1⋅1=11 \cdot 1 = 1, which match the entries. For the matrix with rows (1,−2)(1, -2) and (1,3)(1, 3), whose eigenvalues are 2±i2 \pm i,

(2+i)+(2−i)=4=1+3,(2+i)(2−i)=5=3−(−2).\begin{aligned} (2 + i) + (2 - i) &= 4 \\[0.4em] &= 1 + 3, \\[0.4em] (2 + i)(2 - i) &= 5 \\[0.4em] &= 3 - (-2). \end{aligned}

Check yourself

  1. Find a Schur decomposition of the real matrix
L=[1011].L = \begin{bmatrix} 1 & 0 \\ 1 & 1 \end{bmatrix}.
Show the answer

The only eigenvalue is 11, and Le2=e2Le_2 = e_2, so take q1=e2q_1 = e_2 and complete it with q2=e1q_2 = e_1. The matrix QQ with columns e2e_2 and e1e_1 is real orthogonal, hence unitary, and

Q∗LQ=[1101]=R.Q^{*}LQ = \begin{bmatrix} 1 & 1 \\ 0 & 1 \end{bmatrix} = R.

Reordering the basis turns the lower triangular LL into an upper triangular RR. The entry 11 above the diagonal cannot be removed, because LL has only one independent eigenvector.

  1. A complex 3×33 \times 3 matrix AA has χA(t)=(t−2)2(t+1)\chi_A(t) = (t - 2)^2(t + 1), and its eigenspace for the eigenvalue 22 is one-dimensional. Find tr⁡A\operatorname{tr} A and det⁡A\det A.
Show the answer

The eigenvalues listed with algebraic multiplicity are 22, 22 and −1-1, so

tr⁡A=2+2−1=3,det⁡A=2⋅2⋅(−1)=−4.\begin{aligned} \operatorname{tr} A &= 2 + 2 - 1 = 3, \\[0.4em] \det A &= 2 \cdot 2 \cdot (-1) = -4. \end{aligned}

The one-dimensional eigenspace changes nothing, since the formulas count algebraic multiplicity. Counting 22 only once would give the wrong values 11 and −2-2. As a check, χA(t)=t3−3t2+4\chi_A(t) = t^3 - 3t^2 + 4, and for a 3×33 \times 3 matrix the coefficient of t2t^2 is −tr⁡A-\operatorname{tr} A and the constant term is −det⁡A-\det A. The matrix with rows (2,1,0)(2, 1, 0), (0,2,0)(0, 2, 0) and (0,0,−1)(0, 0, -1) is one example.

  1. Let
A=[3−111].A = \begin{bmatrix} 3 & -1 \\ 1 & 1 \end{bmatrix}.

Find a Schur decomposition with a real orthogonal QQ, and decide whether some unitary QQ could make RR diagonal.

Show the answer

The characteristic polynomial is t2−4t+4=(t−2)2t^2 - 4t + 4 = (t - 2)^2. The kernel of A−2IA - 2I, whose rows are (1,−1)(1, -1) and (1,−1)(1, -1), is spanned by (1,1)(1, 1). Take q1=(1,1)/2q_1 = (1, 1)/\sqrt{2} and q2=(1,−1)/2q_2 = (1, -1)/\sqrt{2}. Then Aq2=(4,0)/2=2q1+2q2Aq_2 = (4, 0)/\sqrt{2} = 2q_1 + 2q_2, so

Q=12[111−1],QTAQ=[2202].\begin{gathered} Q = \frac{1}{\sqrt{2}}\begin{bmatrix} 1 & 1 \\ 1 & -1 \end{bmatrix}, \\[0.4em] Q^{\mathsf{T}}AQ = \begin{bmatrix} 2 & 2 \\ 0 & 2 \end{bmatrix}. \end{gathered}

No unitary QQ can make RR diagonal. A diagonal RR would carry the eigenvalues on its diagonal, so R=2IR = 2I, and then A=Q(2I)Q∗=2IA = Q(2I)Q^{*} = 2I, which is false. Equivalently, A−2IA - 2I has rank 11, so the eigenspace is a line and AA is not diagonalizable at all.

How this lesson connects

It also uses the fundamental theorem of algebra, taken without proof.