Unit 3, lesson 15

Bilinear Forms and Congruence

How a bilinear form is stored in a matrix, why a change of basis acts on that matrix by congruence rather than similarity, and how polarization recovers a symmetric form from its quadratic form.

  • Video 15
  • Coordinate Invariants and Bilinear Forms

The quadratic expression x2+4y2x^2 + 4y^2 equals 88 at the vector (2,1)(2, 1). In the basis (2,0)(2, 0), (0,1)(0, 1) the same vector has coordinates (1,1)(1, 1), and putting those into the old coefficients gives 1+4=51 + 4 = 5, which is wrong. A matrix can record a rule that takes two vectors and returns a number, and such a matrix needs its own law for changing coordinates. This lesson derives that law, called congruence, contrasts it with similarity, and shows which part of the matrix a quadratic form can see. Throughout, the scalars are real and a tuple such as (2,1)(2, 1) stands for a column vector.

Key terms

Bilinear form

Definition Let VV be a vector space over R\mathbb{R}. A bilinear form on VV is a function b ⁣:V×V→Rb \colon V \times V \to \mathbb{R} that is linear in each argument when the other is held fixed. For all vectors and all scalars a,c∈Ra, c \in \mathbb{R},

b(au+cw,y)=a b(u,y)+c b(w,y),b(x,au+cw)=a b(x,u)+c b(x,w).\begin{aligned} b(au + cw, y) &= a\,b(u, y) \\[0.4em] &\quad + c\,b(w, y), \\[0.4em] b(x, au + cw) &= a\,b(x, u) \\[0.4em] &\quad + c\,b(x, w). \end{aligned}

The form is symmetric if b(x,y)=b(y,x)b(x, y) = b(y, x) for all x,y∈Vx, y \in V, and skew-symmetric if b(x,y)=−b(y,x)b(x, y) = -b(y, x) for all x,y∈Vx, y \in V. For each fixed xx the map y↦b(x,y)y \mapsto b(x, y) is a linear functional, an element of V∨V^{\vee}. The same definition makes sense over C\mathbb{C}, but a complex inner product is conjugate-linear in its first argument, so on a nonzero space it is not a bilinear form.

In plain words An operator takes one vector and returns a vector. A bilinear form takes two vectors and returns a number, and it is linear in each of them separately.

Example For every M∈Rn×nM \in \mathbb{R}^{n \times n} the rule b(x,y)=xTMyb(x, y) = x^{\mathsf{T}} M y is a bilinear form on Rn\mathbb{R}^n. With M=diag⁡(1,−1)M = \operatorname{diag}(1, -1) it is b(x,y)=x1y1−x2y2b(x, y) = x_1 y_1 - x_2 y_2. This form is symmetric, yet b(v,v)b(v, v) is positive at v=(1,0)v = (1, 0), negative at v=(0,1)v = (0, 1) and zero at v=(1,1)v = (1, 1). A bilinear form need not be positive.

Matrix of a bilinear form

Definition Let VV be a real vector space of finite dimension nn, let B=(v1,…,vn)\mathcal{B} = (v_1, \dots, v_n) be an ordered basis and let bb be a bilinear form on VV. The matrix of bb in B\mathcal{B} is MB∈Rn×nM_{\mathcal{B}} \in \mathbb{R}^{n \times n} with entries mij=b(vi,vj)m_{ij} = b(v_i, v_j). If ξ=[x]B\xi = [x]_{\mathcal{B}} and η=[y]B\eta = [y]_{\mathcal{B}}, expanding x=∑iξivix = \sum_i \xi_i v_i in the first slot and y=∑jηjvjy = \sum_j \eta_j v_j in the second gives

b(x,y)=∑i,jξi mij ηj=ξTMB η.\begin{aligned} b(x, y) &= \sum_{i, j} \xi_i\, m_{ij}\, \eta_j \\[0.4em] &= \xi^{\mathsf{T}} M_{\mathcal{B}}\, \eta. \end{aligned}

So the values on pairs of basis vectors determine bb, and MBM_{\mathcal{B}} is the only matrix with this property. The form is symmetric exactly when MBT=MBM_{\mathcal{B}}^{\mathsf{T}} = M_{\mathcal{B}}. A vector yy satisfies b(x,y)=0b(x, y) = 0 for every xx exactly when MBη=0M_{\mathcal{B}}\eta = 0, and a vector xx satisfies b(x,y)=0b(x, y) = 0 for every yy exactly when MBTξ=0M_{\mathcal{B}}^{\mathsf{T}}\xi = 0. The form is nondegenerate when neither kind of nonzero vector exists, which for the square matrix MBM_{\mathcal{B}} happens exactly when it is invertible.

In plain words Measure the form on every pair of basis vectors and store the results in a table. Coordinates do the rest, with the first input entering as a row and the second as a column.

Example On P1\mathcal{P}_1, the polynomials of degree at most 11, let b(f,g)=f(0) g(1)b(f, g) = f(0)\,g(1) and use the basis (1,t)(1, t). The values b(1,1)=1b(1, 1) = 1, b(1,t)=1b(1, t) = 1, b(t,1)=0b(t, 1) = 0 and b(t,t)=0b(t, t) = 0 give

MB=[1100].M_{\mathcal{B}} = \begin{bmatrix} 1 & 1 \\ 0 & 0 \end{bmatrix}.

The form is not symmetric, and it is degenerate. The polynomial g=1−tg = 1 - t, with coordinates (1,−1)(1, -1), satisfies b(f,g)=0b(f, g) = 0 for every ff, and f=tf = t satisfies b(f,g)=0b(f, g) = 0 for every gg.

Congruent matrices

Definition Let bb be a bilinear form on a real nn-dimensional space VV with ordered bases B\mathcal{B} and C\mathcal{C}. Let S=PB←CS = P_{\mathcal{B} \leftarrow \mathcal{C}}, the matrix whose columns are the C\mathcal{C} vectors in B\mathcal{B} coordinates, so that [x]B=S[x]C[x]_{\mathcal{B}} = S[x]_{\mathcal{C}}. Substituting into both slots with ξ=[x]C\xi = [x]_{\mathcal{C}} and η=[y]C\eta = [y]_{\mathcal{C}} gives

b(x,y)=(Sξ)TMB (Sη)=ξT(STMB S) η,\begin{aligned} b(x, y) &= (S\xi)^{\mathsf{T}} M_{\mathcal{B}}\, (S\eta) \\[0.4em] &= \xi^{\mathsf{T}} \bigl(S^{\mathsf{T}} M_{\mathcal{B}}\, S\bigr)\, \eta, \end{aligned}

so

MC=STMB S.M_{\mathcal{C}} = S^{\mathsf{T}} M_{\mathcal{B}}\, S.

With P=PC←B=S−1P = P_{\mathcal{C} \leftarrow \mathcal{B}} = S^{-1} the same rule reads MC=(P−1)TMB P−1M_{\mathcal{C}} = (P^{-1})^{\mathsf{T}} M_{\mathcal{B}}\, P^{-1}. Real matrices M,N∈Rn×nM, N \in \mathbb{R}^{n \times n} are congruent if N=STMSN = S^{\mathsf{T}} M S for some invertible S∈Rn×nS \in \mathbb{R}^{n \times n}, so congruent matrices are exactly the matrices of one bilinear form in two bases. Congruence preserves symmetry, rank and nondegeneracy, and

det⁡(STMS)=(det⁡S)2det⁡M,\det(S^{\mathsf{T}} M S) = (\det S)^2 \det M,

so the sign of the determinant survives but its value need not. The eigenvalues and the trace can change. When SS is orthogonal, ST=S−1S^{\mathsf{T}} = S^{-1} and congruence gives the same matrix as similarity.

In plain words A form has two inputs, and the coordinate columns of both of them change. That puts SS on the right and STS^{\mathsf{T}} on the left. No inverse appears, because the output is a number and needs no conversion back. An operator matrix changes by S−1ASS^{-1}AS instead, because its output is a vector that has to be converted back to new coordinates.

Example For MB=diag⁡(1,4)M_{\mathcal{B}} = \operatorname{diag}(1, 4) in the standard basis and C=((2,0),(0,1))\mathcal{C} = ((2, 0), (0, 1)), the matrix S=diag⁡(2,1)S = \operatorname{diag}(2, 1) gives MC=diag⁡(4,4)M_{\mathcal{C}} = \operatorname{diag}(4, 4). The vector (2,1)(2, 1) has C\mathcal{C} coordinates (1,1)(1, 1), and both formulas give 88, as 22+4⋅122^2 + 4 \cdot 1^2 and as 4+44 + 4. The eigenvalues changed from 1,41, 4 to 4,44, 4 and the determinant from 44 to 16=22⋅416 = 2^2 \cdot 4, so the two matrices are not similar, yet they describe the same form.

Quadratic form

Definition The quadratic form of a bilinear form bb on a real space VV is q(v)=b(v,v)q(v) = b(v, v). A function q ⁣:V→Rq \colon V \to \mathbb{R} is called a quadratic form if it arises this way from some bilinear form. When VV is finite-dimensional with ordered basis B\mathcal{B} and ξ=[v]B\xi = [v]_{\mathcal{B}},

q(v)=ξTMB ξ=∑i,jmij ξiξj,q(v) = \xi^{\mathsf{T}} M_{\mathcal{B}}\, \xi = \sum_{i, j} m_{ij}\, \xi_i \xi_j,

and q(cv)=c2q(v)q(cv) = c^2 q(v) for every scalar cc. When dim⁡V≥2\dim V \ge 2, different bilinear forms can have the same quadratic form, because for i≠ji \ne j only the sum mij+mjim_{ij} + m_{ji} affects the coefficient of ξiξj\xi_i \xi_j. Exactly one of them is symmetric, the one whose matrix splits each cross coefficient equally between mijm_{ij} and mjim_{ji}.

In plain words A quadratic form feeds the same vector into both slots. It sees the diagonal entries and the sums of mirror-image entries off the diagonal, and nothing else.

Example The quadratic form q(x)=3x12+4x1x2−x22q(x) = 3x_1^2 + 4x_1x_2 - x_2^2 on R2\mathbb{R}^2 comes from both of the matrices

[322−1],[340−1],\begin{bmatrix} 3 & 2 \\ 2 & -1 \end{bmatrix}, \qquad \begin{bmatrix} 3 & 4 \\ 0 & -1 \end{bmatrix},

and only the first is symmetric. At x=(1,1)x = (1, 1) both give 3+4−1=63 + 4 - 1 = 6.

Polarization identity

Definition Let bb be a symmetric bilinear form on a real vector space VV with quadratic form qq. Then for all x,y∈Vx, y \in V

b(x,y)=12(q(x+y)−q(x)−q(y)).\begin{aligned} b(x, y) &= \tfrac{1}{2}\bigl(q(x + y) \\[0.4em] &\qquad - q(x) - q(y)\bigr). \end{aligned}

To prove it, expand by bilinearity,

q(x+y)=q(x)+b(x,y)+b(y,x)+q(y),\begin{aligned} q(x + y) &= q(x) + b(x, y) \\[0.4em] &\quad + b(y, x) + q(y), \end{aligned}

and use symmetry to combine the two middle terms. Hence a symmetric bilinear form is determined by its quadratic form, and symmetric bilinear forms on VV correspond one to one with quadratic forms on VV. Without symmetry the right side of the identity equals 12(b(x,y)+b(y,x))\tfrac{1}{2}\bigl(b(x, y) + b(y, x)\bigr), the symmetric part of bb, not bb itself.

In plain words For a symmetric form, the values on single vectors are enough to recover the values on all pairs.

Example For q(x)=3x12+4x1x2−x22q(x) = 3x_1^2 + 4x_1x_2 - x_2^2 the values q(1,1)=6q(1, 1) = 6, q(1,0)=3q(1, 0) = 3 and q(0,1)=−1q(0, 1) = -1 give

b(e1,e2)=12(6−3+1)=2,b(e_1, e_2) = \tfrac{1}{2}(6 - 3 + 1) = 2,

which is the off-diagonal entry of the symmetric matrix found above.

Symmetric and skew-symmetric parts

Definition Every M∈Rn×nM \in \mathbb{R}^{n \times n} splits uniquely as M=H+KM = H + K with HT=HH^{\mathsf{T}} = H and KT=−KK^{\mathsf{T}} = -K, namely

H=12(M+MT),K=12(M−MT).\begin{aligned} H &= \tfrac{1}{2}\bigl(M + M^{\mathsf{T}}\bigr), \\[0.4em] K &= \tfrac{1}{2}\bigl(M - M^{\mathsf{T}}\bigr). \end{aligned}

The split is unique because a matrix that is both symmetric and skew-symmetric is zero. A bilinear form splits the same way into a symmetric part and a skew-symmetric part. For every real column xx the scalar xTKxx^{\mathsf{T}}Kx equals its own transpose xTKTx=−xTKxx^{\mathsf{T}}K^{\mathsf{T}}x = -x^{\mathsf{T}}Kx, so it is 00 and

xTMx=xTHx.x^{\mathsf{T}} M x = x^{\mathsf{T}} H x.

A real bilinear form satisfies b(v,v)=0b(v, v) = 0 for every vv exactly when it is skew-symmetric, and such a form is called alternating. One direction is the computation above, and for the other, expanding b(x+y,x+y)=0b(x + y, x + y) = 0 gives b(x,y)=−b(y,x)b(x, y) = -b(y, x).

In plain words The quadratic form sees only the symmetric part. The skew-symmetric part is invisible to it, so a form that is not symmetric can never be recovered from its quadratic form.

Example The matrix with rows (1,4)(1, 4) and (0,2)(0, 2) splits as

[1402]=[1222]+[02−20],\begin{bmatrix} 1 & 4 \\ 0 & 2 \end{bmatrix} = \begin{bmatrix} 1 & 2 \\ 2 & 2 \end{bmatrix} + \begin{bmatrix} 0 & 2 \\ -2 & 0 \end{bmatrix},

and both it and its symmetric part give the quadratic form x12+4x1x2+2x22x_1^2 + 4x_1x_2 + 2x_2^2. The skew-symmetric matrix with rows (0,1)(0, 1) and (−1,0)(-1, 0) has the quadratic form x1x2−x2x1=0x_1x_2 - x_2x_1 = 0, yet its form takes the value b(e1,e2)=1b(e_1, e_2) = 1. It is a nonzero alternating form.

Check yourself

  1. Write the matrix of b(x,y)=x1y1+2x1y2+2x2y1+4x2y2b(x, y) = x_1 y_1 + 2x_1 y_2 + 2x_2 y_1 + 4x_2 y_2 on R2\mathbb{R}^2 in the standard basis. Is bb symmetric? Is it degenerate?
Show the answer

The coefficient of xiyjx_i y_j is mijm_{ij}, so

M=[1224].M = \begin{bmatrix} 1 & 2 \\ 2 & 4 \end{bmatrix}.

It equals its transpose, so bb is symmetric. Its determinant is 4−4=04 - 4 = 0, so bb is degenerate. Indeed y=(2,−1)y = (2, -1) satisfies My=0My = 0, so b(x,y)=0b(x, y) = 0 for every xx.

  1. The form q(x)=x12+3x22q(x) = x_1^2 + 3x_2^2 on R2\mathbb{R}^2 has matrix M=diag⁡(1,3)M = \operatorname{diag}(1, 3) in the standard basis. Find its matrix in the basis c1=(1,1)c_1 = (1, 1), c2=(1,−1)c_2 = (1, -1) and evaluate qq at the vector with new coordinates (1,2)(1, 2) in two ways. What goes wrong if the matrix is changed by similarity instead?
Show the answer

The basis matrix has columns c1c_1 and c2c_2, and congruence gives

S=[111−1],STMS=[4−2−24].\begin{gathered} S = \begin{bmatrix} 1 & 1 \\ 1 & -1 \end{bmatrix}, \\[0.4em] S^{\mathsf{T}} M S = \begin{bmatrix} 4 & -2 \\ -2 & 4 \end{bmatrix}. \end{gathered}

With ξ=(1,2)\xi = (1, 2) the new matrix gives 4⋅12+2⋅(−2)⋅1⋅2+4⋅22=4−8+16=124 \cdot 1^2 + 2 \cdot (-2) \cdot 1 \cdot 2 + 4 \cdot 2^2 = 4 - 8 + 16 = 12. In old coordinates the vector is Sξ=(3,−1)S\xi = (3, -1), and q=9+3=12q = 9 + 3 = 12, the same value. Similarity would give S−1MSS^{-1}MS, the matrix with rows (2,−1)(2, -1) and (−1,2)(-1, 2), which assigns 2⋅12+2⋅(−1)⋅1⋅2+2⋅22=62 \cdot 1^2 + 2 \cdot (-1) \cdot 1 \cdot 2 + 2 \cdot 2^2 = 6 to the same coordinates. That is wrong, because it treats the form as an operator.

  1. Let b(x,y)=x1y2b(x, y) = x_1 y_2 on R2\mathbb{R}^2, with quadratic form qq. Compute 12(q(x+y)−q(x)−q(y))\tfrac{1}{2}\bigl(q(x + y) - q(x) - q(y)\bigr) and compare it with bb. Which hypothesis of the polarization identity fails?
Show the answer

Here q(x)=x1x2q(x) = x_1 x_2, so

q(x+y)−q(x)−q(y)=(x1+y1)(x2+y2)−x1x2−y1y2=x1y2+x2y1.\begin{aligned} &q(x + y) - q(x) - q(y) \\[0.4em] &\quad = (x_1 + y_1)(x_2 + y_2) \\[0.4em] &\qquad - x_1x_2 - y_1y_2 \\[0.4em] &\quad = x_1 y_2 + x_2 y_1. \end{aligned}

Half of this is 12(x1y2+x2y1)\tfrac{1}{2}(x_1 y_2 + x_2 y_1), the symmetric part of bb. At (e1,e2)(e_1, e_2) it gives 12\tfrac{1}{2}, while b(e1,e2)=1b(e_1, e_2) = 1. The form is not symmetric, since b(e2,e1)=0b(e_2, e_1) = 0, and its skew-symmetric part 12(x1y2−x2y1)\tfrac{1}{2}(x_1 y_2 - x_2 y_1) is invisible to qq.

How this lesson connects