The quadratic expression x2+4y2 equals 8 at the vector (2,1). In the basis (2,0), (0,1) the same vector has coordinates (1,1), and putting those into the old coefficients gives 1+4=5, which is wrong. A matrix can record a rule that takes two vectors and returns a number, and such a matrix needs its own law for changing coordinates. This lesson derives that law, called congruence, contrasts it with similarity, and shows which part of the matrix a quadratic form can see. Throughout, the scalars are real and a tuple such as (2,1) stands for a column vector.
Key terms
Definition Let V be a vector space over R. A bilinear form on V is a function b:V×V→R that is linear in each argument when the other is held fixed. For all vectors and all scalars a,c∈R,
b(au+cw,y)b(x,au+cw)=ab(u,y)+cb(w,y),=ab(x,u)+cb(x,w).The form is symmetric if b(x,y)=b(y,x) for all x,y∈V, and skew-symmetric if b(x,y)=−b(y,x) for all x,y∈V. For each fixed x the map y↦b(x,y) is a linear functional, an element of V∨. The same definition makes sense over C, but a complex inner product is conjugate-linear in its first argument, so on a nonzero space it is not a bilinear form.
In plain words An operator takes one vector and returns a vector. A bilinear form takes two vectors and returns a number, and it is linear in each of them separately.
Example For every M∈Rn×n the rule b(x,y)=xTMy is a bilinear form on Rn. With M=diag(1,−1) it is b(x,y)=x1y1−x2y2. This form is symmetric, yet b(v,v) is positive at v=(1,0), negative at v=(0,1) and zero at v=(1,1). A bilinear form need not be positive.
Definition Let V be a real vector space of finite dimension n, let B=(v1,…,vn) be an ordered basis and let b be a bilinear form on V. The matrix of b in B is MB∈Rn×n with entries mij=b(vi,vj). If ξ=[x]B and η=[y]B, expanding x=∑iξivi in the first slot and y=∑jηjvj in the second gives
b(x,y)=i,j∑ξimijηj=ξTMBη.So the values on pairs of basis vectors determine b, and MB is the only matrix with this property. The form is symmetric exactly when MBT=MB. A vector y satisfies b(x,y)=0 for every x exactly when MBη=0, and a vector x satisfies b(x,y)=0 for every y exactly when MBTξ=0. The form is nondegenerate when neither kind of nonzero vector exists, which for the square matrix MB happens exactly when it is invertible.
In plain words Measure the form on every pair of basis vectors and store the results in a table. Coordinates do the rest, with the first input entering as a row and the second as a column.
Example On P1, the polynomials of degree at most 1, let b(f,g)=f(0)g(1) and use the basis (1,t). The values b(1,1)=1, b(1,t)=1, b(t,1)=0 and b(t,t)=0 give
MB=[1010].The form is not symmetric, and it is degenerate. The polynomial g=1−t, with coordinates (1,−1), satisfies b(f,g)=0 for every f, and f=t satisfies b(f,g)=0 for every g.
Congruent matrices
Definition Let b be a bilinear form on a real n-dimensional space V with ordered bases B and C. Let S=PB←C, the matrix whose columns are the C vectors in B coordinates, so that [x]B=S[x]C. Substituting into both slots with ξ=[x]C and η=[y]C gives
b(x,y)=(Sξ)TMB(Sη)=ξT(STMBS)η,so
MC=STMBS.With P=PC←B=S−1 the same rule reads MC=(P−1)TMBP−1. Real matrices M,N∈Rn×n are congruent if N=STMS for some invertible S∈Rn×n, so congruent matrices are exactly the matrices of one bilinear form in two bases. Congruence preserves symmetry, rank and nondegeneracy, and
det(STMS)=(detS)2detM,so the sign of the determinant survives but its value need not. The eigenvalues and the trace can change. When S is orthogonal, ST=S−1 and congruence gives the same matrix as similarity.
In plain words A form has two inputs, and the coordinate columns of both of them change. That puts S on the right and ST on the left. No inverse appears, because the output is a number and needs no conversion back. An operator matrix changes by S−1AS instead, because its output is a vector that has to be converted back to new coordinates.
Example For MB=diag(1,4) in the standard basis and C=((2,0),(0,1)), the matrix S=diag(2,1) gives MC=diag(4,4). The vector (2,1) has C coordinates (1,1), and both formulas give 8, as 22+4⋅12 and as 4+4. The eigenvalues changed from 1,4 to 4,4 and the determinant from 4 to 16=22⋅4, so the two matrices are not similar, yet they describe the same form.
Definition The quadratic form of a bilinear form b on a real space V is q(v)=b(v,v). A function q:V→R is called a quadratic form if it arises this way from some bilinear form. When V is finite-dimensional with ordered basis B and ξ=[v]B,
q(v)=ξTMBξ=i,j∑mijξiξj,and q(cv)=c2q(v) for every scalar c. When dimV≥2, different bilinear forms can have the same quadratic form, because for i=j only the sum mij+mji affects the coefficient of ξiξj. Exactly one of them is symmetric, the one whose matrix splits each cross coefficient equally between mij and mji.
In plain words A quadratic form feeds the same vector into both slots. It sees the diagonal entries and the sums of mirror-image entries off the diagonal, and nothing else.
Example The quadratic form q(x)=3x12+4x1x2−x22 on R2 comes from both of the matrices
[322−1],[304−1],and only the first is symmetric. At x=(1,1) both give 3+4−1=6.
Polarization identity
Definition Let b be a symmetric bilinear form on a real vector space V with quadratic form q. Then for all x,y∈V
b(x,y)=21(q(x+y)−q(x)−q(y)).To prove it, expand by bilinearity,
q(x+y)=q(x)+b(x,y)+b(y,x)+q(y),and use symmetry to combine the two middle terms. Hence a symmetric bilinear form is determined by its quadratic form, and symmetric bilinear forms on V correspond one to one with quadratic forms on V. Without symmetry the right side of the identity equals 21(b(x,y)+b(y,x)), the symmetric part of b, not b itself.
In plain words For a symmetric form, the values on single vectors are enough to recover the values on all pairs.
Example For q(x)=3x12+4x1x2−x22 the values q(1,1)=6, q(1,0)=3 and q(0,1)=−1 give
b(e1,e2)=21(6−3+1)=2,which is the off-diagonal entry of the symmetric matrix found above.
Symmetric and skew-symmetric parts
Definition Every M∈Rn×n splits uniquely as M=H+K with HT=H and KT=−K, namely
HK=21(M+MT),=21(M−MT).The split is unique because a matrix that is both symmetric and skew-symmetric is zero. A bilinear form splits the same way into a symmetric part and a skew-symmetric part. For every real column x the scalar xTKx equals its own transpose xTKTx=−xTKx, so it is 0 and
xTMx=xTHx.A real bilinear form satisfies b(v,v)=0 for every v exactly when it is skew-symmetric, and such a form is called alternating. One direction is the computation above, and for the other, expanding b(x+y,x+y)=0 gives b(x,y)=−b(y,x).
In plain words The quadratic form sees only the symmetric part. The skew-symmetric part is invisible to it, so a form that is not symmetric can never be recovered from its quadratic form.
Example The matrix with rows (1,4) and (0,2) splits as
[1042]=[1222]+[0−220],and both it and its symmetric part give the quadratic form x12+4x1x2+2x22. The skew-symmetric matrix with rows (0,1) and (−1,0) has the quadratic form x1x2−x2x1=0, yet its form takes the value b(e1,e2)=1. It is a nonzero alternating form.
Check yourself
- Write the matrix of b(x,y)=x1y1+2x1y2+2x2y1+4x2y2 on R2 in the standard basis. Is b symmetric? Is it degenerate?
Show the answer
The coefficient of xiyj is mij, so
M=[1224].
It equals its transpose, so b is symmetric. Its determinant is 4−4=0, so b is degenerate. Indeed y=(2,−1) satisfies My=0, so b(x,y)=0 for every x.
- The form q(x)=x12+3x22 on R2 has matrix M=diag(1,3) in the standard basis. Find its matrix in the basis c1=(1,1), c2=(1,−1) and evaluate q at the vector with new coordinates (1,2) in two ways. What goes wrong if the matrix is changed by similarity instead?
Show the answer
The basis matrix has columns c1 and c2, and congruence gives
S=[111−1],STMS=[4−2−24].
With ξ=(1,2) the new matrix gives 4⋅12+2⋅(−2)⋅1⋅2+4⋅22=4−8+16=12. In old coordinates the vector is Sξ=(3,−1), and q=9+3=12, the same value. Similarity would give S−1MS, the matrix with rows (2,−1) and (−1,2), which assigns 2⋅12+2⋅(−1)⋅1⋅2+2⋅22=6 to the same coordinates. That is wrong, because it treats the form as an operator.
- Let b(x,y)=x1y2 on R2, with quadratic form q. Compute 21(q(x+y)−q(x)−q(y)) and compare it with b. Which hypothesis of the polarization identity fails?
Show the answer
Here q(x)=x1x2, so
q(x+y)−q(x)−q(y)=(x1+y1)(x2+y2)−x1x2−y1y2=x1y2+x2y1.
Half of this is 21(x1y2+x2y1), the symmetric part of b. At (e1,e2) it gives 21, while b(e1,e2)=1. The form is not symmetric, since b(e2,e1)=0, and its skew-symmetric part 21(x1y2−x2y1) is invisible to q.