Unit 1, lesson 5

Rank-Nullity and Isomorphisms

The rank-nullity theorem and its proof by extending a kernel basis, when a linear map is injective, surjective or an isomorphism, why the inverse of a bijective linear map is linear, and the rank of a composition.

  • Video 5
  • Bases and Linear Maps

Suppose a real polynomial of degree at most two takes the value 22 at t=0t = 0 and the value 55 at t=1t = 1. The linear polynomial 2+3t2 + 3t fits, but so does 2+3t+s(t2−t)2 + 3t + s(t^2 - t) for every real ss, because t2−tt^2 - t vanishes at both points. Two readings leave one direction of a three-dimensional space undetected, and the rank-nullity theorem says that this count always balances. This lesson proves the theorem and uses it to decide when a linear map is injective, surjective or invertible, and how much rank survives a composition.

Key terms

Rank-nullity theorem

Definition Let VV and WW be vector spaces over F\mathbb{F}, where F\mathbb{F} is R\mathbb{R} or C\mathbb{C}, and let T:V→WT: V \to W be linear. The kernel and the image of TT are the subspaces

ker⁡T={x∈V:T(x)=0},im⁡T={T(x):x∈V}.\begin{aligned} \ker T &= \{x \in V : T(x) = 0\}, \\[0.4em] \operatorname{im} T &= \{T(x) : x \in V\}. \end{aligned}

The nullity of TT is dim⁡ker⁡T\dim \ker T and the rank is rank⁡T=dim⁡im⁡T\operatorname{rank} T = \dim \operatorname{im} T. If VV is finite-dimensional, both are finite and

dim⁡V=dim⁡ker⁡T+rank⁡T.\dim V = \dim \ker T + \operatorname{rank} T.

The space WW need not be finite-dimensional, and its dimension plays no part. For the proof, choose a basis k1,…,krk_1, \dots, k_r of ker⁡T\ker T and extend it to a basis k1,…,kr,v1,…,vsk_1, \dots, k_r, v_1, \dots, v_s of VV. The images T(v1),…,T(vs)T(v_1), \dots, T(v_s) span im⁡T\operatorname{im} T, because expanding any xx in this basis and applying TT removes every kernel term. They are independent. If ∑iaiT(vi)=0\sum_i a_i T(v_i) = 0, then ∑iaivi\sum_i a_i v_i lies in ker⁡T\ker T, so it equals ∑ldlkl\sum_l d_l k_l for some scalars dld_l, and independence of the extended basis forces every aia_i to be 00. Hence the rank is ss, the nullity is rr, and dim⁡V=r+s\dim V = r + s. The cases r=0r = 0 and s=0s = 0 are included, with an empty list as the basis of the zero space.

In plain words The dimension of the domain splits into two counts, the directions the map cannot detect and the independent directions it actually produces. The size of the codomain does not enter.

Example Over R\mathbb{R} let T:P2→R2T: \mathcal{P}_2 \to \mathbb{R}^2 be T(p)=(p(0),p(1))T(p) = (p(0), p(1)), where P2\mathcal{P}_2 is the space of polynomials of degree at most two, including the zero polynomial. For p=a+bt+ct2p = a + bt + ct^2 this gives T(p)=(a,a+b+c)T(p) = (a, a + b + c). The kernel requires a=0a = 0 and b+c=0b + c = 0, so ker⁡T=span⁡(t2−t)\ker T = \operatorname{span}(t^2 - t) has dimension 11. Every target (y1,y2)(y_1, y_2) is reached by y1+(y2−y1)ty_1 + (y_2 - y_1)t, so im⁡T=R2\operatorname{im} T = \mathbb{R}^2 has dimension 22, and 3=1+23 = 1 + 2. One solution plus the kernel gives all solutions, so the polynomials with readings (2,5)(2, 5) are exactly

p(t)=2+3t+s(t2−t),s∈R.p(t) = 2 + 3t + s(t^2 - t), \qquad s \in \mathbb{R}.

Injective map

Definition A map T:V→WT: V \to W is injective, or one-to-one, if T(x)=T(y)T(x) = T(y) implies x=yx = y for all x,y∈Vx, y \in V. A linear map is injective exactly when ker⁡T={0}\ker T = \{0\}. If the kernel is zero and T(x)=T(y)T(x) = T(y), then T(x−y)=0T(x - y) = 0, so x−y=0x - y = 0. If instead some k≠0k \ne 0 lies in the kernel, then T(k)=T(0)T(k) = T(0) with k≠0k \ne 0. When VV is finite-dimensional, rank-nullity turns injectivity into the condition rank⁡T=dim⁡V\operatorname{rank} T = \dim V. When WW is finite-dimensional as well, an injective linear map from VV to WW can exist only if dim⁡V≤dim⁡W\dim V \le \dim W.

In plain words An injective map never sends two different inputs to the same output. For a linear map it is enough to check that only the zero vector goes to zero.

Example The inclusion ι(x,y)=(x,y,0)\iota(x, y) = (x, y, 0) from R2\mathbb{R}^2 to R3\mathbb{R}^3 has kernel {0}\{0\}, so it is injective. The two-reading map T(p)=(p(0),p(1))T(p) = (p(0), p(1)) on P2\mathcal{P}_2 is not injective, since t2−tt^2 - t and the zero polynomial both give (0,0)(0, 0).

Surjective map

Definition A map T:V→WT: V \to W is surjective, or onto, if im⁡T=W\operatorname{im} T = W, that is, if every w∈Ww \in W equals T(x)T(x) for some x∈Vx \in V. Surjectivity depends on the stated codomain WW, not only on the formula. When WW is finite-dimensional, a linear map TT is surjective exactly when rank⁡T=dim⁡W\operatorname{rank} T = \dim W, because a subspace of WW with the same finite dimension as WW is all of WW. If VV is also finite-dimensional, rank-nullity gives rank⁡T≤dim⁡V\operatorname{rank} T \le \dim V, so a surjective linear map from VV to WW can exist only if dim⁡W≤dim⁡V\dim W \le \dim V.

In plain words Every vector of the codomain is hit. For a linear map between finite-dimensional spaces this comes down to comparing the dimension of the image with the dimension of the codomain.

Example The projection π(x,y,z)=(x,y)\pi(x, y, z) = (x, y) from R3\mathbb{R}^3 to R2\mathbb{R}^2 is surjective, since (x,y)=π(x,y,0)(x, y) = \pi(x, y, 0), but it is not injective, because its kernel is the zz-axis. The inclusion ι(x,y)=(x,y,0)\iota(x, y) = (x, y, 0) is not surjective onto R3\mathbb{R}^3, since (0,0,1)(0, 0, 1) is never reached. The same formula viewed as a map to the plane z=0z = 0 is surjective, which is why the codomain has to be stated.

Isomorphism

Definition An isomorphism is a linear map T:V→WT: V \to W that is bijective, meaning both injective and surjective. Two vector spaces over F\mathbb{F} are isomorphic when an isomorphism between them exists. Isomorphic finite-dimensional spaces have the same dimension, since an isomorphism has nullity 00 and rank dim⁡W\dim W. Now let VV and WW be finite-dimensional over F\mathbb{F} with dim⁡V=dim⁡W=n\dim V = \dim W = n, and let T:V→WT: V \to W be linear. Then TT is injective if and only if it is surjective, and either property makes TT an isomorphism. Rank-nullity gives dim⁡ker⁡T+rank⁡T=n=dim⁡W\dim \ker T + \operatorname{rank} T = n = \dim W, so

dim⁡ker⁡T=0  ⟺  rank⁡T=dim⁡W.\begin{aligned} &\dim \ker T = 0 \\[0.4em] &\quad \iff \operatorname{rank} T = \dim W. \end{aligned}

The equivalence can fail when the dimensions differ. The inclusion of R2\mathbb{R}^2 in R3\mathbb{R}^3 is injective and not surjective, and the projection of R3\mathbb{R}^3 onto R2\mathbb{R}^2 is surjective and not injective.

In plain words An isomorphism matches the vectors of two spaces one for one while respecting addition and scaling, so the two spaces carry the same linear structure. It does not say the objects are identical, and different isomorphisms give different matchings. In equal finite dimensions one of the two checks is enough.

Example Over R\mathbb{R} let T:P2→R3T: \mathcal{P}_2 \to \mathbb{R}^3 be T(p)=(p(0),p(1),p(−1))T(p) = (p(0), p(1), p(-1)). If T(p)=0T(p) = 0, then pp has the three distinct roots 00, 11 and −1-1, and a nonzero polynomial of degree at most two has at most two roots, so p=0p = 0. The kernel is zero and both spaces have dimension 33, so TT is an isomorphism. To find the polynomial with readings (2,5,1)(2, 5, 1), write p=a+bt+ct2p = a + bt + ct^2. The readings give a=2a = 2, b+c=3b + c = 3 and −b+c=−1-b + c = -1, so c=1c = 1, b=2b = 2 and p=2+2t+t2p = 2 + 2t + t^2.

Linear inverse

Definition Let T:V→WT: V \to W be a bijective linear map between vector spaces over F\mathbb{F}. Its inverse T−1:W→VT^{-1}: W \to V sends each y∈Wy \in W to the unique x∈Vx \in V with T(x)=yT(x) = y, so T−1∘TT^{-1} \circ T is the identity of VV and T∘T−1T \circ T^{-1} is the identity of WW. The inverse is linear. Take y,z∈Wy, z \in W with T−1(y)=xT^{-1}(y) = x and T−1(z)=vT^{-1}(z) = v, and scalars a,b∈Fa, b \in \mathbb{F}. Linearity of TT gives T(ax+bv)=ay+bzT(ax + bv) = ay + bz, and since ax+bvax + bv is the only preimage of ay+bzay + bz,

T−1(ay+bz)=aT−1(y)+bT−1(z).T^{-1}(ay + bz) = aT^{-1}(y) + bT^{-1}(z).

No finite-dimensional hypothesis is needed. When VV and WW are finite-dimensional with bases B\mathcal{B} and C\mathcal{C}, the matrix [T−1]B←C[T^{-1}]_{\mathcal{B} \leftarrow \mathcal{C}} is the inverse of the square matrix [T]C←B[T]_{\mathcal{C} \leftarrow \mathcal{B}}.

In plain words Undoing a linear bijection never breaks linearity. Reading the map backwards gives another linear map, not merely a function.

Example For the three-reading isomorphism above, solving a=ra = r, a+b+c=sa + b + c = s and a−b+c=ua - b + c = u for arbitrary readings (r,s,u)(r, s, u) gives

T−1(r,s,u)=r+s−u2 t+s+u−2r2 t2.\begin{aligned} T^{-1}(r, s, u) &= r + \frac{s - u}{2}\, t \\[0.4em] &\quad + \frac{s + u - 2r}{2}\, t^2. \end{aligned}

Each coefficient is a linear expression in rr, ss and uu, as the theorem predicts. For example T−1(1,0,4)=1−2t+t2T^{-1}(1, 0, 4) = 1 - 2t + t^2, and indeed (1−t)2(1 - t)^2 takes the values 11, 00 and 44 at 00, 11 and −1-1.

Rank of a composition

Definition Let T:V→WT: V \to W and S:W→ZS: W \to Z be linear maps between vector spaces over F\mathbb{F}, with VV and WW finite-dimensional, and write STST for the composition S∘TS \circ T, which applies TT first. Then ker⁡T⊆ker⁡(ST)\ker T \subseteq \ker(ST) and im⁡(ST)⊆im⁡S\operatorname{im}(ST) \subseteq \operatorname{im} S, and

rank⁡(ST)≤min⁡(rank⁡S,rank⁡T).\operatorname{rank}(ST) \le \min(\operatorname{rank} S, \operatorname{rank} T).

The first inclusion holds because T(x)=0T(x) = 0 gives S(T(x))=S(0)=0S(T(x)) = S(0) = 0. Rank-nullity on the common domain VV then gives

rank⁡(ST)=dim⁡V−dim⁡ker⁡(ST)≤dim⁡V−dim⁡ker⁡T=rank⁡T.\begin{aligned} \operatorname{rank}(ST) &= \dim V - \dim \ker(ST) \\[0.4em] &\le \dim V - \dim \ker T \\[0.4em] &= \operatorname{rank} T. \end{aligned}

This half uses only that VV is finite-dimensional. The second inclusion holds because every output S(T(x))S(T(x)) is an output of SS, so rank⁡(ST)≤rank⁡S\operatorname{rank}(ST) \le \operatorname{rank} S. For matrices over F\mathbb{F} this reads rank⁡(AB)≤min⁡(rank⁡A,rank⁡B)\operatorname{rank}(AB) \le \min(\operatorname{rank} A, \operatorname{rank} B) whenever the product ABAB is defined.

In plain words A composition cannot produce more independent outputs than either stage. What the first map loses stays lost, and the second map cannot reach outside its own image. The bound can be strict.

Example Let T:R→R2T: \mathbb{R} \to \mathbb{R}^2 be T(t)=(t,0)T(t) = (t, 0) and S:R2→RS: \mathbb{R}^2 \to \mathbb{R} be S(x,y)=yS(x, y) = y. Each has rank one, but S(T(t))=0S(T(t)) = 0 for every tt, so STST is the zero map and has rank 00. The map SS discards exactly the direction that TT produces.

Check yourself

  1. A linear map T:R3→R4T: \mathbb{R}^3 \to \mathbb{R}^4 has ker⁡T={0}\ker T = \{0\}. Is TT an isomorphism?
Show the answer

No. Rank-nullity gives rank⁡T=3−0=3\operatorname{rank} T = 3 - 0 = 3, while dim⁡R4=4\dim \mathbb{R}^4 = 4, so the image is a proper subspace of R4\mathbb{R}^4 and TT is not surjective. In fact no linear map from R3\mathbb{R}^3 to R4\mathbb{R}^4 is surjective. The shortcut that makes an injective map automatically surjective needs the domain and codomain to have the same finite dimension, and here they do not.

  1. Let D:P3→P3D: \mathcal{P}_3 \to \mathcal{P}_3 be differentiation over R\mathbb{R}. Find its kernel and image, check rank-nullity, and decide whether DD is injective or surjective.
Show the answer

The derivative of pp is zero exactly when pp is constant, so the kernel is the space of constant polynomials, of dimension 11. The derivative of a0+a1t+a2t2+a3t3a_0 + a_1 t + a_2 t^2 + a_3 t^3 is a1+2a2t+3a3t2a_1 + 2a_2 t + 3a_3 t^2, and every polynomial q0+q1t+q2t2q_0 + q_1 t + q_2 t^2 arises, as the derivative of q0t+q12t2+q23t3q_0 t + \frac{q_1}{2} t^2 + \frac{q_2}{3} t^3. So im⁡D=P2\operatorname{im} D = \mathcal{P}_2, of dimension 33, and 4=1+34 = 1 + 3. The map is not injective, since its kernel is nonzero, and not surjective, since t3t^3 is not in the image. Domain and codomain have the same dimension here, so the two properties had to fail together.

  1. Let AA be a real 3×23 \times 2 matrix and BB a real 2×32 \times 3 matrix. Can ABAB be invertible? Can BABA?
Show the answer

The product ABAB is 3×33 \times 3, and rank⁡(AB)≤rank⁡A≤2<3\operatorname{rank}(AB) \le \operatorname{rank} A \le 2 < 3, so ABAB is never invertible. The product BABA is 2×22 \times 2, and the bound gives only rank⁡(BA)≤2\operatorname{rank}(BA) \le 2, which does not rule out invertibility. It does happen. For the matrices

A=[100100],B=[100010]A = \begin{bmatrix} 1 & 0 \\ 0 & 1 \\ 0 & 0 \end{bmatrix}, \qquad B = \begin{bmatrix} 1 & 0 & 0 \\ 0 & 1 & 0 \end{bmatrix}

the product BABA is the identity I2I_2, while ABAB has rank 22.

How this lesson connects