Unit 1, lesson 2

Real and Complex Vector Spaces

Vector spaces over the real or complex numbers, with the complex conjugate and modulus, the vector space axioms, the subspace test, real versus complex dimension, and polynomials of degree at most n.

  • Video 2
  • Proof and Scalar Fields

The pair (2+i,3−2i)(2 + i, 3 - 2i) can be described by its two complex entries, or by the four real numbers 22, 11, 33 and −2-2 hidden in their real and imaginary parts. So does the space C2\mathbb{C}^2 of complex pairs have two independent directions or four? Both answers are correct, once you say which numbers may be used as scalars. This lesson makes that choice explicit, states the rules every vector space obeys, gives a short test for subspaces and compares real and complex dimension.

Key terms

Field of scalars

Definition In this course the field of scalars F\mathbb{F} is either the real numbers R\mathbb{R} or the complex numbers C\mathbb{C}. A result stated over F\mathbb{F} holds for both, and the field is named whenever the answer depends on it. A complex number has the form z=a+biz = a + bi with a,b∈Ra, b \in \mathbb{R}, where i2=−1i^2 = -1. Its real part is Re⁡z=a\operatorname{Re} z = a and its imaginary part is Im⁡z=b\operatorname{Im} z = b, and two complex numbers are equal exactly when both parts agree. Sums and products follow the usual rules of algebra, with i2i^2 replaced by −1-1,

(a+bi)+(c+di)=(a+c)+(b+d)i,(a+bi)(c+di)=(ac−bd)+(ad+bc)i.\begin{aligned} &(a + bi) + (c + di) \\ &\quad = (a + c) + (b + d)i, \\[0.6em] &(a + bi)(c + di) \\ &\quad = (ac - bd) + (ad + bc)i. \end{aligned}

Both R\mathbb{R} and C\mathbb{C} are fields, number systems in which addition and multiplication obey the usual rules of algebra and every nonzero number has a reciprocal. A vector space over F\mathbb{F} allows vectors to be multiplied only by elements of F\mathbb{F}, so linear combinations, spans, independence, subspaces and dimension are all taken with coefficients in F\mathbb{F}.

In plain words The field is the supply of numbers you may scale by. Changing it changes which combinations are allowed, even when the set of vectors stays the same.

Example The product (2+i)(3−2i)(2 + i)(3 - 2i) equals 6−4i+3i−2i2=8−i6 - 4i + 3i - 2i^2 = 8 - i. In C2\mathbb{C}^2 the vector (i,0)(i, 0) equals i⋅(1,0)i \cdot (1, 0), so it is a scalar multiple of (1,0)(1, 0) when complex scalars are allowed. When only real scalars are allowed it is not, because every multiple c(1,0)c(1, 0) with c∈Rc \in \mathbb{R} has a real first entry.

Complex conjugate

Definition The complex conjugate of z=a+biz = a + bi, with a,b∈Ra, b \in \mathbb{R}, is z‾=a−bi\overline{z} = a - bi. Since zz‾=(a+bi)(a−bi)=a2+b2z\overline{z} = (a + bi)(a - bi) = a^2 + b^2, the modulus of zz is the nonnegative real number

∣z∣=a2+b2=z z‾.\lvert z \rvert = \sqrt{a^2 + b^2} = \sqrt{z\,\overline{z}}.

For all z,w∈Cz, w \in \mathbb{C} the rules z+w‾=z‾+w‾\overline{z + w} = \overline{z} + \overline{w}, zw‾=z‾ w‾\overline{zw} = \overline{z}\,\overline{w} and ∣zw∣=∣z∣∣w∣\lvert zw \rvert = \lvert z \rvert \lvert w \rvert hold, and ∣z∣=0\lvert z \rvert = 0 exactly when z=0z = 0. A complex number zz is real exactly when z‾=z\overline{z} = z. For z≠0z \ne 0 the reciprocal is

1z=z‾∣z∣2.\frac{1}{z} = \frac{\overline{z}}{\lvert z \rvert^2}.

In plain words Conjugation flips the sign of the imaginary part, which reflects the point zz across the real axis of the complex plane. The modulus is the distance from 00 to zz, and multiplying zz by its conjugate always gives a nonnegative real number, the square of that distance.

Example For z=3+4iz = 3 + 4i the conjugate is z‾=3−4i\overline{z} = 3 - 4i, the product is zz‾=9+16=25z\overline{z} = 9 + 16 = 25, and ∣z∣=5\lvert z \rvert = 5. Hence

13+4i=3−4i25.\frac{1}{3 + 4i} = \frac{3 - 4i}{25}.

Compare z2=−7+24iz^2 = -7 + 24i, which is not even real. The square of the modulus is zz‾z\overline{z}, which equals z2z^2 only when zz is real. In the same way ii has modulus 11, although i2=−1i^2 = -1.

Vector space axioms

Definition A vector space over F\mathbb{F} is a set VV with an addition, which gives a vector u+v∈Vu + v \in V for all u,v∈Vu, v \in V, and a scalar multiplication, which gives a vector av∈Vav \in V for all a∈Fa \in \mathbb{F} and v∈Vv \in V, such that the following hold for all u,v,w∈Vu, v, w \in V and a,b∈Fa, b \in \mathbb{F}.

  • Addition is commutative and associative, u+v=v+uu + v = v + u and (u+v)+w=u+(v+w)(u + v) + w = u + (v + w).
  • There is a vector 0∈V0 \in V with v+0=vv + 0 = v for every v∈Vv \in V.
  • Every v∈Vv \in V has an additive inverse −v∈V-v \in V with v+(−v)=0v + (-v) = 0.
  • Scalar multiplication satisfies a(bv)=(ab)va(bv) = (ab)v and 1v=v1v = v.
  • Both distributive laws hold, a(u+v)=au+ava(u + v) = au + av and (a+b)v=av+bv(a + b)v = av + bv.

A statement proved from these rules alone holds in every vector space over F\mathbb{F}, whether its vectors are columns, matrices, polynomials or functions.

In plain words The axioms are the rules of arithmetic you may use with vectors. Nothing else about the vectors is assumed, which is why one proof from the axioms covers columns, matrices and polynomials alike.

Example Two consequences show the axioms at work. First, the zero vector is unique. If 0′0' also satisfies v+0′=vv + 0' = v for every vv, then 0′=0′+0=0+0′=00' = 0' + 0 = 0 + 0' = 0, using in turn that 00 is an identity, commutativity, and that 0′0' is an identity. Second, 0v=00v = 0 for every v∈Vv \in V, where the zero on the left is the scalar and the zero on the right is the vector. Distributivity gives 0v=(0+0)v=0v+0v0v = (0 + 0)v = 0v + 0v, and then

0=0v+(−(0v))=(0v+0v)+(−(0v))=0v+(0v+(−(0v)))=0v+0=0v.\begin{aligned} 0 &= 0v + (-(0v)) \\[0.4em] &= (0v + 0v) + (-(0v)) \\[0.4em] &= 0v + (0v + (-(0v))) \\[0.4em] &= 0v + 0 = 0v. \end{aligned}

The axioms are not automatic. On R2\mathbb{R}^2 with the usual addition, the scaling rule c(x,y)=(cx,0)c(x, y) = (cx, 0) satisfies every axiom except 1v=v1v = v, since it sends 1⋅(1,1)1 \cdot (1, 1) to (1,0)(1, 0). So R2\mathbb{R}^2 with these operations is not a vector space.

Subspace test

Definition Let VV be a vector space over F\mathbb{F}. A subset U⊆VU \subseteq V is a subspace if it is a vector space over F\mathbb{F} under the operations of VV. The subspace test says that UU is a subspace exactly when UU is nonempty and

au+bv∈Ufor all u,v∈U and a,b∈F.\begin{gathered} au + bv \in U \\[0.4em] \text{for all } u, v \in U \text{ and } a, b \in \mathbb{F}. \end{gathered}

The condition is sufficient. Since UU is nonempty it contains some vector uu, and taking v=uv = u with a=b=0a = b = 0 puts 00 in UU. For any u,v∈Uu, v \in U, the choice a=−1a = -1 and b=0b = 0 puts (−1)u=−u(-1)u = -u in UU. The choice a=b=1a = b = 1 gives closure under addition, and the choice b=0b = 0 with any aa gives closure under scaling. The remaining axioms hold in UU because they hold in VV for the same operations. Conversely, a subspace is nonempty, since it contains a zero vector, and it contains every such combination, since it is closed under both operations. The word nonempty cannot be dropped, because the empty set satisfies the closure condition vacuously but contains no zero vector.

In plain words To check a subspace, show that it is not empty and that combining two of its vectors with any allowed scalars never leads outside it. The allowed scalars are those of F\mathbb{F}, so the same set can pass the test over R\mathbb{R} and fail it over C\mathbb{C}.

Example In R2\mathbb{R}^2 the line L={(x,y):x+y=0}L = \{(x, y) : x + y = 0\} contains (0,0)(0, 0). If (x1,y1)(x_1, y_1) and (x2,y2)(x_2, y_2) lie in LL, the combination a(x1,y1)+b(x2,y2)a(x_1, y_1) + b(x_2, y_2) has coordinate sum a(x1+y1)+b(x2+y2)=0a(x_1 + y_1) + b(x_2 + y_2) = 0, so LL is a subspace. The parallel line x+y=1x + y = 1 does not contain (0,0)(0, 0), so it is not. Now regard C\mathbb{C} as a vector space over R\mathbb{R}. The real numbers form a subspace, since real combinations of real numbers are real. Over C\mathbb{C} they do not, because 1∈R1 \in \mathbb{R} but i⋅1=i∉Ri \cdot 1 = i \notin \mathbb{R}.

Real and complex dimension

Definition A basis of a vector space VV over F\mathbb{F} is a list of vectors that spans VV and is linearly independent, both with coefficients in F\mathbb{F}. When VV has a finite basis, the dimension dim⁡FV\dim_{\mathbb{F}} V is the number of vectors in a basis, and the lesson Basis Exchange and Dimension proves that this number does not depend on the basis. Every vector space over C\mathbb{C} is also a vector space over R\mathbb{R}, by allowing only real scalars. If v1,…,vnv_1, \dots, v_n is a basis of VV over C\mathbb{C}, then v1,iv1,…,vn,ivnv_1, iv_1, \dots, v_n, iv_n is a basis of VV over R\mathbb{R}. Indeed, a complex coefficient aj+bjia_j + b_j i on vjv_j, with aj,bja_j, b_j real, contributes the same as the real coefficients aja_j on vjv_j and bjb_j on ivjiv_j. So these 2n2n vectors span VV over R\mathbb{R}. Because v1,…,vnv_1, \dots, v_n are independent over C\mathbb{C}, a real combination of the 2n2n vectors is zero only when every aj+bjia_j + b_j i is zero, that is, when every aja_j and every bjb_j is zero. Hence dim⁡RV=2dim⁡CV\dim_{\mathbb{R}} V = 2\dim_{\mathbb{C}} V for every finite-dimensional complex vector space VV, and in particular

dim⁡CCn=n,dim⁡RCn=2n.\dim_{\mathbb{C}} \mathbb{C}^n = n, \qquad \dim_{\mathbb{R}} \mathbb{C}^n = 2n.

In plain words Dimension counts how many independent coefficients are needed to describe a vector, and that count depends on which scalars are allowed. One complex coefficient carries two real ones.

Example Let e1=(1,0)e_1 = (1, 0) and e2=(0,1)e_2 = (0, 1) in C2\mathbb{C}^2. Over C\mathbb{C} the vector v=(2+i,3−2i)v = (2 + i, 3 - 2i) equals (2+i)e1+(3−2i)e2(2 + i)e_1 + (3 - 2i)e_2, so its coordinate column is (2+i,3−2i)(2 + i, 3 - 2i). Over R\mathbb{R}, with the ordered basis e1,ie1,e2,ie2e_1, ie_1, e_2, ie_2,

v=2e1+1(ie1)+3e2−2(ie2),v = 2e_1 + 1(ie_1) + 3e_2 - 2(ie_2),

so its coordinate column is (2,1,3,−2)(2, 1, 3, -2). The vector has not moved, only the system of coefficients has changed. These four vectors are independent over R\mathbb{R}, because ae1+b(ie1)+ce2+d(ie2)=(a+bi,c+di)ae_1 + b(ie_1) + ce_2 + d(ie_2) = (a + bi, c + di) is zero only when a+bi=0a + bi = 0 and c+di=0c + di = 0, and for real a,b,c,da, b, c, d that forces all four to be 00.

Polynomials of degree at most n

Definition For an integer n≥0n \ge 0, the set Pn\mathcal{P}_n consists of all polynomials

p(t)=a0+a1t+⋯+antnp(t) = a_0 + a_1 t + \cdots + a_n t^n

with coefficients a0,…,an∈Fa_0, \dots, a_n \in \mathbb{F}, including the zero polynomial, whose coefficients are all 00. Two polynomials are equal when their coefficients agree. Polynomials are added and multiplied by scalars coefficient by coefficient, so matching pp with its coefficient column (a0,…,an)(a_0, \dots, a_n) turns these operations into the operations of Fn+1\mathbb{F}^{n+1}, and Pn\mathcal{P}_n inherits every vector space axiom. The polynomials 1,t,…,tn1, t, \dots, t^n form a basis, so dim⁡Pn=n+1\dim \mathcal{P}_n = n + 1. By contrast, the polynomials of degree exactly nn do not form a subspace, since the zero polynomial is not among them.

In plain words A polynomial of degree at most nn is just its list of n+1n + 1 coefficients, so Pn\mathcal{P}_n behaves exactly like Fn+1\mathbb{F}^{n+1}. The dimension is one more than the top degree, because the constant term needs a coefficient of its own.

Example In the real space P2\mathcal{P}_2 the sum (1+2t)+(3−t+t2)=4+t+t2(1 + 2t) + (3 - t + t^2) = 4 + t + t^2 matches the column sum (1,2,0)+(3,−1,1)=(4,1,1)(1, 2, 0) + (3, -1, 1) = (4, 1, 1). The polynomials of degree exactly 22 do not form a subspace. Scaling t2t^2 by 00 leaves the set, and so does the sum t2+(t−t2)=tt^2 + (t - t^2) = t. The polynomials in P2\mathcal{P}_2 with constant term 00 do form a subspace, namely {bt+ct2:b,c∈R}\{bt + ct^2 : b, c \in \mathbb{R}\}, with basis t,t2t, t^2 and dimension 22.

Check yourself

  1. For z=1−2iz = 1 - 2i, find z‾\overline{z}, zz‾z\overline{z} and ∣z∣\lvert z \rvert, and write 1/z1/z in the form a+bia + bi.
Show the answer

The conjugate is z‾=1+2i\overline{z} = 1 + 2i, and zz‾=1+4=5z\overline{z} = 1 + 4 = 5, so ∣z∣=5\lvert z \rvert = \sqrt{5}. Then

11−2i=1+2i5=15+25i.\frac{1}{1 - 2i} = \frac{1 + 2i}{5} = \frac{1}{5} + \frac{2}{5}i.

Multiplying back confirms it, since (1−2i)(1+2i)=5(1 - 2i)(1 + 2i) = 5.

  1. Let U={(z,z‾):z∈C}U = \{(z, \overline{z}) : z \in \mathbb{C}\}, a subset of C2\mathbb{C}^2. Is UU a subspace when C2\mathbb{C}^2 is a vector space over R\mathbb{R}? Is it a subspace over C\mathbb{C}? Where it is a subspace, give a basis.
Show the answer

Over R\mathbb{R} it is a subspace. It contains (0,0)(0, 0), and for z,w∈Cz, w \in \mathbb{C} and real a,ba, b

a(z,z‾)+b(w,w‾)=(az+bw, az‾+bw‾),\begin{aligned} &a(z, \overline{z}) + b(w, \overline{w}) \\[0.4em] &\quad = (az + bw, \ a\overline{z} + b\overline{w}), \end{aligned}

where az‾+bw‾=az+bw‾a\overline{z} + b\overline{w} = \overline{az + bw} because aa and bb are real. Writing z=x+yiz = x + yi gives (z,z‾)=x(1,1)+y(i,−i)(z, \overline{z}) = x(1, 1) + y(i, -i), and this is zero only when x=y=0x = y = 0. So (1,1),(i,−i)(1, 1), (i, -i) is a basis over R\mathbb{R}, and the real dimension is 22.

Over C\mathbb{C} it is not a subspace. The pair (1,1)(1, 1) lies in UU, but i(1,1)=(i,i)i(1, 1) = (i, i) does not, because i‾=−i≠i\overline{i} = -i \ne i. Closure under real scalars does not give closure under complex ones.

  1. Which of these subsets of the real space P2\mathcal{P}_2 are subspaces? (a) The polynomials of degree exactly 22. (b) The polynomials pp with p(2)=0p(2) = 0. (c) The polynomials pp with p(0)=1p(0) = 1. Give a basis of each one that is a subspace.
Show the answer

Set (a) is not a subspace, since it does not contain the zero polynomial, and t2+(t−t2)=tt^2 + (t - t^2) = t has degree 11.

Set (b) is a subspace. It contains the zero polynomial, and if p(2)=q(2)=0p(2) = q(2) = 0 then (cp+dq)(2)=cp(2)+dq(2)=0(cp + dq)(2) = cp(2) + dq(2) = 0 for all real c,dc, d. Writing p(t)=a0+a1t+a2t2p(t) = a_0 + a_1 t + a_2 t^2, the condition a0+2a1+4a2=0a_0 + 2a_1 + 4a_2 = 0 gives a0=−2a1−4a2a_0 = -2a_1 - 4a_2, so

p(t)=a1(t−2)+a2(t2−4).p(t) = a_1(t - 2) + a_2(t^2 - 4).

The polynomials t−2t - 2 and t2−4t^2 - 4 span the set, and they are independent because a combination c(t−2)+d(t2−4)c(t - 2) + d(t^2 - 4) has t2t^2 coefficient dd and tt coefficient cc, so it is the zero polynomial only when c=d=0c = d = 0. So they form a basis, and the dimension is 22.

Set (c) is not a subspace, since the zero polynomial has value 00 at t=0t = 0, not 11.

How this lesson connects

It also uses vector addition, scalar multiplication and basic algebra.