Unit 5, lesson 34

Brownian motion and Gaussian increments

What a standard Brownian motion is, how its independent Gaussian increments give the transition density, the covariance and square-root-of-time scaling, and how to compute a conditional threshold probability.

  • Video 34
  • Information, Brownian motion and quadratic variation

In a constructed arithmetic model the price of an asset is St=100+10WtS_t = 100 + 10 W_t currency units, with tt in years and WW a standard Brownian motion. The model is a toy, since it allows negative prices, but it raises a precise question. If the price is 103103 now, how likely is it to be above 110110 a quarter of a year later, and how does that compare with the same question asked from 100100? A jagged picture of a path cannot answer this, and the full law of the noise can. This lesson defines Brownian motion relative to a filtration, derives its transition density, covariance and scaling from that definition, and computes such conditional threshold probabilities.

Key terms

Brownian motion

Definition Let (Ω,F,(Ft)t≥0,P)(\Omega, \mathcal{F}, (\mathcal{F}_t)_{t \ge 0}, \mathbb{P}) be a filtered probability space. A process W=(Wt)t≥0W = (W_t)_{t \ge 0} is a standard Brownian motion with respect to (Ft)(\mathcal{F}_t) when W0=0W_0 = 0, the process is adapted, almost every path t↦Wtt \mapsto W_t is continuous, and for 0≤s<t0 \le s < t

Wt−Ws∼N(0,t−s),Wt−Ws⊥Fs,\begin{gathered} W_t - W_s \sim N(0, t - s), \\[0.4em] W_t - W_s \perp \mathcal{F}_s , \end{gathered}

where the second line says that the increment is independent of every event in Fs\mathcal{F}_s. That such a process exists is Wiener’s theorem, which the course states without constructing the process. The path regularity theorems are also stated without proof, for example that almost every path is nowhere differentiable. With the natural filtration of WW, the independence condition says that increments over disjoint intervals are independent. With a larger filtration it says more, because the increment must be independent of everything in Fs\mathcal{F}_s, and enlarging the filtration with information about the future can destroy the property. A price model built on WW, such as St=S0+μt+σWtS_t = S_0 + \mu t + \sigma W_t, is an assumption about prices and not a consequence of the definition.

In plain words Brownian motion is a noise model with continuous paths whose fresh shocks are normal, have variance equal to the elapsed time, and are independent of everything the model already knows.

Example Enlarge the natural filtration by revealing W1W_1 at time 00, so the information at time tt is generated by W1W_1 and the path up to tt. The increment W1−W0.25W_1 - W_{0.25} satisfies

Cov⁡(W1−W0.25,W1)=1−0.25=0.75≠0,\begin{aligned} &\operatorname{Cov}(W_1 - W_{0.25}, W_1) \\[0.4em] &\quad = 1 - 0.25 = 0.75 \ne 0, \end{aligned}

so it is not independent of the information at time 0.250.25, and WW is not a Brownian motion for the enlarged filtration, although the law of the process has not changed. In the constructed price model St=100+10WtS_t = 100 + 10 W_t, the coefficient 1010 is in currency units per square-root year, and the price change over a quarter year is normal with mean 00 and standard deviation 100.25=510 \sqrt{0.25} = 5 currency units.

Independent Gaussian increments

Definition For times 0=t0<t1<⋯<tn0 = t_0 < t_1 < \dots < t_n, the increments Wt1−Wt0,…,Wtn−Wtn−1W_{t_1} - W_{t_0}, \dots, W_{t_n} - W_{t_{n-1}} of a standard Brownian motion are independent, and the kkth one is N(0,tk−tk−1)N(0, t_k - t_{k-1}). Over an interval of length h>0h > 0 the increment has variance hh and standard deviation h\sqrt{h}, and it has the same law as h Z\sqrt{h}\, Z with Z∼N(0,1)Z \sim N(0, 1). The levels (Wt1,…,Wtn)(W_{t_1}, \dots, W_{t_n}) are partial sums of the increments, so this vector is jointly Gaussian with mean zero. With tt in years, WtW_t is measured in square-root years, and a coefficient σ\sigma multiplying it carries the units of the modeled quantity per square-root year. Over a step of length hh a drift μ\mu contributes μh\mu h, while the shock σ(Wt+h−Wt)\sigma (W_{t+h} - W_t) has standard deviation ∣σ∣h\lvert \sigma \rvert \sqrt{h}, so when σ≠0\sigma \ne 0 and hh is small the typical shock is much larger than the drift, because h/h=1/h\sqrt{h}/h = 1/\sqrt{h} grows without bound.

In plain words Brownian noise arrives as a stream of fresh, independent normal shocks whose variances add up to the elapsed time. Variance grows in proportion to time, and the typical size of a shock grows like the square root of time.

Example Over a quarter year, h=0.25h = 0.25, the increment has variance 0.250.25 and standard deviation 0.50.5, and the constructed standard normal draw 1.21.2 gives the increment

ΔW=0.25⋅1.2=0.6.\Delta W = \sqrt{0.25} \cdot 1.2 = 0.6 .

For one trading day, h=1/252h = 1/252 years, a log-price model with the constructed drift 0.080.08 per year and volatility 0.20.2 per square-root year has a drift of about 0.000320.00032 and a shock standard deviation of about 0.01260.0126, roughly 4040 times larger.

Transition density

Definition For h>0h > 0 the Brownian transition density is

ph(x,y)=12πhexp⁡(−(y−x)22h),\begin{aligned} &p_h(x, y) \\[0.4em] &= \frac{1}{\sqrt{2\pi h}} \exp\Bigl(-\frac{(y - x)^2}{2h}\Bigr), \end{aligned}

the density in yy of the normal law with mean xx and variance hh. For s≥0s \ge 0, h>0h > 0 and every bounded measurable function ff,

E[f(Ws+h)∣Fs]=∫−∞∞f(y) ph(Ws,y) dy\begin{aligned} &\mathbb{E}[f(W_{s+h}) \mid \mathcal{F}_s] \\[0.4em] &= \int_{-\infty}^{\infty} f(y)\, p_h(W_s, y)\, dy \end{aligned}

almost surely, because Ws+h=Ws+(Ws+h−Ws)W_{s+h} = W_s + (W_{s+h} - W_s), where WsW_s is known at time ss and the increment is independent of Fs\mathcal{F}_s. This is the Markov property, which says that the conditional law of a future level depends on the past only through the current level. The densities compose by the Chapman-Kolmogorov equation

∫−∞∞ph(x,z) pk(z,y) dz=ph+k(x,y)\begin{aligned} &\int_{-\infty}^{\infty} p_h(x, z)\, p_k(z, y)\, dz \\[0.4em] &\quad = p_{h+k}(x, y) \end{aligned}

for h,k>0h, k > 0,

and the joint density of (Wt1,…,Wtn)(W_{t_1}, \dots, W_{t_n}) is the product of the transition densities over the successive intervals, starting from x0=0x_0 = 0. There is no density at h=0h = 0, where the law is the point mass at xx.

In plain words Standing at level xx, the level a time hh later is xx plus a fresh normal shock, so its distribution is a bell curve centered at xx whose width grows like h\sqrt{h}. Integrating a payoff against this density gives its conditional expected value.

Example From x=0.3x = 0.3 over h=0.25h = 0.25 the density at y=1y = 1 is

p0.25(0.3,1)=e−0.98π/2≈0.2995,\begin{aligned} p_{0.25}(0.3, 1) &= \frac{e^{-0.98}}{\sqrt{\pi/2}} \\[0.4em] &\approx 0.2995, \end{aligned}

since (1−0.3)2/(2⋅0.25)=0.98(1 - 0.3)^2 / (2 \cdot 0.25) = 0.98, compared with the peak value 1/π/2≈0.79791/\sqrt{\pi/2} \approx 0.7979 at y=0.3y = 0.3. Splitting the quarter into steps of 0.10.1 and 0.150.15 years and integrating over the intermediate level zz, as Chapman-Kolmogorov allows, gives the same value.

Brownian covariance

Definition For all s,t≥0s, t \ge 0,

Cov⁡(Ws,Wt)=min⁡(s,t).\operatorname{Cov}(W_s, W_t) = \min(s, t).

For s≤ts \le t write Wt=Ws+(Wt−Ws)W_t = W_s + (W_t - W_s). The increment is independent of WsW_s and has mean zero, so

Cov⁡(Ws,Wt)=Var⁡(Ws)+Cov⁡(Ws,Wt−Ws)=s+0=s.\begin{aligned} &\operatorname{Cov}(W_s, W_t) \\[0.4em] &\quad = \operatorname{Var}(W_s) \\[0.4em] &\qquad + \operatorname{Cov}(W_s, W_t - W_s) \\[0.4em] &\quad = s + 0 = s. \end{aligned}

For 0<s≤t0 < s \le t the correlation of the two levels is s/t\sqrt{s/t}. Conversely, a process with W0=0W_0 = 0, continuous paths and centered jointly Gaussian finite-dimensional laws with covariance min⁡(s,t)\min(s, t) is a standard Brownian motion for its natural filtration, because its increments are jointly Gaussian with variance t−st - s and are uncorrelated over disjoint intervals, and uncorrelated jointly Gaussian variables are independent.

In plain words Increments over disjoint intervals are independent, but levels are not, because a later level contains all the earlier increments. The two levels share the noise up to the earlier time, and the variance of that shared part is the earlier time.

Example For a quarter year and a year, Cov⁡(W0.25,W1)=0.25\operatorname{Cov}(W_{0.25}, W_1) = 0.25 and the correlation is 0.25=0.5\sqrt{0.25} = 0.5, while W0.25W_{0.25} and W1−W0.25W_1 - W_{0.25} are independent. The variance of the sum of the two levels is

Var⁡(W1+W0.25)=1+0.25+2⋅0.25=1.75,\begin{aligned} &\operatorname{Var}(W_1 + W_{0.25}) \\[0.4em] &\quad = 1 + 0.25 + 2 \cdot 0.25 = 1.75, \end{aligned}

not the 1.251.25 that independent levels would give.

Brownian scaling

Definition For a fixed c>0c > 0 let Wt(c)=c−1/2WctW^{(c)}_t = c^{-1/2} W_{ct}. Then W(c)W^{(c)} is a standard Brownian motion with respect to the filtration Gt=Fct\mathcal{G}_t = \mathcal{F}_{ct}, so

{c−1/2Wct}t≥0=d{Wt}t≥0,\bigl\{c^{-1/2} W_{ct}\bigr\}_{t \ge 0} \overset{d}{=} \{W_t\}_{t \ge 0},

an equality of the laws of the whole processes. The proof checks the definition. The new process starts at 00, has continuous paths and is adapted to (Gt)(\mathcal{G}_t), and for s<ts < t its increment c−1/2(Wct−Wcs)c^{-1/2}(W_{ct} - W_{cs}) is independent of Fcs=Gs\mathcal{F}_{cs} = \mathcal{G}_s and normal with variance (ct−cs)/c=t−s(ct - cs)/c = t - s. The statement compares distributions, not values on one path. It concerns the driftless standard Brownian motion. For Xt=μt+WtX_t = \mu t + W_t the rescaled process c−1/2Xct=μc t+Wt(c)c^{-1/2} X_{ct} = \mu \sqrt{c}\, t + W^{(c)}_t has drift μc\mu \sqrt{c}, so a drifted Brownian motion does not keep its law under this rescaling unless μ=0\mu = 0 or c=1c = 1.

In plain words Speeding up the clock by a factor cc and shrinking the level by c\sqrt{c} produces a process with exactly the same probabilistic behavior. That is why the probability that WhW_h exceeds a level bb depends on bb and hh only through the ratio b/hb/\sqrt{h}.

Example Taking c=14c = \tfrac14 and t=1t = 1 shows that 2W0.252 W_{0.25} has the same N(0,1)N(0, 1) law as W1W_1, so

P(W0.25>1)=P(W1>2)=1−Φ(2)≈0.02275.\begin{aligned} \mathbb{P}(W_{0.25} > 1) &= \mathbb{P}(W_1 > 2) \\[0.4em] &= 1 - \Phi(2) \approx 0.02275 . \end{aligned}

On a single path, however, W1−2W0.25=(W1−W0.25)−W0.25W_1 - 2 W_{0.25} = (W_1 - W_{0.25}) - W_{0.25} is normal with variance 0.75+0.25=10.75 + 0.25 = 1, so W1≠2W0.25W_1 \ne 2 W_{0.25} with probability one.

Conditional threshold probability

Definition For s≥0s \ge 0, h>0h > 0 and a threshold bb, the transition density with f=1(b,∞)f = \mathbf{1}_{(b, \infty)} gives

P(Ws+h>b∣Fs)=1−Φ(b−Wsh)\begin{aligned} &\mathbb{P}(W_{s+h} > b \mid \mathcal{F}_s) \\[0.4em] &= 1 - \Phi\Bigl(\frac{b - W_s}{\sqrt{h}}\Bigr) \end{aligned}

almost surely, where Φ\Phi is the standard normal distribution function. Written with the regular conditional distribution given Ws=xW_s = x, the probability is 1−Φ((b−x)/h)1 - \Phi((b - x)/\sqrt{h}). For a continuous variable this is not a ratio of probabilities, since the event {Ws=x}\{W_s = x\} has probability zero. The answer is the same for Ws+h≥bW_{s+h} \ge b, because the normal law has no atoms. As h→0h \to 0 it tends to 11 when x>bx > b and to 00 when x<bx < b, and it equals 12\tfrac12 for every hh when x=bx = b. The event concerns the level at time s+hs + h only. The probability that the path reaches bb at some time in [s,s+h][s, s + h] is larger, and for x≤bx \le b it equals 2(1−Φ((b−x)/h))2\bigl(1 - \Phi((b - x)/\sqrt{h})\bigr) by the reflection principle, a result not derived here.

In plain words Measure the distance from the current level to the threshold in units of the remaining standard deviation h\sqrt{h}, then read off the normal tail. Moving the current level closer to the threshold raises the probability, and the remaining variance does not depend on where the path is now.

Example With h=0.25h = 0.25, b=1b = 1 and current level 0.30.3, the standardized distance is 0.7/0.5=1.40.7 / 0.5 = 1.4, so

P(Ws+0.25>1∣Ws=0.3)=1−Φ(1.4)≈0.08076.\begin{aligned} &\mathbb{P}(W_{s+0.25} > 1 \mid W_s = 0.3) \\[0.4em] &\quad = 1 - \Phi(1.4) \approx 0.08076 . \end{aligned}

From level 00 the same question gives 1−Φ(2)≈0.022751 - \Phi(2) \approx 0.02275. In the constructed price model St=100+10WtS_t = 100 + 10 W_t these are the probabilities that the price is above 110110 a quarter later, starting from 103103 and from 100100. The probability that the price touches 110110 at some time during the quarter, starting from 103103, is 2(1−Φ(1.4))≈0.16152(1 - \Phi(1.4)) \approx 0.1615.

Check yourself

  1. Find Var⁡(W1.5−W0.5)\operatorname{Var}(W_{1.5} - W_{0.5}), Cov⁡(W0.5,W1.5)\operatorname{Cov}(W_{0.5}, W_{1.5}), the correlation of W0.5W_{0.5} and W1.5W_{1.5}, and Cov⁡(W0.5,W1.5−W0.5)\operatorname{Cov}(W_{0.5}, W_{1.5} - W_{0.5}).
Show the answer

The increment over an interval of length 11 has variance 11. The covariance of the levels is min⁡(0.5,1.5)=0.5\min(0.5, 1.5) = 0.5, so the correlation is

0.50.5⋅1.5=13≈0.5774.\frac{0.5}{\sqrt{0.5 \cdot 1.5}} = \sqrt{\tfrac13} \approx 0.5774 .

The last covariance is 00, because the increment after time 0.50.5 is independent of W0.5W_{0.5}. It also follows from the first two answers, since Cov⁡(W0.5,W1.5)−Var⁡(W0.5)=0.5−0.5=0\operatorname{Cov}(W_{0.5}, W_{1.5}) - \operatorname{Var}(W_{0.5}) = 0.5 - 0.5 = 0.

  1. A classmate argues from Brownian scaling that W1=2W0.25W_1 = 2 W_{0.25}, so that given W0.25=0.6W_{0.25} = 0.6 the level W1W_1 is 1.21.2 for sure and P(W1>1.2∣W0.25=0.6)=0\mathbb{P}(W_1 > 1.2 \mid W_{0.25} = 0.6) = 0. Find the correct conditional law of W1W_1 and the correct probability.
Show the answer

Scaling is an equality of laws. It says that 2W0.252 W_{0.25} and W1W_1 are both N(0,1)N(0, 1), not that they are equal on a path. Write W1=W0.25+(W1−W0.25)W_1 = W_{0.25} + (W_1 - W_{0.25}), where the increment is N(0,0.75)N(0, 0.75) and independent of W0.25W_{0.25}. Given W0.25=0.6W_{0.25} = 0.6, the level W1W_1 is normal with mean 0.60.6 and variance 0.750.75, so

P(W1>1.2∣W0.25=0.6)=1−Φ(0.60.75)=1−Φ(0.6928)≈0.2442.\begin{aligned} &\mathbb{P}(W_1 > 1.2 \mid W_{0.25} = 0.6) \\[0.4em] &\quad = 1 - \Phi\Bigl(\frac{0.6}{\sqrt{0.75}}\Bigr) \\[0.4em] &\quad = 1 - \Phi(0.6928) \approx 0.2442 . \end{aligned}
  1. Given W1=1W_1 = 1, find the conditional law of W0.25W_{0.25} and the probability P(W0.25>0.5∣W1=1)\mathbb{P}(W_{0.25} > 0.5 \mid W_1 = 1). Compare it with the unconditional probability, and say whether a trader at time 0.250.25 could use this conditional law.
Show the answer

The pair (W0.25,W1)(W_{0.25}, W_1) is jointly Gaussian with variances 0.250.25 and 11 and covariance min⁡(0.25,1)=0.25\min(0.25, 1) = 0.25. The Gaussian conditioning formulas give the conditional mean (0.25/1)⋅1=0.25(0.25/1) \cdot 1 = 0.25 and the conditional variance 0.25−0.252/1=0.18750.25 - 0.25^2/1 = 0.1875, so W0.25W_{0.25} given W1=1W_1 = 1 is N(0.25,0.1875)N(0.25, 0.1875). Then

P(W0.25>0.5∣W1=1)=1−Φ(0.250.1875)=1−Φ(0.5774)≈0.2819,\begin{aligned} &\mathbb{P}(W_{0.25} > 0.5 \mid W_1 = 1) \\[0.4em] &\quad = 1 - \Phi\Bigl(\frac{0.25}{\sqrt{0.1875}}\Bigr) \\[0.4em] &\quad = 1 - \Phi(0.5774) \approx 0.2819, \end{aligned}

compared with the unconditional P(W0.25>0.5)=1−Φ(1)≈0.1587\mathbb{P}(W_{0.25} > 0.5) = 1 - \Phi(1) \approx 0.1587. Knowing that the path ends high makes a high intermediate level more likely, because levels are positively correlated. The calculation is valid as probability, but a trader at time 0.250.25 does not know W1W_1, which is not F0.25\mathcal{F}_{0.25}-measurable, so a strategy that used this law would anticipate the future.

How this lesson connects