Unit 12, lesson 91

Black Litterman and Bayesian portfolio views

How the Black-Litterman model combines an equilibrium prior with uncertain views through a view matrix, how view confidence shapes the posterior mean, and why the predictive covariance adds mean uncertainty to return risk.

  • Video 91
  • Views, estimation risk and risk parity

A constructed prior says that asset 1 has an expected excess return 2.4 percentage points below that of asset 2. An analyst believes the gap is only 1 percentage point but is not certain of it. How far should each expected return move, and how much less uncertain is the mean vector afterward? This lesson sets up the Black-Litterman model, in which an equilibrium prior and noisy views are Gaussian information about the same unknown mean, derives the posterior by Gaussian conditioning, and keeps the uncertainty about the mean separate from the fluctuation of future returns.

Key terms

Black-Litterman model

Definition The Black-Litterman model is a Bayesian model for the unknown vector μ∈Rd\mu \in \mathbb{R}^d of one-period expected excess returns, the expected returns above the risk-free rate. All distributions on this page belong to this model of the physical measure P\mathbb{P}, in which μ\mu is itself random, and none of them is a pricing measure. The model assumes

μ∼N(π,C),q=Pμ+η,η∼N(0,Ω),\begin{gathered} \mu \sim N(\pi, C), \\[0.4em] q = P\mu + \eta, \\[0.4em] \eta \sim N(0, \Omega), \end{gathered}

with η\eta independent of μ\mu. Here π∈Rd\pi \in \mathbb{R}^d is the prior mean, CC the d×dd \times d prior covariance of μ\mu, often C=τΣC = \tau \Sigma with a scalar τ>0\tau > 0, PP a k×dk \times d view matrix, q∈Rkq \in \mathbb{R}^k the stated views and Ω\Omega the k×kk \times k covariance of the view errors. Future excess returns are R=μ+εR = \mu + \varepsilon with ε∼N(0,Σ)\varepsilon \sim N(0, \Sigma) independent of (μ,η)(\mu, \eta), so Σ\Sigma is the covariance of returns given their mean. Then (μ,q)(\mu, q) is jointly Gaussian, and when PCP⊤+ΩPCP^{\top} + \Omega is invertible the posterior of μ\mu given qq is the Gaussian N(m,Cpost)N(m, C_{\text{post}}) of the posterior mean card. Three covariance matrices play three roles, Σ\Sigma for return noise, CC for prior uncertainty about μ\mu and Ω\Omega for view error, and only Σ\Sigma describes how realized returns fluctuate around their mean. The prior, τ\tau and Ω\Omega are modeling inputs chosen by the modeler, not facts verified from data.

In plain words The model treats an equilibrium starting point and an analyst’s views as two noisy measurements of the same unknown expected returns, each with a stated precision, and combines them with Bayes’ rule. The result is a full distribution for the mean, not only a blended point, and that distribution is then used to choose a portfolio.

Example A constructed two-asset version has return covariance Σ=diag⁡(0.04,0.09)\Sigma = \operatorname{diag}(0.04, 0.09) and τ=0.01\tau = 0.01, so C=diag⁡(0.0004,0.0009)C = \operatorname{diag}(0.0004, 0.0009), which gives prior standard deviations of 0.020.02 and 0.030.03 for the two expected returns. There is one relative view, P=(1,−1)P = (1, -1) with q=−0.01q = -0.01 and Ω=0.0001\Omega = 0.0001, a view error with standard deviation 0.010.01. The following cards build π\pi and compute the posterior for these inputs.

Equilibrium prior

Definition Suppose a risk-free asset is available, and an investor with risk aversion δ>0\delta > 0 chooses risky weights ww, with the rest of the wealth in the risk-free asset, to maximize w⊤μ−δ2w⊤Σww^{\top} \mu - \tfrac{\delta}{2} w^{\top} \Sigma w without other constraints. With Σ\Sigma positive definite this objective is strictly concave, and its unique maximizer solves μ=δΣw\mu = \delta \Sigma w. Reverse optimization runs this condition backward. Given reference weights wmktw_{\text{mkt}}, usually market capitalization weights, the equilibrium prior mean is

π=δΣwmkt,\pi = \delta \Sigma w_{\text{mkt}},

the expected excess returns for which wmktw_{\text{mkt}} is optimal in this problem, and the prior is μ∼N(π,C)\mu \sim N(\pi, C). Multiplying by wmkt⊤w_{\text{mkt}}^{\top} gives wmkt⊤π=δ wmkt⊤Σwmktw_{\text{mkt}}^{\top} \pi = \delta\, w_{\text{mkt}}^{\top} \Sigma w_{\text{mkt}}, so δ\delta is the ratio of the reference portfolio’s prior expected excess return to its variance. This is a modeling construction. It assumes that the reference portfolio is mean-variance optimal for the chosen δ\delta and Σ\Sigma, and it does not show that market weights reveal true expected returns.

In plain words Instead of estimating expected returns directly, ask which expected returns would make a sensible reference portfolio the best choice for a mean-variance investor. Each asset’s prior mean is δ\delta times its covariance with the reference portfolio, so assets that add more to the portfolio’s variance get higher prior means. With these means and the risk input Σ\Sigma, the mean-variance problem returns exactly the reference weights, and the views then move the means away from this starting point.

Example With Σ=diag⁡(0.04,0.09)\Sigma = \operatorname{diag}(0.04, 0.09), wmkt=(0.6,0.4)w_{\text{mkt}} = (0.6, 0.4) and δ=2\delta = 2, the prior mean is π=2⋅(0.024,0.036)=(0.048,0.072)\pi = 2 \cdot (0.024, 0.036) = (0.048, 0.072). The reference portfolio has variance 0.36⋅0.04+0.16⋅0.09=0.02880.36 \cdot 0.04 + 0.16 \cdot 0.09 = 0.0288 and prior expected excess return 0.6⋅0.048+0.4⋅0.072=0.05760.6 \cdot 0.048 + 0.4 \cdot 0.072 = 0.0576, which is 2⋅0.02882 \cdot 0.0288. Solving the mean-variance problem with μ=π\mu = \pi returns 12Σ−1π=(0.6,0.4)\tfrac12 \Sigma^{-1} \pi = (0.6, 0.4).

View matrix

Definition A view matrix is a k×dk \times d matrix PP whose row ii picks a linear combination (Pμ)i(P\mu)_i of the expected excess returns, about which the investor states the view qiq_i. The view model is

q=Pμ+η,η∼N(0,Ω),\begin{gathered} q = P\mu + \eta, \\[0.4em] \eta \sim N(0, \Omega), \end{gathered}

with η\eta independent of μ\mu. An absolute view on asset jj has the row ej⊤e_j^{\top}, and a relative view that asset ii outperforms asset jj by qiq_i has the row ei⊤−ej⊤e_i^{\top} - e_j^{\top}. Before qq is seen, the prior predicts

E[q]=Pπ,Cov⁡(q)=PCP⊤+Ω,Cov⁡(μ,q)=CP⊤.\begin{gathered} E[q] = P\pi, \\[0.4em] \operatorname{Cov}(q) = PCP^{\top} + \Omega, \\[0.4em] \operatorname{Cov}(\mu, q) = CP^{\top}. \end{gathered}

The surprise is q−Pπq - P\pi, the difference between what the views say and what the prior predicts for them. The views are statements about expected returns, not about the returns that will be realized.

In plain words Each row of the view matrix names the combination of expected returns that a view talks about, a single asset for an absolute view or a long-short pair for a relative one. The vector qq says what each view claims, and the surprise measures how much the views disagree with the prior.

Example The view that asset 1’s expected excess return is 1 percentage point below asset 2’s is P=(1,−1)P = (1, -1) with q=−0.01q = -0.01. The prior predicts Pπ=0.048−0.072=−0.024P\pi = 0.048 - 0.072 = -0.024, so the surprise is −0.01−(−0.024)=0.014-0.01 - (-0.024) = 0.014. The prior variance of the viewed difference is PCP⊤=0.0004+0.0009=0.0013PCP^{\top} = 0.0004 + 0.0009 = 0.0013, and with Ω=0.0001\Omega = 0.0001 the prior predicts Cov⁡(q)=0.0014\operatorname{Cov}(q) = 0.0014.

View confidence

Definition View confidence is expressed by the view-error covariance Ω\Omega, where a smaller variance means a more confident view, measured against the prior uncertainty CC, which with C=τΣC = \tau\Sigma is set by τ\tau. Write Ψ=PCP⊤\Psi = PCP^{\top} for the prior covariance of the viewed combinations. When Ψ+Ω\Psi + \Omega is invertible, the posterior mean mm of the next card satisfies

Pm=Pπ+Ψ(Ψ+Ω)−1×(q−Pπ),\begin{aligned} Pm &= P\pi + \Psi (\Psi + \Omega)^{-1} \\[0.4em] &\qquad \times (q - P\pi), \end{aligned}

so for a single view with Ψ>0\Psi > 0 and Ω>0\Omega > 0 the viewed quantity moves the fraction κ=Ψ/(Ψ+Ω)\kappa = \Psi/(\Psi + \Omega) of the way from PπP\pi to qq, with 0<κ<10 < \kappa < 1. As Ω\Omega grows without bound, the gain tends to zero and the posterior returns to the prior. As Ω\Omega tends to zero with Ψ\Psi invertible, the posterior satisfies the views exactly. An exact view is this limit, or equivalently conditioning on a degenerate Gaussian, and the precision formula of the next card, which inverts Ω\Omega, cannot be used for it. Several exact views need more care. With Ψ\Psi invertible the limit formula applies, while views that repeat one another need a rank-aware treatment, and views that contradict one another cannot all hold. If Ω=τΩ0\Omega = \tau\Omega_0 scales with τ\tau, then τ\tau cancels from the posterior mean, though not from the posterior covariance. Common conventions, such as Ω=diag⁡(PCP⊤)\Omega = \operatorname{diag}(PCP^{\top}), are modeling choices.

In plain words Confidence decides how far the posterior moves toward a view. A view exactly as uncertain as the prior’s own prediction of it gets half the weight, a nearly certain view is almost fully believed, and a vague one barely moves anything. The numbers in Ω\Omega and τ\tau are judgments, and the posterior is only as meaningful as they are.

Example For the relative view, Ψ=0.0013\Psi = 0.0013. With Ω=0.0001\Omega = 0.0001 the weight is κ=0.0013/0.0014=13/14≈0.929\kappa = 0.0013/0.0014 = 13/14 \approx 0.929, and the viewed difference moves from −0.024-0.024 to −0.024+1314⋅0.014=−0.011-0.024 + \tfrac{13}{14} \cdot 0.014 = -0.011, near the view but not on it. With Ω=0.001\Omega = 0.001 the weight is 13/23≈0.56513/23 \approx 0.565 and the difference becomes about −0.01609-0.01609. With Ω=0.0013=Ψ\Omega = 0.0013 = \Psi the weight is 12\tfrac12 and the difference is −0.017-0.017, halfway between prior and view. As Ω\Omega tends to zero the difference tends to −0.01-0.01.

Posterior mean

Definition In the Black-Litterman model with PCP⊤+ΩPCP^{\top} + \Omega invertible, the posterior distribution of μ\mu given qq is Gaussian with mean mm and covariance CpostC_{\text{post}}, where

m=π+K(q−Pπ),Cpost=C−KPC,K=CP⊤(PCP⊤+Ω)−1.\begin{aligned} m &= \pi + K (q - P\pi), \\[0.4em] C_{\text{post}} &= C - K P C, \\[0.4em] K &= C P^{\top} (P C P^{\top} + \Omega)^{-1}. \end{aligned}

This is Gaussian conditioning. For the jointly Gaussian pair (μ,q)(\mu, q) with the moments of the view matrix card, E[μ∣q]=E[μ]+Cov⁡(μ,q)Cov⁡(q)−1(q−E[q])E[\mu \mid q] = E[\mu] + \operatorname{Cov}(\mu, q) \operatorname{Cov}(q)^{-1} (q - E[q]), and Cov⁡(μ∣q)\operatorname{Cov}(\mu \mid q) is Cov⁡(μ)\operatorname{Cov}(\mu) minus Cov⁡(μ,q)Cov⁡(q)−1Cov⁡(q,μ)\operatorname{Cov}(\mu, q) \operatorname{Cov}(q)^{-1} \operatorname{Cov}(q, \mu). When CC and Ω\Omega are both positive definite, the densities give the same answer. With a=μ−πa = \mu - \pi and b=q−Pμb = q - P\mu, the negative log posterior is, up to a constant,

12a⊤C−1a+12b⊤Ω−1b,\tfrac12 a^{\top} C^{-1} a + \tfrac12 b^{\top} \Omega^{-1} b ,

and collecting the quadratic and linear terms in μ\mu gives the posterior precision and mean

J=C−1+P⊤Ω−1P,m=J−1(C−1π+P⊤Ω−1q),\begin{aligned} J &= C^{-1} + P^{\top} \Omega^{-1} P, \\[0.4em] m &= J^{-1} \bigl( C^{-1} \pi \\[0.4em] &\qquad + P^{\top} \Omega^{-1} q \bigr), \end{aligned}

with Cpost=J−1C_{\text{post}} = J^{-1}. The two forms agree by the Woodbury identity. Since JJ is positive definite, the quadratic is strictly convex, and mm is both the posterior mode and the posterior mean. The gain KK multiplies the surprise, and its columns CP⊤CP^{\top} record how each expected return co-varies with the viewed combinations under the prior. The reduction C−Cpost=CP⊤(PCP⊤+Ω)−1PCC - C_{\text{post}} = CP^{\top}(PCP^{\top} + \Omega)^{-1}PC is positive semidefinite, so in this model the views never increase the uncertainty about the mean in any direction, and CpostC_{\text{post}} does not depend on the value of qq.

In plain words The update moves the prior mean in proportion to the surprise. How much each asset moves depends on its prior covariance with the viewed combination, so a view on one asset can move the expected return of a correlated asset that the view never mentions. The views also reduce uncertainty, but only in the directions they inform.

Example With the constructed inputs, CP⊤=(0.0004,−0.0009)CP^{\top} = (0.0004, -0.0009) and PCP⊤+Ω=0.0014PCP^{\top} + \Omega = 0.0014, so K=(2/7,−9/14)≈(0.2857,−0.6429)K = (2/7, -9/14) \approx (0.2857, -0.6429). The surprise 0.0140.014 raises asset 1 by 0.0040.004 and lowers asset 2 by 0.0090.009, so m=(0.052,0.063)m = (0.052, 0.063), with difference −0.011-0.011. The posterior covariance is

Cpost≈10−4[2.862.572.573.21].C_{\text{post}} \approx 10^{-4} \begin{bmatrix} 2.86 & 2.57 \\ 2.57 & 3.21 \end{bmatrix}.

The variance of the difference falls from 0.00130.0013 to (1/0.0013+1/0.0001)−1≈0.0000929(1/0.0013 + 1/0.0001)^{-1} \approx 0.0000929, a standard deviation of about 0.00960.0096 instead of 0.03610.0361, while the posterior correlation of the two means is about 0.850.85. Knowing their difference well leaves mostly their common level uncertain. The precision form gives the same mm and CpostC_{\text{post}}.

Predictive covariance

Definition In the Black-Litterman model with future excess returns R=μ+εR = \mu + \varepsilon and ε∼N(0,Σ)\varepsilon \sim N(0, \Sigma) independent of (μ,η)(\mu, \eta), and hence of (μ,q)(\mu, q), the predictive distribution of RR given the views is N(m,Σ+Cpost)N(m, \Sigma + C_{\text{post}}). Its covariance, the predictive covariance, follows from the law of total covariance,

Cov⁡(R∣q)=E[Cov⁡(R∣μ,q)∣q]+Cov⁡(E[R∣μ,q]∣q)=Σ+Cpost,\begin{aligned} &\operatorname{Cov}(R \mid q) \\[0.4em] &= E\bigl[\operatorname{Cov}(R \mid \mu, q) \mid q\bigr] \\[0.4em] &\quad + \operatorname{Cov}\bigl(E[R \mid \mu, q] \mid q\bigr) \\[0.4em] &= \Sigma + C_{\text{post}}, \end{aligned}

because given (μ,q)(\mu, q) the return has mean μ\mu and covariance Σ\Sigma, and the conditional covariance of μ\mu given qq is CpostC_{\text{post}}. Using Σ\Sigma alone treats mm as the known mean, and using CpostC_{\text{post}} alone leaves out the return noise. With the risk-free asset and the mean-variance objective of the equilibrium prior card applied to the predictive distribution, the optimal risky weights given the views are

w∗=1δ(Σ+Cpost)−1m,w^{*} = \tfrac{1}{\delta} (\Sigma + C_{\text{post}})^{-1} m ,

with the remainder 1−1⊤w∗1 - \mathbf{1}^{\top} w^{*} in the risk-free asset. A different model for future returns, for example with noise that depends on μ\mu, needs its own predictive covariance computed from that model.

In plain words A forecast of next period’s return is uncertain for two reasons. The return fluctuates around its mean, and the mean itself is not known exactly. The predictive covariance adds the two. When τ\tau is small, CpostC_{\text{post}} is small next to Σ\Sigma and the correction is modest, but replacing Σ\Sigma by CpostC_{\text{post}} is a serious mistake.

Example With the posterior of the previous card, Σ+Cpost\Sigma + C_{\text{post}} has diagonal entries about 0.0402860.040286 and 0.0903210.090321 and off-diagonal entry about 0.0002570.000257. With δ=2\delta = 2, treating the mean as known gives 12Σ−1m=(0.65,0.35)\tfrac12 \Sigma^{-1} m = (0.65, 0.35), and the predictive covariance gives about (0.6432,0.3469)(0.6432, 0.3469), with about 0.00990.0099 of the wealth in the risk-free asset. Using CpostC_{\text{post}} alone would give 12Cpost−1m=(10,90)\tfrac12 C_{\text{post}}^{-1} m = (10, 90), positions driven entirely by uncertainty about the mean rather than by return risk.

Check yourself

  1. Two assets have return covariance with variances 0.040.04 and 0.090.09 and covariance 0.010.01, reference weights (0.5,0.5)(0.5, 0.5) and risk aversion δ=2\delta = 2. Find the equilibrium prior mean, and check that δ\delta equals the reference portfolio’s prior expected excess return divided by its variance. Are these prior means forecasts of returns?
Show the answer

The product Σwmkt\Sigma w_{\text{mkt}} is (0.04⋅0.5+0.01⋅0.5, 0.01⋅0.5+0.09⋅0.5)=(0.025,0.05)(0.04 \cdot 0.5 + 0.01 \cdot 0.5, \ 0.01 \cdot 0.5 + 0.09 \cdot 0.5) = (0.025, 0.05), so π=2⋅(0.025,0.05)=(0.05,0.10)\pi = 2 \cdot (0.025, 0.05) = (0.05, 0.10). The reference portfolio has variance 0.25⋅0.04+0.25⋅0.09+2⋅0.25⋅0.01=0.03750.25 \cdot 0.04 + 0.25 \cdot 0.09 + 2 \cdot 0.25 \cdot 0.01 = 0.0375 and prior expected excess return 0.5⋅0.05+0.5⋅0.10=0.0750.5 \cdot 0.05 + 0.5 \cdot 0.10 = 0.075, and 0.075/0.0375=2=δ0.075/0.0375 = 2 = \delta. Asset 1 gets part of its prior mean 0.050.05 from its covariance with asset 2, which contributes 2⋅0.01⋅0.5=0.012 \cdot 0.01 \cdot 0.5 = 0.01. These numbers are not forecasts. They are the expected excess returns under which the reference weights would be mean-variance optimal for the chosen δ\delta and Σ\Sigma, and they inherit every assumption of that construction.

  1. A prior has mean π=(0.05,0.08)\pi = (0.05, 0.08) and covariance CC with rows (0.0004,0.0003)(0.0004, 0.0003) and (0.0003,0.0009)(0.0003, 0.0009). The only view is the absolute view μ1=0.04\mu_1 = 0.04 with view-error variance 0.00040.0004. Find the posterior mean and covariance. A colleague expects the posterior mean of asset 2 to stay at 0.080.08, since the view does not mention asset 2. Is that right?
Show the answer

Here P=(1,0)P = (1, 0), so Pπ=0.05P\pi = 0.05, the surprise is 0.04−0.05=−0.010.04 - 0.05 = -0.01, CP⊤=(0.0004,0.0003)CP^{\top} = (0.0004, 0.0003) and PCP⊤+Ω=0.0004+0.0004=0.0008PCP^{\top} + \Omega = 0.0004 + 0.0004 = 0.0008. The gain is K=(0.5,0.375)K = (0.5, 0.375), and

m=(0.05,0.08)−0.01⋅(0.5,0.375)=(0.045,0.07625).\begin{aligned} m &= (0.05, 0.08) \\[0.4em] &\quad - 0.01 \cdot (0.5, 0.375) \\[0.4em] &= (0.045, 0.07625) . \end{aligned}

The posterior covariance subtracts K⋅(0.0004,0.0003)K \cdot (0.0004, 0.0003), a matrix with rows (0.0002,0.00015)(0.0002, 0.00015) and (0.00015,0.0001125)(0.00015, 0.0001125), from CC, which leaves rows (0.0002,0.00015)(0.0002, 0.00015) and (0.00015,0.0007875)(0.00015, 0.0007875). The colleague is wrong. Asset 2’s mean falls by 0.003750.00375, because its prior covariance 0.00030.0003 with μ1\mu_1 makes the view informative about it. Only with zero prior covariance, for example a diagonal CC, would asset 2 be unchanged. The view halves the variance of μ1\mu_1, from 0.00040.0004 to 0.00020.0002.

  1. Take the constructed model with Σ=diag⁡(0.04,0.09)\Sigma = \operatorname{diag}(0.04, 0.09), τ=0.01\tau = 0.01, wmkt=(0.6,0.4)w_{\text{mkt}} = (0.6, 0.4) and δ=2\delta = 2, but with no views. Find the predictive covariance and the optimal risky weights 1δV−1π\tfrac{1}{\delta} V^{-1} \pi for V=ΣV = \Sigma, for VV equal to the predictive covariance, and for V=CV = C. Which is the mistake?
Show the answer

Without views the posterior is the prior, so the mean is π=2Σwmkt\pi = 2\Sigma w_{\text{mkt}} and the mean uncertainty is C=τΣC = \tau \Sigma. The predictive covariance is Σ+τΣ=(1+τ)Σ=1.01 Σ\Sigma + \tau\Sigma = (1 + \tau)\Sigma = 1.01\,\Sigma. The three choices give

12Σ−1π=wmkt=(0.6,0.4),12((1+τ)Σ)−1π=wmkt1.01,12(τΣ)−1π=wmkt0.01.\begin{gathered} \tfrac12 \Sigma^{-1} \pi = w_{\text{mkt}} = (0.6, 0.4), \\[0.4em] \tfrac12 \bigl( (1 + \tau)\Sigma \bigr)^{-1} \pi = \tfrac{w_{\text{mkt}}}{1.01}, \\[0.4em] \tfrac12 (\tau\Sigma)^{-1} \pi = \tfrac{w_{\text{mkt}}}{0.01}. \end{gathered}

The predictive weights are about (0.5941,0.3960)(0.5941, 0.3960), with about 0.00990.0099 of the wealth in the risk-free asset, a small step back because the mean is uncertain. Using CC alone gives (60,40)(60, 40), a position one hundred times the reference portfolio. That is the mistake, since CC measures uncertainty about the mean, not the fluctuation of returns, and it leaves out Σ\Sigma.

How this lesson connects