lennardong

Betas

description: I build an intuition for betas from a geometric perspective using linear algebra. Then, I relate this approach to statistical moments and formulas commonly used in Finance

Motivation

Imagine two return series of a futures contract: the front contract and a deferred contract. These are reprsented as n-dimensional vectors, where n is the number of periods:

𝐗:=returns on front contract𝐲:=returns on contract

We want to know much of the front contract's movement "explains" the returns of the deferred contract.

The simplest approach is to assume a constant proportional relationship where multiplying the front contract by some scalar value approximates the deferred contract. The linear assumption means there will always be some residual between its estimate and the true value:

𝐲=β𝐗+𝐮

Notice the underlying assumption of the model here: β is applied in equal measure to every single timestep in the vector. It naively assumes a stable relationship between the two securities over the entire observation window. In markets driven by complex, dynamic factors, we know this is rarely true!

Sidenote A more pedantic approach might be to represent this as a non-linear model or time-varying model such as: 𝐲t=βt𝐗t+𝐮t It is a conscious decision to avoid this complexity and stick to the simple, robust framework of OLS regression. To "bend" this linear assumption, we do it through feature engineering: for example, by applying an exponentially weighted moving average or log transforms.

Thus brings us back to our motivation: Beta (β) is a scalar that expresses the linear relationship between two securities. The OLS model derives this by minimizing the unexplained variance, 𝐮. In practical terms, this ratio can be used for hedging! It is the scaling factor required to match the directional exposure of one asset using another.

Intuition

We can visualize this model from two geometric perspectives: the (N×K) observation space and the (K×N) feature space.

N x K

Imagine the respective returns represented as vectors in n-dimensional space. For each vector, their n observations act as coordinates that define a single point in n-dimensional space. Thus, 𝐗 and 𝐲 are just two vectors pointing somewhere in this space. If we assume there is no intercept, we simply mutiply f by our scalar β.

Intuitively, this stretches the vector 𝐗 along its own axes. We wish to find some value of β that makes our estimated vector β𝐗 "as close as possible" to 𝐲. Geometrically, imagine this as a triangle with edges βf, 𝐲 and the residual gap 𝐮 . Our estimate β^𝐗 is physically trapped on the 1D line defined by 𝐗.

To make our estimate "as close as possible" to d, we must find β that scales 𝐗 on that line that minimizes the length of 𝐮^. The shortest possible path from a point in space (𝐲) to a line (𝐗) is a perpendicular drop. Therefore, at the exact minimum distance, our residual vector 𝐮^ must meet our regressor 𝐗 at a perfect right angle. Recall that for orthogonal vectors, their dot product is zero. Conceptually, this means:

(βf)𝐮=0

We factor out the constant (β) and thus:

𝐗𝐮=0𝐗(𝐲β𝐗)=0𝐗𝐲β(𝐗𝐗)=0β=𝐗𝐲𝐗𝐗

Sidenote: Correlation vs. Beta Let θ be the angle between our estimate β𝐗 and the target 𝐲. The geometric cosine of this angle (cosθ) measures how tightly the two vectors align in space. If our return vectors are perfectly mean-centered, this geometric angle is the exact equivalent of the statistical correlation, ρ. While correlation measures alignment (cosθ), Beta measures scale—it is that alignment multiplied by the ratio of their lengths.

K x N

We can transpose this perspective. Instead of viewing k variables as vectors in n-dimensional space, we can view the n observations as a cloud of points in a data space where k features define the axes. Because we have one regressor (𝐗) and one target (𝐲), this is a simple 2D scatter plot.

Here, the beta is a k-1 hyperplane. Because our model has no intercept, the hyperplane is "pinned" to pivots about the origin. We seek to fit a plane that best fits this cloud of points.

Equivalence

We have derived beta geometrically as the ratio of two inner products:

β=𝐗𝐲𝐗𝐗

Lets assume these return vectors are already mean-centered (see Aside: Constants). I now will show how this ratio is equivalent to standard statistical formulas for beta.

We start by relating lens of linear algebra and statistics. By working with the inner products and vector lengths, we can map vector geometry directly to various statistical moments:

Var(𝐗)=𝐗𝐗n1Cov(𝐗,𝐲)=𝐗𝐲n1σX=𝐗n1ρ=𝐗𝐲𝐗𝐲=cosθ

Clockwise from top left

This gives us a lookup to translate a geometric beta into common statistical operations:

1. Beta = Covariance over Variance If we take our geometric ratio and divide both the numerator and denominator by n1, the scaling factors perfectly cancel out. This immediately yields the textbook OLS formula: β=1n1(𝐗𝐲)1n1(𝐗𝐗)=Cov(𝐗,𝐲)Var(𝐗)

2. Beta = Correlation and Volatility Ratio (ρσyσX) We can expand the inner products using their pure geometric definitions:

Substituting these definitions and referencing the lookup, we get:

β=𝐗𝐲𝐗𝐗=𝐗𝐲cosθ𝐗2=cosθ𝐲𝐗=ρ𝐲/n1𝐗/n1=ρσyσX

This gives us the practical risk-translation formula for beta:

β=ρσyσX

Why does this matter? In a standard OLS regression, the correlation and the volatilities are rigidly bound to the exact same dataset and lookback window. However, in dynamic financial markets, the structural alignment of two assets and their individual volatilities can behave very differently. By breaking beta into its modular components of alignment (ρ) and scale (σyσX), we can mix and match estimators to build a "better beta":

Aside: Constants

In OLS, we must decide whether to include a constant (an intercept, α).

In the k×n matrix space, adding a constant introduces a translation operation. It removes the constraint that the line must pass through the origin, allowing the hyperplane to shift up or down the vertical axis to better center itself through the point cloud.

In the n×k-dimensional vector space, adding a constant introduces a new dimension: a vector of ones, ι. We are now projecting 𝐲 onto a subspace defined by both 𝐗 and ι. Intuiively, we can see that this is now a 2-dimensional subspace.

To isolate just the beta multiplier, we use the Frisch-Waugh-Lovell (FWL) Theorem. Geometrically, the FWL theorem proves we can isolate beta by first projecting both 𝐲 and 𝐗 onto the orthogonal complement of the constant vector ι, and then solving for those projected vectors.

(Potentially, FWL will be explored in a future post)

If we regress these new, mean-centered vectors against each other, we obtain the exact same beta as the full model.