Betas
description: I build an intuition for betas from a geometric perspective using linear algebra. Then, I relate this approach to statistical moments and formulas commonly used in Finance
Motivation
Imagine two return series of a futures contract: the front contract and a deferred contract. These are reprsented as n-dimensional vectors, where n is the number of periods:
We want to know much of the front contract's movement "explains" the returns of the deferred contract.
The simplest approach is to assume a constant proportional relationship where multiplying the front contract by some scalar value approximates the deferred contract. The linear assumption means there will always be some residual between its estimate and the true value:
Notice the underlying assumption of the model here: is applied in equal measure to every single timestep in the vector. It naively assumes a stable relationship between the two securities over the entire observation window. In markets driven by complex, dynamic factors, we know this is rarely true!
Sidenote A more pedantic approach might be to represent this as a non-linear model or time-varying model such as: It is a conscious decision to avoid this complexity and stick to the simple, robust framework of OLS regression. To "bend" this linear assumption, we do it through feature engineering: for example, by applying an exponentially weighted moving average or log transforms.
Thus brings us back to our motivation: Beta () is a scalar that expresses the linear relationship between two securities. The OLS model derives this by minimizing the unexplained variance, . In practical terms, this ratio can be used for hedging! It is the scaling factor required to match the directional exposure of one asset using another.
Intuition
We can visualize this model from two geometric perspectives: the observation space and the feature space.
N x K
Imagine the respective returns represented as vectors in n-dimensional space. For each vector, their n observations act as coordinates that define a single point in n-dimensional space. Thus, and are just two vectors pointing somewhere in this space. If we assume there is no intercept, we simply mutiply f by our scalar .
Intuitively, this stretches the vector along its own axes. We wish to find some value of that makes our estimated vector "as close as possible" to . Geometrically, imagine this as a triangle with edges , and the residual gap . Our estimate is physically trapped on the 1D line defined by .
To make our estimate "as close as possible" to d, we must find that scales on that line that minimizes the length of . The shortest possible path from a point in space () to a line () is a perpendicular drop. Therefore, at the exact minimum distance, our residual vector must meet our regressor at a perfect right angle. Recall that for orthogonal vectors, their dot product is zero. Conceptually, this means:
We factor out the constant () and thus:
Sidenote: Correlation vs. Beta Let be the angle between our estimate and the target . The geometric cosine of this angle () measures how tightly the two vectors align in space. If our return vectors are perfectly mean-centered, this geometric angle is the exact equivalent of the statistical correlation, . While correlation measures alignment (), Beta measures scale—it is that alignment multiplied by the ratio of their lengths.
K x N
We can transpose this perspective. Instead of viewing variables as vectors in -dimensional space, we can view the observations as a cloud of points in a data space where features define the axes. Because we have one regressor () and one target (), this is a simple 2D scatter plot.
Here, the beta is a k-1 hyperplane. Because our model has no intercept, the hyperplane is "pinned" to pivots about the origin. We seek to fit a plane that best fits this cloud of points.
Equivalence
We have derived beta geometrically as the ratio of two inner products:
Lets assume these return vectors are already mean-centered (see Aside: Constants). I now will show how this ratio is equivalent to standard statistical formulas for beta.
We start by relating lens of linear algebra and statistics. By working with the inner products and vector lengths, we can map vector geometry directly to various statistical moments:
Clockwise from top left
- Variance (): The normalized inner product of a vector with itself.
- Covariance (): The normalized inner product of two different vectors.
- Correlation (): The geometric cosine of the angle between the two vectors.
- Standard Deviation (): The normalized Euclidean length (norm) of the vector.
This gives us a lookup to translate a geometric beta into common statistical operations:
1. Beta = Covariance over Variance If we take our geometric ratio and divide both the numerator and denominator by , the scaling factors perfectly cancel out. This immediately yields the textbook OLS formula:
2. Beta = Correlation and Volatility Ratio () We can expand the inner products using their pure geometric definitions:
- the inner product of two vectors is the product of their lengths and the cosine of the angle between them.
- The inner product of a vector with itself is its length squared.
Substituting these definitions and referencing the lookup, we get:
This gives us the practical risk-translation formula for beta:
Why does this matter? In a standard OLS regression, the correlation and the volatilities are rigidly bound to the exact same dataset and lookback window. However, in dynamic financial markets, the structural alignment of two assets and their individual volatilities can behave very differently. By breaking beta into its modular components of alignment () and scale (), we can mix and match estimators to build a "better beta":
- Mismatched Time Horizons: Correlation is noisy and often requires a long, stable lookback window (e.g., 6 to 12 months) to capture the true structural relationship between two contracts. Volatility, on the other hand, clusters and reacts violently to recent events. Risk managers may prefer a much shorter or exponentially weighted window (like an EWMA) for the standard deviations to immediately capture the current market regime.
- Structural Alignment vs. Reactive Volatility: A researcher might measure the correlation () using a long, unweighted historical window (e.g., 6 months of daily returns) to capture the true, stable structural relationship between the front and deferred contracts. However, they could calculate the standard deviations ( and ) using a short-term Exponentially Weighted Moving Average (EWMA). This creates a hybrid beta that anchors to a reliable baseline correlation but scales the immediate hedge ratio based on the localized, present-day volatility of the futures curve.
Aside: Constants
In OLS, we must decide whether to include a constant (an intercept, ).
In the matrix space, adding a constant introduces a translation operation. It removes the constraint that the line must pass through the origin, allowing the hyperplane to shift up or down the vertical axis to better center itself through the point cloud.
In the -dimensional vector space, adding a constant introduces a new dimension: a vector of ones, . We are now projecting onto a subspace defined by both and . Intuiively, we can see that this is now a 2-dimensional subspace.
To isolate just the beta multiplier, we use the Frisch-Waugh-Lovell (FWL) Theorem. Geometrically, the FWL theorem proves we can isolate beta by first projecting both and onto the orthogonal complement of the constant vector , and then solving for those projected vectors.
(Potentially, FWL will be explored in a future post)
If we regress these new, mean-centered vectors against each other, we obtain the exact same beta as the full model.