Multivariate statistics examines relationships among multiple variables simultaneously, extending beyond univariate and bivariate methods to reveal complex patterns in data. These techniques are essential across fields from psychology to ecology, enabling researchers to reduce dimensionality, detect latent structures, test group differences, and predict outcomes when multiple responses or predictors are involved. The key distinction from running separate univariate tests is that multivariate methods account for correlations among variables, preventing inflated error rates and uncovering relationships that single-variable analyses miss. Modern practice increasingly combines classical methods like PCA and MANOVA with nonlinear manifold techniques such as UMAP, making it essential to understand both the assumptions and the appropriate use context of each approach.
What This Cheat Sheet Covers
This topic spans 15 focused tables and 87 indexed concepts. Below is a complete table-by-table outline of this topic, spanning foundational concepts through advanced details.
A jump-to index of every table row in this cheat sheet.
An interactive map of every table and concept in this topic.
Table 1: Foundational Concepts
Before any multivariate method makes sense, you need the building blocks it rests on β the matrices that store how variables vary together, the distributional assumption parametric tests rely on, and the eigen-quantities that drive nearly every dimensionality-reduction technique. Get comfortable with the covariance and correlation matrices and Mahalanobis distance here, because almost every later table reuses them.
| Concept | Example | Description |
|---|---|---|
Ξ£ = [[ΟβΒ², Οββ], [Οββ, ΟβΒ²]] | β’ Square matrix storing covariances between all pairs of variables β’ diagonal contains variances. | |
R = [[1, rββ], [rββ, 1]] | β’ Standardized covariance matrix with 1s on diagonal and correlation coefficients off-diagonal β’ scales variables to β1 to +1 range. | |
X ~ N(ΞΌ, Ξ£) | β’ Joint distribution of variables follows multivariate Gaussian β’ required assumption for parametric tests like MANOVA, MANCOVA, and LDA. | |
Ξ»β = 3.2, Ξ»β = 1.5 | β’ Scalar indicating variance explained by a principal component or factor β’ larger values represent more important dimensions. |