Tagged
Least Squares
Mathematical Derivation of Machine Learning (5): Linear Regression
A complete derivation of linear regression from three perspectives -- algebra (the normal equation), geometry (orthogonal projection), and probability (maximum likelihood) -- followed by Ridge, Lasso, gradient methods, …
Orthogonality and Projections -- When Vectors Mind Their Own Business
Orthogonality is what makes GPS work, noise-canceling headphones cancel, and JPEG compress. This chapter builds geometric intuition for orthogonal vectors, projections, Gram-Schmidt, QR decomposition, and least squares …