Tags

Random Forest

Jan 30, 2026 ML Math Derivations 36 min read

ML Math Derivations (11): Ensemble Learning

Derive why combining weak learners produces strong ones. Covers bias-variance decomposition, Bagging/Random Forest variance reduction, AdaBoost exponential loss, and GBDT gradient optimization in function space.