Tagged

AdaBoost

Jan 30, 2026 ML Math Derivations 19 min read

Machine Learning Mathematical Derivations (11): Ensemble Learning

Derive why combining weak learners produces strong ones. Covers bias-variance decomposition, Bagging/Random Forest variance reduction, AdaBoost exponential loss, and GBDT gradient optimization in function space.