Tagged

Pruning

Jan 26, 2026 ML Math Derivations 21 min read

Machine Learning Mathematical Derivations (7): Decision Trees

From information entropy to the Gini index, from ID3 to CART — a complete derivation of decision-tree mathematics: split criteria, continuous and missing values, pruning, and feature importance, with sklearn-verified …