Tags

KL Divergence

Feb 2, 2026 ML Math Derivations 28 min read

ML Math Derivations (14): Variational Inference and Variational EM

A first-principles derivation of variational inference. From the ELBO identity and the mean-field assumption to the CAVI updates, variational EM, and the reparameterization trick that powers VAEs.