Langevin Dynamics

PDE and Machine Learning (4): Variational Inference and the Fokker-Planck Equation

Variational inference and Langevin MCMC are two faces of the same Fokker-Planck PDE. We derive the equivalence, build SVGD as an interacting-particle approximation, and quantify convergence under log-Sobolev …