14–19 Jan 2024
Aspen Center for Physics
US/Mountain timezone

Diffusion Models: A Return to its Thermodynamic Origins

15 Jan 2024, 17:15
45m
Aspen Center for Physics

Aspen Center for Physics

700 Gillespie Ave, Aspen, CO 81611, United States

Speaker

Akhil Premkumar

Description

The 2015 paper that introduced diffusion models took inspiration from fluctuation theorems in non-equilibrium thermodynamics. I will demonstrate how some of these ideas can be refined through mathematical tools familiar to physicists (path integrals, calculus of variations etc.). This will allow us to study neural networks as a thermodynamic system, and offer a potential explanation for the impressive sample quality of these class of generative models.

Presentation materials