Deep Learning 7: Energy-based models

Slides: https://cwkx.github.io/data/teaching/...
Colab: https://colab.research.google.com/gis...
Twitter:   / cwkx  
Next video:    • Deep Learning Lectures  

Manifolds
Energy-based models
- definition
- GANs as energy-based models
- clustering as an energy-based model
- softmax and softmin
- exact likelihood
Contrastive-divergence approaches
Boltzmann machines
- definition
- restricted and deep Boltzmann machines
Score-based approaches
- Langevin dynamics
- score-matching and denoising diffusion

#manifolds #EBMs #Langevin #deeplearning #energymodels #MCMC #dynamics #DDPM #Boltzmann #RBM #DBM #softmax #scorematching #denoising #diffusion