Deep Learning 8: Sequential models

Описание к видео Deep Learning 8: Sequential models

Slides: https://cwkx.github.io/data/teaching/...
Colab 1: https://colab.research.google.com/gis...
Colab 2: https://colab.research.google.com/gis...
Twitter:   / cwkx  
Next video:    • Deep Learning Lectures  

Recurrent neural networks
- definition
- vanilla RNN implementation
- backpropagation through time
- vanishing/exploding gradients
Long short term memory
- definition
- properties
Transformers
- definition
- encoder-decoder
- end-to-end object detection
- unsupervised translation
- GPT-3
- linear transformers
- transformer equivalences

#transformers #RNNs #deeplearning #LSTM #GPT3 #lineartransformers #gradients

Комментарии

Информация по комментариям в разработке

Похожие видео