Adding Self-Attention to a Convolutional Neural Network! : PyTorch Deep Learning Tutorial Section 13

Описание к видео Adding Self-Attention to a Convolutional Neural Network! : PyTorch Deep Learning Tutorial Section 13

TIMESTAMPS:
0:00 Introduction
0:22 Attention Mechanism Overview
1:20 Self-Attention Introduction
3:02 CNN Limitations
4:09 Using Attention in CNNs
6:30 Attention Integration in CNN
9:06 Learnable Scale Parameter
10:14 Attention Implementation
12:52 Performance Comparison
14:10 Attention Map Visualization
14:29 Conclusion

In this video I show how we can add Self-Attention to a CNN in order to improve the performance of our classifier!

Donations
https://www.buymeacoffee.com/lukeditria

The corresponding code is available here!
https://github.com/LukeDitria/pytorch...

Discord Server:
  / discord  

Комментарии

Информация по комментариям в разработке