Attention in Neural Networks

In this video, we discuss Attention in neural networks. We go through Soft and hard attention, discuss the architecture with examples. SUBSCRIBE to the channel for more awesome content!

My video on Generative Adversarial Networks:    • Generative Adversarial Networks - FUT...  
My video on Convolution Neural Networks:    • Convolution Neural Networks - EXPLAINED  

INVESTING
[1] Webull (You can get 3 free stocks setting up a webull account today): https://a.webull.com/8XVa1znjYxio6ESdff

REFERENCES
Show attend and tell (Image Captioning): https://arxiv.org/pdf/1502.03044.pdf
What is attention: https://blog.heuritech.com/2016/01/20...
Attention is all you need: https://arxiv.org/pdf/1706.03762v5.pdf
Nice blog on Attention: http://www.wildml.com/2016/01/attenti...
Feed Forward + Attention can solve problems: https://arxiv.org/pdf/1512.08756.pdf
Teaching Machines to Read and Comprehend: https://arxiv.org/pdf/1506.03340.pdf