All Things ViTs || CVPR 2023 Tutorial || Hila Chefer and Sayak Paul

This is a video recording of the following CVPR 2023 tutorial - All Things ViTs: Understanding and Interpreting Attention in Vision by Hila Chefer (Tel-Aviv University and Google) and Sayak Paul (Hugging Face).

Sections:

00:00 - Introductions
05:05 - Part 1: Intro to Transformers
21:10 - Part 2: Probing Vision Transformers
38:15 - Part 3: Explaining Transformers
01:09:00 - Part 4: Attention as Explanation
01:18:00 - Guest lecture by Ron Mokady
01:32:00 - Part 5: Attention for downstream tasks
01:51:05 - Conclusion and open questions

All links:

* Tutorial website: https://all-things-vits.github.io/atv (containing all the other tutorial materials)
* CVPR virtual site of the tutorial: https://cvpr2023.thecvf.com/virtual/2...
* Hila Chefer's website: https://hila-chefer.github.io/
* Sayak Paul' website: https://sayak.dev/
* Guest speaker Ron Mokady's website: https://rmokady.github.io/