Masked Autoencoders (MAE) Paper Explained

Описание к видео Masked Autoencoders (MAE) Paper Explained

Paper link: https://arxiv.org/abs/2111.06377

In this video, I explain how masked autoencoders work by inspiring ideas from BERT paper and pertaining a vision transformer without requiring any additional label.

Table of Content:
00:00 Intro
00:19 BERT idea
02:09 Language and vision difference
05:29 Proposed Architecture
11:30 After pertaining
14:03 Masking ratio

Комментарии

Информация по комментариям в разработке