OpenAI’s CLIP explained! | Examples, links to code and pretrained model

Ms. Coffee Bean explains
❓ how OpenAI‘s CLIP works,
❔ what it can and cannot do
⁉️ and what people have been up to using CLIP in awesome applications!
➡️ AI Coffee Break Merch! 🛍️ https://aicoffeebreak.creator-spring....


▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon:   / aicoffeebreak  
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
📺 DALL-E explained by Ms. Coffee Bean:    • OpenAI's DALL-E explained. How GPT-3 ...  

Outline:
* 00:00 CLIP and DALL-E
* 02:14 What can CLIP do?
* 04:22 How does CLIP work?
* 09:12 Limitations
* 12:39 Applications

📄 CLIP paper: Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. Learning Transferable Visual Models From Natural Language Supervision. Image, 2, T2. https://cdn.openai.com/papers/Learnin... (last date accessed: 24.01.2021)

📚 CLIP blog: openai.com/blog/clip/
💻 Use CLIP with huggingface: https://huggingface.co/docs/transform...
I've removed the Colab Link since it was deprecated and not working anymore. A lot is happening in ML and now it is even easier to use CLIP with huggingface 🤗. Link above!

Other links:
📄 Switch Transformers: Fedus, W., Zoph, B., & Shazeer, N. (2021). Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity. arXiv preprint arXiv:2101.03961.
https://arxiv.org/pdf/2101.03961.pdf

📚 Check out the section “10 Novel Applications using Transformers”: https://paperswithcode.com/newsletter/3

🐦Links to the application showcase in Twitter:
1.   / 1352630033832140800  
2.   / 1351271379103002632  
3.   / 1350030541467258881  
4.   / 1351830997403254785  

------------------------------------------
🔗 Links:
YouTube:    / aicoffeebreak  
Twitter:   / aicoffeebreak  
Reddit:   / aicoffeebreak  

#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research

Thumbnail contains the tick emoji designed by OpenMoji – the open-source emoji and icon project. License: CC BY-SA 4.0