Скачать или смотреть Is the new Image-to-Music algorithm Really That Good?

A new algorithm has just surfaced which converts images into short songs. In this video we use this algorithm to make some songs, and then we explore how it works under the hood. TL;DR, it's not very good.

Discord:   / discord  

------- Links -------

Image to music generator: https://huggingface.co/spaces/fffilon...
Img2Music Tweet:   / 1585698118137483276  

CLIP Interrogator huggingface : https://huggingface.co/spaces/pharma/...
CLIP Interrogator github: https://github.com/pharmapsychotic/cl...
t=zJm2wThqCMKmDRFsMuIcYg&s=19

Attempt at reverse-engineering Mubert: https://medium.com/@alexbainter/how-m....
Mubert Website: https://mubert.com/
Mubert Github: https://github.com/MubertAI/Mubert-Te...

Explanation of SBERT: https://towardsdatascience.com/an-int....

BLIP paper: https://arxiv.org/abs/2201.12086
Great video on BLIP (Yannic you beautiful, beautiful Swiss):    • BLIP: Bootstrapping Language-Image Pre-tra...  

------- Music -------

Music from https://freetousemusic.com

‘Daily’ by ‘LuKremBo’:   • lukrembo - daily (no copyright music)  
‘Marshmallow’ by ‘LuKremBo’:   • lukrembo - marshmallow (no copyright music)  
‘Onion’ by LuKremBo:    • lukrembo - onion (no copyright music)  
‘Rose’ by ‘LuKremBo’:    • lukrembo - rose (no copyright music)  
‘Snow’ by LuKremBo:    • lukrembo - snow (no copyright music)  
‘Sunset’ by ‘LuKremBo’:   • lukrembo - sunset (no copyright music)  
‘Branch’ by ‘LuKremBo’:    • lukrembo - branch (no copyright music)  

Many thanks to LuKremBo

#aiart #mubert #aimusic #technology #art