Free Open Source Text to Video - Superhero Trailer

I wanted to see how far I could push AI video generated on my local workstation.

This was done via Stable Diffusion Automatic1111 webUI with the AnimateDiff extension. I didn't do any upscale or frame interpolation, but I did speed up a few clips.

I used the Realistic Vision V5.1 SD checkpoint w/ LowRA Lora at 0.1 to add deeper / richer color. The videos were pretty washed out otherwise.

Negatives = shorter clips than pika & runway. You can get about 16 - 24 frames. 8fps = 2 seconds.

Positives = you can queue up a batch and let it run with virtually no cost (except power & your hardware). On my 4090 it takes about 1 min per clip.

And yes, I put the Hulk, Superman, Wonder Woman, Bruce Lee, Batman, the Flash, and John Wick all in the same trailer. 😂

#genai #animatediff #stablediffusion #generativeai #ai