World's First Fully AI-Made Minecraft Let's Play

Long story short: You are watching an AI play minecraft by itself, and narrate its own video!

The gameplay footage is from MineDojo, an AI agent that learned to play minecraft and achieve objectives through watching gameplay videos. Learn more here: https://minedojo.org/ - Apologies for the low gameplay resolution.

The commentary was achieved through prompting a SOTA language model, Character AI, with youtuber-like comments. Through describing events in the gameplay footage, it was able to write convincing dialogue describing what's happening on screen, even when it's not completely factual at all times. The website supports native text-to-speech of surprisingly high quality, which was also used. Talk to the Minecraft Youtuber character yourself: https://beta.character.ai/chat?char=7...

The music choice was also made by the AI, simply by asking for a music recommendation it would put under its own video. "Anything from c418 really, he's the mastermind behind Minecraft's sound design. If you're looking for one of his most iconic tracks, I'd recommend Sweden. It's a very good and calming relaxing song."