Скачать или смотреть Text-To-Skyrim: The Quest for Chili [Twitch TTS Mod]

Participate and watch LIVE:   / blurbs  
24/7 channel LIVE NOW:   / blurbsalwayson  
ALL EPISODES:    • Text-To-Skyrim  
VODS:    / @blurbsvods  

Discord:   / discord  
TikTok:   / blurbstv  
Twitter:   / blurbstv  
Instagram:   / blurbsttv  

HOW THIS WAS MADE:

So many people asked if this mod will be available publicly, and honestly I'm not sure. It's not a single "mod", but rather multiple programs running in tandem for it to function properly. Additionally, the code is not only spaghetti, but specific to my information. I will however give as many resources as I can for those of you wanting to attempt this.

This works using a mod I created in Skyrim that sends and receives instructions to a node JS server running locally on my machine.
The server reads Twitch chat, and when told by Skyrim dialogue is needed, reaches out to ElevenLabs to generate .wav files. Using this audio, the program listed below is run to generate .lip files needed for lip movement.
After creating a dummy Topic with placeholder voice lines in the Creation Kit, the server hotswaps the new audio/lip files over the existing ones, giving the illusion of a complex dialogue system.
Enjoy the memes!

Sources:
I used SkyrimPlatform to code the plugin in Typescript (personal preference) https://www.nexusmods.com/skyrimspeci...
Program to generate .lip files: https://github.com/Haurrus/FaceFXWrapper
Plugin to inject subtitles into Skyrim: https://github.com/swwu/Mantella-Subt...
Script extender: https://github.com/skyrim-platform/po...
How to convert buffer to .wav blob (gotta do further steps to actually write that to disk however): https://stackoverflow.com/questions/2...