Text-to-Speech ElevenLabs Plugin for TouchDesigner + Whisper, ChatGPT, and MediaPipe Integration

In this tutorial, you'll learn how to use the new ElevenLabs text-to-speech plugin for TouchDesigner. We'll also walk through a project creating a voice-activated 3D talking character by integrating Whisper for speech-to-text, ChatGPT for generating dialogue, ElevenLabs for text-to-speech, and MediaPipe for motion tracking to create an interactive experience.

Link to project file + Plugin on Patreon:   / blankensmithing  

Previous Tutorial on ChatGPT and Whisper:    • GPT-4, ChatGPT, and Whisper(speech-to...  
Noto the Talking Ball's Tutorial:    • Talking ball Starboy in Touchdesigner...  
MediaPipe Plugin Tutorial:    • Free Motion Tracking plugin for Touch...  


0:00 Overview
3:11 ElevenLabs Plugin Overview
7:22 Connect ChatGPT to ElevenLabs
10:11 Configure Whisper with ElevenLabs
17:40 Add MediaPipe Face Tracking