DIY Stable Diffusion API ↔ TouchDesigner

Get access to 200+ hours of TouchDesigner video training, a private Facebook group where Elburz Sorkhabi and Matthew Ragan answer all your questions, and twice-monthly group coaching/mastermind calls here: http://iihq.tv/Trial

If you’re a TouchDesigner Beginner, check out our TouchDesigner Tutorial Series! We teach you all the basics of how to use TouchDesigner, including mouse controls, hotkeys, parameters, the operator families, and more: https://interactiveimmersive.io/touch...

Stable Diffusion is one of several popular text-to-image deep learning models released in the last few years, and is capable of producing highly detailed images based on text prompts from the user.

Say you want to see what a painting of a cellphone by Picasso would’ve looked like — Stable Diffusion can generate a fairly believable approximation of it.

Like other deep learning models, Stable Diffusion is accessible via an API and has its own Python package, which makes it a great candidate for working with in TouchDesigner.

In this video, Jack DiLaura walks you through creating a component for sending requests to the Stable Diffusion API and saving the resulting images to the project folder. The tutorial has been created with beginners in mind, offering a great chance to practice working with APIs and creating reusable components in TouchDesigner.

You’ll take a look at API keys and documentation, build a custom component complete with an interface to send requests to the API, and build out the underlying API request functionality by adapting example Python. Finally, you’ll take a look at the Engine COMP and how it can be very useful for avoiding performance hiccups by distributing processes like accessing an API.

Stability.AI Website: https://stability.ai
Stability.AI API Documentation: https://platform.stability.ai/
External Python Libraries Reference: https://matthewragan.com/workshops/td...

Chapters:
00:00:00 - Connectivity between TouchDesigner and the Stable Diffusion API
00:05:00 - Installing the Stability SDK package
00:08:12 - Getting started in TouchDesigner
00:09:48 - Setting up the API connection
00:14:54 - Setting Default Parameters
00:20:09 - Setting up Custom Parameters and Accessing the API
00:25:22 - Setting up API Parameters
00:30:37 - Saving Generated Images
00:35:55 - Modifying File Naming and Saving the Image
00:41:38 - Setting Up API Call in TouchDesigner
00:46:03 - More TouchDesigner and Immersive Content