Advanced AI Sketch to Image: Style transfer with comfyui and IPadapter

The sketch to render has been one of the most popular AI workflows using stable diffusion. The original method mainly relied on control nets however this new workflow I will show you has far more flexibility and control particularly when it comes to styling.

This is done through the use of ipadapters which are add-on for using images as prompts. You can use it to copy the style, composition, or a face in the reference image. Great to convert a sketch into a specific style render you have a reference of.

00:00 Intro
00:30 IP adapter install
02:37 Control net addition
04:37 Style transfer settings
06:00 Realistic style
06:21 Artistic style
06:50 Weather Style
07:16 Water colour style
07:44 Outro

Install:    • One-click installs for Open Source AI...  
Part I:    • ComfyUI: Getting started for Stable D...  
Part II:    • ComfyUI: Intro to Masking and In-pain...  
Part III:    • ComfyUI: Intro to Control Net- Sketch...  
Part IV:    • Best Photorealistic Models with ComfyUI  

ip adapters: https://huggingface.co/collections/Te...

Checkpoint model: https://civitai.com/models/133005/jug...

Control nets: https://huggingface.co/TencentARC/t2i...

Instagram account:   / urbandecoders  

#ai #architecture #generativedesign #parametric #stablediffusion #upscaling #animation #comfui #image #design #generativedesign #painting #sketchtorender #styletransfer