Live Portrait in Comfy UI similar to Hedra AI but its FREE - Talking Avatar in Local PC

Описание к видео Live Portrait in Comfy UI similar to Hedra AI but its FREE - Talking Avatar in Local PC

Install on your local PC/laptop: LINKS

Github (for Comfy UI) - https://github.com/kijai/ComfyUI-Live...
My workflow with assets -https://openart.ai/workflows/seal_har...

Made with Stable Diffusion and Comfy UI

#hedraai #ai #comfyui

More details about Live Portrait:

LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control is an innovative approach for creating lifelike video animations from a single source image. Here are the key details:

Objective: LivePortrait synthesizes realistic videos by using a single source image as an appearance reference and deriving motion (facial expressions and head pose) from a driving video, audio, text, or other sources.
Framework: Unlike mainstream diffusion-based methods, LivePortrait leverages an implicit-keypoint-based framework. This approach balances computational efficiency and controllability.
Training Data: The model is trained on an extensive dataset of approximately 69 million high-quality frames. A mixed image-video training strategy enhances generalization.
Enhancements:
Compact Implicit Keypoints: These keypoints effectively represent blendshapes, contributing to better generation quality.
Stitching and Retargeting Modules: These modules, implemented with a small MLP, enhance controllability without significant computational overhead.
Performance: LivePortrait achieves remarkable generation speed (12.8ms on an RTX 4090 GPU with PyTorch) even when compared to diffusion-based methods.

Комментарии

Информация по комментариям в разработке