Скачать или смотреть Speak & Paint Final Work Installed in the Space

Speak & Paint is an interactive audiovisual installation where spoken words are transformed into generative light paintings in real time.

Participants speak into a microphone, their voice is transcribed and analyzed by AI for emotional content, and those emotions are mapped to live visuals created in Hydra. The visuals are captured through OBS and projection-mapped using Resolume onto physical canvases in a gallery space.

Rather than painting with hands, visitors “paint” with emotion.
Joy shifts color warmth.
Anger increases contrast and texture.
Calm softens brightness.
Energy drives movement and intensity.

Each interaction produces a unique, unrepeatable composition, a temporary emotional portrait made of light.

Technical Pipeline:
Microphone → AI Transcription → Emotion Analysis → WebSocket → Hydra → OBS → Resolume → Projection Mapping

This project explores the relationship between voice, affect, and generative systems — questioning how technology can translate internal emotional states into shared visual experiences.

Created as part of a projection mapping and interactive media course.