Скачать или смотреть 【Burning Japan2025】 - Voice of the Earth - Archive

“Voice of the Earth” is an immersive multimedia installation that synchronizes projection mapping, lighting, sound, and smoke effects into a unified environmental performance. The work explores the relationship between Earth, humanity, and technology through sensory experience.

In recent years, advances in AI and acoustic analysis have opened new pathways in understanding non-human communication. In 2024, researchers made breakthroughs in decoding the coda sequences, rhythms, and phoneme-like structures in sperm whale vocalizations, suggesting the presence of linguistic features and complex social interactions. Inspired by this research—particularly findings published in Nature Communications—this work reimagines the “voices” of the ocean and the land through light, sound, and motion.

Visitors enter a nature-based installation where they are surrounded by generative visuals and soundscapes derived from whale clicks, moans, and songs. These sounds are re-synthesized using Sonic Pi and Ableton Live, blending real recordings with algorithmic and spatial audio techniques. The installation allows audiences to interact physically—pressing buttons to trigger smoke or dynamic lighting—transforming the piece into a living dialogue between human perception and the environment.

To visually express these “voices,” the project uses computer-generated animations based on natural phenomena and algorithmic patterns (noise, fluid dynamics, reaction-diffusion, etc.), presenting 24 unique visual patterns. The motif of a single “whale eye” represents mutual observation: when we look at nature or technology, they are also looking back at us.

Lighting is precisely synchronized through a custom DMX512 control plugin developed in Ableton, sending OSC signals to lighting fixtures. This combination of artistic sensitivity and technological engineering creates a deeply integrated audiovisual performance.

Through this project, we aim to deepen our understanding of Earth, people, and technology—not as separate entities, but as interconnected voices sharing the same environment. By listening to the non-human world, we expand our perception and imagine new futures of coexistence.