響影 (Hibikikage)

響影 (Hibikikage) or echoshade is a responsive musical system that generates dynamic electronic dance music compositions based on crowd movement and social cohesion. Using cameras to capture motion intensity and location in real-time, the system translates this data into probabilistic algorithmic compositions via Ableton Live and Max MSP. Designed for dance music culture, it fosters a feedback loop where the atmosphere and crowd movements influence each other.

The system envisions the concept of a self-playing nightclub, where music evolves autonomously based on the energy and movement of the crowd, creating an immersive and ever-changing experience without the need for direct human intervention. While designed to operate unattended, the system also allows for manual creative control, blending generative automation with artistic flexibility.

The project integrates machine learning models such as DTW classifiers for gesture-triggered samples and regression models for parameter manipulation, alongside frame differencing for motion analysis. Inspired by studies on emotional contagion and the universal expression of dance, it offers both autonomous generative capabilities and manual control for creative intervention.

Rooted in research on motion structure and philosophical reflections on space, including Shiratori et al. (2004) and Taşçı (2021), echoshade aims to create a novel entertainment experience that bridges technology, music, and human connection. By redefining how music responds to human behavior, it brings to life the vision of a nightclub where the environment itself becomes a dynamic performer.

T. Shiratori, A. Nakazawa and K. Ikeuchi, "Detecting dance motion structure through music analysis," Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings., Seoul, Korea (South), 2004, pp. 857-862, doi: 10.1109/AFGR.2004.1301641.

Taşçı, H. (2021). The Reflection of Gazali's Motion Philosophy on Space: The Unlimited Nature. EKEV Akademi Dergisi Yıl: 25 Sayı: 87 (Yaz 2021), 0(87), 205-216.