Identity Mirror

2023
Interactive Installation (2P)
Created during Interactive Audio/Video Systems

This interactive project explores the transformation of body movement into sound and visualization.

The visual component is realized in TouchDesigner – as a central element, it incorporates a particle system that displays the outlines of the players (maximum of two players). A Kinect Azure captures a variety of data through sensors. In this case, the positions of both hands are read and sent as a data stream to Ableton, allowing specific parameters of built-in synthesizers to be controlled in real time.

Player A can manipulate two parameters of synthesizer A, Player B can control two parameters of synthesizer B. Additionally, a randomly coming impact sound triggers the feedback strength on the horizontal axis, which creates an resolving movement effect.

This installation allows players to transform their own movements into visual effects and ambient soundscapes.


Technique
TouchDesigner – Particle System, Noise, Feedback, Data Stream I/O
Ableton Live – Synthesizer, Parameter Control
Kinect Azure – Body + Hand Tracking

Credits
Concept & Development by Valentin Steiner, Paul Kraner, Joseph Schönacher, Paula Fanta