Hand gesture music

How movement becomes music.

A camera-based instrument tracks selected hand positions, translates them into musical controls and produces sound in real time.

1 · Camera

A webcam captures the movement you choose to show.

2 · Tracking

Hand landmarks, positions and stable poses become musical input.

3 · Mapping

Inputs map to chords, notes, filters and volume changes.

4 · Sound

The browser audio engine produces sound and updates it as you move.

More than a visual effect

A playable motion synth needs responsive sound, stable recognition and honest feedback about what it detects.

No wearable required

A standard webcam reduces setup. Tracking quality still depends on light, position and device performance.