Title: Mouth Synth
Date: 2024
Mediums: computer, camera, custom software (written in JavaScript)
Dimensions: variable
Links: video demo, live demo, blog post
Mouth Synth is an interactive audio-visual installation that synthesizes whimsical, surreal sounds in response to a viewer’s facial movements. As the viewer stands before the installation, their head and mouth gestures are captured and processed by a machine-learning-powered program that translates these movements into playful, expressive music.
Viewers are invited to interact, perform, and experiment, making them an integral part of the artwork itself. By centering the mouth as the primary means of interaction, Mouth Synth challenges conventional modes of control, offering a unique and intimate way to shape sound and engage with art.