MIT Logo

Controllers

  • Build a Band

    A creative tool to make multi-instrument music using hand gestures!

    By: Jack Gray, Jennifer Kim, Hannah Yau

    Demo starts at 2:12

    Read more: Build a Band
  • Bodies In Score

    This project allows users to score movie scenes using a combination of body gestures and MDII large language models (LLMs).

    By: Ifueko Igbinedion, Z Chen, Maynard Larweh

    Demo starts at 2:27

    Read more: Bodies In Score
  • Singy Bird

    Flappy Bird meets Karaoke to create a visually fun, friendly, singing game where the user controls the bird’s flying height with their voice.

    By: Sriram Sethuraman, Jessica Shoemaker, Nicholas Wei

    Demo starts at 3:27

    Read more: Singy Bird
  • Microtonal Omnichord

    A microtonal instrument that allows users to easily create, and transition between, microtonal chords using a drum pad.

    By: Aleksandr Trofimov, Courtney Ma, Evan Ingoldsby

    Demo starts at 4:33

    Read more: Microtonal Omnichord
  • Groove-It

    Bop-It, but if it used a hand motion controller, and it had a beatmatching twist!

    By: Claire Southard, Sharon Zhu

    Demo starts at 3:51

    Read more: Groove-It
  • Orbi

    Camera gesture-controlled synth with orb graphics that change along with the synth effects such as reverb and volume.

    By: Vivien Huang, Hyun Su Price, Alicia Ji

    Demo starts at 2:15

    Read more: Orbi
  • IMSynth


    An interactive synthesizer that uses images to create novel sounds, providing users with a connection between the audio and visual worlds.

    By: Clay Lewis, Patrick Liu, Gage Rodriguez.

    Demo starts at 2:28

    Read more: IMSynth
  • Magic Doodle

    Learn solfege hand symbols (using camera gestures recognition) to battle enemies!

    By: William Feng, Matt Kotzbauer.

    Demo starts at 3:18

    Read more: Magic Doodle
  • Motion Melody

    Motion Melody: An interactive experience that uses dance as a stimulus for music. Dance yourself to dance!

    By: Makram Chahine, Nicole Sobski, Shih-Peng Huang

    Demo starts at 4:54

    Read more: Motion Melody
  • BeatFarm

    A system to produce hip-hop beats based on everyday sounds that you record.

    By Collin Wen, Diego Yañez-Laguna, Lucy Kim

    Demo starts at 3:48

    Read more: BeatFarm