Magenta Studio is a suite of machine learning Ableton Live plugins which I designed and built in collaboration with Google’s Magenta team.

These plugins were built with Max/MSP’s new node.script object. They wrap some of Magenta.js’ core models so they can be easily accessed through Ableton Live.

The challenge with this project was in designing straightforward metaphors and interactions for each of the models which are powerful, but also understandable to musicians who are not as familiar with machine learning.

My favorite plugin from the set is Groove, which is built with Magenta’s MusicVAE. Groove adjusts the timing and velocity of an input drum clip to produce the “feel” of a drummer’s performance. This is similar to what a “humanize” plugin does, but achieved in a totally different way.