A.I. Experiments is a collection of creative applications of machine learning. I worked on 3 of the music-related projects.
A.I. Duet let’s you have a back and forth musical interaction with a neural net through a piano interface. The neural net was built and trained by Google’s Magenta team.
What was exciting to me about A.I. Duet compared to many other Machine Learning generated music projects that I’ve seen was the interactivity. With A.I. Duet you get to hear and better understand how the Neural Net responds to different kinds of inputs.
Infinite Drum Machine
The Infinite Drum Machine is a browser instrument in which listeners could explore 15 thousand samples visualized by sonic similarity using a method called t-SNE.
After navigating the map, you can sequence your sounds on a drum machine interface and make some weird and eclectic beats composed of animals sounds, car noises, and grunts.
Giorgio Cam was originally a concept that Eric threw together in a weekend. You point your camera at an object and using the Google Cloud Vision API, it returns labels for the image. Those labels are then madlibbed into a song by Giorgio Moroder. The result is pretty fun and silly.