This is a tool for visualizing music. You can turn on your mic to sing or play sounds. You can also drop in your own audio or video file. Some modes – like Hilbert Scope and Spectrogram – show the subtle textures of sound. Others show the paths and shapes of different melodies.

Seeing Music was part of a larger project called Creatability which explore how creative tools – drawing, music, and more – can be made more accessible using web and AI technology.

I worked closely with deaf composer Jay Alan Zimmerman to try and implement his design for how music and sound should be visualized to be most useful in his composition and pedagogy.