I build Generative AI models for music and creative applications.
I’m currently a Senior AI Research Scientist in ByteDance/TikTok’s Foundational R&D team and was an AI Resident with the Magenta team at Google Brain. I specialize in LLM-approaches to audio and music generation, as well as the intersection of modern ML with audio signal processing. I code primarily in Python and C++.
These are a selection of my publications and patents in the field of music technology and Generative AI. As research scientist and engineer, I specialize in the fields of audio signal processing, neural audio synthesis, large language modeling for audio and real time signal processing.
Mawf is a DAW plugin for transforming inputs like singing and everyday sounds into musical instruments. It uses industry-first realtime audio ML that runs on the cpu.
2022
Ripple is a mobile app for music-making powered by AI. Hum a tune. Type some lyrics. Upload a voice memo. Ripple will instantly transform it into a song.
2023
Tone Transfer is a website that lets you transform everyday sounds into musical instruments. It is powered by audio ML running directly on the web.
2021
DDSP is an open-source library fusing modern machine learning with classical signal processing.
2020
A unique celebration of India’s Independance Day powered by Music ML and culture.
2022