AI PUBLICATIONS + PRODUCTS

I build ML models for music and creative audio applications.

I’m currently a Senior Research Scientist in the Music ML team at TikTok and was an AI Resident with the Magenta team at Google Brain. I specialize in the intersection of modern ML with audio signal processing, from research to production. I co-invented technologies like the open-source DDSP library and real-time MAWF synthesizer DAW plugin.

00 PUBLICATIONS & PATENTS

These are a selection of my publications and patents in the field of music technology and Generative AI. As research scientist and engineer, I specialize in the fields of audio signal processing, neural audio synthesis, large language modeling for audio and real time signal processing.

01 MAWF AUDIO PLUGIN

Mawf is a DAW plugin for transforming inputs like singing and everyday sounds into musical instruments. It uses industry-first realtime audio ML that runs on the cpu.

@Tiktok
2022

02 RIPPLE

Ripple is a mobile app for music-making powered by AI. Hum a tune. Type some lyrics. Upload a voice memo. Ripple will instantly transform it into a song.

@Tiktok
2023

03 TONE TRANSFER

Tone Transfer is a website that lets you transform everyday sounds into musical instruments. It is powered by audio ML running directly on the web.

@Google
2021

04 DDSP: DIFFERENTIABLE DIGITAL SIGNAL PROCESSING

DDSP is an open-source library fusing modern machine learning with classical signal processing.

@Google
2020

05 SOUNDS OF INDIA

A unique celebration of India’s Independance Day powered by Music ML and culture.

@Google
2022