AI PUBLICATIONS + PRODUCTS

I build Generative AI models for music and creative applications.

I’m currently a Senior AI Research Scientist in ByteDance/TikTok’s Foundational R&D team and was an AI Resident with the Magenta team at Google Brain. I specialize in LLM-approaches to audio and music generation, as well as the intersection of modern ML with audio signal processing. I code primarily in Python and C++.

00 PUBLICATIONS & PATENTS

These are a selection of my publications and patents in the field of music technology and Generative AI. As research scientist and engineer, I specialize in the fields of audio signal processing, neural audio synthesis, large language modeling for audio and real time signal processing.

01 MAWF AUDIO PLUGIN

Mawf is a DAW plugin for transforming inputs like singing and everyday sounds into musical instruments. It uses industry-first realtime audio ML that runs on the cpu.

@Tiktok
2022

02 RIPPLE

Ripple is a mobile app for music-making powered by AI. Hum a tune. Type some lyrics. Upload a voice memo. Ripple will instantly transform it into a song.

@Tiktok
2023

03 TONE TRANSFER

Tone Transfer is a website that lets you transform everyday sounds into musical instruments. It is powered by audio ML running directly on the web.

@Google
2021

04 DDSP: DIFFERENTIABLE DIGITAL SIGNAL PROCESSING

DDSP is an open-source library fusing modern machine learning with classical signal processing.

@Google
2020

05 SOUNDS OF INDIA

A unique celebration of India’s Independance Day powered by Music ML and culture.

@Google
2022