AI PUBLICATIONS + PRODUCTS

I build Generative AI models for music and creative audio applications.

I was a Senior AI Research Scientist at ByteDance/TikTok in the Foundation Model SEED R&D team for Doubao (China’s ChatGPT). I developed music and audio generation features powered by Diffusion/LLM. I was previously an AI Resident at Google Brain/DeepMind in the Magenta team where I specialized in the intersection of machine learning with audio signal processing. I code primarily in Python/C++ and have degrees in Physics and Music.

00 PUBLICATIONS & PATENTS

A selection of my publications and patents in music technology and Generative AI. I specialize in audio signal processing, neural audio synthesis and LLM’s for audio.

01 SEED-MUSIC
SEED-MUSIC is a unified framework leveraging both auto-regressive language modeling and diffusion for controlled music generation and audio editing workflows.

@ByteDance/Tiktok
2024

02 DOUBAO 豆包 AGENT MUSIC GENERATION
Doubao is an AI Agent akin to China’s ChatGPT. A unique feature is its integrated music generation features.

@ByteDance/Tiktok
2024

03 HAIMIAN 海绵音乐 AI MUSIC GENERATION
Haimian is an AI Music generation app. It enables creators to make expressive vocal music and instrumental music in a variety of genres.

@ByteDance/Tiktok
2024

04 RIPPLE

Ripple is a mobile app for music-making powered by AI. Hum a tune. Type some lyrics. Upload a voice memo. Ripple will instantly transform it into a song.

@Tiktok
2023

05 MAWF AUDIO PLUGIN

Mawf is a DAW plugin for transforming inputs like singing and everyday sounds into musical instruments. It uses industry-first realtime audio ML that runs on the cpu.

@Tiktok
2022

06 TONE TRANSFER

Tone Transfer is a website that lets you transform everyday sounds into musical instruments. It is powered by audio ML running directly on the web.

@Google
2021

07 SOUNDS OF INDIA

A unique celebration of India’s Independance Day powered by Music ML and culture.

@Google
2020

08 DDSP: DIFFERENTIABLE DIGITAL SIGNAL PROCESSING

DDSP is an open-source library fusing modern machine learning with classical signal processing.

@Google
2020