AI PUBLICATIONS + PRODUCTS


I specialize in machine learning for music, speech and audio generation. These include modern diffusion and LLM approaches as well as methods which combine ML with classical signal processing.





00 PUBLICATIONS & PATENTS

These are a selection of my publications and patents in the field of music technology and Generative AI. As research scientist and engineer, I specialize in the fields of audio signal processing, neural audio synthesis, large language modeling for audio and real time signal processing.


Read More





01 SEED-MUSIC

SEED-MUSIC is a unified framework leveraging both auto-regressive language modeling and diffusion for controlled music generation and audio editing workflows.


Read More

@ByteDance/Tiktok
2024




02 DOUBAO 豆包 AI AGENT MUSIC GENERATION

Doubao is an AI Agent akin to China’s ChatGPT. A unique feature is its integrated music generation features.


Read More

@ByteDance/Tiktok
2024



03 HAIMIAN 海绵音乐 AI MUSIC GENERATION

Doubao is an AI Agent akin to China’s ChatGPT. A unique feature is its integrated music generation features.

Read More

@ByteDance/Tiktok
2024



04 RIPPLE

Ripple is a mobile app for music-making powered by AI. Hum a tune. Type some lyrics. Upload a voice memo. Ripple will instantly transform it into a song. 

Read More

@TikTok
2023






05 MAWF AUDIO PLUGIN

Mawf is a DAW plugin for transforming inputs like singing and everyday sounds into musical instruments. It uses industry-first realtime audio ML that runs on the cpu.

Read More

@TikTok
2022




06 TONE TRANSFER

Tone Transfer is a website that lets you transform everyday sounds into musical instruments. It is powered by audio ML running directly on the web.

Read More


@Google
2021







07 SOUND OF INDIA

Sounds of India is a unique and fun interactive musical experience launching for India’s 74th Independence Day, inspired by Indian tradition and powered by machine learning. 

Read More

@Google
2020





08 DDSP: DIFFERENTIABLE DIGITAL SIGNAL PROCESSING

DDSP is an open-source library fusing modern machine learning with classical signal processing. 

Read More

@Google
2020