AI PUBLICATIONS + PRODUCTS
I specialize in machine learning for music, speech and audio generation. These include modern diffusion and LLM approaches as well as methods which combine ML with classical signal processing.
00 PUBLICATIONS & PATENTS
These are a selection of my publications and patents in the field of music technology and Generative AI. As research scientist and engineer, I specialize in the fields of audio signal processing, neural audio synthesis, large language modeling for audio and real time signal processing.
Read More
01 SEED-MUSIC
SEED-MUSIC is a unified framework leveraging both auto-regressive language modeling and diffusion for controlled music generation and audio editing workflows.
Read More
@ByteDance/Tiktok
2024
2024
02 DOUBAO 豆包 AI AGENT MUSIC GENERATION
Doubao is an AI Agent akin to China’s ChatGPT. A unique feature is its integrated music generation features.
Read More
@ByteDance/Tiktok
2024
2024
Doubao is an AI Agent akin to China’s ChatGPT. A unique feature is its integrated music generation features.
Read More
@ByteDance/Tiktok
2024
2024
04 RIPPLE
Ripple is a mobile app for music-making powered by AI. Hum a tune. Type some lyrics. Upload a voice memo. Ripple will instantly transform it into a song.
Read More
@TikTok
2023
2023
Mawf is a DAW plugin for transforming inputs like singing and everyday sounds into musical instruments. It uses industry-first realtime audio ML that runs on the cpu.
Read More
@TikTok
2022
2022
06 TONE TRANSFER
Tone Transfer is a website that lets you transform everyday sounds into musical instruments. It is powered by audio ML running directly on the web.
Read More
@Google
2021
2021
07 SOUND OF INDIA
Sounds of India is a unique and fun interactive musical experience launching for India’s 74th Independence Day, inspired by Indian tradition and powered by machine learning.
Read More
@Google
2020
2020
08 DDSP: DIFFERENTIABLE DIGITAL SIGNAL PROCESSING
DDSP is an open-source library fusing modern machine learning with classical signal processing.
Read More
@Google
2020
2020