magenta-realtime
Google Magenta's first real-time music generation open model
Google Magenta's first real-time music generation open-source model (filed under AI music, also in the voice stream).
Voice AI: lifelike TTS, accurate ASR, and real-time voice agents.
Key features
- Open-weights real-time music generation model
- Python library magenta-rt with JAX and MLX backends
- C++ inference engine for streaming audio on Apple Silicon
- Example apps: AUv3 DAW plugin, standalone macOS app, note control
Good for
- Musicians generating music in real time on Apple Silicon
- Developers building DAW plugins or embedding music AI in apps
Stack & tags
PythonJAXMLXC++music-generationreal-timeopen-weightsapple-silicondaw-pluginjaxmlx
Quick start
uv pip install "magenta-rt[mlx]"
mrt models download
mrt mlx generate --prompt "disco funk" --duration 4.0 --model=mrt2_baseFrom the project README on GitHub.