Evaluating MiniMax-Music3 for Long-Form AI Music Generation

https://hackernoon.imgix.net/images/1786718445475_np1k22a.png

Overview

MiniMax-Music3 generates complete songs up to five minutes long from lyrics and detailed music descriptions, producing 32 kHz, 16-bit stereo WAV audio. Built by MiniMaxAI, the model combines an 8B Global LLM for long-range musical structure, a 0.6B Local LLM for frame-level acoustic detail, and a continuous hidden-state synthesis system using Flow Matching and Flow-VAE (2.4B and 123M respectively). The architecture processes music through eight layers of Residual Vector Quantization, with a semantic codebook of 16,384 entries and seven acoustic codebooks of 1,024 entries each. The Global LLM is initialized from Qwen3-8B and adapted during training to semantic music tokens. Inference requires CUDA and uses sglang-omni as the primary inference framework, with support for diffusers and ComfyUI pipelines. The most critical constraint before evaluating this model is that it requires 24GB+ VRAM for full precision inference, though CPU offloading can reduce this to 8GB with slower generation speed.

...

Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE