feat: [new model] minimax music3 - #5345
Merged
Merged
Conversation
Contributor
There was a problem hiding this comment.
Code Review
This pull request integrates the MiniMax-Music3 text-to-music model into Xinference, adding backend support via the Diffusers ModularPipeline engine, updating model specifications, and introducing a new 'text2music' capability. It also updates the frontend UI to support music generation with localized translations and dedicated form fields. The review feedback suggests fixing a conflict between group offloading and CPU offloading in the backend, supporting 'bf16' as a data type alias, using safer number parsing with fallbacks in the frontend configuration, improving the lyrics input placeholder text, and adding the new model to the legacy dispatch chain for robustness.
Minamiyama
force-pushed
the
models/minimax-music3
branch
from
August 16, 2026 14:58
8d76a44 to
e255c84
Compare
qinxuye
reviewed
Aug 16, 2026
qinxuye
reviewed
Aug 16, 2026
qinxuye
reviewed
Aug 17, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds initial MiniMax-Music3 support as a built-in audio model with the new
text2musicability.MiniMax-Music3using DiffusersModularPipelinePOST /v1/audio/speechendpointBackend
minimax_music3text2musicThe model is registered under the MiniMax-Music3 Community License.
API
Music generation reuses
/v1/audio/speech:input: lyricskwargs.instruct: music descriptionkwargs.seed: non-negative random seed, default0kwargs.duration: maximum duration in seconds, default60, range0.04to360response_format:wavonlyUnsupported speech or sampling parameters are rejected with model-specific validation errors.
Web UI
Adds a distinct Music Generation capability with:
Regular TTS and voice-cloning forms retain their existing behavior.