Add MI325X recipe for Laguna S 2.1 - #665
Open
akii96 wants to merge 2 commits into
Open
Conversation
Contributor
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
akii96
force-pushed
the
add-laguna-s-mi325x
branch
from
July 22, 2026 13:28
28f930e to
21dee91
Compare
![gemini-code-assist[bot]](https://cdn.statically.io/img/avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
Code Review
This pull request adds support and documentation for running the Laguna-S-2.1 model on AMD ROCm hardware (specifically 8× MI325X GPUs in BF16 precision), including hardware overrides and a launch guide. The review feedback points out that the new AMD ROCm launch command is missing the --max-model-len 262144 parameter, which is inconsistent with other multi-GPU commands and could lead to out-of-memory errors.
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
akii96
force-pushed
the
add-laguna-s-mi325x
branch
from
July 22, 2026 13:36
21dee91 to
66af305
Compare
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Validation
gfx942)vllm/vllm-openai-rocm:nightly-387189c42997b27e2c04b5d97ef8190ffa2bf909node scripts/build-recipes-api.mjspassed with 149 models.