Search results

Kimi-K3 deployment recipe from official docs fails on H200 GPU with OOM and CP-related RuntimeError

Status: Open.

#698 In vllm-project/recipes;

· frankSARU opened on Jul 29, 2026

Recipe request: moonshotai/Kimi-K3

Status: Open.

#685 In vllm-project/recipes;

· tony-42069 opened on Jul 27, 2026

Add support for community VLLM containers in recipes

Status: Open.

#671 In vllm-project/recipes;

· prodney-dev opened on Jul 23, 2026

Add inference example for DeepSeek-V4-Flash-DSpark on 8×RTX Pro 6000 (SM120 / Blackwell) ？

Status: Open.

#600 In vllm-project/recipes;

· xzwgit opened on Jun 30, 2026

Glm 5.1 DP + EP not present in vllm recipes.

Status: Open.

#599 In vllm-project/recipes;

· VishnuHaasan opened on Jun 30, 2026

Recipe request: cyankiwi/Qwen3.5-4B-AWQ-INT8-INT4

Status: Open.

#560 In vllm-project/recipes;

· Poyzi06 opened on Jun 17, 2026

[RFC] Add staged Huawei Ascend NPU support to vLLM Recipes

Status: Open.

#498 In vllm-project/recipes;

· robellliu-dev opened on Jun 1, 2026

[Bug] DeepSeek-V4-Pro multi_node_tep renders invalid TP=16 command for FP8 weights

Status: Open.

#497 In vllm-project/recipes;

· observerw opened on May 31, 2026

Folder names don't match provider names

Status: Open.

#491 In vllm-project/recipes;

· Karim-siala opened on May 28, 2026

Gemma4: max_num_batched_tokens error for 26B MoE on 1× A100/H100 (BF16) command

Status: Open.

#441 In vllm-project/recipes;

· suleymanzahi opened on May 5, 2026

DEEPSEEK-V4-FLASH ON H20-141G*8 SINGLE NODE ERROR

Status: Open.

#429 In vllm-project/recipes;

· cxljkb1994 opened on Apr 30, 2026

mimo-v2.5 request must chat_template_kwargs bug

Status: Open.

#425 In vllm-project/recipes;

· yiminghub2024 opened on Apr 29, 2026