Skip to content

Pull requests: vllm-project/vllm

New pull request New
757 Open 9,591 Closed
757 Open 9,591 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[CUDA graphs] Implement simple cuda graph v1
#20328 opened Jul 1, 2025 by WoosukKwon • Draft
8
[Kernel][Bugfix] Fixup some warnings in nvfp4_blockwise_moe when CUDA < 12.8 bug Something isn't working ready ONLY add when PR is ready to merge/full CI is needed
#20324 opened Jul 1, 2025 by tlrmchlsmth Loading…
6
[Bugfix] Fix the max_seq_len limit of 16384 for DeepSeek models
#20322 opened Jul 1, 2025 by huaqiangwang Loading…
3 of 4 tasks
4
[USAGE] Improve error handling for weight initialization in Unquantized… documentation Improvements or additions to documentation v1
#20321 opened Jul 1, 2025 by koiker Loading…
3 of 4 tasks
5
HF Hub LoRA Resolver ci/build documentation Improvements or additions to documentation
#20320 opened Jul 1, 2025 by alex-jw-brooks Loading…
8
fix(cpu): Handle None ModelConfig during default initialization
#20319 opened Jul 1, 2025 by Flink-ddd Loading…
1
4
[Feature] Add HTTP support for KV cache events
#20318 opened Jul 1, 2025 by Zyann1 • Draft
1 of 4 tasks
5
fix[Docs]: link anchor is incorrect #20309 documentation Improvements or additions to documentation structured-output
#20315 opened Jul 1, 2025 by yyzxw Loading…
4 tasks
12
[Kernel] Optimize Prefill Attention in Unified Triton Attention Kernel
#20308 opened Jul 1, 2025 by jvlunteren Loading…
7
Add support for Prithvi geospatial model in serving mode documentation Improvements or additions to documentation frontend multi-modality Related to multi-modality (#4194) needs-rebase structured-output v1
#20307 opened Jul 1, 2025 by mgazz • Draft
1 of 4 tasks
8
[doc] quark_mxfp4_introduction documentation Improvements or additions to documentation
#20306 opened Jul 1, 2025 by lihaoyang-amd • Draft
4
[Feature] Support Minimax-M1 function calls features documentation Improvements or additions to documentation frontend tool-calling
#20297 opened Jul 1, 2025 by qscqesze Loading…
8
Enable fp8 kv cache on rocm aiter backend. rocm Related to AMD ROCm v1
#20295 opened Jul 1, 2025 by fsx950223 • Draft
4 tasks
6
[Hardware][RISC-V] Add RISC-V architecture cpu inference support ci/build
#20292 opened Jul 1, 2025 by huangzhengx Loading…
9
Enable group size 64 for Machete
#20290 opened Jul 1, 2025 by czhu-cohere Loading…
3 of 4 tasks
5
[Model] Adds support for SlimMoE models Phi-tiny-MoE-instruct
#20286 opened Jun 30, 2025 by zichongli5 Loading…
3 of 4 tasks
4
[Misc][Doc] Add missing comment for LLM frontend
#20285 opened Jun 30, 2025 by draftbk Loading…
1 of 4 tasks
3
Support DeepSeekV3-style block FP8 quantization with CT quantization
#20279 opened Jun 30, 2025 by mgoin Loading…
21
[TPU] Temporary fix vmem oom for long model len by reducing page size ready ONLY add when PR is ready to merge/full CI is needed tpu Related to Google TPUs v1
#20278 opened Jun 30, 2025 by Chenyaaang Loading…
4
[Docs] use uv in GPU installation docs documentation Improvements or additions to documentation
#20277 opened Jun 30, 2025 by davidxia Loading…
8
[Bugfix][Frontend]: Fix API server connection refused on wsl2 frontend
#20275 opened Jun 30, 2025 by Chen-zexi Loading…
3 of 4 tasks
5
Dummy commit
#20273 opened Jun 30, 2025 by dhonnappa-amd Loading…
4
[Bugfix] Fix None value handling in trace span creation for cancelled requests
#20272 opened Jun 30, 2025 by br4mm Loading…
3 of 4 tasks
5
[Refactor] Refactor import utils frontend multi-modality Related to multi-modality (#4194) performance Performance-related issues speculative-decoding structured-output tool-calling v1
#20269 opened Jun 30, 2025 by yewentao256 Loading…
1
10
[Benchmark] Add benchmark tool for multi turn conversations performance Performance-related issues
#20267 opened Jun 30, 2025 by pliops-daniels Loading…
2
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.