Skip to content

Pull requests: vllm-project/vllm

New pull request New
691 Open 8,844 Closed
691 Open 8,844 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[doc] fix the list rendering issue - security.md documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed
#18982 opened May 31, 2025 by reidliu41 Loading…
2
[BugFix] Fix multi-node offline data-parallel bug Something isn't working documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed v1
#18981 opened May 31, 2025 by njhill Loading…
1
1
fix security issue of logging llm output frontend ready ONLY add when PR is ready to merge/full CI is needed tool-calling
#18980 opened May 31, 2025 by luccafong Loading…
4
Fix FlashMLA detection in ray environment
#18979 opened May 30, 2025 by eicherseiji Loading…
1
[Bugfix][Model] Attempt to fix eagle in V0.
#18978 opened May 30, 2025 by gshtras Loading…
6
[BugFix][V1] Fix memory profiling bug v1
#18974 opened May 30, 2025 by ProExpertProg Loading…
5
[Core] Remove unnecessary copy of multi modal input embeddings v1
#18973 opened May 30, 2025 by lgeiger Loading…
1
[V1][Spec Decode][Ngram] 1.35x gain -> 1.95x gain on InstructCoder with prompt fix
#18971 opened May 30, 2025 by ekagra-ranjan Loading…
2
Reduce logs in CLI scripts and plugin loader
#18970 opened May 30, 2025 by mgoin Loading…
1
[P/D] NixlConnector use cache device index for memory registration ready ONLY add when PR is ready to merge/full CI is needed
#18969 opened May 30, 2025 by ptarasiewiczNV Loading…
2
Let max_num_batched_tokens use human_readable_int for large numbers
#18968 opened May 30, 2025 by mgoin Loading…
1
[Performance] Replace per-tensor/token FP8 quant CUDA kernels with torch.compile
#18965 opened May 30, 2025 by mgoin • Draft
1
[Bugfix][core] Prefix caching enabled causes incorrect outputs
#18957 opened May 30, 2025 by quanliu1991 Loading…
1
1
[Misc] add return token strs for tokenize frontend
#18941 opened May 30, 2025 by reidliu41 Loading…
1
3
[Core] hybrid dtype for Pooling Models: float32 for weights and activation, float16 or bfloat16 for attention. ci/build tpu Related to Google TPUs v1
#18940 opened May 30, 2025 by noooop Loading…
1
Abstract mooncake store connector to kv store connector
#18936 opened May 30, 2025 by maobaolong Loading…
3
[Misc] reuse num_tokens_across_dp of get_dp_padding to avoid unnecessary dp all reduce in set_forward_context v1
#18935 opened May 30, 2025 by izhuhaoran Loading…
13
[Bugfix][Config] Fix config dtype get error
#18934 opened May 30, 2025 by MengqingCao Loading…
3
Adding "LoRA Test %N" to AMD production tests ci/build rocm Related to AMD ROCm
#18929 opened May 29, 2025 by Concurrensee Loading…
1
feat: add data parallel rank to KVEventBatch documentation Improvements or additions to documentation v1
#18925 opened May 29, 2025 by PeaBrane Loading…
1
10
[Neuron] Add Multi-Modal model support for Neuron documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed
#18921 opened May 29, 2025 by aws-satyajith Loading…
11
[Core] Remove int32->int64->int32 overhead in FlashInfer sampling v1
#18920 opened May 29, 2025 by lgeiger Loading…
8
[Misc] Fix path and python alias errors in disagg_prefill exmaples documentation Improvements or additions to documentation
#18919 opened May 29, 2025 by Jeffwan Loading…
1
update the arch list for Blackwell support on nightly dockerfile ci/build
#18912 opened May 29, 2025 by kushanam Loading…
1
[BugFix] Pydantic part 2 ci/build ready ONLY add when PR is ready to merge/full CI is needed
#18911 opened May 29, 2025 by ProExpertProg Loading…
5
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.