Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[do-not-merge] Ibm dev rebuild #254

Open
wants to merge 42 commits into
base: main
Choose a base branch
from
Open

[do-not-merge] Ibm dev rebuild #254

wants to merge 42 commits into from

Conversation

fialhocoelho
Copy link

To trigger img build.

simon-mo and others added 30 commits November 15, 2024 12:47
@simon-mo
[Docs] Add Nebius as sponsors (vllm-project#10371)
c76ac49 
Signed-off-by: simon-mo <simon.mo@hey.com>
@russellb
[Frontend] Add --version flag to CLI (vllm-project#10369)
a067f85 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
@russellb
[Doc] Move PR template content to docs (vllm-project#10159)
3e8d14d 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
@mikegre-google
[Docs] Misc updates to TPU installation instructions (vllm-project#10165
4f168f6 
)
@DarkLight1337
[Frontend] Automatic detection of chat content format from AST (vllm-…
32e46e0 
…project#9919)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@youkaichao
[doc] add doc for the plugin system (vllm-project#10372)
755b853 
Signed-off-by: youkaichao <youkaichao@gmail.com>
@youkaichao
[misc][plugin] improve log messages (vllm-project#10386)
2f427c2 
Signed-off-by: youkaichao <youkaichao@gmail.com>
@rasmith
[BugFix] [Kernel] Fix GPU SEGV occuring in fused_moe kernel (vllm-pro…
1d75472 
…ject#10385)

Signed-off-by: Randall Smith <Randall.Smith@amd.com>
@kakao-steve-ai
[Misc] Update benchmark to support image_url file or http (vllm-proje…
8b6725b 
…ct#10287)

Signed-off-by: rbbang <anjaehyun87@gmail.com>
@skylee-01
[Misc] Medusa supports custom bias (vllm-project#10361)
b98d89e
@imkero
[Bugfix] Fix M-RoPE position calculation when chunked prefill is enab…
361c29e 
…led (vllm-project#10388)

Signed-off-by: imkero <kerorek@outlook.com>
@WoosukKwon
[V1] Add code owners for V1 (vllm-project#10397)
661a34f 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
@youkaichao
[2/N][torch.compile] make compilation cfg part of vllm cfg (vllm-proj…
4fd9375 
…ect#10383)

Signed-off-by: youkaichao <youkaichao@gmail.com>
@ywang96
[V1] Refactor model executable interface for all text-only language m…
643ecf7 
…odels (vllm-project#10374)

Signed-off-by: Roger Wang <ywang@roblox.com>
@xuechendi
[CI/Build] Fix IDC hpu [Device not found] issue (vllm-project#10384)
905d0f0 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
@Isotr0py
[Bugfix][CPU] Fix CPU embedding runner with tensor parallel (vllm-pro…
cf349c4 
…ject#10394)

Signed-off-by: Isotr0py <2037008807@qq.com>
@youkaichao
[platforms] refactor cpu code (vllm-project#10402)
8d74b5a 
Signed-off-by: youkaichao <youkaichao@gmail.com>
@jikunshang
[Hardware] [HPU]add mark_step for hpu (vllm-project#10239)
76aab90 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
@imkero
[Bugfix] Fix mrope_position_delta in non-last prefill chunk (vllm-pro…
80d85c5 
…ject#10403)

Signed-off-by: imkero <kerorek@outlook.com>
@wchen61
[Misc] Enhance offline_inference to support user-configurable paramet… (
d1557e6 
vllm-project#10392)

Signed-off-by: wchen61 <wchen61@foxmail.com>
@Isotr0py
[Misc] Add uninitialized params tracking for AutoWeightsLoader (vll…
c4e4643 
…m-project#10327)

Signed-off-by: Isotr0py <2037008807@qq.com>
@HollowMan6
[Bugfix] Ignore ray reinit error when current platform is ROCm or XPU (…
47826ca 
…vllm-project#10375)

Signed-off-by: Hollow Man <hollowman@opensuse.org>
@youkaichao
[4/N][torch.compile] clean up set_torch_compile_backend (vllm-project…
51bb12d 
…#10401)

Signed-off-by: youkaichao <youkaichao@gmail.com>
@lk-chen
[VLM] Report multi_modal_placeholders in output (vllm-project#10407)
c7dec92 
Signed-off-by: Linkun Chen <lkchen+anyscale@github.com>
@Maybewuss
[Model] Remove redundant softmax when using PoolingType.STEP (vllm-pr…
01aae1c 
…oject#10415)
@B-201
[Model][LoRA]LoRA support added for glm-4v (vllm-project#10418)
5be4e52 
Signed-off-by: B-201 <Joy25810@foxmail.com>
@Isotr0py
[Model] Remove transformers attention porting in VITs (vllm-project#1…
e7ebb66 
…0414)

Signed-off-by: Isotr0py <2037008807@qq.com>
@B-201
[Doc] Update doc for LoRA support in GLM-4V (vllm-project#10425)
4186be8 
Signed-off-by: B-201 <Joy25810@foxmail.com>
@youkaichao
[5/N][torch.compile] torch.jit.script --> torch.compile (vllm-project…
7851b45 
…#10406)

Signed-off-by: youkaichao <youkaichao@gmail.com>
@ismael-dm
[Doc] Add documentation for Structured Outputs (vllm-project#9943)
31894a2 
Signed-off-by: ismael-dm <ismaeldm99@gmail.com>
andrew and others added 12 commits November 18, 2024 09:52
@andrew
Fix open_collective value in FUNDING.yml (vllm-project#10426)
4f686d1 
Signed-off-by: Andrew Nesbitt <andrewnez@gmail.com>
@mgoin
[Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)
281cc4b 
Signed-off-by: mgoin <michael@neuralmagic.com>
@yma11
[Hardware][XPU] AWQ/GPTQ support for xpu backend (vllm-project#10107)
6b2d25e 
Signed-off-by: yan ma <yan.ma@intel.com>
@angusYuhao
[Kernel] Explicitly specify other value in tl.load calls (vllm-projec…
c2170a5 
…t#9014)

Signed-off-by: Angus Wang <wangjadehao@gmail.com>
@LucasWilkinson
[Kernel] Initial Machete W4A8 support + Refactors (vllm-project#9855)
96d999f 
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
3444895 
…20241118

Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 9522
e58ac91 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 6357
9223ac3 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 10235
b715908 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 10400
6aa7422 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 10430
565cfcc 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
pin mistral and install adapter from branch 🚀
049cf55 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho fialhocoelho requested a review from njhill as a code owner December 2, 2024 22:22
@openshift-merge-robot
Copy link

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@openshift-ci openshift-ci bot requested review from heyselbi and NickLucche December 2, 2024 22:22
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Dec 2, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fialhocoelho
Once this PR has been reviewed and has the lgtm label, please assign terrytangyuan for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Dec 2, 2024

@fialhocoelho: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/rocm-pr-image-mirror 049cf55 link true /test rocm-pr-image-mirror
ci/prow/cuda-pr-image-mirror 049cf55 link true /test cuda-pr-image-mirror
ci/prow/images 049cf55 link true /test images
ci/prow/smoke-test 049cf55 link true /test smoke-test

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@njhill njhill Awaiting requested review from njhill njhill is a code owner

@heyselbi heyselbi Awaiting requested review from heyselbi

@NickLucche NickLucche Awaiting requested review from NickLucche

Assignees
No one assigned
Labels
needs-rebase
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.