Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[do-not-merge] Ibm 20241219 #267

Open
wants to merge 26 commits into
base: main
Choose a base branch
from
Open

[do-not-merge] Ibm 20241219 #267

wants to merge 26 commits into from

Conversation

fialhocoelho
Copy link

Internal image build.

mgoin and others added 25 commits December 17, 2024 16:34
@mgoin
[Bugfix] Set temperature=0.7 in test_guided_choice_chat (vllm-project…
c77eb8a 
…#11264)
@comaniac
[V1] Prefix caching for vision language models (vllm-project#11187)
bf8717e 
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
@kzawora-intel
[Bugfix] Restore support for larger block sizes (vllm-project#11259)
866fa45 
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
@wallashss
[Bugfix] Fix guided decoding with tokenizer mode mistral (vllm-projec…
8b79f9e 
…t#11046)
@yma11
[MISC][XPU]update ipex link for CI fix (vllm-project#11278)
f04e407
@dsikka @Faraz9877
@ilmarkov @rahul-tuli @robertgshaw2-neuralmagic
[Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (vllm-project…
60508ff 
…#10995)

Co-authored-by: Faraz Shahsavan <faraz.shahsavan@gmail.com>
Co-authored-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Rahul Tuli <rahul@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
@Isotr0py
[Bugfix] Fix broken phi3-v mm_processor_kwargs tests (vllm-project#11263
996aa70 
)

Signed-off-by: Isotr0py <2037008807@qq.com>
@simon-mo
[CI][Misc] Remove Github Action Release Workflow (vllm-project#11274)
362cff1
@jikunshang
[FIX] update openai version (vllm-project#11287)
f954fe0 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
@joerunde
[Bugfix] fix minicpmv test (vllm-project#11304)
ca5f54a 
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
@alexm-neuralmagic
[V1] VLM - enable processor cache by default (vllm-project#11305)
fdea8ec 
Signed-off-by: Alexander Matveev <alexm@neuralmagic.com>
@tlrmchlsmth
[Bugfix][Build/CI] Fix sparse CUTLASS compilation on CUDA [12.0, 12.2) (
5a9da2e 
vllm-project#11311)

Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
@tjohnson31415
[Model] IBM Granite 3.1 (vllm-project#11307)
17ca964 
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
@mgoin
[CI] Expand test_guided_generate to test all backends (vllm-project#1…
a30482f 
…1313)

Signed-off-by: mgoin <michael@neuralmagic.com>
@heheda12345
[V1] Simplify prefix caching logic by removing `num_evictable_compute…
c6b0a7d 
…d_blocks` (vllm-project#11310)
@DarkLight1337
[VLM] Merged multimodal processor for Qwen2-Audio (vllm-project#11303)
6142ef0 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@varun-sundar-rabindranath
[Kernel] Refactor Cutlass c3x (vllm-project#10049)
8936316 
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
@ruisearch42 @comaniac
[Misc] Optimize ray worker initialization time (vllm-project#11275)
f26c4ae 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
@varun-sundar-rabindranath
[misc] benchmark_throughput : Add LoRA (vllm-project#11267)
9835673 
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
@liuyanyi @DarkLight1337
[Feature] Add load generation config from model (vllm-project#11164)
5aef498 
Signed-off-by: liuyanyi <wolfsonliu@163.com>
Signed-off-by: Yanyi Liu <wolfsonliu@163.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
@DarkLight1337
[Bugfix] Cleanup Pixtral HF code (vllm-project#11333)
a0f7d53 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
@yecohn @DarkLight1337
[Model] Add JambaForSequenceClassification model (vllm-project#10860)
6c7f881 
Signed-off-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
d45405a 
…20241219
@fialhocoelho
Squash 6357
5e5307e 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho
Squash 10235
e362236 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
@fialhocoelho fialhocoelho self-assigned this Dec 19, 2024
@fialhocoelho fialhocoelho requested a review from njhill as a code owner December 19, 2024 16:05
@openshift-ci openshift-ci bot requested review from heyselbi and tarukumar December 19, 2024 16:05
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Dec 19, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fialhocoelho
Once this PR has been reviewed and has the lgtm label, please assign raghul-m for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@yecohn @joerunde @fialhocoelho
install adapter for 0.6.5 and PR#196 for adapter
27fe49e 
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
Co-authored-by: Joe Runde <Joseph.Runde@ibm.com>
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Dec 19, 2024 •
edited
Loading

@fialhocoelho: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 27fe49e link true /test smoke-test

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@njhill njhill Awaiting requested review from njhill njhill is a code owner

@heyselbi heyselbi Awaiting requested review from heyselbi

@tarukumar tarukumar Awaiting requested review from tarukumar

Assignees

@fialhocoelho fialhocoelho

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.