[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

Isotr0py · 2025-10-15T11:32:38Z

Purpose

Part fo [Feature]: Clean up vllm.utils #26900
Split pytorch related helper functions into single file

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist

The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
The test plan, such as providing test command.
The test results, such as pasting the results comparison before and after, or e2e results
(Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
(Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify · 2025-10-15T15:23:13Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @Isotr0py.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Signed-off-by: isotr0py <2037008807@qq.com>

mergify · 2025-10-16T08:47:49Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @Isotr0py.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

Signed-off-by: isotr0py <2037008807@qq.com>

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Signed-off-by: isotr0py <2037008807@qq.com>

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify · 2025-10-18T05:56:06Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @Isotr0py.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify · 2025-10-18T13:58:10Z

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @Isotr0py.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

…ct#26908) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: isotr0py <2037008807@qq.com>

…ct#26908) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: isotr0py <2037008807@qq.com> Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>

…ct#26908) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: isotr0py <2037008807@qq.com> Signed-off-by: xuebwang-amd <xuebwang@amd.com>

### What this PR does / why we need it? Upgrade to new vllm commit: vllm-project/vllm@c9461e0 - Fix many imports, caused by vllm-project/vllm#26908 - Fix import ```sha256```, caused by vllm-project/vllm#27169 - Remove ```SchedulerConfig.send_delta_data```, caused by vllm-project/vllm#27142 - Fix ```FusedMoE``` because of dual stream execution, caused by vllm-project/vllm#26440 ### Does this PR introduce _any_ user-facing change? N/A ### How was this patch tested? CI passed with new added/existing test. - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a --------- Signed-off-by: MengqingCao <cmq0113@163.com> Signed-off-by: Icey <1790571317@qq.com> Co-authored-by: MengqingCao <cmq0113@163.com>

### What this PR does / why we need it? Upgrade to new vllm commit: vllm-project/vllm@c9461e0 - Fix many imports, caused by vllm-project/vllm#26908 - Fix import ```sha256```, caused by vllm-project/vllm#27169 - Remove ```SchedulerConfig.send_delta_data```, caused by vllm-project/vllm#27142 - Fix ```FusedMoE``` because of dual stream execution, caused by vllm-project/vllm#26440 ### Does this PR introduce _any_ user-facing change? N/A ### How was this patch tested? CI passed with new added/existing test. - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a --------- Signed-off-by: MengqingCao <cmq0113@163.com> Signed-off-by: Icey <1790571317@qq.com> Co-authored-by: MengqingCao <cmq0113@163.com> Signed-off-by: nwpu-zxr <zhouxuerong2@huawei.com>

…ct#26908) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: isotr0py <2037008807@qq.com> Signed-off-by: 0xrushi <6279035+0xrushi@users.noreply.github.com>

Isotr0py and others added 2 commits October 7, 2025 20:59

draft

3765f9f

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Merge branch 'vllm-project:main' into torch-utils

41cd6e9

mergify bot added deepseek Related to DeepSeek models multi-modality Related to multi-modality (#4194) tpu Related to Google TPUs labels Oct 15, 2025

mergify bot assigned sangstar Oct 15, 2025

update mop context

7dffb1e

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot added the v1 label Oct 15, 2025

mergify bot added the needs-rebase label Oct 15, 2025

Isotr0py added 2 commits October 15, 2025 23:25

update

20876be

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Merge remote-tracking branch 'upstream/main' into torch-utils

ea5ad7a

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot removed the needs-rebase label Oct 15, 2025

move STR_DTYPE_TO_TORCH_DTYPE and kv_caches utils

a4ac619

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot added the performance Performance-related issues label Oct 15, 2025

move current_stream

47601ee

Signed-off-by: isotr0py <2037008807@qq.com>

mergify bot added the kv-connector label Oct 16, 2025

move cuda_device_count_stateless

7cacad0

Signed-off-by: isotr0py <2037008807@qq.com>

mergify bot added the rocm Related to AMD ROCm label Oct 16, 2025

mergify bot added the needs-rebase label Oct 16, 2025

Merge remote-tracking branch 'upstream/main' into torch-utils

eaa7a95

Signed-off-by: isotr0py <2037008807@qq.com>

mergify bot removed the needs-rebase label Oct 16, 2025

Isotr0py added 2 commits October 16, 2025 21:27

weak_ref_tensors and get_cuda_view_from_cpu_tensor

b97b512

Signed-off-by: isotr0py <2037008807@qq.com>

move torch verison helper and ops registration

8648ac2

Signed-off-by: isotr0py <2037008807@qq.com>

mergify bot added llama Related to Llama models qwen Related to Qwen models labels Oct 16, 2025

Isotr0py and others added 3 commits October 16, 2025 22:36

rename torch_utils.py to torch.py

b0853f8

Signed-off-by: isotr0py <2037008807@qq.com>

fix import

32923fd

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

rename back to torch_utils to avoid conflicts

9a78766

Signed-off-by: isotr0py <2037008807@qq.com>

mergify bot removed the needs-rebase label Oct 17, 2025

Isotr0py added 2 commits October 18, 2025 00:58

Merge branch 'main' into torch-utils

e67b2f1

fix

6655659

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot added the needs-rebase label Oct 18, 2025

Merge remote-tracking branch 'upstream/main' into torch-utils

515c98c

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot removed the needs-rebase label Oct 18, 2025

Merge remote-tracking branch 'upstream/main' into torch-utils

218714e

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot added the needs-rebase label Oct 18, 2025

Merge remote-tracking branch 'upstream/main' into torch-utils

81c925c

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot removed the needs-rebase label Oct 18, 2025

move kv_cache_dtype_str_to_dtype

2c28a3a

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

vllm-bot merged commit 6ac5e06 into vllm-project:main Oct 18, 2025
74 of 76 checks passed

Isotr0py deleted the torch-utils branch October 18, 2025 17:15

dongbo910220 mentioned this pull request Oct 18, 2025

[Chore] Separate out hashing utilities from vllm.utils #27151

Merged

wxsIcey mentioned this pull request Oct 20, 2025

[main] Fix main to vllm newer commit vllm-project/vllm-ascend#3544

Closed

lywa1998 pushed a commit to lywa1998/vllm that referenced this pull request Oct 20, 2025

[Chore] Clean up pytorch helper functions in vllm.utils (vllm-proje…

dfa953f

…ct#26908) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: isotr0py <2037008807@qq.com>

maobaolong mentioned this pull request Oct 20, 2025

[FIX][Adapt_vllm] Fix ci failed by get_kv_cache_torch_dtype missed LMCache/LMCache#1833

Merged

adabeyta pushed a commit to adabeyta/vllm that referenced this pull request Oct 20, 2025

[Chore] Clean up pytorch helper functions in vllm.utils (vllm-proje…

47e208d

…ct#26908) Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: isotr0py <2037008807@qq.com>

This was referenced Oct 23, 2025

Upgrade to new vllm commit and Refactor DeepSeekV3.2 vllm-project/vllm-ascend#3644

Closed

Upgrade to new vllm commit vllm-project/vllm-ascend#3663

Closed

wxsIcey mentioned this pull request Oct 24, 2025

Upgrade to new vllm commit vllm-project/vllm-ascend#3719

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

Uh oh!

Isotr0py commented Oct 15, 2025 •

edited by github-actions bot

Loading

Uh oh!

mergify bot commented Oct 15, 2025

Uh oh!

mergify bot commented Oct 16, 2025

Uh oh!

mergify bot commented Oct 18, 2025

Uh oh!

mergify bot commented Oct 18, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Uh oh!

[Chore] Clean up pytorch helper functions in vllm.utils #26908

[Chore] Clean up pytorch helper functions in vllm.utils #26908

Uh oh!

Conversation

Isotr0py commented Oct 15, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Test Plan

Test Result

Uh oh!

mergify bot commented Oct 15, 2025

Uh oh!

mergify bot commented Oct 16, 2025

Uh oh!

mergify bot commented Oct 18, 2025

Uh oh!

mergify bot commented Oct 18, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

[Chore] Clean up pytorch helper functions in `vllm.utils` #26908

Isotr0py commented Oct 15, 2025 •

edited by github-actions bot

Loading