[Chore] Separate out `vllm.utils.import_utils` #27022

DarkLight1337 · 2025-10-16T12:51:12Z

Purpose

vllm.utils.import_from_path -> vllm.utils.import_utils.import_from_path
vllm.utils.resolve_obj_by_qualname -> vllm.utils.import_utils.resolve_obj_by_qualname
vllm.utils.get_vllm_optional_dependencies -> vllm.utils.import_utils.get_vllm_optional_dependencies
vllm.utils.PlaceholderModule -> vllm.utils.import_utils.PlaceholderModule
vllm.utils.LazyLoader -> vllm.utils.import_utils.LazyLoader

Originally I thought about moving the _has_module-based functions here as well, but I decided they are better suited to be grouped with pytorch utils.

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist

The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
The test plan, such as providing test command.
The test results, such as pasting the results comparison before and after, or e2e results
(Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
(Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

russellb · 2025-10-16T14:14:02Z

looks like you have a doc build error:

WARNING -  mkdocs_autorefs: api/vllm/utils/import_utils.md: from /home/docs/checkouts/readthedocs.org/user_builds/vllm/checkouts/27022/vllm/utils/import_utils.py:67: (vllm.utils.import_utils._PlaceholderBase) Could not find cross-reference target 'vllm.utils._PlaceholderBase.__getattr__'

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

DarkLight1337 · 2025-10-16T14:33:23Z

Fixed

njhill · 2025-10-16T16:59:29Z

How about vllm.utils.imports?

DarkLight1337 · 2025-10-16T17:04:16Z

Renaming to import_utils since it causes conflicts with the std importlib library

Because of this I think we need to rename the other utils as well. Let's do that in another PR. Any suggestions on names?

yewentao256

LGTM, thanks for the work!

njhill · 2025-10-16T20:43:53Z

Renaming to import_utils since it causes conflicts with the std importlib library

Because of this I think we need to rename the other utils as well. Let's do that in another PR. Any suggestions on names?

The clash is with importlib though right? imports should be ok I think?

May be personal preference but I think vllm.utils.abc is better than vllm.utils.abc_utils.

DarkLight1337 · 2025-10-17T02:45:07Z

I am referring to the other utils like vllm.utils.asyncio and vllm.utils.functools

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Culprit commit: vllm-project/vllm#27022 --------- Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Culprit commit: vllm-project/vllm#27022 --------- Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>

### What this PR does / why we need it? This is the step 1 of refactoring code to adapt with vllm main, and this pr aligned with vllm-project/vllm@17c540a 1. refactor deepseek to the latest code arch as of vllm-project/vllm@17c540a 2. bunches of fixes due to vllm changes - Fix `AscendScheduler` `__post_init__`, caused by vllm-project/vllm#25075 - Fix `AscendScheduler` init got an unexpected arg `block_size`, caused by vllm-project/vllm#26296 - Fix `KVCacheManager` `get_num_common_prefix_blocks` arg, caused by vllm-project/vllm#23485 - Fix `MLAAttention` import,caused by vllm-project/vllm#25103 - Fix `SharedFusedMoE` import, caused by vllm-project/vllm#26145 - Fix `LazyLoader` improt, caused by vllm-project/vllm#27022 - Fix `vllm.utils.swap_dict_values` improt, caused by vllm-project/vllm#26990 - Fix `Backend` enum import, caused by vllm-project/vllm#25893 - Fix `CompilationLevel` renaming to `CompilationMode` issue introduced by vllm-project/vllm#26355 - Fix fused_moe ops, caused by vllm-project/vllm#24097 - Fix bert model because of `inputs_embeds`, caused by vllm-project/vllm#25922 - Fix MRope because of `get_input_positions_tensor` to `get_mrope_input_positions`, caused by vllm-project/vllm#24172 - Fix `splitting_ops` changes introduced by vllm-project/vllm#25845 - Fix multi-modality changes introduced by vllm-project/vllm#16229 - Fix lora bias dropping issue introduced by vllm-project/vllm#25807 - Fix structured ouput break introduced by vllm-project/vllm#26737 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? CI passed with existing test. - vLLM version: v0.11.0rc3 - vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0 --------- Signed-off-by: MengqingCao <cmq0113@163.com> Signed-off-by: Icey <1790571317@qq.com> Co-authored-by: Icey <1790571317@qq.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: xuebwang-amd <xuebwang@amd.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: 0xrushi <6279035+0xrushi@users.noreply.github.com>

[Chore] Separate out vllm.utils.importlib

42c8b0e

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

DarkLight1337 requested a review from Isotr0py October 16, 2025 12:51

DarkLight1337 added the ready ONLY add when PR is ready to merge/full CI is needed label Oct 16, 2025

mergify bot added frontend multi-modality Related to multi-modality (#4194) performance Performance-related issues structured-output v1 labels Oct 16, 2025

github-project-automation bot added this to Structured Output Oct 16, 2025

Rename

5b42ca9

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Fix doc

cde7b8e

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

russellb approved these changes Oct 16, 2025

View reviewed changes

yewentao256 approved these changes Oct 16, 2025

View reviewed changes

aarnphm approved these changes Oct 16, 2025

View reviewed changes

DarkLight1337 merged commit 4d4d6ba into vllm-project:main Oct 17, 2025
65 checks passed

DarkLight1337 deleted the separate-utils-importlib branch October 17, 2025 00:49

github-project-automation bot moved this to Done in Tool Calling Oct 17, 2025

github-project-automation bot moved this to Done in Structured Output Oct 17, 2025

wxsIcey mentioned this pull request Oct 17, 2025

[CI] Upgrade vllm to newest commit vllm-project/vllm-ascend#3423

Closed

Zhuul pushed a commit to Zhuul/vllm that referenced this pull request Oct 17, 2025

[Chore] Separate out vllm.utils.importlib (vllm-project#27022)

d4b599c

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

adobrzyn mentioned this pull request Oct 17, 2025

[FIX_FOR_VLLM_LATEST] Fix for #27022 vllm-project/vllm-gaudi#418

Merged

xuechendi pushed a commit to vllm-project/vllm-gaudi that referenced this pull request Oct 18, 2025

[FIX_FOR_VLLM_LATEST] Fix for #27022 (#418)

b8ded81

Culprit commit: vllm-project/vllm#27022 --------- Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>

DarkLight1337 mentioned this pull request Oct 19, 2025

[Misc] Move utils to avoid conflicts with stdlib, and move tests #27169

Merged

5 tasks

lywa1998 pushed a commit to lywa1998/vllm that referenced this pull request Oct 20, 2025

[Chore] Separate out vllm.utils.importlib (vllm-project#27022)

7e5e4fd

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

MengqingCao mentioned this pull request Oct 22, 2025

[1/N][Refactor] Refactor code to adapt with vllm main vllm-project/vllm-ascend#3612

Merged

albertoperdomo2 pushed a commit to albertoperdomo2/vllm that referenced this pull request Oct 23, 2025

[Chore] Separate out vllm.utils.importlib (vllm-project#27022)

223647b

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>

alhridoy pushed a commit to alhridoy/vllm that referenced this pull request Oct 24, 2025

[Chore] Separate out vllm.utils.importlib (vllm-project#27022)

7f36b9d

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

hlahkar pushed a commit to hlahkar/vllm-gaudi that referenced this pull request Oct 24, 2025

[FIX_FOR_VLLM_LATEST] Fix for #27022 (vllm-project#418)

5883300

Culprit commit: vllm-project/vllm#27022 --------- Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>

xuebwang-amd pushed a commit to xuebwang-amd/vllm that referenced this pull request Oct 24, 2025

[Chore] Separate out vllm.utils.importlib (vllm-project#27022)

9515d6e

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: xuebwang-amd <xuebwang@amd.com>

xuebwang-amd pushed a commit to xuebwang-amd/vllm that referenced this pull request Oct 24, 2025

[Chore] Separate out vllm.utils.importlib (vllm-project#27022)

a22dd50

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: xuebwang-amd <xuebwang@amd.com>

0xrushi pushed a commit to 0xrushi/vllm that referenced this pull request Oct 26, 2025

[Chore] Separate out vllm.utils.importlib (vllm-project#27022)

fb84a87

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: 0xrushi <6279035+0xrushi@users.noreply.github.com>

0xrushi pushed a commit to 0xrushi/vllm that referenced this pull request Oct 26, 2025

[Chore] Separate out vllm.utils.importlib (vllm-project#27022)

491cdab

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: 0xrushi <6279035+0xrushi@users.noreply.github.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[Chore] Separate out `vllm.utils.import_utils` #27022

[Chore] Separate out `vllm.utils.import_utils` #27022

Uh oh!

DarkLight1337 commented Oct 16, 2025 •

edited by github-actions bot

Loading

Uh oh!

russellb commented Oct 16, 2025

Uh oh!

DarkLight1337 commented Oct 16, 2025

Uh oh!

njhill commented Oct 16, 2025

Uh oh!

DarkLight1337 commented Oct 16, 2025 •

edited

Loading

Uh oh!

yewentao256 left a comment

Uh oh!

njhill commented Oct 16, 2025

Uh oh!

Uh oh!

DarkLight1337 commented Oct 17, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

Uh oh!

[Chore] Separate out vllm.utils.import_utils #27022

[Chore] Separate out vllm.utils.import_utils #27022

Uh oh!

Conversation

DarkLight1337 commented Oct 16, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Test Plan

Test Result

Uh oh!

russellb commented Oct 16, 2025

Uh oh!

DarkLight1337 commented Oct 16, 2025

Uh oh!

njhill commented Oct 16, 2025

Uh oh!

DarkLight1337 commented Oct 16, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

yewentao256 left a comment

Choose a reason for hiding this comment

Uh oh!

njhill commented Oct 16, 2025

Uh oh!

Uh oh!

DarkLight1337 commented Oct 17, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

[Chore] Separate out `vllm.utils.import_utils` #27022

[Chore] Separate out `vllm.utils.import_utils` #27022

DarkLight1337 commented Oct 16, 2025 •

edited by github-actions bot

Loading

DarkLight1337 commented Oct 16, 2025 •

edited

Loading