Skip to content

[Bug][main]: vllm (main) serve failed due to quantization choice haven't init #1042

@Yikun

Description

@Yikun

Your current environment

The output of `python collect_env.py`
Your output of above commands here

🐛 Describe the bug

Traceback (most recent call last):
  File "/usr/local/python3.10.17/bin/vllm", line 8, in <module>
    sys.exit(main())
  File "/__w/vllm-ascend/vllm-ascend/vllm-empty/vllm/entrypoints/cli/main.py", line 50, in main
    cmd.subparser_init(subparsers).set_defaults(
  File "/__w/vllm-ascend/vllm-ascend/vllm-empty/vllm/entrypoints/cli/serve.py", line 101, in subparser_init
    serve_parser = make_arg_parser(serve_parser)
  File "/__w/vllm-ascend/vllm-ascend/vllm-empty/vllm/entrypoints/openai/cli_args.py", line 246, in make_arg_parser
    parser = AsyncEngineArgs.add_cli_args(parser)
  File "/__w/vllm-ascend/vllm-ascend/vllm-empty/vllm/engine/arg_utils.py", line 1[57](https://github.com/vllm-project/vllm-ascend/actions/runs/15357519122/job/43219462384#step:10:58)4, in add_cli_args
    current_platform.pre_register_and_update(parser)
  File "/__w/vllm-ascend/vllm-ascend/vllm_ascend/platform.py", line 79, in pre_register_and_update
    if ASCEND_QUATIZATION_METHOD not in quant_action.choices:
TypeError: argument of type 'NoneType' is not iterable

https://github.com/vllm-project/vllm-ascend/actions/runs/15357519122/job/43219462384

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions