Skip to content

Conversation

@zzzzwwjj
Copy link
Collaborator

What this PR does / why we need it?

fix ascend_scheduler with v0.9.0

Does this PR introduce any user-facing change?

If you don't want to open chunked-prefill and fallback to v0engine's scheduler, you can init LLM with param: additional_config={'ascend_scheduler_config': {}}.

Now ascend_scheduler can't support with prefix_cache, so you need to add param: enable_prefix_caching=False to close it.
ascend_scheduler can't support with PD Disaggreate and mtp.

How was this patch tested?

Signed-off-by: zzzzwwjj <1183291235@qq.com>
@wangxiyuan
Copy link
Collaborator

this pr can be closed now, it has been fixed here #839

@zzzzwwjj zzzzwwjj closed this Jun 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants