[CI] Fix Nightly Failures #17997
[CI] Fix Nightly Failures #17997
Conversation
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add 🚀 |
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
robertgshaw2-redhat
requested review from
LiuXiaoxuanPKU and
njhill
as code owners
robertgshaw2-redhat
requested review from
DarkLight1337 and
ywang96
as code owners
| # TODO(@darklight): Remove this skip once the CI is fixed. | ||
| pytest.skip(reason=("Failing in the CI due to env variable mismatch. " | ||
| "Setting the XFORMERS does not seem to be working " | ||
| "in the CI environment properly."), | ||
| allow_module_level=True) |
There was a problem hiding this comment.
Honestly I have no idea why this is happening. The test passes locally...
There was a problem hiding this comment.
Its due to some env variable getting set that overrides the attn backend gloablly
|
This pull request has merge conflicts that must be resolved before it can be |
| "ATTN_BACKEND", | ||
| [ | ||
| "FLASH_ATTN", | ||
| # "FLASHINFER", @mgoin is looking at this. |
|
This pull request has merge conflicts that must be resolved before it can be |
3 participants
SUMMARY: