-
-
Couldn't load subscription status.
- Fork 10.9k
[Model][0/N] Improve all pooling task | clean up #25817
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
This pull request has merge conflicts that must be resolved before it can be |
f13cd39 to
d9cd590
Compare
|
This pull request has merge conflicts that must be resolved before it can be |
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <noooop@126.com>
|
Documentation preview: https://vllm--25817.org.readthedocs.build/en/25817/ |
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <noooop@126.com>
|
Ready for review |
Signed-off-by: wang.yuqi <noooop@126.com>
|
The pooling tests are still failing |
Signed-off-by: wang.yuqi <noooop@126.com>
After some investigation. I will delete test_bert_splade_sparse_embed_smoke because I think vllm is likely not supported for hf-internal-testing/tiny-random-bert because its head_size=8 |
|
cc @gjgjos |
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <noooop@126.com> Signed-off-by: 1994 <1994@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com> Signed-off-by: Dhruvil Bhatt <bhattdbh@amazon.com>
Signed-off-by: wang.yuqi <noooop@126.com> Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <noooop@126.com> Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Signed-off-by: wang.yuqi <noooop@126.com> Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Signed-off-by: wang.yuqi <noooop@126.com> Signed-off-by: 0xrushi <6279035+0xrushi@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com> Signed-off-by: 0xrushi <6279035+0xrushi@users.noreply.github.com>
Improve all pooling task
These PRs are mostly conflicting with each other, so combining them into a series would better inform reviewers about what happened. And what else needs to be done after that?
Purpose
Fix some minor issues found during the implementation of this series to keep subsequent PRs cleaner.
Test Plan
keep ci grean
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.