-
-
Notifications
You must be signed in to change notification settings - Fork 11.4k
[Misc] Remove more get_input_embeddings_v0
#25857
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request continues the effort to remove dead code related to the legacy get_input_embeddings implementation. The changes correctly remove usages of merge_multimodal_embeddings and the now-unused get_input_embeddings_v0 method from several multimodal models.
My main feedback is that since the goal is to remove dead code, the merge_multimodal_embeddings function in vllm/model_executor/models/utils.py should be removed entirely rather than just being deprecated, assuming it's no longer used anywhere after this PR. This would make the cleanup more complete and align better with the PR's intent. I've left specific comments to this effect.
| import torch.nn as nn | ||
| from torch.func import functional_call | ||
| from transformers import PretrainedConfig | ||
| from typing_extensions import deprecated |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
get_input_embedddingsget_input_embeddings
get_input_embeddingsget_input_embeddings_v0
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Purpose
#25331 missed a few files
Test Plan
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.