We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent bec8afa commit 2740c11Copy full SHA for 2740c11
vllm/model_executor/layers/rotary_embedding/base.py
@@ -146,7 +146,8 @@ def forward_hip(
146
else:
147
# ops.rotary_embedding() is an in-place operation
148
# that updates the query and key tensors.
149
- self.forward_cuda(positions, query, key)
+ # FIXME: self.forward_cuda is not a in-place operation in eager mode.
150
+ return self.forward_cuda(positions, query, key)
151
return query, key
152
153
def forward_xpu(
0 commit comments