Skip to content

Commit 007c50e

Browse files
committed
error fix
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
1 parent bddef4d commit 007c50e

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/lora/layers/logits_processor.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -105,6 +105,7 @@ def create_lora_weights(
105105
dtype=lora_config.lora_dtype,
106106
device=self.device,
107107
)
108+
self.sharded_to_full_mapping_gpu: Optional[torch.Tensor]
108109
if self.sharded_to_full_mapping is not None:
109110
self.sharded_to_full_mapping_gpu = torch.tensor(
110111
self.sharded_to_full_mapping,

0 commit comments

Comments
 (0)