Skip to content

Commit f8bf2e9

Browse files
lihaoyang-amdilmarkov
authored andcommitted
change comment
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
1 parent 4e2cfc4 commit f8bf2e9

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/distributed/device_communicators/custom_all_reduce.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -286,8 +286,8 @@ def init_custom_quick_allreduce(self):
286286
self.create_qr_shared_buffer()
287287
if dtype == torch.bfloat16 and not self.use_fp16_kernels:
288288
logger.info(
289-
"Custom quick allreduce: converting bf16 to fp16 "
290-
"can speed up qr, "
289+
"Custom quick allreduce: converting bf16 inputs to "
290+
"fp16 can improve performance"
291291
"set envs.VLLM_ROCM_QR_CAST_BF16_TO_FP16=1 to turn on.")
292292
self.qr_disabled = False
293293

0 commit comments

Comments
 (0)