Skip to content

Commit

Permalink
fix typo
Browse files Browse the repository at this point in the history
  • Loading branch information
Wanglongzhi2001 committed Jan 9, 2025
1 parent 934e8d8 commit ae57a2b
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion llm/server/server/engine/infer.py
Original file line number Diff line number Diff line change
Expand Up @@ -508,7 +508,6 @@ def run(self):
self.share_inputs['infer_seed'].add_(infer_seed_increment)
self.share_inputs['infer_seed'][:] %= self.MAX_INFER_SEED
if self.free_list_len > 0:
logger.info('You got into step CUDA!!!')
self.step_cuda(seq_lens_this_time)


Expand Down

0 comments on commit ae57a2b

Please sign in to comment.