Skip to content

automatically set max_batch_size according to the device when it is not specified#2434

Merged
lvhan028 merged 5 commits intoInternLM:mainfrom lvhan028:auto-max-batch-sizeSep 9, 2024
+83-46

Commits

Commits on Sep 7, 2024

Commits on Sep 9, 2024