Add handling of max_gen_len from mlc-llm chat_config#64

Closed

elvin-n wants to merge 3 commits intooctoml:batch-servingfrom Deelvin:amalyshe/fix_max_len_mb

+239-30

Commits on Nov 14, 2023

Commits on Nov 15, 2023

Handle proper max seq len in the staged engine
elvin-n
committed