Skip to content

Set truncate_prompt_tokens in SamplingParams, silently truncating very large prompts and preventing vllm from throwing exception#198

Merged
yanxi-chen merged 3 commits intoagentscope-ai:mainfrom
vadimkantorov:main
Aug 20, 2025
Merged

Set truncate_prompt_tokens in SamplingParams, silently truncating very large prompts and preventing vllm from throwing exception#198
yanxi-chen merged 3 commits intoagentscope-ai:mainfrom
vadimkantorov:main

Commits

Commits on Aug 20, 2025

Comments