I use aiter main branch directly. _Originally posted by @fsx950223 in https://github.com/vllm-project/vllm/issues/17710#issuecomment-2888023848_