Add Splitwise implementation to vLLM#2809

aashaka wants to merge 6 commits intovllm-project:mainvllm-project/vllm:mainfrom

aashaka:splitwise-praashaka/vllm-oss:splitwise-prCopy head branch name to clipboard