Skip to content

Conversation

@zhuohan123
Copy link
Member

@zhuohan123 zhuohan123 commented May 19, 2023

Fix #77

@zhuohan123 zhuohan123 requested a review from WoosukKwon May 19, 2023 18:57
Copy link
Collaborator

@WoosukKwon WoosukKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks!

@zhuohan123 zhuohan123 merged commit 7297fa6 into main May 20, 2023
@zhuohan123 zhuohan123 deleted the cleanup-megatron branch May 24, 2023 04:40
dtrifiro added a commit to dtrifiro/vllm that referenced this pull request Jul 30, 2024
…with-main

Sync release with main for RHOAI 2.12
mht-sharma pushed a commit to mht-sharma/vllm that referenced this pull request Aug 1, 2024
* Putting server and LLM on different processes

* result queues cleanup

* Syncing server start with LLM init

* Renamed model to protocol to match the original endpoint

* Formatting

* Removing tuning parameters that are no longer used

* process spawn method from env

* Cleanup and refactor

* Where did this come from?

* mypy much

* One unhappy linter in the CI, one unhappy linter. Refactor it down, format it around, 3 unhappy linters in the CI
jikunshang pushed a commit to jikunshang/vllm that referenced this pull request Aug 15, 2024
Co-authored-by: Krzysztof Laskowski <klaskowski@habana.ai>
Bounty-hunter pushed a commit to Bounty-hunter/vllm that referenced this pull request Nov 4, 2025
* # This is a combination of 6 commits.
# This is the 1st commit message:

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

# This is the commit message vllm-project#2:

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

# This is the commit message vllm-project#3:

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

# This is the commit message vllm-project#4:

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

# This is the commit message vllm-project#5:

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

# This is the commit message vllm-project#6:

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

* mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

* mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

mooncake store connector

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>

fix comments

* Update vllm/distributed/ec_transfer/utils/tensor_memory_pool.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update vllm/distributed/ec_transfer/ec_lookup_buffer/mooncake_store.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update vllm/distributed/ec_transfer/ec_connector/mooncake_storage_connector.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Apply suggestion from @wuhang2014

line length format

* Apply suggestion from @wuhang2014

remove extra empty line

---------

Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>
Co-authored-by: wuhang <whlbx@hotmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Clean up Megatron-LM code

3 participants