Skip to content

Commit 9ab3f61

Browse files
chaunceyjiangFeiDaLI
authored andcommitted
[P/D] MultiConnector supports shutdown (vllm-project#24425)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
1 parent e1db7e4 commit 9ab3f61

File tree

1 file changed

+12
-0
lines changed

1 file changed

+12
-0
lines changed

vllm/distributed/kv_transfer/kv_connector/v1/multi_connector.py

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -88,6 +88,18 @@ def clear_connector_metadata(self) -> None:
8888
for c in self._connectors:
8989
c.clear_connector_metadata()
9090

91+
def shutdown(self):
92+
exception: Optional[Exception] = None
93+
for c in self._connectors:
94+
try:
95+
c.shutdown()
96+
except Exception as e:
97+
logger.exception("Exception during connector %s shutdown.",
98+
c.__class__.__name__)
99+
exception = e
100+
if exception:
101+
raise exception
102+
91103
# ==============================
92104
# Worker-side methods
93105
# ==============================

0 commit comments

Comments
 (0)