-
Notifications
You must be signed in to change notification settings - Fork 688
Closed
Labels
bugSomething isn't workingSomething isn't workinggood first issueGood for newcomersGood for newcomers
Description
Describe the Bug
As titled, using the current latest vllm patch 0.10.2. The following warnings would be emitted.
2025-09-22T20:41:39.574150Z WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `13360216285664366642`, expected i64
2025-09-22T20:41:39.604077Z WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `17902732804607437140`, expected i64
2025-09-22T20:41:39.628185Z WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `15765887992743536090`, expected i64
2025-09-22T20:41:39.634966Z WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `9785811643504054785`, expected i64
2025-09-22T20:41:39.654848Z WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `9285426219697592752`, expected i64
2025-09-22T20:41:39.745116Z WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `9931421009535857991`, expected i64
2025-09-22T20:41:39.769742Z WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid length 2, expected 1 element in sequence
Steps to Reproduce
Run dynamo/components/backends/vllm/launch/agg_router.sh and send some requests to trigger this behavior
Expected Behavior
Should not have warnings
Actual Behavior
Has warnings
Environment
dynamo env didn't work for me
Additional Context
Using the latest vllm patch to better support disagg
Screenshots
No response
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workinggood first issueGood for newcomersGood for newcomers