Skip to content

[BUG]: KV event publisher does not work with latest vllm #3169

@PeaBrane

Description

@PeaBrane

Describe the Bug

As titled, using the current latest vllm patch 0.10.2. The following warnings would be emitted.

2025-09-22T20:41:39.574150Z  WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `13360216285664366642`, expected i64
2025-09-22T20:41:39.604077Z  WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `17902732804607437140`, expected i64
2025-09-22T20:41:39.628185Z  WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `15765887992743536090`, expected i64
2025-09-22T20:41:39.634966Z  WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `9785811643504054785`, expected i64
2025-09-22T20:41:39.654848Z  WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `9285426219697592752`, expected i64
2025-09-22T20:41:39.745116Z  WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid value: integer `9931421009535857991`, expected i64
2025-09-22T20:41:39.769742Z  WARN dynamo_llm::kv_router::publisher: Failed to decode KVEventBatch msgpack error=invalid length 2, expected 1 element in sequence

Steps to Reproduce

Run dynamo/components/backends/vllm/launch/agg_router.sh and send some requests to trigger this behavior

Expected Behavior

Should not have warnings

Actual Behavior

Has warnings

Environment

dynamo env didn't work for me

Additional Context

Using the latest vllm patch to better support disagg

Screenshots

No response

Metadata

Metadata

Assignees

Labels

bugSomething isn't workinggood first issueGood for newcomers

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions