Search results

Does it support multi-role instances， and what is the plan?

Status: Open.

#1499 In vllm-project/aibrix;

· Ramonaaaaa opened on Aug 25, 2025

Does it support the Volcano scheduler, and what is the plan?

Status: Open.

#1498 In vllm-project/aibrix;

· Ramonaaaaa opened on Aug 25, 2025

Missing final empty chunk in chunked response when requested through gateway, but not when requested through model directly

Status: Open.

#1494 In vllm-project/aibrix;

· malsbat opened on Aug 22, 2025

kvcache offload failed for rayclusterfleet

Status: Open.

#1493 In vllm-project/aibrix;

· ltm920716 opened on Aug 22, 2025

how to set affinity for KVCache and could the cache pods use the same rdma nic with engine pod？

Status: Open.

#1492 In vllm-project/aibrix;

· ltm920716 opened on Aug 22, 2025

[follow-up] Improve Unit Test Coverage for Routing Algorithms in pkg/plugins/gateway/algorithms

area/gateway

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1485 In vllm-project/aibrix;

· googs1025 opened on Aug 20, 2025

flaky test case: TestStrategyRequiresCache + TestRandomRouting 503 Service Unavailable

area/testingIssues or PRs related to testingIssues or PRs related to testing

Status: Open.

#1482 In vllm-project/aibrix;

· Jeffwan opened on Aug 19, 2025

failed to create pod \"llm-xpyd-roleset-xxxxx" already exists, the server was not able to generate a unique name for the object

kind/bugSomething isn't workingSomething isn't working

kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

priority/critical-urgentHighest priority. Must be actively worked on as someone's top priority right now.Highest priority. Must be actively worked on as someone's top priority right now.

Status: Open.

#1481 In vllm-project/aibrix;

· Jeffwan opened on Aug 19, 2025

Does StormService support HPA (Horizontal Pod Autoscaling) for each role within a RoleSet?

area/autoscaling

area/disaggregated

kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.

Status: Open.

#1480 In vllm-project/aibrix;

· alex337 opened on Aug 19, 2025

How to run AIBrix kvcache offload on npu，like 910B

area/kv-cache

kind/documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#1476 In vllm-project/aibrix;

· HF-001 opened on Aug 19, 2025

Having trouble sending requests to vllm servers

area/benchmark

Status: Open.

#1471 In vllm-project/aibrix;

· rexxy-sasori opened on Aug 18, 2025

PodAutoscaler resource not found. Clean scaler object in memory since object default/llama2-70b-pa must have been deleted

Status: Open.

#1459 In vllm-project/aibrix;

· Jeffwan opened on Aug 16, 2025