Skip to content

Commit 30b31f9

Browse files
authored
feat(request): do not filter by model label in transcription (#712)
Signed-off-by: Max Wittig <max.wittig@siemens.com>
1 parent b275117 commit 30b31f9

File tree

1 file changed

+2
-6
lines changed
  • src/vllm_router/services/request_service

1 file changed

+2
-6
lines changed

src/vllm_router/services/request_service/request.py

Lines changed: 2 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -585,15 +585,11 @@ async def route_general_transcriptions(
585585

586586
endpoints = service_discovery.get_endpoint_info()
587587

588-
# filter the endpoints url by model name and model label for transcriptions
588+
# filter the endpoints url by model name
589589
transcription_endpoints = []
590590
for ep in endpoints:
591591
for model_name in ep.model_names:
592-
if (
593-
model == model_name
594-
and ep.model_label == "transcription"
595-
and not ep.sleep
596-
):
592+
if model == model_name and not ep.sleep:
597593
transcription_endpoints.append(ep)
598594

599595
if not transcription_endpoints:

0 commit comments

Comments
 (0)