Search results

Docs: All vLLM Deployment Options Should Use Same Model Name

documentationImprovements or additions to documentationImprovements or additions to documentation

good first issueDenotes an issue ready for a new contributor, according to the "help wanted" guidelines.Denotes an issue ready for a new contributor, according to the "help wanted" guidelines.

help wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#907 In kubernetes-sigs/gateway-api-inference-extension;

· danehans opened on Jun 2, 2025

Docs: Quickstart GKE Clean-Up

documentationImprovements or additions to documentationImprovements or additions to documentation

good first issueDenotes an issue ready for a new contributor, according to the "help wanted" guidelines.Denotes an issue ready for a new contributor, according to the "help wanted" guidelines.

help wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

#895 In kubernetes-sigs/gateway-api-inference-extension;

· danehans opened on May 30, 2025

Conformance: Add Mock EPP

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

#893 In kubernetes-sigs/gateway-api-inference-extension;

· danehans opened on May 29, 2025

Revisiting the InferenceModel API and replacing it with InferenceSchedulingObjective

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#892 In kubernetes-sigs/gateway-api-inference-extension;

· ahg-g opened on May 29, 2025

EndPoint Picker does not receive response body from envoy under Istio

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

#888 In kubernetes-sigs/gateway-api-inference-extension;

· shmuelk opened on May 29, 2025

Conformance: Add tests for inferencepool_httproute_port_validation

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#886 In kubernetes-sigs/gateway-api-inference-extension;

· SinaChavoshi opened on May 29, 2025

Refactor the repeated echoserver from individual tests to shared manifest

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#885 In kubernetes-sigs/gateway-api-inference-extension;

· SinaChavoshi opened on May 28, 2025

Docs: Website should use "Inference Gateway" terminology

kind/documentationCategorizes issue or PR as related to documentation.Categorizes issue or PR as related to documentation.

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#884 In kubernetes-sigs/gateway-api-inference-extension;

· robscott opened on May 28, 2025

conformance: Add HTTP calls to validate E2E routing for HTTPRouteMultipleGatewaysDifferentPools

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#879 In kubernetes-sigs/gateway-api-inference-extension;

· SinaChavoshi opened on May 27, 2025

(Conformance): Use Primary / Secondary naming convention.

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#877 In kubernetes-sigs/gateway-api-inference-extension;

· SinaChavoshi opened on May 27, 2025

Refactor Test Directory Structure

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#864 In kubernetes-sigs/gateway-api-inference-extension;

· SinaChavoshi opened on May 22, 2025

Create Dedicated Shared Location for Feature Names

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#863 In kubernetes-sigs/gateway-api-inference-extension;

· SinaChavoshi opened on May 22, 2025

test: add test for metrics register

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#861 In kubernetes-sigs/gateway-api-inference-extension;

· nayihz opened on May 21, 2025

Developer guide for the scheduling framework

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#856 In kubernetes-sigs/gateway-api-inference-extension;

· ahg-g opened on May 20, 2025

Clarify/Formalize "Reconciled" Condition Type for HTTPRoute Status

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#846 In kubernetes-sigs/gateway-api-inference-extension;

· SinaChavoshi opened on May 15, 2025

KubeCon North America 2025 CFP Collaboration

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#841 In kubernetes-sigs/gateway-api-inference-extension;

· danehans opened on May 15, 2025

Spike: look into doing an ext_proc shim for proxy_wasm

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#840 In kubernetes-sigs/gateway-api-inference-extension;

· shaneutt opened on May 15, 2025

Make it easier to enable/disable plugins without writing code and make it easier to add plugins

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#839 In kubernetes-sigs/gateway-api-inference-extension;

· shmuelk opened on May 15, 2025

Enhanced OpenAI Chat-Completions API Support

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#827 In kubernetes-sigs/gateway-api-inference-extension;

· vMaroon opened on May 13, 2025

InferencePool Status Condition Defaulting

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

#825 In kubernetes-sigs/gateway-api-inference-extension;

· danehans opened on May 12, 2025

 ·  

InferencePool API General Availability (GA)

Enable PostResponse plugins to receive the body of the response

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#821 In kubernetes-sigs/gateway-api-inference-extension;

· shmuelk opened on May 12, 2025

e2e: Add /chat/completions Test Case

good first issueDenotes an issue ready for a new contributor, according to the "help wanted" guidelines.Denotes an issue ready for a new contributor, according to the "help wanted" guidelines.

help wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.

triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.

Status: Open.

#814 In kubernetes-sigs/gateway-api-inference-extension;

· danehans opened on May 9, 2025

Proposal: Add Explicit Status Conditions to InferencePool API Spec

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#806 In kubernetes-sigs/gateway-api-inference-extension;

· SinaChavoshi opened on May 8, 2025

Prefix Aware Scorer

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#801 In kubernetes-sigs/gateway-api-inference-extension;

· oglok opened on May 8, 2025

Add Inference Extension to vLLM Integrations Doc

needs-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.Indicates an issue or PR lacks a `triage/foo` label and requires one.

Status: Open.

#794 In kubernetes-sigs/gateway-api-inference-extension;

· danehans opened on May 7, 2025