Skip to content

vLLM OpenAI compatible server integration #512

New issue
New issue
Closed
Closed
vLLM OpenAI compatible server integration#512
Labels
questionvLLMThings involving vLLM support
@jamestwhedbee

Description

@jamestwhedbee
jamestwhedbee
opened on Jan 8, 2024

Your vLLM integration works beautifully, I was wondering if you were looking to support their OpenAI-compatible server as well

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionvLLMThings involving vLLM support

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions