Popular repositories Loading

1. text-generation-inference text-generation-inference Public

   Forked from IBM/text-generation-inference

   IBM development fork of https://github.com/huggingface/text-generation-inference

   Python

2. model_server model_server Public

   Forked from openvinotoolkit/model_server

   A scalable inference server for models optimized with OpenVINO™

   C++

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. vllm-spyre vllm-spyre Public

   Forked from vllm-project/vllm-spyre

   Community maintained hardware plugin for vLLM on Spyre

   Python

5. caikit caikit Public

   Forked from caikit/caikit

   Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.

   Python