Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 33.1k 5k

2. horovod/horovod horovod/horovod Public

   Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

   Python 14.3k 2.2k

3. kserve/kserve kserve/kserve Public

   Standardized Serverless ML Inference Platform on Kubernetes

   Python 3.8k 1.1k

4. IsaacRe/vllm-kvcompress IsaacRe/vllm-kvcompress Public

   KV cache compression for high-throughput LLM inference

   Python 101 5

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python