Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 29.5k 4.4k

2. DeepSpeed DeepSpeed Public archive

   Forked from microsoft/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

3. mamba mamba Public

   Forked from state-spaces/mamba

   Mamba SSM architecture

   Python

4. FasterTransformer FasterTransformer Public

   Forked from NVIDIA/FasterTransformer

   Transformer related optimization, including BERT, GPT

   C++