Popular repositories Loading

1. Danielkinz.github.io Danielkinz.github.io Public

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. paged_exllamav2 paged_exllamav2 Public

   Forked from turboderp-org/exllamav2

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python