Pinned Loading

1. MQBench MQBench Public

   Model Quantization Benchmark

   Python 823 143

2. United-Perception United-Perception Public

   United Perception

   Python 433 68

3. Dipoorlet Dipoorlet Public

   Offline Quantization Tools for Deploy.

   Python 130 16

4. LightLLM LightLLM Public

   LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

   Python 3.4k 268

5. LightCompress LightCompress Public

   [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

   Python 512 59

6. OmniBal OmniBal Public

   [ICML 2025] This is the official PyTorch implementation of "OmniBal: Towards Fast Instruction-Tuning for Vision-Language Models via Omniverse Computation Balance".

   Python 23 3