Pinned Loading

1. JamAIBase JamAIBase Public

   The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate…

   Python 1.1k 37

2. vllm vllm Public

   Forked from vllm-project/vllm

   vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 90 5

3. embeddedllm embeddedllm Public

   EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

   Python 43 1