Skip to content
@LlamaEdge

LlamaEdge

The easiest, smallest and fastest local LLM runtime and API server. Creating cross-platform LLM agents and web services in Rust.

Pinned Loading

  1. LlamaEdge LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 1.4k 126

  2. llama-nexus llama-nexus Public

    Rust 2

  3. rag-api-server rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    Rust 52 12

  4. sd-api-server sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 21 2

  5. whisper-api-server whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 15 3

  6. tts-api-server tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 9 2

Repositories

Showing 10 of 25 repositories
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…