Skip to content
@LlamaEdge

LlamaEdge

The easiest, smallest and fastest local LLM runtime and API server. Creating cross-platform LLM agents and web services in Rust.

Pinned Loading

  1. LlamaEdge LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 1.1k 91

  2. rag-api-server rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    Rust 31 8

  3. sd-api-server sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 15 2

  4. whisper-api-server whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 10 3

  5. tts-api-server tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 5 1

  6. llama-proxy-server llama-proxy-server Public

    Rust 2

Repositories

Showing 10 of 21 repositories
  • LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/LlamaEdge’s past year of commit activity
    Rust 1,095 Apache-2.0 91 3 (1 issue needs help) 2 Updated Nov 20, 2024
  • LlamaEdge/sd-proxy-server’s past year of commit activity
    Rust 1 0 0 0 Updated Nov 19, 2024
  • WavUp Public
    LlamaEdge/WavUp’s past year of commit activity
    Rust 0 0 0 0 Updated Nov 19, 2024
  • whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/whisper-api-server’s past year of commit activity
    Rust 10 3 2 0 Updated Nov 19, 2024
  • LlamaEdge/wavup-server’s past year of commit activity
    Python 0 0 0 0 Updated Nov 18, 2024
  • talktalk Public
    LlamaEdge/talktalk’s past year of commit activity
    Shell 9 1 0 0 Updated Nov 15, 2024
  • rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    LlamaEdge/rag-api-server’s past year of commit activity
    Rust 31 Apache-2.0 8 9 2 Updated Nov 12, 2024
  • tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/tts-api-server’s past year of commit activity
    Rust 5 1 1 0 Updated Nov 11, 2024
  • sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/sd-api-server’s past year of commit activity
    Rust 15 2 5 0 Updated Nov 8, 2024
  • www Public

    Public website

    LlamaEdge/www’s past year of commit activity
    HTML 0 3 0 0 Updated Oct 27, 2024

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…