Skip to content
@EmbeddedLLM

EmbeddedLLM

EmbeddedLLM is the creator behind JamAI Base, a platform designed to orchestrate AI with spreadsheet-like simplicity.

Pinned Loading

  1. JamAIBase JamAIBase Public

    The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate…

    Python 1k 33

  2. vllm vllm Public

    Forked from vllm-project/vllm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 87 6

  3. embeddedllm embeddedllm Public

    EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

    Python 40 1

Repositories

Showing 10 of 53 repositories
  • vllm Public Forked from vllm-project/vllm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

    EmbeddedLLM/vllm’s past year of commit activity
    Python 87 Apache-2.0 8,921 27 (1 issue needs help) 3 Updated Jul 21, 2025
  • vllmtests Public

    This is a repository containing the tools for testing vLLM correctness and perf regression

    EmbeddedLLM/vllmtests’s past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Jul 21, 2025
  • LMCache Public Forked from LMCache/LMCache

    ROCm support of Ultra-Fast and Cheaper Long-Context LLM Inference

    EmbeddedLLM/LMCache’s past year of commit activity
    Python 0 Apache-2.0 372 1 0 Updated Jul 15, 2025
  • vllm-rocmfork Public Forked from ROCm/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    EmbeddedLLM/vllm-rocmfork’s past year of commit activity
    Python 0 Apache-2.0 8,921 0 0 Updated Jun 30, 2025
  • roxl Public Forked from ai-dynamo/nixl

    NVIDIA Inference Xfer Library (NIXL)

    EmbeddedLLM/roxl’s past year of commit activity
    C++ 0 Apache-2.0 112 0 0 Updated Jun 6, 2025
  • aiter Public Forked from ROCm/aiter

    AI Tensor Engine for ROCm

    EmbeddedLLM/aiter’s past year of commit activity
    Python 0 MIT 70 0 0 Updated Jun 5, 2025
  • JamAIBase Public

    The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

    EmbeddedLLM/JamAIBase’s past year of commit activity
    Python 1,025 Apache-2.0 33 1 0 Updated May 29, 2025
  • aiter-api-watcher Public

    This is a repository to monitor the fast changing ROCm/aiter repository to alert user that AITER function of interests e.g. in vLLM, in SGLang has been updated at certain commit.

    EmbeddedLLM/aiter-api-watcher’s past year of commit activity
    Python 0 Apache-2.0 0 39 0 Updated Apr 28, 2025
  • vllmWorkshop Public

    vLLM Workshop Content

    EmbeddedLLM/vllmWorkshop’s past year of commit activity
    2 Apache-2.0 0 0 0 Updated Apr 3, 2025
  • EmbeddedLLM/amd-gpu-workshops’s past year of commit activity
    Jupyter Notebook 0 4 0 0 Updated Mar 20, 2025

Most used topics

Loading…