Repositories list

• JamAIBase

  Public
  The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

  pythonworkflowai+ 17serverlesschatbotspreadsheetsvelteorchestrationbaasagents+ 10

  Python

  •

  Apache License 2.0

  •17•429•1•1•Updated Nov 21, 2024Nov 21, 2024

• SageAttention-rocm

  Public
  ROCm Quantized Attention that achieves speedups of 2.1x and 2.7x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.

  Cuda

  •

  Apache License 2.0

  •22•0•0•0•Updated Nov 21, 2024Nov 21, 2024

• infinity-executable

  Public
  Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting a wide range of text-embedding models and frameworks.

  Python

  •

  MIT License

  •115•0•0•0•Updated Nov 20, 2024Nov 20, 2024

• torchac_rocm

  Public
  ROCm Implementation of torchac_cuda from LMCache

  Cuda

  •1•0•0•0•Updated Nov 17, 2024Nov 17, 2024

• vllm

  Public
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

  inferencepytorchtransformer+ 6gptamdgpurocmmodel-servingllmllm-inference

  Python

  •

  Apache License 2.0

  •4.6k•89•4•0•Updated Nov 16, 2024Nov 16, 2024

• axolotl-amd

  Public
  Go ahead and axolotl questions

  Python

  •

  Apache License 2.0

  •876•0•0•0•Updated Nov 16, 2024Nov 16, 2024

• Liger-Kernel

  Public
  Efficient Triton Kernels for LLM Training

  Python

  •

  BSD 2-Clause "Simplified" License

  •208•0•0•0•Updated Nov 16, 2024Nov 16, 2024

• LMCache-ROCm

  Public
  ROCm support of Ultra-Fast and Cheaper Long-Context LLM Inference

  Python

  •

  Apache License 2.0

  •24•0•0•0•Updated Nov 14, 2024Nov 14, 2024

• jamaibase-ts-docs

  Public
  Typescript Documentation of JamAISDK

  HTML

  •0•0•0•0•Updated Nov 14, 2024Nov 14, 2024

• skypilot

  Public
  SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

  Python

  •

  Apache License 2.0

  •513•0•0•0•Updated Nov 7, 2024Nov 7, 2024

• flash-attention-docker

  Public
  This is a repository that contains a CI/CD that will try to compile docker images that already built flash attention into the image to facilitate quicker development and deployment of other frameworks.

  Shell

  •

  Apache License 2.0

  •0•1•0•0•Updated Oct 26, 2024Oct 26, 2024

• flash-attention-rocm

  Public
  ROCm Fork of Fast and memory-efficient exact attention (The idea of this branch is to hope to generate flash attention pypi package to be readily installed and used.

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •1.3k•0•0•0•Updated Oct 26, 2024Oct 26, 2024

• vllm-rocmfork

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •4.6k•0•0•0•Updated Oct 23, 2024Oct 23, 2024

• etalon

  Public
  LLM Serving Performance Evaluation Harness

  Python

  •

  Apache License 2.0

  •5•0•0•0•Updated Oct 17, 2024Oct 17, 2024

• unstructured-python-client

  Public
  A Python client for the Unstructured hosted API

  Python

  •

  MIT License

  •17•0•0•1•Updated Oct 14, 2024Oct 14, 2024

• embeddedllm

  Public
  EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

  windowscpullama+ 15gemmamistraldirectx-12openvinonpuopenvino-inference-engineaipc+ 8

  Python

  •0•21•6•2•Updated Oct 6, 2024Oct 6, 2024

• LLM_Sizing_Guide

  Public
  A calculator to estimate the memory footprint, capacity, and latency on NVIDIA AMD Intel

  Python

  •2•0•0•0•Updated Oct 4, 2024Oct 4, 2024

• github-bot

  Public
  Go

  •1•0•0•0•Updated Sep 26, 2024Sep 26, 2024

• PowerToys

  Public
  Windows system utilities to maximize productivity

  C#

  •

  MIT License

  •6.6k•0•0•0•Updated Aug 9, 2024Aug 9, 2024

• arena-hard-auto

  Public
  Arena-Hard-Auto: An automatic LLM benchmark.

  Jupyter Notebook

  •

  Apache License 2.0

  •74•0•0•0•Updated Jul 15, 2024Jul 15, 2024

• unstructured-api-executable

  Public
  Python

  •

  Apache License 2.0

  •118•0•0•0•Updated Jul 11, 2024Jul 11, 2024

• unstructured-inference-executable

  Public
  Python

  •

  Apache License 2.0

  •53•0•0•0•Updated Jul 9, 2024Jul 9, 2024

• unstructured-executable

  Public
  Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

  HTML

  •

  Apache License 2.0

  •764•1•0•0•Updated Jul 9, 2024Jul 9, 2024

• workshop

  Public
  Jupyter Notebook

  •0•0•0•0•Updated Jun 25, 2024Jun 25, 2024

• ai-town

  Public
  A MIT-licensed, deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live, chat and socialize.

  TypeScript

  •

  MIT License

  •711•0•0•0•Updated Jun 23, 2024Jun 23, 2024

• jamaibase-cookbook

  Public
  JamAI Base cookbook repo

  Python

  •

  Apache License 2.0

  •0•4•0•0•Updated Jun 10, 2024Jun 10, 2024

• jamaibase-expressjs-vercel

  Public
  TypeScript

  •1•0•0•0•Updated May 31, 2024May 31, 2024

• jamaibase-nextjs-vercel

  Public
  TypeScript

  •0•1•0•0•Updated May 31, 2024May 31, 2024

• nlux-jamai

  Public
  The 𝗣𝗼𝘄𝗲𝗿𝗳𝘂𝗹 Conversational AI JavaScript Library

  TypeScript

  •

  Other

  •64•0•0•0•Updated May 31, 2024May 31, 2024

• mamba-rocm

  Public
  Python

  •

  Apache License 2.0

  •1.1k•5•0•0•Updated Apr 22, 2024Apr 22, 2024