Running large language models on a single GPU for throughput-oriented scenarios.
-
Updated
Oct 28, 2024 - Python
#
high-throughput
Here are 82 public repositories matching this topic...
A thread-safe queue faster and more resource efficient than golang's native channels
go golang optimization concurrency ringbuffer low-latency lock-free fastest high-throughput memory-efficient thread-safe spsc-queue mpsc-queue highly-concurrent zero-allocations zenq
-
Updated
Mar 12, 2024 - Go
Time series monitoring and alerting platform.
-
Updated
Feb 12, 2022 - Java
Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)
reinforcement-learning deep-learning gpu cuda pytorch numba high-throughput multiagent-reinforcement-learning
-
Updated
Aug 2, 2024 - Python
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
-
Updated
Aug 1, 2024 - Python
quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.
python workflow database dft chemistry hpc quantum-mechanics quantum-chemistry high-throughput computational-materials-science
-
Updated
Dec 23, 2024 - Python
atomate2 is a library of computational materials science workflows
-
Updated
Dec 28, 2024 - Python
ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
-
Updated
Oct 30, 2024 - Python
extremly light uart library for AVR 8 bit microcontrollers
c avr transmission optimized flow-control uart rs232 rs485 avr-gcc prematured usart high-speed low-overhead arduino-less high-throughput avr-microcontroller avr-microcontrollers
-
Updated
Mar 13, 2024 - C
A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.
fast caching benchmark memoization cpp high-performance cache lru data-structures low-latency fastest high-throughput lru-cache cache-simulator multi-level-cache low-latency-queries least-recently-used set-associative-cache direct-mapped-cache clock-second-chance
-
Updated
Jan 18, 2024 - C++
An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.
-
Updated
Dec 26, 2024 - Java
A reactive driver for Aeron transport (https://github.com/real-logic/aeron)
-
Updated
Jun 20, 2021 - Java
A Simple Way of Creating Job Workflows in Go running in Processes, Containers, Tasks, Pods, or Jobs
go macos linux docker kubernetes golang workflow hpc containers workflow-engine singularity processes k8s high-throughput
-
Updated
Dec 20, 2024 - Go
Full automation of relative protein-ligand binding free energy calculations in GROMACS
-
Updated
May 3, 2021 - Python
🔬🖥 Automated Blood Vasculature Analysis of 3D Light-Sheet Image Volumes
docker bioinformatics snakemake high-throughput graph-analysis vessel-segmentation 3d-imaging 3d-skeleton light-sheet-microscopy
-
Updated
Jun 6, 2024 - Python
Window-Based Hybrid CPU/GPU Stream Processing Engine
streaming stream gpu stream-processing hybrid high-throughput multicore sliding-windows streaming-data saber multicore-cpu
-
Updated
Nov 16, 2022 - Java
A low-latency, high-throughput order matching system implementation.
finance trading cpp concurrency multithreading trading-platform low-latency high-throughput matching-engine orderbook
-
Updated
Jul 3, 2023 - C++
The Zavolab Automated RNA-seq Pipeline
docker workflow bioinformatics rna-seq snakemake pipeline reproducible-research conda singularity fair high-throughput transcriptomics
-
Updated
Dec 22, 2024 - Python
High-throughput molecular docking with multiple targets and ligands using Vina series engines
docker pipeline computational-chemistry docking high-throughput autodock vina smina qvina flexible-residues
-
Updated
Sep 9, 2020 - Python
MatID is a python package for identifying and analyzing atomistic systems based on their structure. MatID is designed to help researchers in the automated analysis and labeling of atomistic datasets.
-
Updated
Nov 28, 2023 - Python
Improve this page
Add a description, image, and links to the high-throughput topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the high-throughput topic, visit your repo's landing page and select "manage topics."