-
Notifications
You must be signed in to change notification settings - Fork 60
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
RahulSChand/gpu_poor
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
About
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
Topics
Stars
Watchers
Forks
Packages 0
No packages published