This is a zig port of https://github.com/karpathy/llama2.c Basic inferencing functionality supported.
You need zig version 0.11 or newer.
zig build run -Doptimize=ReleaseFast -- stories15M.bin 0 128 "your prompt here"
-
Notifications
You must be signed in to change notification settings - Fork 0
vodkaslime/llama2.zig
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published