Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Visual Walkthrough of Llama2.c #483

Open
ZoroDerVonCodier opened this issue Feb 14, 2024 · 0 comments
Open

New Visual Walkthrough of Llama2.c #483

ZoroDerVonCodier opened this issue Feb 14, 2024 · 0 comments

Comments

@ZoroDerVonCodier
Copy link

@karpathy - thank you for the great software. I wrote up a visual walk-through of how it all works in detail. I think I got it all right and am currently using the software along with the llama2.cu fork by @rogerallen and the 4-bit gpu fork by @ankan-ban. On a Windows PC I am seeing 7t/s on just the CPU, 20+ with fp32 on the GPU and 140+ t/s with the 4-bit gpu. Really fun stuff! I hope this visual walk-through is helpful.

https://www.signalpop.com/2024/02/10/understanding-llama2-c-and-chatgpt-a-visual-design-walkthrough/

Cheers!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant