Inspired by and Learned from Andrej Karpathy.
The gpt 2 this project reproduce is based on the 124M model size, with 12 layers of Transformers and 768 d_model size.
The model is written using PyTorch, and Huggingface Transformers.
-
Notifications
You must be signed in to change notification settings - Fork 0
Wooonster/NanoGPT
About
A simple implementation of GPT-2, with some other stuff.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published