Skip to content

Pull requests: karpathy/llm.c

New pull request New
111 Open 483 Closed
111 Open 483 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Mapping "py" gpt2 functionalities to match "c"
#783 opened Oct 31, 2024 by omarswelam Loading…
Verify vocab is padded before reshaping
#782 opened Oct 23, 2024 by austinleedavis Loading…
FP32 FlashAttention
#781 opened Oct 20, 2024 by ssiu Loading…
fix: false-positive check for nccl install on ubuntu
#775 opened Oct 2, 2024 by leiDnedyA Loading…
1
Activation Checkpointing for Llama3 branch
#773 opened Oct 2, 2024 by ademeure Loading…
Add repkv_backward_kernel2 and repkv_kernel2 (llama3 branch)
#771 opened Sep 28, 2024 by insop Loading…
2
-pm -> -pi: typo in error_usage
#765 opened Sep 22, 2024 by thundergolfer Loading…
Micro optimization for softmax_forward_kernel5
#762 opened Sep 20, 2024 by insop Loading…
6
FP8 with Tensor Reorg
#760 opened Sep 19, 2024 by ademeure • Draft
Update download_starter_pack.sh
#758 opened Sep 18, 2024 by dongrixinyu Loading…
Add RoPE positional encoding - llama3 feature branch
#756 opened Sep 13, 2024 by gordicaleksa Loading…
1
Add SwiGLU support - llama3 feature branch
#755 opened Sep 13, 2024 by gordicaleksa Loading…
3
add llama 3 support to llm.c
#754 opened Sep 13, 2024 by karpathy • Draft
Adamw thread coarsening kernel
#753 opened Sep 3, 2024 by saladpalad Loading…
Fix sizing typo in train_gpt2_fp32.cu
#748 opened Aug 25, 2024 by gajanan-choudhary Loading…
2
log with LINE and FILE for better addressing.
#746 opened Aug 22, 2024 by NEWPLAN Loading…
1
Re: Fixed modal script for updated cudnn version, and read errors
#743 opened Aug 14, 2024 by vyom1611 Loading…
check libnccl instead of nccl to be more reliable
#742 opened Aug 14, 2024 by dengl11 Loading…
[WIP] initial curand implementation for model init
#741 opened Aug 13, 2024 by ngc92 Loading…
1
multi-threaded model initialization
#737 opened Aug 12, 2024 by ngc92 Loading…
2
Add external KV to LLaMA 3
#734 opened Aug 10, 2024 by gordicaleksa Loading…
Faster GELU forward & backward using MUFU.TANH for SM7.5+
#721 opened Jul 31, 2024 by ademeure Loading…
4
Add SwiGLU support
#718 opened Jul 29, 2024 by gordicaleksa Loading…
1
Add RoPE positional encoding
#714 opened Jul 28, 2024 by gordicaleksa Loading…
3
Outlier detection: catch more outliers by not updating moving average with skipped updates
#711 opened Jul 25, 2024 by ademeure • Draft
1
ProTip! Mix and match filters to narrow down what you’re looking for.