Skip to content

Pull requests: pytorch/torchtune

New pull request New
47 Open 1,072 Closed
47 Open 1,072 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix PackedDataset bug for seq_len > 2 * max_seq_len setting. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1697 opened Sep 26, 2024 by mirceamironenco • Draft
5 of 13 tasks
1
1
[WIP] Resizable image positional embeddings CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1695 opened Sep 26, 2024 by felipemello1 • Draft
1 of 13 tasks
1
Fix Mistral tokenizer if no eos_token is added CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1693 opened Sep 26, 2024 by devxinvestor Loading…
7 of 13 tasks
1
Llama3.2 knowledge distillation config CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1690 opened Sep 26, 2024 by lindawangg Loading…
8 of 13 tasks
1
[WIP] Quick Llama3.2 e2e tutorial CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1685 opened Sep 25, 2024 by RdoubleA Loading…
13 tasks
2
Fixing recompiles in KV-cache + compile CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1663 opened Sep 24, 2024 by SalmanMohammadi • Draft
7 of 13 tasks
23
[DO NOT LAND] Test custom components for distributed CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1657 opened Sep 23, 2024 by RdoubleA Loading…
1
Skip entire header for llama3 decode CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1656 opened Sep 23, 2024 by RdoubleA Loading…
1 of 13 tasks
7
[Feat] Activation offloading for distributed lora recipe CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1645 opened Sep 21, 2024 by Jackmin801 Loading…
3 of 13 tasks
5
[draft] test wandb usage CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1638 opened Sep 20, 2024 by mori360 • Draft
13 tasks
2
Add KD distributed recipe CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1631 opened Sep 20, 2024 by lindawangg Loading…
9 of 13 tasks
2
[WIP] Add tests for lora finetune single device act offload CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1604 opened Sep 16, 2024 by janeyx99 • Draft
1
Add low_cpu_ram config to qlora recipes configs (excluding 2B/13B/70B configs) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1580 opened Sep 13, 2024 by mikaylagawarecki Loading…
1 of 13 tasks
3
do NOT review - offloading for other recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1578 opened Sep 13, 2024 by felipemello1 • Draft
4 tasks
2
[DRAFT] Factor out core SDPA CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1561 opened Sep 12, 2024 by dvorjackz • Draft
3 of 7 tasks
9
do not review - llama 3 and 2 instantiate pos emb only once CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1556 opened Sep 12, 2024 by felipemello1 Loading…
1 of 4 tasks
1
Integrate INT8 mixed-precision from torchao 0.5 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1552 opened Sep 12, 2024 by gau-nernst • Draft
2 of 13 tasks
16
[FSDP2] LoRA/QLoRA move state dict to cpu CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1531 opened Sep 10, 2024 by weifengpy • Draft
1 of 4 tasks
2
[Draft]Support Optimizer-in-the-backward CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1530 opened Sep 10, 2024 by mori360 • Draft
1 of 13 tasks
3
[DO NOT REVIEW] Classification datasets CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1511 opened Sep 6, 2024 by SalmanMohammadi • Draft
1
WIP: Revamp torchtune overview/landing page CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
#1507 opened Sep 5, 2024 by tstatler • Draft
1 of 13 tasks
2
Adding Classification Use Case CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1502 opened Sep 5, 2024 by qqlabs • Draft
1 of 13 tasks
29
Reduce compile time for single-device and multi-device recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1445 opened Aug 29, 2024 by yf225 Loading…
1 of 13 tasks
6
Fix dtype error during quantized generation CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1371 opened Aug 19, 2024 by mreso Loading…
7 of 13 tasks
1
16
Fix KV cache CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1364 opened Aug 19, 2024 by stsouko Loading…
3 of 13 tasks
13
ProTip! Exclude everything labeled bug with -label:bug.