Skip to content

Issues: jzhang38/EasyContext

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

31 Open 15 Closed
31 Open 15 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Inquiry Regarding Zero3 and Sequence Parallelism Compatibility
#54 opened Sep 28, 2024 by SihengLi99
2
dependency confilct
#53 opened Sep 28, 2024 by SihengLi99
saving intermediate checkpoints
#52 opened Sep 24, 2024 by 1190303125
Can not run the example script succesully.
#51 opened Sep 14, 2024 by feifeibear
Size mismatch inside zigzag_ringattention backward
#47 opened Sep 9, 2024 by jinghan23
RuntimeError: CUDA error: an illegal memory access was encountered
#46 opened Aug 22, 2024 by uditsharma7
1
Is this SFT method or PT method？
#45 opened Aug 21, 2024 by 233function
1
When will the model code support the Qwen series models?
#44 opened Aug 6, 2024 by 233function
2
TypeError: _flash_attn_forward() missing 1 required positional argument: 'softcap'
#43 opened Jul 29, 2024 by Ziyang412
2
How to estimate the maximum context length this repo can support for larger models?
#42 opened Jul 26, 2024 by JingyangDeng
拓展长上下文的技术是？
#41 opened Jul 22, 2024 by zzhdbw
2
Logits shift in loss computation
#39 opened Jul 14, 2024 by shivamag125
1
Does it support SFT training?
#38 opened Jul 11, 2024 by Lomax314
comparison of different sequence parallel methods
#37 opened Jul 8, 2024 by sunying2018
1
Dataset length question
#36 opened Jun 25, 2024 by 5taku
2
Will EasyContext support Qwen series model?
#35 opened Jun 7, 2024 by WeixuanXiong
May I see your wandb report while training?
#34 opened May 29, 2024 by fahadh4ilyas
How to auto-regression generate？
#33 opened May 28, 2024 by yileld
Can we just use the sloth gradient checkpointing by uncommenting this line?
#30 opened May 21, 2024 by vkaul11
4
how to infer the model?
#27 opened May 9, 2024 by laoda513
how to acquire the real whole batch sequenece training loss(reduction_mode=mean) ?
#24 opened Apr 26, 2024 by littttttlebird
2
attention_mask
#23 opened Apr 26, 2024 by Nianqitongs
Need a running script for ‘dist_flash_attn’
#22 opened Apr 26, 2024 by LzhinFdu
5
integrate it into the Transformers Trainer?
#20 opened Apr 19, 2024 by jkl375
1
error when finetuning yi-34b
#13 opened Apr 10, 2024 by puppet101
2
ProTip! Type g i on any issue or pull request to go back to the issue listing page.