Skip to content

Issues: linkedin/Liger-Kernel

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

59 Open 149 Closed
59 Open 149 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Allow option to use fused linear cross entropy during validation
#703 opened May 5, 2025 by connermanuel
1
Multi-Token Attention feature
#688 opened Apr 28, 2025 by qingquansong
1
I have triton 3.3.0 but it shows this error : liger-kernel 0.5.8 depends on triton>=2.3.1
#682 opened Apr 24, 2025 by FurkanGozukara
No improvement in memory usage for small LLMs
#677 opened Apr 23, 2025 by Manan17
2
Support for windows build
#670 opened Apr 16, 2025 by sorasoras
No Significant Improvement Observed in Model Training Speed
#664 opened Apr 11, 2025 by albertbou92
1
[New Model] Support LLaMA 4 family
#657 opened Apr 6, 2025 by BenasdTW
2
DeepSeek Native Sparse Attention (NSA) Kernel feature fun help wanted Extra attention is needed
#656 opened Apr 5, 2025 by qingquansong
3
The Liger-Kernel library is running slower.
#642 opened Apr 1, 2025 by kadirnar
2
Host Documentation on Online Site Following Setup
#641 opened Apr 1, 2025 by ParagEkbote
Further Improved Convergence test
#637 opened Mar 31, 2025 by jp1924
[RFC] More robust revert functions for convergence tests
#636 opened Mar 30, 2025 by Tcc0403
Error when training using FSDP and LoRA with modules_to_save parameter
#631 opened Mar 26, 2025 by BenasdTW
1
Generalized PPO loss (& improve current GRPO loss)
#626 opened Mar 24, 2025 by qingquansong
4 tasks
@qingquansong
4
[ROCm]: State of Liger Kernel CI on AMD on ROCm 6.3
#624 opened Mar 22, 2025 by tjtanaa
[transformers] support DeepSeek V3 enhancement New feature or request feature good first issue Good for newcomers help wanted Extra attention is needed huggingface
#623 opened Mar 22, 2025 by yundai424
Support DAPO Chunked loss feature
#620 opened Mar 21, 2025 by qingquansong
@srzhu97
2
GKD trainer + chunked JSD loss + FSDP
#615 opened Mar 17, 2025 by benyaminjami
1
[bug] deepspeed zero++ multinode with liger kernel
#603 opened Mar 11, 2025 by SoundProvider
2
When enabling naive model parallelism using device_map, the liger-kernel does not work.
#593 opened Mar 3, 2025 by Songjw133
@yundai424
5
revert_liger_kernel_to_xxx can't revert LigerCrossEntropyLoss for transformers>=4.46.1 bug Something isn't working
#542 opened Jan 27, 2025 by Tcc0403
7
Issue while building from source on ROCM
#538 opened Jan 22, 2025 by agunapal
1
4
Support the new Solar architecture enhancement New feature or request feature huggingface
#537 opened Jan 22, 2025 by arnavgarg1
2
Gradient checkpointing for grad_weight in LFCE
#533 opened Jan 20, 2025 by cassanof
4
Megatron Support
#513 opened Jan 4, 2025 by huyiwen
2
ProTip! Add no:assignee to see everything that’s not assigned.