Skip to content

Issues: alibaba/rtp-llm

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

20 Open 82 Closed
20 Open 82 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

socket.gaierror: [Errno -5] No address associated with hostname
#136 opened Apr 15, 2025 by Greatpanc
MODEL_TYPE 需要填写的是什么内容，参考文档中不是很清晰
#135 opened Apr 15, 2025 by Greatpanc
最新代码源码编译报错
#132 opened Feb 24, 2025 by leyiwang
5
what's the decode token speed of 7b qwen gptq int4 model on v100?
#131 opened Feb 20, 2025 by FWXT
Is there any tutorial document on how to use pd-disaggregation?
#130 opened Feb 7, 2025 by Dimensionzw
1
support ebedding和reranker 部署时量化8
#124 opened Nov 7, 2024 by invisifire
3
2张16G的T4卡都跑不起来examples/test.py
#120 opened Sep 27, 2024 by zhangtaibo
1
[Doc] 多卡并行文档修改建议
#115 opened Sep 13, 2024 by linnlh
RTP-LLM 模式下，llama3.1 FP16 效果不一样
#114 opened Sep 13, 2024 by anigi98932
1
无法运行tests目录下的Python测试脚本，缺少libtest_ops.so
#110 opened Aug 28, 2024 by leepoly
1
双卡A6000推理，模型推理结束，一张卡GPU利用率为0，一张卡GPU利用率100%
#109 opened Aug 28, 2024 by zf761
1
speculate sampling用medusa加载medusa官方模型报错
#105 opened Aug 22, 2024 by wcsjtu
6
推理出现乱码（показать показать показать показать показать）（USE_NEW_DEVICE_IMPL=1）
#100 opened Aug 9, 2024 by w066650
1
HELP: No matching distribution found for torch==2.1.0+cu121 error while install maga_transformer with .whl in release 0.2.0
#91 opened Jul 21, 2024 by HuXinjing
7
support DeepSeek-V2-Lite-Chat
#84 opened Jul 12, 2024 by jianglan89
1
v0.2.0(cuda12)对比 v0.1.13(cuda11)表现下降
#74 opened Jun 26, 2024 by invisifire
1
qwen2 gptq tp=4 报错：AssertionError: error config
#71 opened Jun 25, 2024 by xinge666
3
Qwen Chat CUDA OutOfMemory
#63 opened May 31, 2024 by xorange
2
#RTP-LLM Developer Event# 春季限定活动，捉bug送美味咖啡☕️
#25 opened Mar 6, 2024 by tt0718
2
support Yi-Vl
#23 opened Mar 3, 2024 by Lzhang-hub
5
ProTip! Adding no:label will show everything without a label.