Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

显存占满之前就开始使用共享显存 #405

Open
0pera opened this issue Dec 2, 2024 · 0 comments
Open

显存占满之前就开始使用共享显存 #405

0pera opened this issue Dec 2, 2024 · 0 comments

Comments

@0pera
Copy link

0pera commented Dec 2, 2024

我尝试用我的老笔记本（GTX 1050Ti 4G显存）跑着玩一下，但是哪怕加载最小的模型，输出速度依然很慢。我打开任务管理器检查，发现显存占用比例比较奇怪，有比较多的共享显存占用：
屏幕截图 2024-12-02 091956

我尝试过用Jan来跑小模型，在显存没爆的情况下，应该不至于只有2token/s……
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@0pera