Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

内存占用过高,运行时间过长问题 #39

Open
yujunpeng2k opened this issue Dec 17, 2023 · 6 comments
Open

内存占用过高,运行时间过长问题 #39

yujunpeng2k opened this issue Dec 17, 2023 · 6 comments

Comments

@yujunpeng2k
Copy link

想知道用cpu和GPU运行一次各需要多少时间。如果要复现KDD那篇论文,10次随机种子实验,因子池大小取【10,20,50,100】,多进程跑起来内存根本不够,想知道如何解决这个问题,望解答,十分感谢!

@yujunpeng2k
Copy link
Author

求解答

@xuehongyanL
Copy link
Contributor

gpu单次实验大概5~10h?算力和内存就只能自行解决了
#35

@yujunpeng2k
Copy link
Author

为什么我P400的显卡,跑100的股票池,30Wstep,一个种子就得跑二十多个小时。。

@Chlorie
Copy link
Contributor

Chlorie commented Jan 3, 2024

多进程占用同一张卡确实可能会拖慢计算,GPU资源调度比较费劲。
另外现在版本的 Rank IC 计算确实优化比较拉,像 #35 需要跑大数据集的话会在那块爆显存。我最近针对这个优化过,可能过一阵子有空会更新一下。

@yujunpeng2k
Copy link
Author

yujunpeng2k commented Jan 3, 2024 via email

@smallgamerun
Copy link

多进程占用同一张卡确实可能会拖慢计算,GPU资源调度比较费劲。 另外现在版本的 Rank IC 计算确实优化比较拉,像 #35 需要跑大数据集的话会在那块爆显存。我最近针对这个优化过,可能过一阵子有空会更新一下。

请问有更新的版本了吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants