-
Notifications
You must be signed in to change notification settings - Fork 22
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Gensim word2vec can not scale to networks with million nodes efficiently, find alternative #19
Comments
@RemyLau I was building some of the cross species networks and I noticed that as the threads were increased (I have got up to 120 cpus going), generating the walks became very fast, however, the training time of the gensim model slows down a considerable amount. Using too many threads in gensim seems to be a known problem as shared in this post.. I think there could be two ways to help fix this
|
@ChristopherMancuso thanks for the suggestion! I'll try to do some testing and see how it goes. From my experience, gensim don't work well on AMD machines. But on Intel's, it's pretty fast and scales pretty well; not sure if there's architectural optimization done specifically for intel's chip. I will transfer your reply to a new issue to keep things separate. |
No description provided.
The text was updated successfully, but these errors were encountered: