Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Online word2vec test #778

Closed
wants to merge 31 commits into from
Closed

Online word2vec test #778

Changes from 1 commit
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
1c63c9a
Merge branch 'release-0.12.3rc1'
tmylk Nov 5, 2015
280a488
Merge branch 'release-0.12.3'
tmylk Nov 6, 2015
ddeb002
Merge branch 'release-0.12.3'
tmylk Nov 6, 2015
f2ac3a9
Update CHANGELOG.txt
tmylk Nov 6, 2015
cf09e8c
Update CHANGELOG.txt
tmylk Nov 6, 2015
b61287a
resolve merge conflict in Changelog
tmylk Jan 29, 2016
3ade404
Merge branch 'release-0.12.4' with #596
tmylk Jan 31, 2016
e9f86ba
recovering lost work
Jun 15, 2015
be1a0f0
fix test?
zachmayer Feb 23, 2016
0848018
dont sort vocab when updating
zachmayer Feb 23, 2016
9e6522e
Merge branch 'release-0.13.0'
tmylk Jun 10, 2016
87c4e9c
Merge branch 'release-0.13.0'
tmylk Jun 10, 2016
9c74b40
Release version typo fix
tmylk Jun 10, 2016
7b30025
Merge branch 'release-0.13.0rc1'
tmylk Jun 10, 2016
d18f06f
Merge branch 'onlineW2V' of https://github.com/zachmayer/gensim into …
isomap Jun 21, 2016
6228b73
fix build_vocab
isomap Jun 21, 2016
aef1791
add assert online add word vector value was changed after online trai…
isomap Jun 21, 2016
b616d4f
add new_sentences volume to pass the test
isomap Jun 21, 2016
de79c8e
Merge branch 'release-0.13.0'
tmylk Jun 22, 2016
d4f9cc5
Merge branch 'release-0.13.1'
tmylk Jun 23, 2016
baaa1d6
fix test
isomap Jun 24, 2016
46fae36
Merge remote-tracking branch 'upstram/master' into online-w2v
isomap Jul 8, 2016
5e30552
add test code for online w2v
isomap Jul 8, 2016
ec95b8f
small fix
isomap Jul 8, 2016
48c9f29
fix test
isomap Jul 12, 2016
22dab54
fix online w2v code and add sanity checking
isomap Jul 12, 2016
d21dd2c
assertGreater -> assertLess
isomap Jul 12, 2016
8f70e15
Add online word2vec tutorial.ipynb and Update wikicorpus.py for old w…
isomap Sep 4, 2016
7f7007f
Fix test and wikicorpus
isomap Sep 9, 2016
2e393de
fix indent
isomap Sep 9, 2016
adf45ef
update online w2v tutorial to use delta wikipedia
isomap Sep 28, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion gensim/test/test_word2vec.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ class LeeCorpus(object):
def __iter__(self):
with open(datapath('lee_background.cor')) as f:
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tmylk Should be smart_open (we want to use smart_open consistently across gensim).

for line in f:
yield utils.simple_preprocess(line)
yield utils.simple_preprocess(line)

list_corpus = list(LeeCorpus())

Expand Down