Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix incorrect image link in experiments.md #29

Merged
merged 1 commit into from
Mar 7, 2018
Merged

Fix incorrect image link in experiments.md #29

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/experiments.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -101,7 +101,7 @@ these counts efficiently (but without compression), we would need approximately

Python Counter (dict) uses approximately 800 MB to store this set in RAM.

![Precision on unigrams data](docs/bounter_unigrams_wiki.png)
![Precision on unigrams data](bounter_unigrams_wiki.png)

#### Bigrams
The Wikipedia data set contains 179,413,989 distinct bigrams in 1,857,420,106 total bigrams.
Expand All @@ -121,7 +121,7 @@ Storing them all in a single Python counter would require approximately 17.2 GB
| CMS log8 | 1001s | 1219s | 1103s |


![Precision on bigrams data](docs/bounter_bigrams_wiki.png)
![Precision on bigrams data](bounter_bigrams_wiki.png)

We used words collocations to distinguish phrases using our collected data. As a reference,
we calculated whether bigram is a phrase using reference exact counts on a set of 2000 randomly
Expand Down