Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

freebase download failure #180

Open
guihaomin opened this issue Apr 24, 2018 · 5 comments
Open

freebase download failure #180

guihaomin opened this issue Apr 24, 2018 · 5 comments

Comments

@guihaomin
Copy link

I tried to do the ./pull-dependencies fullfreebase-vdb in the tutorial. However the script segmentation fault at the last %1....

@ppasupat
Copy link
Collaborator

ppasupat commented Apr 24, 2018

  • Could you try removing lib/fb_data/ and rerunning the command?
  • Could you check if there is enough space? The file is very large (30GB total).

@guihaomin
Copy link
Author

I figure out the problem is a wget bug in version 1.19.1. I downloaded and compiled/install wget 1.91.4 and that solved the issue.

@Vimos
Copy link

Vimos commented May 17, 2018

May I ask if this freebase for WebQuestions or SimpleQuestions? Or it's just a subset for fun?

Here are the stats for the freebase vdb

minghuan@heatwave-PowerEdge-R710 ➜  virtuoso ./bin/isql 1111 dba dba exec="SPARQL SELECT ?g COUNT(*) { GRAPH ?g {?s ?p ?o.} } GROUP BY ?g ORDER BY DESC 2;"
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3217 as of May 17 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3217 OpenLink Virtuoso ODBC Driver

g                                                                                 callret-1
LONG VARCHAR                                                                      LONG VARCHAR
_______________________________________________________________________________

http://rdf.freebase.com                                                           595449808
http://localhost:8890/DAV/                                                        2959
http://www.openlinksw.com/schemas/virtrdf#                                        2520
http://www.w3.org/2002/07/owl#                                                    160
http://localuriqaserver/sparql                                                    14
http://www.w3.org/ns/ldp#                                                         3

6 Rows. -- 1156705 msec.

@ppasupat
Copy link
Collaborator

It should be the complete KB needed for WebQuestions.

We didn't have involvement with SimpleQuestions. You can download the subset of Freebased needed for SimpleQuestions on the Facebook Research webpage

@Vimos
Copy link

Vimos commented May 23, 2018

Thank you for the reply!
I noticed that different researchers may use different freebase subset for research.
Recently I tried to use this freebase to evaluate another work, but failed to get satisfying result. The main reason is that, candidate entity mids offered by him cannot be found in this freebase.
He may used a different subset. This might be a painful point for many KBQA researchers.

Thank you again! Really learning a lot from this repo!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants