-
Notifications
You must be signed in to change notification settings - Fork 205
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
./gradlew check hanging #15
Comments
I have the same error it hang on Building 83%, but it hang if I run i have winodws 8.1 64 Bit |
Oh, seems like my replies were going just to the original submitter instead of this issue, oops.
|
Please let me know if there's anything new. Even if you've solved this, too! |
I know this issue is closed - but I'm running into a similar problem. It hangs for me at 83% while running Here are the last few lines from the output:
It always stops while producing a resource from ner-en-time.bin. I'm running this in an EC2 instance, not using a proxy (that I'm aware of) and have disabled ipv6. I do see a few errors in the output as well - there is an exception relating to enwiki not being available at http://enwiki.ailao.eu:8983/solr as well as the following:
Any ideas, things for me to try? |
It probably hanged because of the enwiki not being available. And that was the case as some prankster logged into the admin interface (which I thought is available only via localhost) and renamed the enwiki core (and hopefully did nothing else)... Yay. Now I'll need to figure out how the heck to configure solr to disable this... If the problem persists, please include complete output with debugging enabled. |
Not sure whether it's directly related, but I experienced a rather similar issue (also stopped at 83%, same last messages) that was actually caused by an exception earlier on. When you enable unlimited buffering in your terminal and scroll up you might see an exception about some DKpro component not found in your Maven repository [FileNotFoundException for classpath:/de/tudarmstadt/ukp/dkpro/core/opennlp/lib/sentence-en-maxent.properties, I think - it should say something like org.apache.uima.analysis_engine.impl.PrimitiveAnalysisEngine_impl callAnalysisComponentProcess(417) SEVERE: Exception occured shortly before and then print the typical stack trace afterwards]. Here is where it gets muddy, though. I just ran and reran the YodaQA commands a few times and the exception vanished. Once it does, it should never appear again. Happened to me on a few machines / images / VM instances afair. [Interestingly, even though I usually copy over my .m2 and .gradle caches.] |
Please reopen this issue. I reproduced the error today, so it's not caused by enwiki. When I build YodaQA 1.4 I run into the same exception. Actually asking 3 questions via "./gradlew run -q" reliably fixes this: I have reproduced the error twice by creating a new Docker container and I didn't do anything besides Ctrl-c after YodaQA got stuck and immediately rerunning "./gradlew run -q" to ask the same question. Both times on the third iteration - as esoterically as it sounds - the error vanished and never reoccurred. Maybe WON'T FIX, because it's cool that you need to know the secret ritual to launch it? 😁 |
Hi! Thanks for all the reports. I'll reopen this issue as what you describe should really be fixed; though I never noticed anything like this before on the systems where I ran YodaQA. :( I think for newcomers to this issue, the important message is that multiple causes may cause the run hanging. The bottom line is that the hang is caused by an exception earlier (possibly way above in the scrollback, try running with
|
I get a hang on
edit: I ran run with
|
Hi! Anyone who runs into such a problem, please do include (e.g. link to pastebin) the full output. The last few preceding lines are pretty much always irrelevant to the problem. Even the last exception, if you see any, will be irrelevant. The first exception that happens throughout the whole run is indicative of what the problem is. (If there is no exception, that'd be another problem yet altogether.) |
I don't want to be irrationally optimistic here, but has anyone experienced this error lately, esp. on the 1.5 release? Because I haven't... Maybe this can be closed if nobody confirms or reports new occurrences over the next two weeks? |
Unfortunately, a student of mine experienced this just on Monday :(
|
cz.brmlab.yodaqa.provider.rdf.DBpediaTypesTest > testQueryTitleForm STARTED
Same here. So, is it a proxy issue? or bug? |
Apparently, we had some trouble with connectivity of a couple of our services last night. Does the problem persist? Have you tried just running gradle a couple of times? |
Still problematic. Is there way to install everything on local machine and test QA system? (instead of connect to remote server or w/o any dependencies). |
Certainly. The individual resources are listed in the data/ directory,
with insrtuctions for each to set up locally. Some are easier, other
more complicated. The easiest and possibly problematic for you (if
gradle hangs in the test phase) is dbpedia, please follow the howto
in data/dbpedia/README.md to set up your own.
|
Bad news: My ritual does not work anymore and I cannot run YodaQA anymore. The dependency de.tudarmstadt.ukp.dkpro.core.opennlp-model-sentence-en-maxent:20120616.1 cannot be found anywhere, as before. Any suggestions how to proceed? Not surprising, cmp. http://mvnrepository.com/artifact/de.tudarmstadt.ukp.dkpro.core/de.tudarmstadt.ukp.dkpro.core.opennlp-model-sentence-en-maxent Gives 404. Maybe host it yourself like eij for BlanQA? Or get rid of it - it seems to be a testing dependency only. The file seems to be also here: https://zoidberg.ukp.informatik.tu-darmstadt.de/jenkins/job/DKPro%20Core%20Documentation%20%28GitHub%29/de.tudarmstadt.ukp.dkpro.core$de.tudarmstadt.ukp.dkpro.core.doc-asl/doclinks/5/#model-de.tudarmstadt.ukp.dkpro.core.opennlp-model-sentence-en-maxent But I haven't been able to inject it into my Gradle cache so far. PS: PPS: PPPS:
and then using it via
in Thus, I currently see no way to use Yoda. Please get back to me about this asap. Thanks. |
The file should be available again from zoidberg (http://zoidberg.ukp.informatik.tu-darmstadt.de/artifactory/public-model-releases-local) once its maintenance is complete. We do not plan to upload this file (or any other model files) to Maven Central for the time being. The problem is, that most model files are in a somewhat grey area when it comes to their license status. To upload something on Maven Central (or Bintray), we would have to know pretty well which licensed these artifacts are under. People using Maven intensively are strongly encouraged to set up caching/proxy repositories to maintain copies of the artifacts they require (not only DKPro Core artifacts, but any artifacts). |
Works. Amazing, thank you so much. |
Argh. Thanks for the heads-up, seems like someone again renamed the core from "collection1" recently, this has happenned before but unfortunately solr has no concept of authentication and the proper proxying is not straightforward to set up and I never have the extra 2 hours in life to do that... "Fixed" now. |
No worries. I'll see if I can delete my comment above to try and avoid the issue. |
Has anyone found a workaround/fix to this? EDIT:
|
Then don't use -q but enable debug output to get some diagnostics. :)
|
I had a similar issue after trying to run YodaQA inside docker. Building a container using the Dockerfile at the project root with an added last line of The odd thing was that on certain questions, this bug did not occur, and when I was running Yoda locally on my Mac I didn't observe the behavior - only when inside Docker. I've found that the underlying reason was multiple threads attempting to download an NLP model jar file simultaneously and overwriting some ivy xml files in the ~/.ivy2 cache folder. Thank you @pasky for this amazing software!! I'm currently trying to adapt Yoda to only query a custom knowledge graph (w/o freebase). |
I strongly recommend adding model dependencies into the pom for production systems and even disabling auto-download entirely (set system property |
Sorry for my ignorance, but to be clear:
are added as well? Like for example, adding And as for setting the system property to true, does that mean executing a command of |
My comment was from the perspective of DKPro Core itself, not from the perspective of yodaqa or gradle. I am not very familiar with gradle. Looking at the list of dependencies you posted above, it seems as if there are no dependencies on the models that are required by all of these components, e.g. MaltParser, BerkeleyParser, etc. So if there are no explicit dependencies then instead of gradle downloading the models at compile time, the DKPro Core components will try to download the models at runtime. For a production system, I would recommend downloading the models at compile-time and disabling auto-download at runtime. There is a guide here about how to add models in a Maven POM - I am not sure how that translates to Gradle. |
I see; I'll look into it and see if downloading the models at compile time + using the system property that disables downloading resources at runtime also resolves the issue. Thank you! |
Is anybody still having similar issue? We are having same issue and gradle script is stuck at 83% command Output A:\yodaqa>gradlew.bat web -Dorg.slf4j.simpleLogger.log.cz.brmlab.yodaqa=debug INFO ServerConnector - Started ServerConnector@13e98e7e{HTTP/1.1}{0.0.0.0:4567}
checked ipv6 connectivity with http://ipv6.whatismyv6.com/ and it looks fine. |
Tried with this command: Exception ALERT: main seems stuck for more than 300s waiting for a job delivery. java.net.SocketException: Unexpected end of file from server Then progress stopped at 83%. Will continue to look more into this. |
./gradlew check stuck at 83 %. Kindly help me to resolve this. cz.brmlab.yodaqa.provider.rdf.DBpediaTypesTest > testQueryTitleForm STARTED
|
@brojokm If you have read all the things that are above, and haven't found your solution, please try both of the following: Or
|
@nagygergo after running ./gradlew check --debug it is showing
|
@brojokm I see. This seems to be an issue with the DBPedia server being down, so the test suite is failing. In the Getting Started guide You can find how to do that here Notice: The disk space and computational cost of running all the data backends alongside yodaQA is a bit beyond what common user hardware (eg. a laptop) can do. You can find more about what hardware others were using. |
After running the command ./gradlew check, the execution hangs during test, output is shown below. I am running the command as admin. Even after leaving the system for whole day.
What could be the reason for this, and how can I fix it ?
/yodaqa-master]$ ./gradlew check
:generateTypeSystem UP-TO-DATE
:compileJava UP-TO-DATE
:compileGroovy UP-TO-DATE
:processResources UP-TO-DATE
:classes UP-TO-DATE
:generateTestTypeSystem UP-TO-DATE
:compileTestJava UP-TO-DATE
:compileTestGroovy UP-TO-DATE
:processTestResources UP-TO-DATE
:testClasses UP-TO-DATE
:test
cz.brmlab.yodaqa.provider.rdf.DBpediaTypesTest > testQueryTitleForm STARTED
The text was updated successfully, but these errors were encountered: