Optimize initial import with GridFS

[richardwilly98]

GridFS.getFileList() return DBObject(s) where GridFSDBFile.getInputStream failed [1].
Due to this issue we currently call an additional GridFSDBFile.findOne()

This code should most likely be optimized [2].

Related to #47

[1] - mongodb/mongo-java-driver#48
[2] - https://github.com/richardwilly98/elasticsearch-river-mongodb/blob/master/src/main/java/org/elasticsearch/river/mongodb/Slurper.java#L145

[richardwilly98]

Question has been posted here [1].

[1] - https://groups.google.com/forum/#!topic/mongodb-user/1cyufSRfN1I

[benmccann]

FYI, I'm having a test failing on the current master that might be related to this

Failed tests: testImportPDFAttachment(org.elasticsearch.river.mongodb.gridfs.RiverMongoWithGridFSTest): testImportPDFAttachment failed

[richardwilly98]

@benmccann the latest build was successful [1].

I have seen by past some issue with unit test due to time to index the document in ES. I have recently changed the time to wait for a document to be indexed from 6 sec to 2 sec [2] Drone CI server seems happy with the change (I was initially using BuildHive).

Could you please try to revert back to 6 sec to see if it helps? Also make sure to clean target folder.
If not please provide the console log and target/test-elasticsearch-river-mongo.log

[1] - https://drone.io/github.com/richardwilly98/elasticsearch-river-mongodb/latest
[2] - 220e51c#L3L83

[richardwilly98]

@benmccann still having issues with test failing?

[benmccann]

Haven't done any development on this in the past couple weeks. I'll be sure to try your suggestion if I run into a test failure again.