(2nd round) fix under fs and glusterfs configuration issues #630
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is an enhanced fix to #623. Previous fix failed on TestDFSIO test because in that test, the fs.defaultFS property is already set. If so, then avoid overriding this property. This new fix passed the tests.
When tachyon is used for MapReduce jobs, under fs may not be properly initialized.
This fix is to set those properties before under fs initialize() is called. If the properties are already set in core-site.xml, then don't overwrite them.
On my glutster setup, a wordcount test was run to validate this patch. Separately, @pfxuan validated part of the fix on his setup using orangefs as under fs.
The core-site.xml in use can be found at http://pastebin.com/WuR6Xn7v
The wordcount test output can be found at http://pastebin.com/aJJVSBK9