[SPARK-22233] [core] Allow user to filter out empty split in HadoopRDD#19464

Closed

liutang123 wants to merge 8 commits intoapache:masterfrom

liutang123:SPARK-22233

Commits on Oct 10, 2017

allow user to filter out empty split in HadoopRDD
nicholijia
committed

Commits on Oct 12, 2017

change spark.hadoop.filterOutEmptySplit to spark.files.filterOutEmptySplit and add it to internal/config; add test case
nicholijia
committed
simpfy code; use spark.files.ignoreEmptySplits as config name
nicholijia
committed
optimize code.
nicholijia
committed

Commits on Oct 13, 2017

Commits on Oct 14, 2017