[SPARK-17159][Streaming] optimise check for new files in FileInputDStream#17745

Closed

steveloughran wants to merge 1 commit intoapache:masterfrom

steveloughran:cloud/SPARK-17159-listfiles-minimal

Commits on Apr 24, 2017

SPARK-17159 minimal patch of hchanges to FileInputDStream to reduce File status requests when querying files. This is a minor optimisation when working with filesystems, but significant when workin…
steveloughran
committed