[SPARK-25331][SS] Make FileStreamSink ignore partitions of batches that have already been written to file system#22331

Closed

misutoth wants to merge 3 commits intoapache:masterfrom

misutoth:file-sink-dupe

Commits on Sep 4, 2018

Tests for idempotency of FileStreamSink
misutoth
committed

Commits on Sep 19, 2018

[SPARK-25331][SS] Make FileStreamSink ignore partitions of batches that have already been written to file system
misutoth
committed

Commits on Sep 24, 2018

[SPARK-25331][SS] Make newTaskTempFile() fail fast if staging directory has not yet been created.
misutoth
committed