[SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files#24110

Closed

xuanyuanking wants to merge 16 commits intoapache:masterfrom

xuanyuanking:SPARK-25341-3.0

Commits on Apr 22, 2019

Changes on reader writer and extend shuffle block id
xuanyuanking
committed
Add mapSideIndeterminate in shuffle dependency

liyuanjian
authored and
xuanyuanking
committed
Rerun all indeterminate stage

liyuanjian
authored and
xuanyuanking
committed
UT fix

liyuanjian
authored and
xuanyuanking
committed
Fix mima test

liyuanjian
authored and
xuanyuanking
committed
Add new UT

liyuanjian
authored and
xuanyuanking
committed
fix after rebase
xuanyuanking
committed
Bug fix after SPARK-25250
xuanyuanking
committed
extend all shuffle block id, not only the indeterminate ones.
xuanyuanking
committed
rebase and fix build
xuanyuanking
committed
reimplement by using the local properties of Task
xuanyuanking
committed
UT fix and comment address
xuanyuanking
committed
address comment
xuanyuanking
committed
address comment 4.7
xuanyuanking
committed
fix and address rxin comments
xuanyuanking
committed
address #24359
xuanyuanking
committed