[SPARK-10554][Core] Fix NPE with ShutdownHook

[nithinasokan]

https://issues.apache.org/jira/browse/SPARK-10554

Fixes NPE when ShutdownHook tries to cleanup temporary folders

[andrewor14]

ok to test

[andrewor14]

Looks fine. I would add a comment to explain that the blockManagerId could be null if the block manager is not initialized properly.

[nithinasokan]

@andrewor14 fixed here 40e487b

[SparkQA]

Test build #42345 has finished for PR 8720 at commit 2639ffd.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • class ShuffleDependency[K: ClassTag, V: ClassTag, C: ClassTag](
  • class CoGroupedRDD[K: ClassTag](
  • class ShuffledRDD[K: ClassTag, V: ClassTag, C: ClassTag](
  • class MultilayerPerceptronClassifier(JavaEstimator, HasFeaturesCol, HasLabelCol, HasPredictionCol,
  • class MultilayerPerceptronClassificationModel(JavaModel):
  • class StringIndexer(JavaEstimator, HasInputCol, HasOutputCol, HasHandleInvalid):
  • ("thresholds", "Thresholds in multi-class classification to adjust the probability of " +
  • class HasHandleInvalid(Params):
  • class HasElasticNetParam(Params):
  • class HasFitIntercept(Params):
  • class HasStandardization(Params):
  • class HasThresholds(Params):
  • thresholds = Param(Params._dummy(), "thresholds", "Thresholds in multi-class classification to adjust the probability of predicting each class. Array must have length equal to the number of classes, with values >= 0. The class with largest value p/t is predicted, where p is the original probability of that class and t is the class' threshold.")
  • self.thresholds = Param(self, "thresholds", "Thresholds in multi-class classification to adjust the probability of predicting each class. Array must have length equal to the number of classes, with values >= 0. The class with largest value p/t is predicted, where p is the original probability of that class and t is the class' threshold.")

[andrewor14]

Hm, retest this please?

[SparkQA]

Test build #42354 has finished for PR 8720 at commit 40e487b.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #42360 has finished for PR 8720 at commit 40e487b.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

Merged to master / 1.5