[SPARK-13825][CORE] Upgrade to Scala 2.11.8

[jaceklaskowski]

What changes were proposed in this pull request?

Upgrade to 2.11.8 (from the current 2.11.7)

How was this patch tested?

A manual build

[srowen]

Jenkins test this please

[srowen]

This is OK for 2.x of course, and 1.6.x too I think. It's just a bug release, and the 2.11 build is the secondary one for 1.6 anyway, so slightly lower risk in any event.

[SparkQA]

Test build #53027 has finished for PR 11681 at commit 5ae9816.

• This patch fails build dependency tests.
• This patch merges cleanly.
• This patch adds no public classes.

[JoshRosen]

Hey @jaceklaskowski, you should run ./dev/test-dependencies.sh --replace-manifest and commit the result in order to get the dependency tests to pass.

[jaceklaskowski]

@srowen Mind triggering a test? Thanks!

[srowen]

Jenkins test this please

[SparkQA]

Test build #53206 has finished for PR 11681 at commit 3e3356c.

• This patch fails to build.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

(Copying part of my email) This fails because we don't have the fork of genjavadoc compiled for Spark 2.11.8.

We can see the org.spark-project packages here:

http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.spark-project%22

I've forgotten who maintains the custom fork builds, and I don't know
the reasons we needed a fork of genjavadoc. Is it still relevant?

Heh, there's no plugin for 2.11.8 from the upstream project either anyway:
http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22com.typesafe.genjavadoc%22

This may be blocked for now

[srowen]

@mengxr is it possible to generate these plugins one more time for Scala 2.11.8 and 2.10.6? Maybe it's the last time we need to.
(Upstream now has plugins for 2.11.8/2.10.6)

[mengxr]

I will do a cross build and @brkyvz will help publish the jars. cc: @jodersky

[brkyvz]

@mengxr @srowen @jaceklaskowski Jars are now published. They should be available in a couple of hours if not already.

[srowen]

Jenkins retest this please

[SparkQA]

Test build #54174 has finished for PR 11681 at commit 3e3356c.

• This patch fails to build.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

Thanks @brkyvz -- it doesn't look like it pushed yet but maybe there's a delay. I can check again in a few days. http://search.maven.org/#search%7Cga%7C1%7Corg.spark-project%20genjavadoc

[srowen]

@brkyvz @mengxr it looks like the artifacts haven't pushed. Is it possible to double-check what happened there?

[brkyvz]

@srowen I realized that I forgot to push the release button :( They've been available under staging repositories at:
https://oss.sonatype.org/content/repositories/orgspark-project-1118 and
https://oss.sonatype.org/content/repositories/orgspark-project-1119

very sorry for the delay

[srowen]

Ha yeah I've done that before in Sonatype.

[srowen]

Jenkins retest this please

[jodersky]

FYI, I have two PRs pending to get the genjavadoc changes merged into upstream. I haven't had any feedback yet so if anyone wants to have a look please do lightbend/genjavadoc#70 lightbend/genjavadoc#71

[SparkQA]

Test build #54679 has finished for PR 11681 at commit 3e3356c.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

Merged to master