-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-15899] [SQL] Fix the construction of the file path with hadoop Path for Spark 2.0 #14600
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…path in create table string
|
Jenkins test this please |
|
Test build #63604 has finished for PR 14600 at commit
|
|
Thanks @avulanov for the follow up. Merging to 2.0 |
…Path for Spark 2.0 This PR contains the adaptation of #13868 for Spark 2.0 ## What changes were proposed in this pull request? Fix the construction of the file path in `SQLConf.scala` and unit tests that rely on this: `SQLConfSuite` and `DDLSuite`. Previous way of construction caused the creation of incorrect path on Windows. ## How was this patch tested? Run unit tests on Windows Author: avulanov <nashb@yandex.ru> Closes #14600 from avulanov/SPARK-15899-file-2.0.
|
When can we expect a spark release with those changes incorporated? |
|
You can take a look at the JIRA -- would be in 2.0.1 or 2.1.0 whichever comes first. It could be a month or two before one of those happens. There's a workaround in the JIRA though. |
|
Can anyone post the sample usage for this exception in Spark 2.0, I'm still facing this exception? |
|
@srowen Do you mind if I ask this is supposed to be closed (as it is merged into 2.0)? |
|
Yes @avulanov can you close it? we can't close it directly and the bot can only close PRs opened vs master. |
Praveenmail2him
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It is fixed.
This PR contains the adaptation of #13868 for Spark 2.0
What changes were proposed in this pull request?
Fix the construction of the file path in
SQLConf.scalaand unit tests that rely on this:SQLConfSuiteandDDLSuite. Previous way of construction caused the creation of incorrect path on Windows.How was this patch tested?
Run unit tests on Windows