Skip to content

[SPARK-6216] [PySpark] check the python version in worker #5404

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
davies wants to merge 2 commits into from
Closed

[SPARK-6216] [PySpark] check the python version in worker #5404

davies wants to merge 2 commits into from

Conversation

@davies
Copy link
Contributor

@davies davies commented Apr 7, 2015

No description provided.

@SparkQA
Copy link

SparkQA commented Apr 7, 2015

Test build #29819 has started for PR 5404 at commit e559248.

@SparkQA
Copy link

SparkQA commented Apr 8, 2015

Test build #29819 has finished for PR 5404 at commit e559248.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.
  • This patch does not change any dependencies.

@AmplabJenkins
Copy link

AmplabJenkins commented Apr 8, 2015

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29819/
Test PASSed.

@JoshRosen
Copy link
Contributor

JoshRosen commented Apr 10, 2015

LGTM. I'm going to pull merge this into master (1.4.0). Thanks!

@asfgit asfgit closed this in 4740d6a Apr 10, 2015
@davies davies mentioned this pull request May 15, 2015
Closed
asfgit pushed a commit that referenced this pull request May 18, 2015
@JoshRosen
[SPARK-6216] [PYSPARK] check python version of worker with driver
a833209 
This PR revert #5404, change to pass the version of python in driver into JVM, check it in worker before deserializing closure, then it can works with different major version of Python.

Author: Davies Liu <davies@databricks.com>

Closes #6203 from davies/py_version and squashes the following commits:

b8fb76e [Davies Liu] fix test
6ce5096 [Davies Liu] use string for version
47c6278 [Davies Liu] check python version of worker with driver

(cherry picked from commit 32fbd29)
Signed-off-by: Josh Rosen <joshrosen@databricks.com>
asfgit pushed a commit that referenced this pull request May 18, 2015
@JoshRosen
[SPARK-6216] [PYSPARK] check python version of worker with driver
32fbd29 
This PR revert #5404, change to pass the version of python in driver into JVM, check it in worker before deserializing closure, then it can works with different major version of Python.

Author: Davies Liu <davies@databricks.com>

Closes #6203 from davies/py_version and squashes the following commits:

b8fb76e [Davies Liu] fix test
6ce5096 [Davies Liu] use string for version
47c6278 [Davies Liu] check python version of worker with driver
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request May 28, 2015
@jeanlyn
[SPARK-6216] [PYSPARK] check python version of worker with driver
6ee9228 
This PR revert apache#5404, change to pass the version of python in driver into JVM, check it in worker before deserializing closure, then it can works with different major version of Python.

Author: Davies Liu <davies@databricks.com>

Closes apache#6203 from davies/py_version and squashes the following commits:

b8fb76e [Davies Liu] fix test
6ce5096 [Davies Liu] use string for version
47c6278 [Davies Liu] check python version of worker with driver
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
@jeanlyn
[SPARK-6216] [PYSPARK] check python version of worker with driver
f58e5b5 
This PR revert apache#5404, change to pass the version of python in driver into JVM, check it in worker before deserializing closure, then it can works with different major version of Python.

Author: Davies Liu <davies@databricks.com>

Closes apache#6203 from davies/py_version and squashes the following commits:

b8fb76e [Davies Liu] fix test
6ce5096 [Davies Liu] use string for version
47c6278 [Davies Liu] check python version of worker with driver
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
@nemccarthy
[SPARK-6216] [PYSPARK] check python version of worker with driver
df617b9 
This PR revert apache#5404, change to pass the version of python in driver into JVM, check it in worker before deserializing closure, then it can works with different major version of Python.

Author: Davies Liu <davies@databricks.com>

Closes apache#6203 from davies/py_version and squashes the following commits:

b8fb76e [Davies Liu] fix test
6ce5096 [Davies Liu] use string for version
47c6278 [Davies Liu] check python version of worker with driver
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@davies @SparkQA @AmplabJenkins @JoshRosen