Skip to content

Conversation

@BryanCutler
Copy link
Member

Executing deploy.client.TestClient fails due to bad class name for TestExecutor in ApplicationDescription.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps a naive question, but why not use classOf[TextExecutor].getCanonicalName so that this doesn't break in the future and is easier to grep with IntelliJ?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree that would be better. Since TestExecutor is an object, it looks like I would have to use TestExecutor.getClass.getCanonicalName which returns "org.apache.spark.deploy.client.TestExecutor$" and then the $ would need to be removed.

So it's slightly more complicated, but still probably more future proof. Let me implement that and verify everything still works.

@SparkQA
Copy link

SparkQA commented Oct 23, 2015

Test build #44239 has finished for PR 9255 at commit 4d0a593.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@BryanCutler
Copy link
Member Author

test this please

@srowen
Copy link
Member

srowen commented Oct 23, 2015

Is the issue that it's missing "org.apache" or something -- does it cause a problem?

@BryanCutler
Copy link
Member Author

Yes, it was missing "org.apache" and when running the TestClient, the master continuously tries and fails to start an executor.

@srowen
Copy link
Member

srowen commented Oct 23, 2015

Heh, I think this was just an oversight from the long-ago rename from spark.* to org.apache.spark.* as it exists in the initial revision: https://github.com/apache/spark/blob/46eecd110a4017ea0c86cbb1010d0ccd6a5eb2ef/core/src/main/scala/org/apache/spark/deploy/client/TestClient.scala

It does look like a typo, and I suppose this has just never been used ... ? probably virtually dead code but hey, let's just fix it.

@BryanCutler
Copy link
Member Author

Haha, that's what I thought.. I must be the only one trying to run this code! But it did help me quickly test something, so it served some purpose :)

@SparkQA
Copy link

SparkQA commented Oct 23, 2015

Test build #44250 has finished for PR 9255 at commit 1fab574.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Oct 23, 2015

Test build #44254 has finished for PR 9255 at commit 1fab574.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Oct 25, 2015

Test build #1955 has finished for PR 9255 at commit 1fab574.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

asfgit pushed a commit that referenced this pull request Oct 25, 2015
…ploy.client.TestClient

Executing deploy.client.TestClient fails due to bad class name for TestExecutor in ApplicationDescription.

Author: Bryan Cutler <bjcutler@us.ibm.com>

Closes #9255 from BryanCutler/fix-TestClient-classname-SPARK-11287.

(cherry picked from commit 80279ac)
Signed-off-by: Sean Owen <sowen@cloudera.com>
@asfgit asfgit closed this in 80279ac Oct 25, 2015
@srowen
Copy link
Member

srowen commented Oct 25, 2015

Merged to master/1.5

@BryanCutler BryanCutler deleted the fix-TestClient-classname-SPARK-11287 branch November 18, 2015 21:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants