Skip to content

Conversation

@holdenk
Copy link
Contributor

@holdenk holdenk commented Aug 27, 2019

What changes were proposed in this pull request?

Matches the response from minikube service against a regex to extract the URL

Why are the changes needed?

minikube 1.3.1 on OSX has different formatting than expected

Does this PR introduce any user-facing change?

No

How was this patch tested?

Ran the existing integration test run on OSX with minikube 1.3.1

@SparkQA
Copy link

SparkQA commented Aug 27, 2019

@SparkQA
Copy link

SparkQA commented Aug 27, 2019

Test build #109833 has finished for PR 25599 at commit 3cdea4f.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Aug 27, 2019

url
case _ =>
logWarning(s"Response from minikube ${rawUrl} did not match URL regex")
rawUrl
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One question -- did this ever work before? meaning, would we ever get a response that doesn't match the regex legitimately? If so should it be a warning? Or is it that this doesn't work at all right now?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So I've only tested on OSX and just incase someone elses setup doesn't match the regex (which I'm not sure would work) I figured a fall-through with a warning was a good approach. I also considered just throwing here.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Out of curiosity what does the minikube command return for you? wondering if it's something that varies by version or we have a problem with the command outputting extra stuff. Seems like it intends to only return a URL.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Talking with Stavros, this was not happening on previous version of minikube, so if we strip it, we just need to be careful it also works with earlier revs.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the problem is that it's * some://url:port[whitespace] then this looks like a fine fix. Would it help unblock other PRs?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It should be backward compatible. No junk prefix, then that subexpression is empty.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@holdenk OK to merge? seems like a decent fix

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My bad for not responding sooner, yeah it's fine :)

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-28886][KUBERNETES] Fix the DepsTestsSuite with minikube 1.3.1 [SPARK-28886][K8S] Fix the DepsTestsSuite with minikube 1.3.1 Aug 28, 2019
@srowen srowen closed this in 0ed9fae Sep 9, 2019
@srowen
Copy link
Member

srowen commented Sep 9, 2019

Merged to master

PavithraRamachandran pushed a commit to PavithraRamachandran/spark that referenced this pull request Sep 15, 2019
### What changes were proposed in this pull request?

Matches the response from minikube service against a regex to extract the URL

### Why are the changes needed?

minikube 1.3.1 on OSX has different formatting than expected

### Does this PR introduce any user-facing change?

No

### How was this patch tested?

Ran the existing integration test run on OSX with minikube 1.3.1

Closes apache#25599 from holdenk/SPARK-28886-fix-deps-tests-with-minikube-1.3.1.

Authored-by: Holden Karau <hkarau@apple.com>
Signed-off-by: Sean Owen <sean.owen@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants