Skip to content

Conversation

@kiszk
Copy link
Member

@kiszk kiszk commented Sep 8, 2017

What changes were proposed in this pull request?

This PR fixes flaky test InMemoryCatalogedDDLSuite "alter table: rename cached table".
Since this test validates distributed DataFrame, the result should be checked by using checkAnswer. The original version used df.collect().Seq method that does not guaranty an order of each element of the result.

How was this patch tested?

Use existing test case

@kiszk kiszk changed the title [TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite [SPARK-21946][TEST]: fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite Sep 8, 2017
@gatorsmile
Copy link
Member

LGTM pending Jenkins.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM, too.
Thank you for picking up this, @kiszk .

@SparkQA
Copy link

SparkQA commented Sep 8, 2017

Test build #81539 has finished for PR 19159 at commit 7a47891.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

Retest this please.

@SparkQA
Copy link

SparkQA commented Sep 8, 2017

Test build #81543 has finished for PR 19159 at commit 7a47891.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gatorsmile
Copy link
Member

Thanks! Merged to master/2.2

asfgit pushed a commit that referenced this pull request Sep 8, 2017
…" in InMemoryCatalogedDDLSuite

## What changes were proposed in this pull request?

This PR fixes flaky test `InMemoryCatalogedDDLSuite "alter table: rename cached table"`.
Since this test validates distributed DataFrame, the result should be checked by using `checkAnswer`. The original version used `df.collect().Seq` method that does not guaranty an order of each element of the result.

## How was this patch tested?

Use existing test case

Author: Kazuaki Ishizaki <ishizaki@jp.ibm.com>

Closes #19159 from kiszk/SPARK-21946.

(cherry picked from commit 8a4f228)
Signed-off-by: gatorsmile <gatorsmile@gmail.com>
@asfgit asfgit closed this in 8a4f228 Sep 8, 2017
MatthewRBruce pushed a commit to Shopify/spark that referenced this pull request Jul 31, 2018
…" in InMemoryCatalogedDDLSuite

## What changes were proposed in this pull request?

This PR fixes flaky test `InMemoryCatalogedDDLSuite "alter table: rename cached table"`.
Since this test validates distributed DataFrame, the result should be checked by using `checkAnswer`. The original version used `df.collect().Seq` method that does not guaranty an order of each element of the result.

## How was this patch tested?

Use existing test case

Author: Kazuaki Ishizaki <ishizaki@jp.ibm.com>

Closes apache#19159 from kiszk/SPARK-21946.

(cherry picked from commit 8a4f228)
Signed-off-by: gatorsmile <gatorsmile@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants