Skip to content

Conversation

@xuanyuanking
Copy link
Member

What changes were proposed in this pull request?

Backport #23277 to branch 2.2 without the metrics renaming.

How was this patch tested?

New test case in SQLMetricsSuite.

@SparkQA
Copy link

SparkQA commented Dec 12, 2018

Test build #100036 has finished for PR 23300 at commit 6c442d1.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

@xuanyuanking .
It seems to fail to build.

[error] /home/jenkins/workspace/SparkPullRequestBuilder/sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala:447: package org.apache.spark.sql.test is not a value
[error]   test("SPARK-26327: FileSourceScanExec metrics") {
[error]   ^
[error] /home/jenkins/workspace/SparkPullRequestBuilder/sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala:448: not found: value withTable
[error]     withTable("testDataForScan") {
[error]     ^
[error] /home/jenkins/workspace/SparkPullRequestBuilder/sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala:449: not found: value spark
[error]       spark.range(10).selectExpr("id", "id % 3 as p")
[error]       ^
[error] /home/jenkins/workspace/SparkPullRequestBuilder/sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala:452: not found: value spark
[error]       val df = spark.sql(
[error]                ^
[error] /home/jenkins/workspace/SparkPullRequestBuilder/sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala:454: not found: value testSparkPlanMetrics
[error]       testSparkPlanMetrics(df, 1, Map(
[error]       ^

@xuanyuanking
Copy link
Member Author

Yea UT cherry-pick in a wrong place, sorry for this, fix in this commit.

@SparkQA
Copy link

SparkQA commented Dec 13, 2018

Test build #100060 has finished for PR 23300 at commit 7239aac.

  • This patch fails SparkR unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

Retest this please.

@SparkQA
Copy link

SparkQA commented Dec 13, 2018

Test build #100097 has finished for PR 23300 at commit 7239aac.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Merged to branch-2.2.
Thanks.

asfgit pushed a commit that referenced this pull request Dec 14, 2018
…rics update

## What changes were proposed in this pull request?

Backport #23277 to branch 2.2 without the metrics renaming.

## How was this patch tested?

New test case in `SQLMetricsSuite`.

Closes #23300 from xuanyuanking/SPARK-26327-2.2.

Authored-by: Yuanjian Li <xyliyuanjian@gmail.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@xuanyuanking
Copy link
Member Author

Thanks Dongjoon.

@xuanyuanking xuanyuanking deleted the SPARK-26327-2.2 branch December 15, 2018 06:01
Willymontaz pushed a commit to criteo-forks/spark that referenced this pull request Sep 26, 2019
…rics update

## What changes were proposed in this pull request?

Backport apache#23277 to branch 2.2 without the metrics renaming.

## How was this patch tested?

New test case in `SQLMetricsSuite`.

Closes apache#23300 from xuanyuanking/SPARK-26327-2.2.

Authored-by: Yuanjian Li <xyliyuanjian@gmail.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Willymontaz pushed a commit to criteo-forks/spark that referenced this pull request Sep 27, 2019
…rics update

## What changes were proposed in this pull request?

Backport apache#23277 to branch 2.2 without the metrics renaming.

## How was this patch tested?

New test case in `SQLMetricsSuite`.

Closes apache#23300 from xuanyuanking/SPARK-26327-2.2.

Authored-by: Yuanjian Li <xyliyuanjian@gmail.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants