Skip to content

Conversation

@dbtsai
Copy link
Member

@dbtsai dbtsai commented Mar 5, 2020

What changes were proposed in this pull request?

There are two implementation of quoteIfNeeded. One is in org.apache.spark.sql.connector.catalog.CatalogV2Implicits.quote and the other is in OrcFiltersBase.quoteAttributeNameIfNeeded. This PR will consolidate them into one.

Why are the changes needed?

Simplify the codebase.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Existing UTs.

@dbtsai dbtsai changed the title [SPARK-31058] [SQL] Consolidate the implementation of quoteIfNeeded [SPARK-31058] [SQL] [test-hive1.2] Consolidate the implementation of quoteIfNeeded Mar 5, 2020
@dbtsai
Copy link
Member Author

dbtsai commented Mar 5, 2020

jenkins retest this please

@SparkQA
Copy link

SparkQA commented Mar 5, 2020

Test build #119414 has finished for PR 27814 at commit 7623d06.

  • This patch fails Scala style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@gengliangwang gengliangwang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM.

@dbtsai dbtsai closed this in fe126a6 Mar 6, 2020
dbtsai added a commit that referenced this pull request Mar 6, 2020
…uoteIfNeeded`

### What changes were proposed in this pull request?
There are two implementation of quoteIfNeeded.  One is in `org.apache.spark.sql.connector.catalog.CatalogV2Implicits.quote` and the other is in `OrcFiltersBase.quoteAttributeNameIfNeeded`. This PR will consolidate them into one.

### Why are the changes needed?
Simplify the codebase.

### Does this PR introduce any user-facing change?
No

### How was this patch tested?
Existing UTs.

Closes #27814 from dbtsai/SPARK-31058.

Authored-by: DB Tsai <d_tsai@apple.com>
Signed-off-by: DB Tsai <d_tsai@apple.com>
(cherry picked from commit fe126a6)
Signed-off-by: DB Tsai <d_tsai@apple.com>
@dbtsai
Copy link
Member Author

dbtsai commented Mar 6, 2020

Merged in master/3.0. Thanks.

@dbtsai dbtsai deleted the SPARK-31058 branch March 6, 2020 00:15
@SparkQA
Copy link

SparkQA commented Mar 6, 2020

Test build #119422 has finished for PR 27814 at commit 12ef04d.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dbtsai
Copy link
Member Author

dbtsai commented Mar 6, 2020

Note that, the test was failing on non related kafka test due to timeout.

@SparkQA
Copy link

SparkQA commented Mar 6, 2020

Test build #119412 has finished for PR 27814 at commit 7623d06.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Mar 6, 2020

Test build #119417 has finished for PR 27814 at commit 89445fe.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

sjincho pushed a commit to sjincho/spark that referenced this pull request Apr 15, 2020
…uoteIfNeeded`

### What changes were proposed in this pull request?
There are two implementation of quoteIfNeeded.  One is in `org.apache.spark.sql.connector.catalog.CatalogV2Implicits.quote` and the other is in `OrcFiltersBase.quoteAttributeNameIfNeeded`. This PR will consolidate them into one.

### Why are the changes needed?
Simplify the codebase.

### Does this PR introduce any user-facing change?
No

### How was this patch tested?
Existing UTs.

Closes apache#27814 from dbtsai/SPARK-31058.

Authored-by: DB Tsai <d_tsai@apple.com>
Signed-off-by: DB Tsai <d_tsai@apple.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants