Skip to content

Conversation

@yaooqinn
Copy link
Member

@yaooqinn yaooqinn commented Feb 28, 2020

This reverts commit afaeb29.

What changes were proposed in this pull request?

Based on the result and comment from #27552 (comment)

In the hive module, server-side provides datetime values simply use value.toSting, and the client-side regenerates the results back in HiveBaseResultSet with java.sql.Date(Timestamp).valueOf.
there will be inconsistency between client and server if we use java8 APIs

Why are the changes needed?

the change is still unclear enough

Does this PR introduce any user-facing change?

no

How was this patch tested?

Nah

@yaooqinn
Copy link
Member Author

cc @cloud-fan and @MaxGekk

SELECT DATE_TRUNC('MILLENNIUM', DATE '1970-03-20')

the case passed both SQLQueryTestSuite and ThriftServerQueryTestSuite w/o that commit.

localSparkSession.conf.set(SQLConf.ANSI_ENABLED.key, true)
case _ =>
}
localSparkSession.conf.set(SQLConf.DATETIME_JAVA8API_ENABLED.key, true)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we remove this?

The main goal of #27552 is to remove this line. If we can remove it and still pass all tests, then #27552 can be safely removed.

@SparkQA
Copy link

SparkQA commented Feb 28, 2020

Test build #119083 has finished for PR 27733 at commit bcfacb3.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Feb 28, 2020

Test build #119086 has finished for PR 27733 at commit 532f99c.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@cloud-fan
Copy link
Contributor

retest this please

@SparkQA
Copy link

SparkQA commented Feb 28, 2020

Test build #119092 has finished for PR 27733 at commit 532f99c.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yaooqinn yaooqinn requested a review from cloud-fan March 3, 2020 06:02
@cloud-fan
Copy link
Contributor

thanks, merging to master/3.0!

@cloud-fan cloud-fan closed this in 1fac06c Mar 3, 2020
cloud-fan pushed a commit that referenced this pull request Mar 3, 2020
This reverts commit afaeb29.

### What changes were proposed in this pull request?

Based on the result and comment from #27552 (comment)

In the hive module, server-side provides datetime values simply use `value.toSting`, and the client-side regenerates the results back in `HiveBaseResultSet` with `java.sql.Date(Timestamp).valueOf`.
there will be inconsistency between client and server if we use java8 APIs

### Why are the changes needed?

the change is still unclear enough

### Does this PR introduce any user-facing change?

no
### How was this patch tested?

Nah

Closes #27733 from yaooqinn/SPARK-30808.

Authored-by: Kent Yao <yaooqinn@hotmail.com>
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
(cherry picked from commit 1fac06c)
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
sjincho pushed a commit to sjincho/spark that referenced this pull request Apr 15, 2020
This reverts commit afaeb29.

### What changes were proposed in this pull request?

Based on the result and comment from apache#27552 (comment)

In the hive module, server-side provides datetime values simply use `value.toSting`, and the client-side regenerates the results back in `HiveBaseResultSet` with `java.sql.Date(Timestamp).valueOf`.
there will be inconsistency between client and server if we use java8 APIs

### Why are the changes needed?

the change is still unclear enough

### Does this PR introduce any user-facing change?

no
### How was this patch tested?

Nah

Closes apache#27733 from yaooqinn/SPARK-30808.

Authored-by: Kent Yao <yaooqinn@hotmail.com>
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants