Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use consistent version of string_to_timestamp_nanos in DataFusion #767

Merged
merged 3 commits into from
Jul 24, 2021

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Jul 21, 2021

Which issue does this PR close?

Resolves #766.

Rationale for this change

Constant folding was using a different implementation than if the function was evaluated

What changes are included in this PR?

Use same function

Are there any user-facing changes?

no

Notes

It would probably be good to simply remove the copy in DataFusion and use the one upstream in arrow, but given #765 I thought it would be prudent to wait until we are are more confident to do so

@github-actions github-actions bot added the datafusion Changes in the datafusion crate label Jul 21, 2021
Copy link
Contributor

@Dandandan Dandandan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Maybe could use a test to make sure the right one is used?

@alamb
Copy link
Contributor Author

alamb commented Jul 22, 2021

Looks good. Maybe could use a test to make sure the right one is used?

What would you think about simply deleting the copy in datafusion (and always using the one in arrow) ? That is probably the best test :)

@alamb alamb force-pushed the alamb/unified_timestamps branch from ead2ce3 to aba03df Compare July 23, 2021 21:15
@alamb
Copy link
Contributor Author

alamb commented Jul 23, 2021

@Dandandan I pushed a commit to remove the copy of string_to_timestamp_nanos in DataFusion entirely -- what do you think of this change?

cc @velvia

@Dandandan
Copy link
Contributor

Nice cleanup 👍

@alamb alamb merged commit 5151135 into apache:master Jul 24, 2021
@houqp houqp added the bug Something isn't working label Aug 7, 2021
@alamb alamb deleted the alamb/unified_timestamps branch October 6, 2022 18:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working datafusion Changes in the datafusion crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Constant folding of to_timestamp uses different implementation than actual function call
3 participants