Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix GpuSum type to match resultType #3500

Merged
merged 2 commits into from
Sep 16, 2021

Conversation

abellina
Copy link
Collaborator

This fixes an issue that @andygrove had found in Spark 3.2.0. The explicit casting was removed as part of #3417, and I am adding it here in the preUpdate step. Some of this could be folded into the input projection, as done with GpuAverage, but for now this works and should unblock those testing with 3.2.0.

The binding is odd and we are cleaning up as part of #3194

… aggregation in sum

Signed-off-by: Alessandro Bellina <abellina@nvidia.com>
@abellina abellina added Spark 3.2+ bug Something isn't working labels Sep 15, 2021
@abellina abellina changed the title Shuffle/fix gpu sum type cast Fix GpuSum type to match resultType Sep 15, 2021
Copy link
Contributor

@andygrove andygrove left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I confirmed that merging this to branch-21.10 fixes the regressions when run with Spark 3.2

@abellina
Copy link
Collaborator Author

build

@jlowe
Copy link
Member

jlowe commented Sep 15, 2021

build

@pxLi
Copy link
Collaborator

pxLi commented Sep 16, 2021

build -- 429 failure

@pxLi
Copy link
Collaborator

pxLi commented Sep 16, 2021

build

1 similar comment
@pxLi
Copy link
Collaborator

pxLi commented Sep 16, 2021

build

@abellina abellina merged commit 119f473 into NVIDIA:branch-21.10 Sep 16, 2021
@abellina
Copy link
Collaborator Author

Thanks @pxLi !

@abellina abellina deleted the shuffle/fix_gpu_sum_type_cast branch September 16, 2021 04:37
@sameerz sameerz added this to the Sep 13 - Sep 24 milestone Sep 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Spark 3.2+
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants