Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unshim join execs [databricks] #4416

Merged
merged 4 commits into from
Jan 5, 2022
Merged

Conversation

jlowe
Copy link
Member

@jlowe jlowe commented Dec 21, 2021

The various join execs were shimmed solely because Spark moved the location of the build side classes. We already have a GpuBuildSide as a common stand-in for this, along with a shim'd GpuJoinUtils that can convert the Spark build side type to the GPU type. Therefore there isn't a need to keep these joins in the shim any longer. The related shim interfaces for joins also are removed.

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
@jlowe jlowe added this to the Dec 13 - Jan 7 milestone Dec 21, 2021
@jlowe jlowe self-assigned this Dec 21, 2021
@jlowe
Copy link
Member Author

jlowe commented Dec 22, 2021

build

@sameerz sameerz added the build Related to CI / CD or cleanly building label Dec 29, 2021
@jlowe
Copy link
Member Author

jlowe commented Jan 4, 2022

build

Copy link
Collaborator

@revans2 revans2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I love to see this kind of thing happening.

@jlowe
Copy link
Member Author

jlowe commented Jan 4, 2022

CI failures are in udf tests and appear to be unrelated. Executor seemed to hangup during those tests.

@jlowe
Copy link
Member Author

jlowe commented Jan 4, 2022

build

@jlowe
Copy link
Member Author

jlowe commented Jan 5, 2022

build

@jlowe jlowe merged commit 4004ec6 into NVIDIA:branch-22.02 Jan 5, 2022
@jlowe jlowe deleted the unshim-joins branch January 5, 2022 17:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants