Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update spark330shim to use released lib #5848

Merged

Conversation

pxLi
Copy link
Collaborator

@pxLi pxLi commented Jun 16, 2022

fix #5698

revert #5693

and update spark330 shim as non-snapshot profile

@pxLi pxLi added documentation Improvements or additions to documentation build Related to CI / CD or cleanly building labels Jun 16, 2022
@pxLi
Copy link
Collaborator Author

pxLi commented Jun 16, 2022

build

1 similar comment
@NvTimLiu
Copy link
Collaborator

build

@@ -171,6 +171,7 @@ case $DIST_PROFILE in
313
320
321
330
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should drop it from snapshots?(WithDatabricks)) on L162

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good catch! updated

@pxLi
Copy link
Collaborator Author

pxLi commented Jun 16, 2022

build

@pxLi pxLi merged commit d1f601a into NVIDIA:branch-22.06 Jun 16, 2022
// temporarily allow 3.3.1 while 3.3.0 release candidates are being produced
private val VERSION331 = SparkShimVersion(3, 3, 1)
val VERSIONNAMES = Seq(VERSION, VERSION331).flatMap(v => Seq(s"$v", s"$v-SNAPSHOT"))
val VERSIONNAMES = Seq(s"$VERSION", s"$VERSION-SNAPSHOT")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Snapshot support should have been removed here, posted a fix at #5858. I don't think it's must-fix for 22.06.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants