Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DNM] [core] Fix for Spark3.2.0 support #3063

Closed
wants to merge 2 commits into from
Closed

Conversation

yma11
Copy link
Contributor

@yma11 yma11 commented Sep 7, 2023

What changes were proposed in this pull request?

fix build failure for Spark3.2.0

How was this patch tested?

N/A

@github-actions
Copy link

github-actions bot commented Sep 7, 2023

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

@github-actions
Copy link

github-actions bot commented Sep 7, 2023

Run Gluten Clickhouse CI

@FelixYBW FelixYBW changed the title Fix for Spark3.2.0 support [core] Fix for Spark3.2.0 support Sep 9, 2023
@FelixYBW FelixYBW changed the title [core] Fix for Spark3.2.0 support [DNM] [core] Fix for Spark3.2.0 support Sep 11, 2023
@FelixYBW
Copy link
Contributor

Internally we don't track the Spark3.2.0. The PR is used for customers who happen to use spark3.2.0

@winningsix
Copy link
Contributor

Nit: @yma11 Do we want to fix gluten-it as well reported by CI/CD? Not sure whether further issues can be identified as well.

java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.DataSourceUtils$.datetimeRebaseMode(Lscala/Function1;Ljava/lang/String;)Lscala/Enumeration$Value;
at

@yma11
Copy link
Contributor Author

yma11 commented Sep 12, 2023

Nit: @yma11 Do we want to fix gluten-it as well reported by CI/CD? Not sure whether further issues can be identified as well.

java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.DataSourceUtils$.datetimeRebaseMode(Lscala/Function1;Ljava/lang/String;)Lscala/Enumeration$Value;
at

No, we won't fix it as we don't officially support Spark3.2.0. This PR will be kept open and customer can cherry pick it if need.

@github-actions
Copy link

Run Gluten Clickhouse CI

@FelixYBW FelixYBW added the spark 3.2.0 for spark3.2.0 support, not merge into main label Sep 28, 2023
Copy link

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.

@github-actions github-actions bot added the stale stale label Nov 13, 2023
Copy link

This PR was closed because it has been stalled for 10 days with no activity.

@github-actions github-actions bot closed this Nov 23, 2023
@yma11 yma11 deleted the spark32 branch January 10, 2024 07:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
spark 3.2.0 for spark3.2.0 support, not merge into main stale stale
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants