Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade Apache Spark to 3.4.0 #1880

Merged
merged 13 commits into from
Apr 14, 2023
Merged

Upgrade Apache Spark to 3.4.0 #1880

Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
22e1673
1.
bjornjorgensen Feb 22, 2023
c2ab900
rc2
bjornjorgensen Mar 2, 2023
f4a4611
Merge branch 'main' into spark3.4
mathbunnyru Mar 7, 2023
27c9fb2
rc3
bjornjorgensen Mar 9, 2023
62ac0f7
Merge branch 'main' into spark3.4
bjornjorgensen Mar 9, 2023
ce9189f
RC4
bjornjorgensen Mar 10, 2023
1f3c181
fix checksum
bjornjorgensen Mar 10, 2023
1d15559
rc5
bjornjorgensen Mar 30, 2023
1a25fee
Merge branch 'main' into spark3.4
bjornjorgensen Mar 30, 2023
8779235
Merge branch 'main' into spark3.4
mathbunnyru Apr 4, 2023
0f7446e
rc6
bjornjorgensen Apr 7, 2023
0977688
rc7
bjornjorgensen Apr 8, 2023
1ee2413
3.4.0
bjornjorgensen Apr 13, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions pyspark-notebook/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,10 +15,10 @@ USER root
# Spark dependencies
# Default values can be overridden at build time
# (ARGS are in lower case to distinguish them from ENV)
ARG spark_version="3.3.2"
ARG spark_version="3.4.0"
ARG hadoop_version="3"
ARG scala_version
ARG spark_checksum="4cd2396069fbe0f8efde2af4fd301bf46f8c6317e9dea1dd42a405de6a38380635d49b17972cb92c619431acece2c3af4c23bfdf193cedb3ea913ed69ded23a1"
ARG spark_checksum="67bc912e9192ef2159540cb480820e5466dfd91e907c97c5a4787587e3020be042b76c40c51854f2a5dbeb8c3775fe12d9021c1200c4704463ec644132243a69"
ARG openjdk_version="17"

ENV APACHE_SPARK_VERSION="${spark_version}" \
Expand Down