Skip to content

Commit

Permalink
2815!3.5.4+affirm.dev2 release: This build works with batch-infra-tas…
Browse files Browse the repository at this point in the history
…ks DT spark sentinels

- Revert back to iceberg-aws-bundle and remove software.amazon.awssdk
- Switch hadoop-aws to hadoop.version otherwise, Spark would fail to find the classes
  • Loading branch information
mrafayaleem committed Feb 6, 2025
1 parent afd4f88 commit 13511ac
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 5 deletions.
8 changes: 4 additions & 4 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -434,14 +434,14 @@
<scope>runtime</scope>
</dependency>
<dependency>
<groupId>software.amazon.awssdk</groupId>
<artifactId>bundle</artifactId>
<version>2.30.13</version>
<groupId>org.apache.iceberg</groupId>
<artifactId>iceberg-aws-bundle</artifactId>
<version>1.7.1</version>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-aws</artifactId>
<version>3.4.1</version>
<version>${hadoop.version}</version>
</dependency>
</dependencies>
<dependencyManagement>
Expand Down
2 changes: 1 addition & 1 deletion python/pyspark/version.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,4 @@
# See the License for the specific language governing permissions and
# limitations under the License.

__version__: str = "3.5.4"
__version__: str = "2815!3.5.4+affirm.dev2"

0 comments on commit 13511ac

Please sign in to comment.