v1.3.0

Update

• Spark to 3.3.0
• Delta to 2.2.0

update dependencies

v1.1.1

update dependencies

update to Spark3

v1.1.0

TEDO-1157 upgrade to Spark3

Deliver transitive dependencies

When installing the library, python will install also the pyspark-core-utils dependencies.

v1.0.1: Merge pull request #1 from christiandietze/main

Do not deliver Spark dependency

v1.0

First release of PySpark Core Utils library

Features:

• PySpark session config built from provided configuration
• Configuration is loaded by configurations file and command line
• Supports multi environment
• Provides a Logging solution the app
• Provides multi steps for organising your steps (init, run, cleanup)