v1.0
First release of PySpark Core Utils library
Features:
- PySpark session config built from provided configuration
- Configuration is loaded by configurations file and command line
- Supports multi environment
- Provides a Logging solution the app
- Provides multi steps for organising your steps (
init
,run
,cleanup
)