Skip to content

v1.0

Compare
Choose a tag to compare
@alexcomu alexcomu released this 01 Apr 10:38
· 15 commits to main since this release

First release of PySpark Core Utils library

Features:

  • PySpark session config built from provided configuration
  • Configuration is loaded by configurations file and command line
  • Supports multi environment
  • Provides a Logging solution the app
  • Provides multi steps for organising your steps (init, run, cleanup)