SDP Release 24.11

[lfrancke]

Stackable Data Platform (SDP) Release 24.11 is now publicly available!

Highlights

• Authentication:
  • Apache Airflow and Apache NiFi with OIDC support.
  • Apache Kafka introduces Kerberos support.
• Security:
  • TLS certificate provisioning now supported with cert-manager.
  • RSA key lengths can be customized for generated key pairs.
  • Enhanced Secret Operator permissions for managing listener volumes.
• Listener Updates:
  • Kafka connectivity now supports IP addresses and Fully Qualified Domain Names (FQDNs).
• Dependencies:
  • Apache HBase now supports Azure Data Lake Storage Gen2 (ADLS).
• Operations:
  • HDFS upgrade support with manual intervention.
• Miscellaneous:
  • NiFi, Airflow, and Superset now support custom Python code in configuration files.
  • Docker images updated for OpenShift security constraints and non-root container setups.

There are a ton of other new features, bug fixes and vulnerabilities we squashed.

Find more details in the release notes or our announcement blog post