Cloudflow 2.1.0

📣 Cloudflow 2.1.0 released!

We are pleased to announce another release of Cloudflow.

In 2.1.0 we have reorganized the way that Cloudflow interacts with Spark and Flink, to put more control into the hands of our users. These experimental features are opt-in in Cloudflow 2.1.0 with plans to make them permanent in the future.

We needed a more robust and production capable integration with Flink and Spark than we had to date. We wanted to allow our users to completely manage Flink and Spark and still create interconnected Cloudflow applications. We also wanted our users to be able to take advantage of Native Kubernetes integration in Flink 1.13. To that end we came up with cloudflow-contrib which allows Flink and Spark to be set up in a way that meets the demands of the customers.

We will release this via a three step release process: Experimental feature, Transitional feature, and finally the removal of support for the older third-party-operator way of managing Flink and Spark.

Please see the documentation for cloudflow-contrib here.

For existing users of Cloudflow 2.0.25 it is important to note that Cloudflow must be upgraded with the helm charts, as described in the documentation. The Cloudflow kubectl plugin must also be upgraded to 2.1.0 and existing applications must be rebuilt with the 2.1.0 sbt-cloudflow plugin.

Another notable change is that the ScalaTest dependency has been bumped to 3.2.3, which breaks source compatibility.

📗 What’s Changed

• The glorious return back to core #1041 by @andreaTP
• Remove more Bintray references #1039 by @andreaTP
• More bintray replacements #1038 by @debasishg
• Remove magnolia #1037 by @andreaTP
• Fix pod config stacking with empty lists #1036 by @andreaTP
• Bump protocol and application descriptor version #1035 by @andreaTP
• Remove the prometheus config map #1031 by @andreaTP
• cloudsmith get.sh script #1027 by @andreaTP
• Add new saveAppGraph sbt task #1020 by @Lockdain
• Fix tests instability #1026 by @andreaTP
• Fix Jackson version #1024 by @andreaTP
• Introduce a flag in CLI to disable runtime checks #1023 by @andreaTP
• get.sh unsafe download #1022 by @andreaTP
• Added spark-enabled flag. #1021 by @RayRoestenburg
• Runner config from the CLI #1014 by @andreaTP
• Add a flag to disable Flink in the operator #1017 by @andreaTP
• Cross version back to binary #1019 by @andreaTP
• Descriptor generator to it's own library #1013 by @andreaTP

🙇 Credits

Special thanks to the following contributors who helped with this release: @Lockdain, @RayRoestenburg, @andreaTP, @debasishg and Cloudflow @lightbend