[Task]: Flink 2 Support

[Abacn]

What needs to happen?

Flink 2 was released in March 2025.

In terms of Beam Flink Runner, one of the most relevant change is the removal of DataSet API.

We should follow

https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/dev/datastream/dataset_migration/

to migrate to DataStream API. This can be done for current Flink runner. We can move forward once we get rid of org.apache.flink:flink-java dependency,

Also Flink 2 dropped Java 8 support. We need to set applyJavaNature(..., requireJavaVersion: JavaVersion.VERSION_11) for BeamModulePlugin.

See also

https://nightlies.apache.org/flink/flink-docs-master/release-notes/flink-2.0/

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Infrastructure
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner