[SUPPORT] Hudi(0.10.0) backward compatibility for Flink 1.11/1.12 version

[guoch]

Tips before filing an issue

• Have you gone through our FAQs? Yes

• Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.

• If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced

Hudi flink bundle version 0.10.0 and master version cannot be running in the flink 1.11. While flink 1.11 version are still widely used in many situation, and hudi is keeping doing great job to support flink better in newer version.

According to the discussion here #3291, the community was unlikely to backward support for old flink version. (Hudi did something like hudi 0.8-flink 1.11, hudi 0.9- flink 1.12, hudi 0.10 - flink 1.13, new hudi version cannot work in old flink)

While old Spark version (2.4/3.1) are always supported with different mvn compiling profiles, is there any possibility to retain the support for old flink version using similar trick like Spark ?

Expected behavior
New version can be backward compatible with old flink version using different profiles.

Environment Description

• Hudi version : 0.10.0 and master branch

• Spark version : 3.2.0

• Hive version : 3.1.2

• Hadoop version : 3.3.1

• Flink version: 1.11.3

• Storage (HDFS/S3/GCS..) : HDFS

• Running on Docker? (yes/no) : no

[danny0405]

I think we can after the flink version is stable, for e,g the flink 1.14.x.

[guoch]

Got it. Thanks for the info.