[ZEPPELIN-5976] Support Flink 1.18

[keinkonzept]

What is this PR for?

This PR aims to support Flink 1.18

What type of PR is it?

Feature

Todos

• - Task

What is the Jira issue?

https://issues.apache.org/jira/browse/ZEPPELIN-5976

How should this be tested?

Pass GA.

Screenshots (if appropriate)

Questions:

• Does the license files need to update? No.
• Is there breaking changes for older versions? No.
• Does this needs documentation? No.

[pan3793]

java.lang.RuntimeException: error reading Scala signature of org.apache.flink.table.api.ImplicitExpressionConversions: unsafe symbol x$2 (child of value <local api>) in runtime reflection universe
  at scala.reflect.internal.pickling.UnPickler.unpickle(UnPickler.scala:44)
  at scala.reflect.runtime.JavaMirrors$JavaMirror.unpickleClass(JavaMirrors.scala:622)

Same error I faced in my previous try, but no idea after some digging ...

[zjffdu]

Details

Most likely it is due to scala version

[gfeldman]

First, thank you for the PR. I was able to compile your branch and it booted up and worked as expected, but the catalog registration did not work in the sense of adding a file catalog store. Looking in the Flink repo, it looks like they started instantiating the catalog manager differently. I don't know if the current flink shim structure is easily adapted to the new utilities added or something else needs to be done. If I get time this weekend I'd like to build off your work to see if we can get it working.

[keinkonzept]

Hi, thanks for taking a look at it. I stumbled upon the same - was a bit too quick to celebrate after getting it up and running initially.

[shanzi]

Any updates on this?

[pan3793]

I pushed my previous try in #4864, anyone interested in could take over ...