Issue #498: Add Hudi Codebase

[JosepSampe]

Description

• Add Hudi codebase Add Initial Hudi Codebase for Qbeast-Spark #498

Type of change

New Hudi table format support

Checklist:

Here is the list of things you should do before submitting this pull request:

• New feature / bug fix has been committed following the Contribution guide.
• Add logging to the code following the Contribution guide.
• Add comments to the code (make it easier for the community!).
• Change the documentation.
• Add tests.
• Your branch is updated to the main branch (dependent changes have been merged).

[Jiaweihu08]

Great work! Just some comments here.

[Jiaweihu08]

We need to study the isolation level of different operations in Hudi. In delta, for instance, metadata updates are Serializable, and more rigorous checks are done for concurrent writes.

[Jiaweihu08]

Are the following the same for Delta? If so, we can centralize them somehow to avoid duplication? What do you think?

[JosepSampe]

encodeBlocks is the same, while decodeBlocks is slightly different, although we can probably make both the same

[osopardo1]

Nice to see the Hudi support advancing. Congrats!!

I know it's a draft, but I would like to fully understand the changes and try to minimize the issues we already made in the Delta Integration. I've added a few comments (some of them about semanthics, don't worry......)