Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Iceberg API is unable to connect to Hive Metastore > 4.0.0-beta-1 #11928

Open
1 of 3 tasks
mderoy opened this issue Jan 8, 2025 · 1 comment
Open
1 of 3 tasks

Iceberg API is unable to connect to Hive Metastore > 4.0.0-beta-1 #11928

mderoy opened this issue Jan 8, 2025 · 1 comment
Labels

Comments

@mderoy
Copy link
Contributor

mderoy commented Jan 8, 2025

Apache Iceberg version

1.7.1 (latest release)

Query engine

None

Please describe the bug 🐞

between hive metastore 4.0.0-beta-1 and 4.0.0, the hive metastore configurations were updated, for example the variable METASTOREWAREHOUSE was updated to METASTORE_WAREHOUSE (these properties also seem deprecated and will eventually be moved out of HiveConf and into into MetastoreConf class as well). After updating, connections to the metastore will fail via a java.lang.NoSuchFieldError: METASTOREURIS exception since even the latest version of https://github.com/apache/iceberg/blob/main/hive-metastore/src/main/java/org/apache/iceberg/hive/HiveCatalog.java references the old field names.

I did find one closed ticket referencing this
#10429
but this seems to be a user of the query engine having issues, where the suggestion was to use hive's own shaded iceberg depdency, while I am the user of the java API which currently is unable to connect using the latest hive libraries.

Willingness to contribute

  • I can contribute a fix for this bug independently
  • I would be willing to contribute a fix for this bug with guidance from the Iceberg community
  • I cannot contribute a fix for this bug at this time
@mderoy mderoy added the bug Something isn't working label Jan 8, 2025
@manuzhang
Copy link
Collaborator

We haven't supported connecting to metastore with Hive 4.0 yet. There's ongoing PR and discussion

@manuzhang manuzhang added hive and removed bug Something isn't working labels Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants