Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure unity export - "table already exists" #8292

Open
offirc2 opened this issue Oct 20, 2024 · 0 comments
Open

Azure unity export - "table already exists" #8292

offirc2 opened this issue Oct 20, 2024 · 0 comments
Labels
bug Something isn't working contributor P2

Comments

@offirc2
Copy link
Contributor

offirc2 commented Oct 20, 2024

What happened?

For Unity Catalog Export functionality in Azure Databricks, create external table in Unity Catalog fails first time with "table already exists" error message but it succeeds in 2nd attempt.

C836CB0E-2D2C-4255-ABFB-64D46E6D587A (3)
DEA69998-8B5F-4CFA-AF0A-71CF96E212DC (2)

It seems to basically the first table, the first time it tries the command, it says it failed because the table already exists. But then when we look at the command text, it runs it a second time and then it succeeds the second time around. The other thing is obviously, if we have a bunch of tables being updated at the same time and it generates a whole bunch of actions doing the same thing and some of them end up colliding and overlapping and they all fail obviously.

Bottom line - it’s functional, but its just generating a lot of errors and exceptions and failures, things like that get logged kind of mostly on the lakeFS side, i guess in the action logs, but also on the sql warehouse, we can see obviously all those failed commands.

@offirc2 offirc2 added bug Something isn't working contributor labels Oct 20, 2024
@talSofer talSofer added the P2 label Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working contributor P2
Projects
None yet
Development

No branches or pull requests

2 participants