Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature - retry Iceberg drop on DDL timeout fail #312

Open
brabster opened this issue May 18, 2023 · 1 comment
Open

Feature - retry Iceberg drop on DDL timeout fail #312

brabster opened this issue May 18, 2023 · 1 comment
Labels
enhancement New feature or request

Comments

@brabster
Copy link
Contributor

brabster commented May 18, 2023 •
edited
Loading

As @nicor88 has pointed out, you can get DDL timeouts with Iceberg DROP TABLE - DDL timeout seems to be 60s, not the 30min as advertised.

Can we make the drop table retryable? My experiments suggest that the operation may succeed on the 2nd/3rd attempt, maybe Athena is deleting what it can in 60s so retrying may be successful and could avoid a failed run?

I can look into how we'd do this but checking it's worthwhile
@brabster brabster mentioned this issue May 22, 2023
Merged
2 tasks
@brabster
Copy link
Contributor Author

Reported issue on AWS re:Post https://repost.aws/questions/QUqVwL0QU7T1W2xwmXB8XTWg/athena-iceberg-drop-table-ddl-timeout-after-60s

@Jrmyy Jrmyy added the enhancement New feature or request label Oct 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@brabster @Jrmyy