Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Periodic snapshots expiring tasks will be scheduled redundantly #2453

Closed
1 of 2 tasks
Tracked by #2448 ...
wangtaohz opened this issue Dec 19, 2023 · 1 comment · Fixed by #2458
Closed
1 of 2 tasks
Tracked by #2448 ...

[Bug]: Periodic snapshots expiring tasks will be scheduled redundantly #2453

wangtaohz opened this issue Dec 19, 2023 · 1 comment · Fixed by #2458
Assignees
Labels
type:bug Something isn't working

Comments

@wangtaohz
Copy link
Contributor

What happened?

There are 3 threads simultaneously performing snapshot expiring on the same table.

2023-12-19 17:29:38,325 INFO [ASYNC-SnapshotsExpiringExecutor-0] [com.netease.arctic.server.optimizing.maintainer.MixedTableMaintainer] [] - hdfs://xxxx/yyyy/zzzz/change delete 384 ch
ange files
2023-12-19 17:29:38,406 INFO [ASYNC-SnapshotsExpiringExecutor-3] [com.netease.arctic.server.optimizing.maintainer.MixedTableMaintainer] [] - hdfs://xxxx/yyyy/zzzz/change delete 384 ch
ange files
2023-12-19 17:29:39,233 INFO [ASYNC-SnapshotsExpiringExecutor-4] [com.netease.arctic.server.optimizing.maintainer.MixedTableMaintainer] [] - hdfs://xxxx/yyyy/zzzz/change delete 384 ch
ange files

Affects Versions

master

What engines are you seeing the problem on?

No response

How to reproduce

Update the table properties.

Relevant log output

No response

Anything else

I believe other executors like DataExpiringExecutor OrphanFilesCleaningExecutor have the same problem.

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

  • I agree to follow this project's Code of Conduct
@wangtaohz wangtaohz added the type:bug Something isn't working label Dec 19, 2023
@HuangFru
Copy link
Contributor

I reproduced the issue and I will submit a PR to fix it later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants