Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ARCTIC-920][Optimize] Fix the problem of data inconsistency after minor optimize #921

Merged
merged 6 commits into from
Dec 14, 2022

Conversation

hzluting
Copy link
Contributor

@hzluting hzluting commented Dec 12, 2022

Why are the changes needed?

fix #920

Brief change log

  • force refresh the base table when checking the file cache in the base table
  • remove isRunning in TableOptimizeRuntime and use optimize task size to check whether the table is running
  • generate partition running status before getting data files to avoid incorrect plan

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before making a pull request

Documentation

  • Does this pull request introduces a new feature? (no)
  • If yes, how is the feature documented? (not documented)

force refresh the base table when checking the file cache in the base table
@github-actions github-actions bot added module:ams-server Ams server module module:ams-dashboard Ams dashboard module labels Dec 12, 2022
luting added 3 commits December 12, 2022 19:14
fix review
fix review
1. remove isRunning and use optimize task size to check whether the table is running
2. generate partition running status before getting data files to avoid incorrect plan
luting added 2 commits December 13, 2022 17:35
fix review
fix review
@wangtaohz
Copy link
Contributor

LGTM

Copy link
Contributor

@zhoujinsong zhoujinsong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@wangtaohz wangtaohz merged commit e2b9c16 into apache:master Dec 14, 2022
@hzluting hzluting deleted the force-refresh-snapshot branch December 15, 2022 11:26
zhoujinsong pushed a commit that referenced this pull request May 31, 2023
…nor optimize (#921)

* fix #920
1. force refresh the base table when checking the file cache in the base table
2. remove isRunning and use optimize task size to check whether the table is running
3. generate partition running status before getting data files to avoid incorrect plan

Co-authored-by: luting <dylzlt93299@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module:ams-dashboard Ams dashboard module module:ams-server Ams server module
Projects
None yet
3 participants