-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
VReplication: tracking rows_copied
#7980
Conversation
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
Signed-off-by: Rohit Nayak <rohit@planetscale.com>
Signed-off-by: Shlomi Noach <2607934+shlomi-noach@users.noreply.github.com>
Good to review! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Just noting here that after the copy phase the rows_copied will never change.
@rohit-nayak-ps currently - that's the objective. Just count the number of rows copied by While this PR is good, I do notice that on a very long running vreplication stream, and with near zero traffic, That's an unexpected behavior. It also relates to what I'll write more about tomorrow. So this is another thing to iterate on: I'd like to see |
Description
_vt.vreplication
has new column,rows_copied
, which is updated periodically duringvreplication
work, to reflect the actual number of rows written on the target table.The value is written together with
time_updated
, so it does not get transactionally synced with each copy iteration, it follows closely though, and makes a good estimate.This will be later used by Online DDL to track Vreplication-based migration progress & ETA.
Related Issue(s)
rows_copied
#7963Checklist
Deployment Notes