Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

executor: replace should not change other rows when auto ID is out of range (#30301) #32324

Merged
merged 14 commits into from
Jun 17, 2022

Conversation

ti-srebot
Copy link
Contributor

@ti-srebot ti-srebot commented Feb 14, 2022

cherry-pick #30301 to release-5.3
You can switch your code base to this Pull Request by using git-extras:

# In tidb repo:
git pr https://github.com/pingcap/tidb/pull/32324

After apply modifications, you can push your change to this PR via:

git push git@github.com:ti-srebot/tidb.git pr/32324:release-5.3-450d72fd6ef4

What problem does this PR solve?

Issue Number: close #29483

Problem Summary:

SET sql_mode="NO_ENGINE_SUBSTITUTION";
DROP TABLE IF EXISTS t1;
CREATE TABLE t1 (a tinyint not null auto_increment primary key, b char(20));
INSERT INTO t1 VALUES (127,"maxvalue");
REPLACE INTO t1 VALUES (0,"newmaxvalue");

Specifying a zero value for the auto_increment column triggers ID allocation. In the current implementation, the allocated ID will be replaced in the row which is equivalent to

REPLACE INTO t1 VALUES (128,"newmaxvalue");

Since 128 is out of range for tinyint column, 128 is truncated to 127 in setDatumAutoIDAndCast():

REPLACE INTO t1 VALUES (127,"newmaxvalue");

However, these two REPLACE statements should be different because

  • for the 0 case, it means adding a new row.
  • for the 127 case, it means updating an old row if exists.

What is changed and how it works?

In this PR, I add a check inside setDatumAutoIDAndCast() to prevent a truncated auto-ID is used. The error message is different from MySQL's "duplicate primary key" because of the implementation difficulty: there is no way to tell ReplaceExec that whether the row is filled by auto-IDs without changing the interface.

func (e *ReplaceExec) exec(ctx context.Context, newRows [][]types.Datum) error {

This can cause MySQL incompatibility when there is no duplicated auto-ID:

SET sql_mode="";
CREATE TABLE t1 (a tinyint not null auto_increment primary key, b char(20));
INSERT INTO t1 VALUES (127,"maxvalue");
DELETE FROM t1;
REPLACE INTO t1 VALUES (0,"newmaxvalue"); -- MySQL executes successfully
-- ERROR 1467 (HY000): Failed to read auto-increment value from storage engine

I think it is fine because this error can be an alert, reminding the users that auto-IDs are exhausted.

Check List

Tests

  • Unit test
  • Integration test
  • Manual test (add detailed scripts or steps below)
  • No code

Side effects

  • Performance regression: Consumes more CPU
  • Performance regression: Consumes more Memory
  • Breaking backward compatibility

Documentation

  • Affects user behaviors
  • Contains syntax changes
  • Contains variable changes
  • Contains experimental features
  • Changes MySQL compatibility

Release note

Fix an issue that REPLACE statement changing other rows when the auto ID is out of range

Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
@ti-chi-bot
Copy link
Member

ti-chi-bot commented Feb 14, 2022

[REVIEW NOTIFICATION]

This pull request has been approved by:

  • AilinKid
  • winoros

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

@ti-srebot
Copy link
Contributor Author

/run-all-tests

@ti-chi-bot ti-chi-bot added do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. release-note Denotes a PR that will be considered when it comes time to generate release notes. and removed do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. labels Feb 14, 2022
@ti-srebot ti-srebot added compatibility-breaker Violation of forwards/backwards compatibility in a design-time piece. size/S Denotes a PR that changes 10-29 lines, ignoring generated files. type/5.3-cherry-pick labels Feb 14, 2022
@ti-chi-bot ti-chi-bot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/S Denotes a PR that changes 10-29 lines, ignoring generated files. labels Feb 14, 2022
@ti-srebot
Copy link
Contributor Author

@tangenta you're already a collaborator in bot's repo.

@ti-chi-bot ti-chi-bot added size/S Denotes a PR that changes 10-29 lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Feb 15, 2022
Copy link
Contributor

@AilinKid AilinKid left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-chi-bot ti-chi-bot added the status/LGT1 Indicates that a PR has LGTM 1. label Feb 15, 2022
@ti-chi-bot ti-chi-bot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Feb 23, 2022
@ti-chi-bot ti-chi-bot added status/LGT2 Indicates that a PR has LGTM 2. and removed status/LGT1 Indicates that a PR has LGTM 1. labels Apr 12, 2022
@VelocityLight VelocityLight added cherry-pick-approved Cherry pick PR approved by release team. and removed do-not-merge/cherry-pick-not-approved labels Jun 15, 2022
@XuHuaiyu
Copy link
Contributor

/merge

@ti-chi-bot
Copy link
Member

This pull request has been accepted and is ready to merge.

Commit hash: 9705da4

@ti-chi-bot ti-chi-bot added the status/can-merge Indicates a PR has been approved by a committer. label Jun 16, 2022
@XuHuaiyu
Copy link
Contributor

/merge

@sre-bot
Copy link
Contributor

sre-bot commented Jun 16, 2022

@XuHuaiyu
Copy link
Contributor

/merge

1 similar comment
@XuHuaiyu
Copy link
Contributor

/merge

@ti-chi-bot ti-chi-bot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 17, 2022
@tangenta
Copy link
Contributor

/run-mysql-test

1 similar comment
@tangenta
Copy link
Contributor

/run-mysql-test

@tangenta
Copy link
Contributor

/run-unit-test

@tangenta
Copy link
Contributor

/run-check_dev

@ti-chi-bot ti-chi-bot merged commit 2c68cc0 into pingcap:release-5.3 Jun 17, 2022
@heibaijian heibaijian added this to the v5.3.2 milestone Jun 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cherry-pick-approved Cherry pick PR approved by release team. compatibility-breaker Violation of forwards/backwards compatibility in a design-time piece. release-note Denotes a PR that will be considered when it comes time to generate release notes. size/S Denotes a PR that changes 10-29 lines, ignoring generated files. status/can-merge Indicates a PR has been approved by a committer. status/LGT2 Indicates that a PR has LGTM 2. type/5.3-cherry-pick
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants