Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Detect and signal schema changes on vttablets #8005

Merged
merged 15 commits into from
May 7, 2021
Merged

Detect and signal schema changes on vttablets #8005

merged 15 commits into from
May 7, 2021

Commits on Apr 30, 2021

  1. add queries and tests for detecting schema changes 

    Signed-off-by: Andres Taylor <andres@planetscale.com>
    @systay
    systay committed Apr 30, 2021
    Configuration menu
    Copy the full SHA
    7228320 View commit details
    Browse the repository at this point in the history

  2. added schema change detection and schema copy to health streamer 

    Signed-off-by: Harshit Gangal <harshit@planetscale.com>
    @harshit-gangal
    harshit-gangal committed Apr 30, 2021
    Configuration menu
    Copy the full SHA
    9e1ff35 View commit details
    Browse the repository at this point in the history

  3. proto changed to send table name having changed schema 

    Signed-off-by: Harshit Gangal <harshit@planetscale.com>
    @harshit-gangal
    harshit-gangal committed Apr 30, 2021
    Configuration menu
    Copy the full SHA
    67dcf8e View commit details
    Browse the repository at this point in the history

  4. send table names in health stream for changed schema 

    Signed-off-by: Harshit Gangal <harshit@planetscale.com>
    @harshit-gangal
    harshit-gangal committed Apr 30, 2021
    Configuration menu
    Copy the full SHA
    d3fda2a View commit details
    Browse the repository at this point in the history

Commits on May 3, 2021

  1. wrote test for healthstreamer.Stream and schema changes 

    Signed-off-by: Andres Taylor <andres@planetscale.com>
    @systay
    systay committed May 3, 2021
    Configuration menu
    Copy the full SHA
    8e1f210 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2021

  1. Merge remote-tracking branch 'upstream/master' into schema-fetch 

    Signed-off-by: Andres Taylor <andres@planetscale.com>
    @systay
    systay committed May 5, 2021
    Configuration menu
    Copy the full SHA
    ce022a0 View commit details
    Browse the repository at this point in the history

  2. make it possible to turn schema change signaling on and off 

    Signed-off-by: Andres Taylor <andres@planetscale.com>
    @systay
    systay committed May 5, 2021
    Configuration menu
    Copy the full SHA
    22337a4 View commit details
    Browse the repository at this point in the history

  3. make sure to create the database for the schemacopy 

    Signed-off-by: Andres Taylor <andres@planetscale.com>
    @systay
    systay committed May 5, 2021
    Configuration menu
    Copy the full SHA
    d34acd8 View commit details
    Browse the repository at this point in the history

  4. added e2e test for health stream to test the schema changes detection… 

    … signal

Signed-off-by: Harshit Gangal <harshit@planetscale.com>
    @harshit-gangal
    harshit-gangal committed May 5, 2021
    Configuration menu
    Copy the full SHA
    c0eb6ba View commit details
    Browse the repository at this point in the history

  5. change the limit from 5 rows to 10K rows in detect schema change query 

    Signed-off-by: Harshit Gangal <harshit@planetscale.com>
    @harshit-gangal
    harshit-gangal committed May 5, 2021
    Configuration menu
    Copy the full SHA
    d22c4aa View commit details
    Browse the repository at this point in the history

  6. close the conn pool 

    Signed-off-by: Harshit Gangal <harshit@planetscale.com>
    @harshit-gangal
    harshit-gangal committed May 5, 2021
    Configuration menu
    Copy the full SHA
    ed0487a View commit details
    Browse the repository at this point in the history

  7. set the schema reload time to a more reasonable value 

    Signed-off-by: Andres Taylor <andres@planetscale.com>
    @systay
    systay committed May 5, 2021
    Configuration menu
    Copy the full SHA
    b739db5 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2021

  1. change schema reload time and refactor test 

    Signed-off-by: Harshit Gangal <harshit@planetscale.com>
    @harshit-gangal
    harshit-gangal committed May 6, 2021
    Configuration menu
    Copy the full SHA
    33a16d2 View commit details
    Browse the repository at this point in the history

  2. publish the schema changed tables after the schema copy table is updated 

    Signed-off-by: Harshit Gangal <harshit@planetscale.com>
    @harshit-gangal
    harshit-gangal committed May 6, 2021
    Configuration menu
    Copy the full SHA
    a903ca5 View commit details
    Browse the repository at this point in the history

  3. not to error on initial schema change check 

    Signed-off-by: Harshit Gangal <harshit@planetscale.com>
    @harshit-gangal
    harshit-gangal committed May 6, 2021
    Configuration menu
    Copy the full SHA
    6a52cf5 View commit details
    Browse the repository at this point in the history