Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update docker-compose examples to take advantage of improvements in Vitess #7009

Merged
merged 39 commits into from
Nov 12, 2020
Merged

Update docker-compose examples to take advantage of improvements in Vitess #7009

merged 39 commits into from
Nov 12, 2020

Conversation

jawabuu
Copy link
Contributor

@jawabuu jawabuu commented Nov 9, 2020 •
edited
Loading

This PR cleans up the compose example and takes advantage of newer Vitess constructs.

  1. Integration with Orchestrator/ vtorc to manage Master-Election (InitTablet & InitShardMaster are removed)
  2. Uses smaller lite images instead of the huge base images.
  3. Automatic Vreplication from External Master to Vitess Managed Cluster.

@deepthi @sougou @shlomi-noach @derekperkins

@jawabuu
Switch docker image from vitess:base to vitess:lite
730145f 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
make available init_db.sql as well as VT env variables
df26a6a 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
rewrite to use available binaries and allowed paths in lite image
4a9109a 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
fix vtctld backup_storage_root path
663d22f 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
update vtcompose to use vites:lite image
1ccfcd9 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
add mysql57 cnf to ensure mysql starts with log_bin enabled
71f88fe 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Remove SetReadWrite call from schemaload script
598e0a2 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Use IPs for hostnames to provide better visualization in orchestrator
3808aa9 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Clean up code to use tablet_role=externalmaster for unmanaged tablets
039acc1 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Add the external db user to managed tablets to ensure functionality o…
d26d39f 
…f orchestrator

Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Disable semi-sync and active-reparents for orchestrator
b0d74a6 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Add dedicated tablet for external_db, convention will be to use /d00
7466fe0 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Add vtorc and vreplication service. Stack is now automated end to end.
d4b8892 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Add default vtorc config & automate externaldb credentials
c485cfe 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
skip external vreplication if none is configures
cf5cbf5 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
add vtorc script to manage vtorc config file
420ba22 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Use IP only if VTHOST is not set
0e0e92a 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Use port 13000 for ORchestrator to pontentially avouid port conflicts
9c7c138 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Refactor vtcompose to use vtorc & vreplication
5a20107 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Add convenience mysql container to demonstrate migration into vitess
2bcd697 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Configure port for externalmasterTablet
7e423f7 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Set tabletname to contaner IP if none is set
5fa86b0 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Add comments on _vt database name
a43a8b1 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Update README to reflect orchestrator updates
e75482f 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Add pointer to the parent README
77ae90f 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Fix incorrect healthcheck port
589455a 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Pass EXTERNAL_DB variable to vreplication container
991e6e5 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Make schemafiles optional
0d95279 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
fix vttablet restore_from_backup flag
e49591b 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
add missing DB_PORT and DB_HOST to vttablets
e0127bd 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
gofmt on vtcompose.go
b6af37c 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Fix script executable permissions
62ac7a4 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Mount mysql cnf as read_only
dbf4ec6 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
enable log-bin in externaldb command arguments
8fcc230 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
restor mycnf mount//NOTE file needs to be readonly to be applied
123c099 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Allow script to continue on CopySchemaShard errors
c037c51 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu
Set required mysqld options to enable replication
e225227 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@sougou
Copy link
Contributor

sougou commented Nov 12, 2020

Can you resolve the merge conflicts (I just merged your other PR)

@jawabuu
Copy link
Contributor Author

jawabuu commented Nov 12, 2020

Can you resolve the merge conflicts (I just merged your other PR)

@sougou Resolving right away

@jawabuu
Merge remote-tracking branch 'upstream/master' into use-vtorc
1aa5590
@jawabuu
Fix typo
e844b25 
Signed-off-by: jawabuu <49921621+jawabuu@users.noreply.github.com>
@jawabuu jawabuu requested a review from sougou as a code owner November 12, 2020 05:01
@jawabuu jawabuu mentioned this pull request Nov 12, 2020
Merged
@sougou sougou merged commit 8d3a8a2 into vitessio:master Nov 12, 2020
@askdba askdba added this to the v9.0 milestone Nov 27, 2020
@rafael rafael mentioned this pull request Mar 17, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sougou sougou sougou approved these changes

@shlomi-noach shlomi-noach Awaiting requested review from shlomi-noach

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
v9.0
Development

Successfully merging this pull request may close these issues.
3 participants
@jawabuu @sougou @askdba