Skip to content

Releases: vitessio/vitess

Vitess 5.0.0 Beta

13 Jan 22:01
1b384b8
Compare
Choose a tag to compare
Vitess 5.0.0 Beta Pre-release
Pre-release

Known Issues

Important! This release contains a bug, where MySQL configuration files were intended to be bundled in the mysqlctl binary, are not correctly bundled. The workaround is to ensure that $VTROOT/config is available on your system. We intend to fix this issue before final release of Vitess 5.0.

Incompatible Changes

This release includes the following changes, which may result in incompatibilities when upgrading from a previous release:

Removal of binaries from release packages
The release packages have been improved to no longer ship unneeded dependencies. If you previously installed etcd, zookeeper or consul as part of the Vitess package, you will now need to download and install it separately. #5545 #5645

Refactoring MySQL Configuration Files
The included my.cnf files for MySQL have been simplified and improved. There may be some isolated cases where the difference in configuration may lead to compatibility issues with a previous installation of MySQL. #5326 #5517 #5704

VTROOT, VT_MYSQL_ROOT, VTDATAROOT changes
You are no longer required to specify the environment variables VTROOT, VT_MYSQL_ROOT, VTDATAROOT in order to run the Vitess examples. These variables have been changed to autodetect. Use of these variables is still permitted, but discouraged, as they may be removed in a future release. #5488 #5506 #5654 #5560

Elimination of VTTOP environment variable
The environment variable VTTOP has been eliminated, with all uses changed to VTROOT instead. In most cases VTROOT can also be autodetected, so it is encouraged to remove VTTOP from any scripts. #5527 #5632 #5546 #5548

Removal of vtqueryserver
The unused vtqueryserver utility has been removed. #5583

web_dir2 and web_dir options removed from vtctld
The web files used by vtctld are now embedded into the vtctld binary, simplifying configuration. This results in a behavior change since web_dir and web_dir2 are no longer valid parameters when starting vtctld. Please be sure to update your startup scripts accordingly. #5597

Examples now check for dependencies
The examples now check for shell programs that are required to execute correctly. If you do not have the following programs in your PATH, it will result in an error: mysqld etcd etcdctl curl vtctlclient vttablet vtgate vtctld mysqlctl #5543

Changes to build from source
The build from source instructions have changed. See https://vitess.io/docs/contributing/build-from-source/ for details.

Bugs Fixed

  • The stability of prepared statements has been improved #5562 #5441
  • The portability of shell scripts has been improved. #5384 #5480
  • The semi-sync extension is now optional #5483
  • A panic could occur when a sequence name was bad. #5621
  • Loading TLS and x509 certificates now consumes less memory. #5423
  • Helm no longer complains about nil values in templates. #5484
  • Add workaround for common MySQL replication error #5627
  • Add null as a valid constant SELECT value for vtexplain #5624
  • Creating new shards could overwhelm a topo server. Vitess now no longer performs actions concurrently when creating shards in the topo. #5436
  • VTExplain could race when waiting around for the fakesqldb tabletserver #5476
  • VTGate now correctly resolves columns in information_schema tables. #5608
  • The query SHOW FULL COLUMNS now works correctly with a filter #5558
  • Backups now pass the correct filesize to Ceph #5369
  • Vtbackup will now stop replication after reaching the goal position. #5437
  • The bundled version of log4j has been upgraded #5691
  • VTTablet now accepts external tablets in Azure MySQL #5683
  • VTGate now advertises protocol support for FOUND ROWS #5676
  • A buffered reader is now placed in front of xtrabackup’s STDOUT pipe, potentially reducing memory usage #5666
  • Consultopo: Enforce a connection heartbeat for Watch() #5673
  • The tabletmanager now ensures that it is fully shutdown before closing the topology client #5667

Functionality Added or Changed

  • Several improvements to VReplication #5432 #5628 #5367 #5594 #5575 #5574 #5509 #5500 #5498 #5494 #5491 #5457 #5456 #5454 #5429 #5490 #5515 #5689 #5688 #5669
    Including:
    • Support for file+pos based replication, allowing replication in from MySQL instances which do not have GTIDs enabled
    • New Materialize command
    • Support for Vdiff, Reshard
    • Vindex and multi-column support
  • Several Improvements to Docker files. #5592 #5510 #5470 #5458 #5444 #5492 #5661
    Including:
    • A refactoring of vitess/lite files
    • Support for aarch64
    • The default mysql data files are now removed from the vitess/lite images
    • The latest xtrabackup is always retrieved
    • Jemalloc and tcmalloc are now bundled.
  • Mysqlctl now checks that it is not being executed as root. This helps debugging scenarios, since mysqld will refuse to execute as root by default. #5419 #5644
  • The examples have been improved. Improvements include a check that all dependencies are installed, and warn if it looks like selinux or apparmor prevented mysqlctl from starting #5543 #5573 #5461 #5433 #5426 #5386
  • The bootstrap process will search for etcd in the PATH, and won’t install it if it is present. In addition, etcd on aarch64 is now supported. #5427 #5481 #5428 #5495 #5434 #5425
  • VTGate now supports proxy protocol #5563
  • There is now an option for TLS enabled etcd server connections. #5496
  • Vtgate now advertises itself as a MySQL 5.7 server #5482
  • A vt_monitoring user has been added to init_db.sql. #5486
  • Mysqlctl now supports bootstrapping MariaDB 10.4. Please note that MariaDB 10.4 is not yet supported. #5374
  • VTGate now provides a scatter of query statistics #5422
  • Vttablet now provides better granularity for errors that come out of the transaction pool #5373
  • Experimental support for region-aware vindexes, and xxhash vindexes #5390 #5439
  • VTTablet servers now support an option to disable caching field names to avoid schema mismatches #5572
  • VTGate: Query routing has been improved when using LEFT JOIN queries #5551
  • VTGate: The parser now supports additional types of BEGIN statements #5550
  • VTTablet servers no longer rechecks the mysql port if it was explicitly provided. This helps ensure operation in proxied environments. #5383
  • The 64 bit hash implementation has been changed from 3DES to DES #5529
  • Demote a master vttablet to a SPARE instead of REPLICA is now supported #5520
  • Vttestserver now supports vschema operations via vtgate #5582
  • The vtgate resolver has been simplified #5679

Build Environment Changes

Vitess 4.0.1

15 Nov 00:24
0629f0d
Compare
Choose a tag to compare

An issue was discovered in the previous packages, where packages reported the wrong version.

Bugs Fixed

  • Add stronger protection against running examples as root #5431

Vitess 4.0

05 Nov 15:46
cc07de2
Compare
Choose a tag to compare

Important Changes

  • Vitess 4.0 no longer supports Statement-Based Replication. Users upgrading will need to switch to Row-Based Replication.
  • V2 Routing is now deprecated and will be removed in a future release. This was an undocumented API that was never officially supported.
  • The default topology server has switched to etcd. ZooKeeper and Consul remain fully supported.
  • Support for InfluxDB as a monitoring backend has been removed. Prometheus is recommended in place.
  • VReplication support is experimental. We are satisfied with the stability and test coverage of this feature but may make changes to the command-line interface based on feedback received. These changes will not follow the Vitess deprecation policy.
  • Prepared statements support is experimental. Support for prepared statements was merged later in the development cycle, and anticipate that there may still be undiscovered edge-cases.
  • The internal representation of topology has been altered between Vitess 3.0 and 4.0. For the most part, it is backward and forwards compatible. The only caveat is to not upgrade to 4.0 while performing horizontal/vertical resharding.
  • The internal Vitess tables VReplication, local_metadata and shard_metadata tables have been modified to support multiple databases in the same mysql instance. This schema change is expected to be forwards and backwards compatible with Vitess 3.0.
  • Support for VStream is experimental. We invite feedback from users before stabilizing this feature in an upcoming release.
  • The included MySQL configuration files bundled with Vitess have been improved. This may lead to cases where a MySQL server started with Vitess 3.0 will not start in Vitess 4.0. Please see the error log for the MySQL server for details.
  • The configuration flags timeout, replication_timeout, gcs_backup_storage_project and lock_timeout have been deprecated and will be removed in the next release of Vitess.
  • The reparenting process has been significantly improved in Vitess 4.0. It is important that you follow the recommended upgrade order for components so that reparents work properly while components are on mixed versions.

Bugs Fixed

Functionality Added or Changed

Build Environment Changes

Read more

Vitess 3.0

10 Dec 04:47
4f192d1
Compare
Choose a tag to compare

Vitess 3.0 many new features over 2.2.

Download

  • Server binaries are available in the Docker image "vitess/lite:v3.0.0-rc.1".
  • Java client packages are published on Maven Central (To be uploaded).
  • Source code is available via the tag "v3.0.0-rc.1".

Upgrading

All Vitess 3.0 changes are backward compatible with the 2.2 release. Please make sure that you follow the recommended upgrade order: vttablet->vtctld->vtgate.

Changes since 2.2

Usability

  • Tutorial that runs on Minikube
  • Tutorial that runs on local host
  • Simplified db parameters for vttablet
  • Formal support for externally managed mysql

Monitoring

  • Prometheus plug-in

SQL constructs

  • Comment directives: QUERY_TIMEOUT_MS=1000, MULTI_SHARD_AUTOCOMMIT, SKIP_QUERY_PLAN_CACHE
  • Partial Scatter
  • New ALTER VSCHEMA syntax
  • Multi-table DDL statements
  • Workbench connectivity
  • Cross-shard subqueries
  • Improved handling of select * constructs

Performance

  • vtbench: Benchmarking tool
  • MySQL protocol performance improvements
  • Faster reparents
  • Parallelized backups (4X faster)
  • Snappier InitShardMaster and PlannedReparentShard
  • Improved coordination with Orchestrator

New MySQL versions support

  • MySQL 8.0 and MariaDB 10.3

Build

  • Pure Go 1.11. You can now build with CGO_ENABLED=0.

Resharding and VReplication

  • ShowResharding
  • CancelResharding
  • Safer MigrateServedTypes
  • Auto-reverse direction of MigrateServedTypes to allow rollback of a previous MigrateServedTypes
  • Workflow SplitDiff parallelized across shards
  • SplitClone uses destination master for comparison

Vitess v3.0.0-rc.3

09 Dec 19:55
4f192d1
Compare
Choose a tag to compare
Vitess v3.0.0-rc.3 Pre-release
Pre-release

Fix a couple of issues in local example:

  • restore vschema.sql to keep vagrant working
  • teardown correct vttablets after horizontal resharding

Vitess v3.0.0-rc.2

09 Dec 07:38
43aa7e9
Compare
Choose a tag to compare
Vitess v3.0.0-rc.2 Pre-release
Pre-release
  • Fixed a typo in helm charts
  • Removed settings that are incompatible with 8.0

Vitess v3.0.0-rc.1

08 Dec 04:05
8e64c77
Compare
Choose a tag to compare
Vitess v3.0.0-rc.1 Pre-release
Pre-release

This is the first release candidate of the 3.0 release.

We expect minimal changes between this and the final 3.0 release.

Download

  • Server binaries are available in the Docker image "vitess/lite:v3.0.0-rc.1".
  • Java client packages are published on Maven Central (To be uploaded).
  • Source code is available via the tag "v3.0.0-rc.1".

Usability

  • Tutorial that runs on Minikube
  • Tutorial that runs on local host
  • Simplified db parameters for vttablet
  • Formal support for externally managed mysql

Monitoring

  • Prometheus plug-in

SQL constructs

  • Comment directives: QUERY_TIMEOUT_MS=1000, MULTI_SHARD_AUTOCOMMIT, SKIP_QUERY_PLAN_CACHE
  • Partial Scatter
  • New ALTER VSCHEMA syntax
  • Multi-table DDL statements
  • Workbench connectivity
  • Cross-shard subqueries
  • Improved handling of select * constructs

Performance

  • vtbench: Benchmarking tool
  • MySQL protocol performance improvements
  • Faster reparents
  • Parallelized backups (4X faster)
  • Snappier InitShardMaster and PlannedReparentShard
  • Improved coordination with Orchestrator

New MySQL versions support

  • MySQL 8.0 and MariaDB 10.3

Build

  • Pure Go 1.11. You can now build with CGO_ENABLED=0.

Resharding and VReplication

  • ShowResharding
  • CancelResharding
  • Safer MigrateServedTypes
  • Auto-reverse direction of MigrateServedTypes to allow rollback of a previous MigrateServedTypes
  • Workflow SplitDiff parallelized across shards
  • SplitClone uses destination master for comparison

Vitess 2.2

31 May 20:05
66e84fa
Compare
Choose a tag to compare

Vitess 2.2 brings many new features over 2.1.1.

Download

  • Server binaries are available in the Docker image "vitess/lite:v2.2".
  • Java client packages are published on Maven Central.
  • Source code is available via the tag "v2.2".

Upgrading

All Vitess 2.2 changes are backward compatible with the 2.1.1 release. Please make sure that you follow our recommended upgrade order.

Changes since the 2.1.1 Release

VTGate

  • Query normalization
  • Streamlog and plan stats
  • Instant-commit for autocommit
  • Smarter pass-through of SQL statements for unsharded keyspaces or single-shard targets.
  • Pass-through support for information_schema and dual table
  • Improved master detection (if multiple vttablets declare themselves to be master)
  • Multi-column vindexes

VTTablet

  • Heartbeat
  • Can run on a separate machine from its MySQL
  • Hot row protection for DMLs
  • Per-user transaction limits

Improved RBR support

  • Vttablet allows all ‘INSERT..ON DUPLICATE KEY’ constructs if MySQL is in RBR mode.
  • JSON support for RBR filtered replication and update stream
  • A separate flag to pass-through all DMLs without rewriting them.

New Session-based protocol with support for TargetString and autocommit

  • Legacy mode flag for those transitioning to the new behavior
  • Auth plugin

MySQL protocol behaves more like mysql

  • Autocommit is on by default, and mimics MySQL for set autocommit, begin & commit commands.
  • Support of use statement with the ability to target keyspace, shard, tablet type or a combination of those.
  • Support for CLIENT_FOUND_ROWS connection flag
  • Support streaming

New constructs:

  • SET TRANSACTION_MODE=[single,multi,2pc]
  • SELECT NEXT :n VALUES FROM seq
  • SHOW VINDEXES

Messages

  • Multi-column support
  • ACL
  • New STREAM sql syntax

More query constructs

  • Scatter aggregates, order by and limit (count and offset)
  • Cross-shard delete
  • INSERT ON DUPLICATE KEY with lookup vindexes
  • INSERT IGNORE with lookup vindexes
  • Cross-shard sorting of date/time and text columns
  • UPDATE of secondary lookup vindex columns

Vindexes

  • Autocommit support for lookup vindexes
  • Write_only support which can be used for migration
  • Keyrange support
  • Null vindex

GRPC

  • Upgrade to 1.10.0, faster and more efficient
  • Allow setting of max message size for GRPC

Misc

  • VTExplain: new tool for previewing query plans end-to-end
  • Vtqueryserver: a new mysql proxy that has all the guardrails of vttablet, but can be used directly from an app.
  • New docker-compose example
  • New kubernetes helm charts
  • Apache V2 license
  • Move to CNCF
  • Java client moved under io.vitess root
  • Query logging support to output as JSON and log to a file
  • Improved caching of topology server state at vtgate to allow queries to continue when the topo service is unavailable.
  • Optional flags to limit the time a query will wait for a connection from the pool and the total number of outstanding requests.
  • Options to redact and/or truncate sensitive queries in the debug UIs

Deprecated

  • Queryserver-config-strict-mode
  • PHP client
  • V1 toposerver scheme

Vitess v2.2.0-rc.1

25 May 17:59
66e84fa
Compare
Choose a tag to compare
Vitess v2.2.0-rc.1 Pre-release
Pre-release

This is the first release candidate of the 2.2 release.

We expect minimal changes between this and the final 2.2 release.

Download

  • Server binaries are available in the Docker image "vitess/lite:v2.2.0-rc.1".
  • Java client packages are published on Maven Central.
  • Source code is available via the tag "v2.2.0-rc.1".

Upgrading

All Vitess 2.2 changes are backward compatible with the 2.1.1 release. Please make sure that you follow our recommended upgrade order.

Changes since the 2.1.1 Release

VTGate

  • Query normalization
  • Streamlog and plan stats
  • Instant-commit for autocommit
  • Smarter pass-through of SQL statements for unsharded keyspaces or single-shard targets.
  • Pass-through support for information_schema and dual table
  • Improved master detection (if multiple vttablets declare themselves to be master)
  • Multi-column vindexes

VTTablet

  • Heartbeat
  • Can run on a separate machine from its MySQL
  • Hot row protection for DMLs
  • Per-user transaction limits

Improved RBR support

  • Vttablet allows all ‘INSERT..ON DUPLICATE KEY’ constructs if MySQL is in RBR mode.
  • JSON support for RBR filtered replication and update stream
  • A separate flag to pass-through all DMLs without rewriting them.

New Session-based protocol with support for TargetString and autocommit

  • Legacy mode flag for those transitioning to the new behavior
  • Auth plugin

MySQL protocol behaves more like mysql

  • Autocommit is on by default, and mimics MySQL for set autocommit, begin & commit commands.
  • Support of use statement with the ability to target keyspace, shard, tablet type or a combination of those.
  • Support for CLIENT_FOUND_ROWS connection flag
  • Support streaming

New constructs:

  • SET TRANSACTION_MODE=[single,multi,2pc]
  • SELECT NEXT :n VALUES FROM seq
  • SHOW VINDEXES

Messages

  • Multi-column support
  • ACL
  • New STREAM sql syntax

More query constructs

  • Scatter aggregates, order by and limit (count and offset)
  • Cross-shard delete
  • INSERT ON DUPLICATE KEY with lookup vindexes
  • INSERT IGNORE with lookup vindexes
  • Cross-shard sorting of date/time and text columns
  • UPDATE of secondary lookup vindex columns

Vindexes

  • Autocommit support for lookup vindexes
  • Write_only support which can be used for migration
  • Keyrange support
  • Null vindex

GRPC

  • Upgrade to 1.10.0, faster and more efficient
  • Allow setting of max message size for GRPC

Misc

  • VTExplain: new tool for previewing query plans end-to-end
  • Vtqueryserver: a new mysql proxy that has all the guardrails of vttablet, but can be used directly from an app.
  • New docker-compose example
  • New kubernetes helm charts
  • Apache V2 license
  • Move to CNCF
  • Java client moved under io.vitess root
  • Query logging support to output as JSON and log to a file
  • Improved caching of topology server state at vtgate to allow queries to continue when the topo service is unavailable.
  • Optional flags to limit the time a query will wait for a connection from the pool and the total number of outstanding requests.
  • Options to redact and/or truncate sensitive queries in the debug UIs

Deprecated

  • Queryserver-config-strict-mode
  • PHP client
  • V1 toposerver scheme

Vitess 2.1.1

22 May 14:01
Compare
Choose a tag to compare

Bugfix release for Vitess 2.1.

Changes since 2.1:

  • Fixed issue that auto inc columns for unsharded keyspaces were not working (#2804).

If you are upgrading from a version < 2.1.0, please read the "Upgrading" section from the 2.1 release notes: https://github.com/youtube/vitess/releases/tag/v2.1.0