From d27e7de35c7920c7077c83f0c31d9328ecde8cb2 Mon Sep 17 00:00:00 2001 From: ti-srebot Date: Mon, 30 Nov 2020 12:05:26 +0800 Subject: [PATCH 01/34] update v4.0.9 release notes at 2020-11-30T12:05:26 Signed-off-by: ti-srebot --- tidb/4.0.9.md | 120 ++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 120 insertions(+) create mode 100644 tidb/4.0.9.md diff --git a/tidb/4.0.9.md b/tidb/4.0.9.md new file mode 100644 index 0000000000000..e3287c0b4883b --- /dev/null +++ b/tidb/4.0.9.md @@ -0,0 +1,120 @@ +--- +title: tidb v4.0.9 Release Notes +category: Releases +aliases: ['/docs/dev/releases/v4.0.9/'] +--- + +# tidb v4.0.9 Release Notes + +Release date: November 30, 2020 + +TiDB version: v4.0.9 + +## Bug Fixes + ++ TiDB + + - Fix incorrect results when using a prefix index with OR condition [#21287](https://github.com/pingcap/tidb/pull/21287) + - Fix a bug cause panic when retry is enable. [#21285](https://github.com/pingcap/tidb/pull/21285) + - Fix a bug that checks partition definition according to column type [#21273](https://github.com/pingcap/tidb/pull/21273) + - Fix a bug that hash type partition does not check partition name is unique [#21257](https://github.com/pingcap/tidb/pull/21257) + - Fix unexpected error when `INSERT` meets index join in some cases. [#21249](https://github.com/pingcap/tidb/pull/21249) + - Fix insert value into hash partition table which not int [#21238](https://github.com/pingcap/tidb/pull/21238) + - Fix Bigint unsigned column value in CASE WHEN operator is converted to bigint signed #9869 [#21236](https://github.com/pingcap/tidb/pull/21236) + - Fix a bug that index-hash-join and index-merge-join doesn't consider collation [#21219](https://github.com/pingcap/tidb/pull/21219) + - Fix issue of the query result of slow_query maybe miss some rows. [#21211](https://github.com/pingcap/tidb/pull/21211) + - `DELETE` may not delete data correctly when the database name is not in pure lower representation. [#21206](https://github.com/pingcap/tidb/pull/21206) + - Raise an error when preparing the `load data` statement. [#21199](https://github.com/pingcap/tidb/pull/21199) + - Fix a bug that partition table does not consider collation in `create table` and `select` sentence. [#21181](https://github.com/pingcap/tidb/pull/21181) + - Disallow multi-updates on primary key [#21113](https://github.com/pingcap/tidb/pull/21113) + - Fix a bug causes schema change after DML [#21050](https://github.com/pingcap/tidb/pull/21050) + - Fix the bug that can not query the coalesced column when use using-join. [#21021](https://github.com/pingcap/tidb/pull/21021) + - Fix wrong results for some semi join queries. [#21019](https://github.com/pingcap/tidb/pull/21019) + - Fix table lock for update statement. [#21002](https://github.com/pingcap/tidb/pull/21002) + - Fix stack overflow when building recursive view. [#21001](https://github.com/pingcap/tidb/pull/21001) + - Ddl: ignore integer zerofill size attribute when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) + - Fix unexpected results when do merge join on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) + - Fix the issue that sometimes a transaction that has undetermined result may be treated as failed. [#20925](https://github.com/pingcap/tidb/pull/20925) + ++ PD + + - Fix the issue that the leader role does not take effect when using the replacement rule in some cases [#3208](https://github.com/pingcap/pd/pull/3208) + - Fix the bug that `trace-region-flow` will be accidentally changed to `false`. [#3120](https://github.com/pingcap/pd/pull/3120) + ++ TiFlash + + - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use. [#1248](https://github.com/pingcap/tics/pull/1248) + - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual usage. [#1212](https://github.com/pingcap/tics/pull/1212) + +## New Features + ++ TiFlash + + - Support multi-disks for storing latest data [#1159](https://github.com/pingcap/tics/pull/1159) + +## Others + ++ TiDB + + - Fix issue of explain for connection can't show the last query plan/ [#21315](https://github.com/pingcap/tidb/pull/21315) + - Add metric for connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) + - Fix the issue that when Index Merge is used in a transaction with RC isolation level, the result may be incorrect. [#21253](https://github.com/pingcap/tidb/pull/21253) + - Planner: fix wrong point get plan generation in fast plan code path [#21244](https://github.com/pingcap/tidb/pull/21244) + - Expression: keep the original data type when doing date arithmetic operations [#21176](https://github.com/pingcap/tidb/pull/21176) + - Ban (index) merge join heuristically when convert equal conditions to other conditions. [#21146](https://github.com/pingcap/tidb/pull/21146) + - Ddl: Fix partition table's partition column values type check [#21136](https://github.com/pingcap/tidb/pull/21136) + - Make dump binary time more compatible with MySQL [#21135](https://github.com/pingcap/tidb/pull/21135) + - Differentiate types for user variables [#21107](https://github.com/pingcap/tidb/pull/21107) + - Fix auto-id allocation failed because of transaction's write-conflict retry. [#21079](https://github.com/pingcap/tidb/pull/21079) + - Fix The JSON Data can not import to TiDB correctly by `load data` [#21074](https://github.com/pingcap/tidb/pull/21074) + - Fix up displaying executor runtime info & Add runtime information for DML in explain analyze [#21066](https://github.com/pingcap/tidb/pull/21066) + - Deprecate `enable-streaming`. [#21055](https://github.com/pingcap/tidb/pull/21055) + - Avoid unnecessary warnings/errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) + - TiDB now provides an error for statements that use the syntax `LOCK IN SHARE MODE`. This helps alert users that this feature is not implemented by TiDB, but a workaround to restore the previous behavior is available by setting `tidb_enable_noop_functions=1`. [#21005](https://github.com/pingcap/tidb/pull/21005) + - Set correct default value for new added enum column. [#20998](https://github.com/pingcap/tidb/pull/20998) + - Allow set GOGC in config file. [#20922](https://github.com/pingcap/tidb/pull/20922) + ++ TiKV + + - Fix a bug that Coprocessor may return wrong result when there are > 255 columns. [#9131](https://github.com/tikv/tikv/pull/9131) + - Fix an issue that region merge may cause data loss during network partition. [#9108](https://github.com/tikv/tikv/pull/9108) + - Enable dynamically change config pessimistic-txn.pipelined. [#9100](https://github.com/tikv/tikv/pull/9100) + - Running checksum in BR and Lightning should have less influence on the cluster performance. [#9098](https://github.com/tikv/tikv/pull/9098) + - Revert "encryption: Turn file dictionary into log style" [#9097](https://github.com/tikv/tikv/pull/9097) + - Add a metrics for ingest sst errors [#9096](https://github.com/tikv/tikv/pull/9096) + - Prevent hibernation when there are still peers catching up logs [#9093](https://github.com/tikv/tikv/pull/9093) + - Increase the success rate of pipelined pessimistic locking. [#9086](https://github.com/tikv/tikv/pull/9086) + - Fix a bug may cause analyze statement panic when using the latin1 character set. [#9082](https://github.com/tikv/tikv/pull/9082) + - Config: fix invalid advertise-status-addr [#9036](https://github.com/tikv/tikv/pull/9036) + - Fix cast decimal as time expr get wrong result when deal with numbers argument [#9031](https://github.com/tikv/tikv/pull/9031) + - Add check to avoid corruption due to RocksDB block cache error #8243. Also disable `force-consistency-checks` by default to improve performance. [#9029](https://github.com/tikv/tikv/pull/9029) + - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to 1024. [#9020](https://github.com/tikv/tikv/pull/9020) + - Fix the bug that lightning fails to ingest sst files to tikv with importer/local backend when TDE is enabled [#8995](https://github.com/tikv/tikv/pull/8995) + - Turn file dictionary into log style. [#8960](https://github.com/tikv/tikv/pull/8960) + - Add config for max-background-flushes [#8947](https://github.com/tikv/tikv/pull/8947) + - Add tag to split command to trace its source [#8936](https://github.com/tikv/tikv/pull/8936) + - Fix the issue that reports a key-exist error when a key is locked and deleted by a committed transaction. [#8930](https://github.com/tikv/tikv/pull/8930) + - Enable the unified read pool for the storage module by default. [#8887](https://github.com/tikv/tikv/pull/8887) + ++ PD + + - Dashboard: update to v2020.11.26.1 [#3219](https://github.com/pingcap/pd/pull/3219) + - Check cluster version on stores become tombstone [#3213](https://github.com/pingcap/pd/pull/3213) + - The store of lower version is no longer allowed to change from `Tombstone` back to `Up`. [#3206](https://github.com/pingcap/pd/pull/3206) + - Fix a bug that service safe points with infinite TTL may disappear. [#3143](https://github.com/pingcap/pd/pull/3143) + ++ TiFlash + + - Implement `batch_read_index` to reduce latency about replica read. [#1236](https://github.com/pingcap/tics/pull/1236) + - Refine TiFlash's error message [#1231](https://github.com/pingcap/tics/pull/1231) + - Limit the memory usage of cache data under huge volume data. [#1229](https://github.com/pingcap/tics/pull/1229) + - > [#1227](https://github.com/pingcap/tics/pull/1227) + - Add metric "number of handling cop task". [#1183](https://github.com/pingcap/tics/pull/1183) + ++ Tools + + - TiCDC + + * Metrics: add alert for tikv hibernate regions [#1120](https://github.com/pingcap/ticdc/pull/1120) + * Fix the bug that multiple owners could exist when owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) + * Kafka_consumer: fix wrong timezone when 'TZ' env is not set and downstream is mysql [#1095](https://github.com/pingcap/ticdc/pull/1095) From 9f6e27582d3d94414d9c13d419d9376d1fd410cd Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 30 Nov 2020 12:39:05 +0800 Subject: [PATCH 02/34] add to TOC, release-notes.md --- TOC.md | 1 + tidb/4.0.9.md => releases/release-4.0.9.md | 26 ++++++++++++---------- releases/release-notes.md | 1 + 3 files changed, 16 insertions(+), 12 deletions(-) rename tidb/4.0.9.md => releases/release-4.0.9.md (98%) diff --git a/TOC.md b/TOC.md index 61ceeaf7a0499..0385be4f813ca 100644 --- a/TOC.md +++ b/TOC.md @@ -529,6 +529,7 @@ + [All Releases](/releases/release-notes.md) + [TiDB Roadmap](/roadmap.md) + v4.0 + + [4.0.9](/releases/release-4.0.9.md) + [4.0.8](/releases/release-4.0.8.md) + [4.0.7](/releases/release-4.0.7.md) + [4.0.6](/releases/release-4.0.6.md) diff --git a/tidb/4.0.9.md b/releases/release-4.0.9.md similarity index 98% rename from tidb/4.0.9.md rename to releases/release-4.0.9.md index e3287c0b4883b..e469d495b0b26 100644 --- a/tidb/4.0.9.md +++ b/releases/release-4.0.9.md @@ -1,14 +1,22 @@ --- -title: tidb v4.0.9 Release Notes -category: Releases -aliases: ['/docs/dev/releases/v4.0.9/'] +title: TiDB 4.0.9 Release Notes --- -# tidb v4.0.9 Release Notes +# TiDB 4.0.9 Release Notes + +Release date: December 3, 2020 + +TiDB version: 4.0.9 + +## New Features + ++ TiFlash + + - Support multi-disks for storing latest data [#1159](https://github.com/pingcap/tics/pull/1159) + +## Improvements -Release date: November 30, 2020 -TiDB version: v4.0.9 ## Bug Fixes @@ -46,12 +54,6 @@ TiDB version: v4.0.9 - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use. [#1248](https://github.com/pingcap/tics/pull/1248) - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual usage. [#1212](https://github.com/pingcap/tics/pull/1212) -## New Features - -+ TiFlash - - - Support multi-disks for storing latest data [#1159](https://github.com/pingcap/tics/pull/1159) - ## Others + TiDB diff --git a/releases/release-notes.md b/releases/release-notes.md index aa87a60437674..42bf75b3fa2c0 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -7,6 +7,7 @@ aliases: ['/docs/dev/releases/release-notes/','/docs/dev/releases/rn/'] ## 4.0 +- [4.0.9](/releases/release-4.0.9.md) - [4.0.8](/releases/release-4.0.8.md) - [4.0.7](/releases/release-4.0.7.md) - [4.0.6](/releases/release-4.0.6.md) From 4f51817e508374487403af89635ddf9d5f0e6901 Mon Sep 17 00:00:00 2001 From: ti-srebot Date: Mon, 30 Nov 2020 13:17:17 +0800 Subject: [PATCH 03/34] update v4.0.9 release notes at 2020-11-30T13:17:16 Signed-off-by: ti-srebot --- releases/4.0.9.md | 128 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 128 insertions(+) create mode 100644 releases/4.0.9.md diff --git a/releases/4.0.9.md b/releases/4.0.9.md new file mode 100644 index 0000000000000..6409468d8fdc3 --- /dev/null +++ b/releases/4.0.9.md @@ -0,0 +1,128 @@ +--- +title: tidb v4.0.9 Release Notes +category: Releases +aliases: ['/docs/dev/releases/v4.0.9/'] +--- + +# tidb v4.0.9 Release Notes + +Release date: November 30, 2020 + +TiDB version: v4.0.9 + +## New Features + ++ TiFlash + + - Support multi-disks for storing latest data [#1159](https://github.com/pingcap/tics/pull/1159) + +## Bug Fixes + ++ TiDB + + - Fix incorrect results when using a prefix index with OR condition [#21287](https://github.com/pingcap/tidb/pull/21287) + - Fix a bug cause panic when retry is enable. [#21285](https://github.com/pingcap/tidb/pull/21285) + - Fix a bug that checks partition definition according to column type [#21273](https://github.com/pingcap/tidb/pull/21273) + - Fix a bug that hash type partition does not check partition name is unique [#21257](https://github.com/pingcap/tidb/pull/21257) + - Fix unexpected error when `INSERT` meets index join in some cases. [#21249](https://github.com/pingcap/tidb/pull/21249) + - Fix insert value into hash partition table which not int [#21238](https://github.com/pingcap/tidb/pull/21238) + - Fix Bigint unsigned column value in CASE WHEN operator is converted to bigint signed #9869 [#21236](https://github.com/pingcap/tidb/pull/21236) + - Fix a bug that index-hash-join and index-merge-join doesn't consider collation [#21219](https://github.com/pingcap/tidb/pull/21219) + - Fix issue of the query result of slow_query maybe miss some rows. [#21211](https://github.com/pingcap/tidb/pull/21211) + - `DELETE` may not delete data correctly when the database name is not in pure lower representation. [#21206](https://github.com/pingcap/tidb/pull/21206) + - Raise an error when preparing the `load data` statement. [#21199](https://github.com/pingcap/tidb/pull/21199) + - Fix a bug that partition table does not consider collation in `create table` and `select` sentence. [#21181](https://github.com/pingcap/tidb/pull/21181) + - Disallow multi-updates on primary key [#21113](https://github.com/pingcap/tidb/pull/21113) + - Fix a bug causes schema change after DML [#21050](https://github.com/pingcap/tidb/pull/21050) + - Fix the bug that can not query the coalesced column when use using-join. [#21021](https://github.com/pingcap/tidb/pull/21021) + - Fix wrong results for some semi join queries. [#21019](https://github.com/pingcap/tidb/pull/21019) + - Fix table lock for update statement. [#21002](https://github.com/pingcap/tidb/pull/21002) + - Fix stack overflow when building recursive view. [#21001](https://github.com/pingcap/tidb/pull/21001) + - Ddl: ignore integer zerofill size attribute when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) + - Fix unexpected results when do merge join on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) + - Fix the issue that sometimes a transaction that has undetermined result may be treated as failed. [#20925](https://github.com/pingcap/tidb/pull/20925) + ++ PD + + - Fix the issue that the leader role does not take effect when using the replacement rule in some cases [#3208](https://github.com/pingcap/pd/pull/3208) + - Fix the bug that `trace-region-flow` will be accidentally changed to `false`. [#3120](https://github.com/pingcap/pd/pull/3120) + ++ TiFlash + + - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use. [#1248](https://github.com/pingcap/tics/pull/1248) + - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual usage. [#1212](https://github.com/pingcap/tics/pull/1212) + +## Improvements + ++ TiDB + + - Ban (index) merge join heuristically when convert equal conditions to other conditions. [#21146](https://github.com/pingcap/tidb/pull/21146) + - Differentiate types for user variables [#21107](https://github.com/pingcap/tidb/pull/21107) + - Allow set GOGC in config file. [#20922](https://github.com/pingcap/tidb/pull/20922) + ++ TiKV + + - Add tag to split command to trace its source [#8936](https://github.com/tikv/tikv/pull/8936) + ++ TiFlash + + - Implement `batch_read_index` to reduce latency about replica read. [#1236](https://github.com/pingcap/tics/pull/1236) + - Refine TiFlash's error message [#1231](https://github.com/pingcap/tics/pull/1231) + - Limit the memory usage of cache data under huge volume data. [#1229](https://github.com/pingcap/tics/pull/1229) + - > [#1227](https://github.com/pingcap/tics/pull/1227) + - Add metric "number of handling cop task". [#1183](https://github.com/pingcap/tics/pull/1183) + +## Others + ++ TiDB + + - Fix issue of explain for connection can't show the last query plan/ [#21315](https://github.com/pingcap/tidb/pull/21315) + - Add metric for connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) + - Fix the issue that when Index Merge is used in a transaction with RC isolation level, the result may be incorrect. [#21253](https://github.com/pingcap/tidb/pull/21253) + - Planner: fix wrong point get plan generation in fast plan code path [#21244](https://github.com/pingcap/tidb/pull/21244) + - Expression: keep the original data type when doing date arithmetic operations [#21176](https://github.com/pingcap/tidb/pull/21176) + - Ddl: Fix partition table's partition column values type check [#21136](https://github.com/pingcap/tidb/pull/21136) + - Make dump binary time more compatible with MySQL [#21135](https://github.com/pingcap/tidb/pull/21135) + - Fix auto-id allocation failed because of transaction's write-conflict retry. [#21079](https://github.com/pingcap/tidb/pull/21079) + - Fix The JSON Data can not import to TiDB correctly by `load data` [#21074](https://github.com/pingcap/tidb/pull/21074) + - Fix up displaying executor runtime info & Add runtime information for DML in explain analyze [#21066](https://github.com/pingcap/tidb/pull/21066) + - Deprecate `enable-streaming`. [#21055](https://github.com/pingcap/tidb/pull/21055) + - Avoid unnecessary warnings/errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) + - TiDB now provides an error for statements that use the syntax `LOCK IN SHARE MODE`. This helps alert users that this feature is not implemented by TiDB, but a workaround to restore the previous behavior is available by setting `tidb_enable_noop_functions=1`. [#21005](https://github.com/pingcap/tidb/pull/21005) + - Set correct default value for new added enum column. [#20998](https://github.com/pingcap/tidb/pull/20998) + ++ TiKV + + - Fix a bug that Coprocessor may return wrong result when there are > 255 columns. [#9131](https://github.com/tikv/tikv/pull/9131) + - Fix an issue that region merge may cause data loss during network partition. [#9108](https://github.com/tikv/tikv/pull/9108) + - Enable dynamically change config pessimistic-txn.pipelined. [#9100](https://github.com/tikv/tikv/pull/9100) + - Running checksum in BR and Lightning should have less influence on the cluster performance. [#9098](https://github.com/tikv/tikv/pull/9098) + - Revert "encryption: Turn file dictionary into log style" [#9097](https://github.com/tikv/tikv/pull/9097) + - Add a metrics for ingest sst errors [#9096](https://github.com/tikv/tikv/pull/9096) + - Prevent hibernation when there are still peers catching up logs [#9093](https://github.com/tikv/tikv/pull/9093) + - Increase the success rate of pipelined pessimistic locking. [#9086](https://github.com/tikv/tikv/pull/9086) + - Fix a bug may cause analyze statement panic when using the latin1 character set. [#9082](https://github.com/tikv/tikv/pull/9082) + - Config: fix invalid advertise-status-addr [#9036](https://github.com/tikv/tikv/pull/9036) + - Fix cast decimal as time expr get wrong result when deal with numbers argument [#9031](https://github.com/tikv/tikv/pull/9031) + - Add check to avoid corruption due to RocksDB block cache error #8243. Also disable `force-consistency-checks` by default to improve performance. [#9029](https://github.com/tikv/tikv/pull/9029) + - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to 1024. [#9020](https://github.com/tikv/tikv/pull/9020) + - Fix the bug that lightning fails to ingest sst files to tikv with importer/local backend when TDE is enabled [#8995](https://github.com/tikv/tikv/pull/8995) + - Turn file dictionary into log style. [#8960](https://github.com/tikv/tikv/pull/8960) + - Add config for max-background-flushes [#8947](https://github.com/tikv/tikv/pull/8947) + - Fix the issue that reports a key-exist error when a key is locked and deleted by a committed transaction. [#8930](https://github.com/tikv/tikv/pull/8930) + - Enable the unified read pool for the storage module by default. [#8887](https://github.com/tikv/tikv/pull/8887) + ++ PD + + - Dashboard: update to v2020.11.26.1 [#3219](https://github.com/pingcap/pd/pull/3219) + - Check cluster version on stores become tombstone [#3213](https://github.com/pingcap/pd/pull/3213) + - The store of lower version is no longer allowed to change from `Tombstone` back to `Up`. [#3206](https://github.com/pingcap/pd/pull/3206) + - Fix a bug that service safe points with infinite TTL may disappear. [#3143](https://github.com/pingcap/pd/pull/3143) + ++ Tools + + - TiCDC + + * Metrics: add alert for tikv hibernate regions [#1120](https://github.com/pingcap/ticdc/pull/1120) + * Fix the bug that multiple owners could exist when owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) + * Kafka_consumer: fix wrong timezone when 'TZ' env is not set and downstream is mysql [#1095](https://github.com/pingcap/ticdc/pull/1095) From b925a5c590ff81a8de9517cff35d994b1264da72 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 30 Nov 2020 13:28:59 +0800 Subject: [PATCH 04/34] update --- releases/4.0.9.md | 128 -------------------------------------- releases/release-4.0.9.md | 49 ++++++++------- 2 files changed, 27 insertions(+), 150 deletions(-) delete mode 100644 releases/4.0.9.md diff --git a/releases/4.0.9.md b/releases/4.0.9.md deleted file mode 100644 index 6409468d8fdc3..0000000000000 --- a/releases/4.0.9.md +++ /dev/null @@ -1,128 +0,0 @@ ---- -title: tidb v4.0.9 Release Notes -category: Releases -aliases: ['/docs/dev/releases/v4.0.9/'] ---- - -# tidb v4.0.9 Release Notes - -Release date: November 30, 2020 - -TiDB version: v4.0.9 - -## New Features - -+ TiFlash - - - Support multi-disks for storing latest data [#1159](https://github.com/pingcap/tics/pull/1159) - -## Bug Fixes - -+ TiDB - - - Fix incorrect results when using a prefix index with OR condition [#21287](https://github.com/pingcap/tidb/pull/21287) - - Fix a bug cause panic when retry is enable. [#21285](https://github.com/pingcap/tidb/pull/21285) - - Fix a bug that checks partition definition according to column type [#21273](https://github.com/pingcap/tidb/pull/21273) - - Fix a bug that hash type partition does not check partition name is unique [#21257](https://github.com/pingcap/tidb/pull/21257) - - Fix unexpected error when `INSERT` meets index join in some cases. [#21249](https://github.com/pingcap/tidb/pull/21249) - - Fix insert value into hash partition table which not int [#21238](https://github.com/pingcap/tidb/pull/21238) - - Fix Bigint unsigned column value in CASE WHEN operator is converted to bigint signed #9869 [#21236](https://github.com/pingcap/tidb/pull/21236) - - Fix a bug that index-hash-join and index-merge-join doesn't consider collation [#21219](https://github.com/pingcap/tidb/pull/21219) - - Fix issue of the query result of slow_query maybe miss some rows. [#21211](https://github.com/pingcap/tidb/pull/21211) - - `DELETE` may not delete data correctly when the database name is not in pure lower representation. [#21206](https://github.com/pingcap/tidb/pull/21206) - - Raise an error when preparing the `load data` statement. [#21199](https://github.com/pingcap/tidb/pull/21199) - - Fix a bug that partition table does not consider collation in `create table` and `select` sentence. [#21181](https://github.com/pingcap/tidb/pull/21181) - - Disallow multi-updates on primary key [#21113](https://github.com/pingcap/tidb/pull/21113) - - Fix a bug causes schema change after DML [#21050](https://github.com/pingcap/tidb/pull/21050) - - Fix the bug that can not query the coalesced column when use using-join. [#21021](https://github.com/pingcap/tidb/pull/21021) - - Fix wrong results for some semi join queries. [#21019](https://github.com/pingcap/tidb/pull/21019) - - Fix table lock for update statement. [#21002](https://github.com/pingcap/tidb/pull/21002) - - Fix stack overflow when building recursive view. [#21001](https://github.com/pingcap/tidb/pull/21001) - - Ddl: ignore integer zerofill size attribute when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) - - Fix unexpected results when do merge join on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) - - Fix the issue that sometimes a transaction that has undetermined result may be treated as failed. [#20925](https://github.com/pingcap/tidb/pull/20925) - -+ PD - - - Fix the issue that the leader role does not take effect when using the replacement rule in some cases [#3208](https://github.com/pingcap/pd/pull/3208) - - Fix the bug that `trace-region-flow` will be accidentally changed to `false`. [#3120](https://github.com/pingcap/pd/pull/3120) - -+ TiFlash - - - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use. [#1248](https://github.com/pingcap/tics/pull/1248) - - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual usage. [#1212](https://github.com/pingcap/tics/pull/1212) - -## Improvements - -+ TiDB - - - Ban (index) merge join heuristically when convert equal conditions to other conditions. [#21146](https://github.com/pingcap/tidb/pull/21146) - - Differentiate types for user variables [#21107](https://github.com/pingcap/tidb/pull/21107) - - Allow set GOGC in config file. [#20922](https://github.com/pingcap/tidb/pull/20922) - -+ TiKV - - - Add tag to split command to trace its source [#8936](https://github.com/tikv/tikv/pull/8936) - -+ TiFlash - - - Implement `batch_read_index` to reduce latency about replica read. [#1236](https://github.com/pingcap/tics/pull/1236) - - Refine TiFlash's error message [#1231](https://github.com/pingcap/tics/pull/1231) - - Limit the memory usage of cache data under huge volume data. [#1229](https://github.com/pingcap/tics/pull/1229) - - > [#1227](https://github.com/pingcap/tics/pull/1227) - - Add metric "number of handling cop task". [#1183](https://github.com/pingcap/tics/pull/1183) - -## Others - -+ TiDB - - - Fix issue of explain for connection can't show the last query plan/ [#21315](https://github.com/pingcap/tidb/pull/21315) - - Add metric for connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) - - Fix the issue that when Index Merge is used in a transaction with RC isolation level, the result may be incorrect. [#21253](https://github.com/pingcap/tidb/pull/21253) - - Planner: fix wrong point get plan generation in fast plan code path [#21244](https://github.com/pingcap/tidb/pull/21244) - - Expression: keep the original data type when doing date arithmetic operations [#21176](https://github.com/pingcap/tidb/pull/21176) - - Ddl: Fix partition table's partition column values type check [#21136](https://github.com/pingcap/tidb/pull/21136) - - Make dump binary time more compatible with MySQL [#21135](https://github.com/pingcap/tidb/pull/21135) - - Fix auto-id allocation failed because of transaction's write-conflict retry. [#21079](https://github.com/pingcap/tidb/pull/21079) - - Fix The JSON Data can not import to TiDB correctly by `load data` [#21074](https://github.com/pingcap/tidb/pull/21074) - - Fix up displaying executor runtime info & Add runtime information for DML in explain analyze [#21066](https://github.com/pingcap/tidb/pull/21066) - - Deprecate `enable-streaming`. [#21055](https://github.com/pingcap/tidb/pull/21055) - - Avoid unnecessary warnings/errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) - - TiDB now provides an error for statements that use the syntax `LOCK IN SHARE MODE`. This helps alert users that this feature is not implemented by TiDB, but a workaround to restore the previous behavior is available by setting `tidb_enable_noop_functions=1`. [#21005](https://github.com/pingcap/tidb/pull/21005) - - Set correct default value for new added enum column. [#20998](https://github.com/pingcap/tidb/pull/20998) - -+ TiKV - - - Fix a bug that Coprocessor may return wrong result when there are > 255 columns. [#9131](https://github.com/tikv/tikv/pull/9131) - - Fix an issue that region merge may cause data loss during network partition. [#9108](https://github.com/tikv/tikv/pull/9108) - - Enable dynamically change config pessimistic-txn.pipelined. [#9100](https://github.com/tikv/tikv/pull/9100) - - Running checksum in BR and Lightning should have less influence on the cluster performance. [#9098](https://github.com/tikv/tikv/pull/9098) - - Revert "encryption: Turn file dictionary into log style" [#9097](https://github.com/tikv/tikv/pull/9097) - - Add a metrics for ingest sst errors [#9096](https://github.com/tikv/tikv/pull/9096) - - Prevent hibernation when there are still peers catching up logs [#9093](https://github.com/tikv/tikv/pull/9093) - - Increase the success rate of pipelined pessimistic locking. [#9086](https://github.com/tikv/tikv/pull/9086) - - Fix a bug may cause analyze statement panic when using the latin1 character set. [#9082](https://github.com/tikv/tikv/pull/9082) - - Config: fix invalid advertise-status-addr [#9036](https://github.com/tikv/tikv/pull/9036) - - Fix cast decimal as time expr get wrong result when deal with numbers argument [#9031](https://github.com/tikv/tikv/pull/9031) - - Add check to avoid corruption due to RocksDB block cache error #8243. Also disable `force-consistency-checks` by default to improve performance. [#9029](https://github.com/tikv/tikv/pull/9029) - - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to 1024. [#9020](https://github.com/tikv/tikv/pull/9020) - - Fix the bug that lightning fails to ingest sst files to tikv with importer/local backend when TDE is enabled [#8995](https://github.com/tikv/tikv/pull/8995) - - Turn file dictionary into log style. [#8960](https://github.com/tikv/tikv/pull/8960) - - Add config for max-background-flushes [#8947](https://github.com/tikv/tikv/pull/8947) - - Fix the issue that reports a key-exist error when a key is locked and deleted by a committed transaction. [#8930](https://github.com/tikv/tikv/pull/8930) - - Enable the unified read pool for the storage module by default. [#8887](https://github.com/tikv/tikv/pull/8887) - -+ PD - - - Dashboard: update to v2020.11.26.1 [#3219](https://github.com/pingcap/pd/pull/3219) - - Check cluster version on stores become tombstone [#3213](https://github.com/pingcap/pd/pull/3213) - - The store of lower version is no longer allowed to change from `Tombstone` back to `Up`. [#3206](https://github.com/pingcap/pd/pull/3206) - - Fix a bug that service safe points with infinite TTL may disappear. [#3143](https://github.com/pingcap/pd/pull/3143) - -+ Tools - - - TiCDC - - * Metrics: add alert for tikv hibernate regions [#1120](https://github.com/pingcap/ticdc/pull/1120) - * Fix the bug that multiple owners could exist when owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) - * Kafka_consumer: fix wrong timezone when 'TZ' env is not set and downstream is mysql [#1095](https://github.com/pingcap/ticdc/pull/1095) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index e469d495b0b26..7e09fa51a83a6 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -16,7 +16,23 @@ TiDB version: 4.0.9 ## Improvements ++ TiDB + + - Ban (index) merge join heuristically when convert equal conditions to other conditions. [#21146](https://github.com/pingcap/tidb/pull/21146) + - Differentiate types for user variables [#21107](https://github.com/pingcap/tidb/pull/21107) + - Allow set GOGC in config file. [#20922](https://github.com/pingcap/tidb/pull/20922) + ++ TiKV + + - Add tag to split command to trace its source [#8936](https://github.com/tikv/tikv/pull/8936) + ++ TiFlash + - Implement `batch_read_index` to reduce latency about replica read. [#1236](https://github.com/pingcap/tics/pull/1236) + - Refine TiFlash's error message [#1231](https://github.com/pingcap/tics/pull/1231) + - Limit the memory usage of cache data under huge volume data. [#1229](https://github.com/pingcap/tics/pull/1229) + - [#1227](https://github.com/pingcap/tics/pull/1227) + - Add metric "number of handling cop task". [#1183](https://github.com/pingcap/tics/pull/1183) ## Bug Fixes @@ -44,6 +60,16 @@ TiDB version: 4.0.9 - Fix unexpected results when do merge join on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) - Fix the issue that sometimes a transaction that has undetermined result may be treated as failed. [#20925](https://github.com/pingcap/tidb/pull/20925) ++ TiKV + + - Fix a bug that Coprocessor may return wrong result when there are > 255 columns. [#9131](https://github.com/tikv/tikv/pull/9131) + - Fix an issue that region merge may cause data loss during network partition. [#9108](https://github.com/tikv/tikv/pull/9108) + - Fix a bug may cause analyze statement panic when using the latin1 character set. [#9082](https://github.com/tikv/tikv/pull/9082) + - Fix cast decimal as time expr get wrong result when deal with numbers argument [#9031](https://github.com/tikv/tikv/pull/9031) + - Fix the bug that lightning fails to ingest sst files to tikv with importer/local backend when TDE is enabled [#8995](https://github.com/tikv/tikv/pull/8995) + - Config: fix invalid advertise-status-addr [#9036](https://github.com/tikv/tikv/pull/9036) + - Fix the issue that reports a key-exist error when a key is locked and deleted by a committed transaction. [#8930](https://github.com/tikv/tikv/pull/8930) + + PD - Fix the issue that the leader role does not take effect when using the replacement rule in some cases [#3208](https://github.com/pingcap/pd/pull/3208) @@ -63,10 +89,8 @@ TiDB version: 4.0.9 - Fix the issue that when Index Merge is used in a transaction with RC isolation level, the result may be incorrect. [#21253](https://github.com/pingcap/tidb/pull/21253) - Planner: fix wrong point get plan generation in fast plan code path [#21244](https://github.com/pingcap/tidb/pull/21244) - Expression: keep the original data type when doing date arithmetic operations [#21176](https://github.com/pingcap/tidb/pull/21176) - - Ban (index) merge join heuristically when convert equal conditions to other conditions. [#21146](https://github.com/pingcap/tidb/pull/21146) - Ddl: Fix partition table's partition column values type check [#21136](https://github.com/pingcap/tidb/pull/21136) - Make dump binary time more compatible with MySQL [#21135](https://github.com/pingcap/tidb/pull/21135) - - Differentiate types for user variables [#21107](https://github.com/pingcap/tidb/pull/21107) - Fix auto-id allocation failed because of transaction's write-conflict retry. [#21079](https://github.com/pingcap/tidb/pull/21079) - Fix The JSON Data can not import to TiDB correctly by `load data` [#21074](https://github.com/pingcap/tidb/pull/21074) - Fix up displaying executor runtime info & Add runtime information for DML in explain analyze [#21066](https://github.com/pingcap/tidb/pull/21066) @@ -74,28 +98,17 @@ TiDB version: 4.0.9 - Avoid unnecessary warnings/errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) - TiDB now provides an error for statements that use the syntax `LOCK IN SHARE MODE`. This helps alert users that this feature is not implemented by TiDB, but a workaround to restore the previous behavior is available by setting `tidb_enable_noop_functions=1`. [#21005](https://github.com/pingcap/tidb/pull/21005) - Set correct default value for new added enum column. [#20998](https://github.com/pingcap/tidb/pull/20998) - - Allow set GOGC in config file. [#20922](https://github.com/pingcap/tidb/pull/20922) + TiKV - - Fix a bug that Coprocessor may return wrong result when there are > 255 columns. [#9131](https://github.com/tikv/tikv/pull/9131) - - Fix an issue that region merge may cause data loss during network partition. [#9108](https://github.com/tikv/tikv/pull/9108) - Enable dynamically change config pessimistic-txn.pipelined. [#9100](https://github.com/tikv/tikv/pull/9100) - Running checksum in BR and Lightning should have less influence on the cluster performance. [#9098](https://github.com/tikv/tikv/pull/9098) - - Revert "encryption: Turn file dictionary into log style" [#9097](https://github.com/tikv/tikv/pull/9097) - Add a metrics for ingest sst errors [#9096](https://github.com/tikv/tikv/pull/9096) - Prevent hibernation when there are still peers catching up logs [#9093](https://github.com/tikv/tikv/pull/9093) - Increase the success rate of pipelined pessimistic locking. [#9086](https://github.com/tikv/tikv/pull/9086) - - Fix a bug may cause analyze statement panic when using the latin1 character set. [#9082](https://github.com/tikv/tikv/pull/9082) - - Config: fix invalid advertise-status-addr [#9036](https://github.com/tikv/tikv/pull/9036) - - Fix cast decimal as time expr get wrong result when deal with numbers argument [#9031](https://github.com/tikv/tikv/pull/9031) - Add check to avoid corruption due to RocksDB block cache error #8243. Also disable `force-consistency-checks` by default to improve performance. [#9029](https://github.com/tikv/tikv/pull/9029) - - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to 1024. [#9020](https://github.com/tikv/tikv/pull/9020) - - Fix the bug that lightning fails to ingest sst files to tikv with importer/local backend when TDE is enabled [#8995](https://github.com/tikv/tikv/pull/8995) - - Turn file dictionary into log style. [#8960](https://github.com/tikv/tikv/pull/8960) + - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to 1024 [#9020](https://github.com/tikv/tikv/pull/9020) - Add config for max-background-flushes [#8947](https://github.com/tikv/tikv/pull/8947) - - Add tag to split command to trace its source [#8936](https://github.com/tikv/tikv/pull/8936) - - Fix the issue that reports a key-exist error when a key is locked and deleted by a committed transaction. [#8930](https://github.com/tikv/tikv/pull/8930) - Enable the unified read pool for the storage module by default. [#8887](https://github.com/tikv/tikv/pull/8887) + PD @@ -105,14 +118,6 @@ TiDB version: 4.0.9 - The store of lower version is no longer allowed to change from `Tombstone` back to `Up`. [#3206](https://github.com/pingcap/pd/pull/3206) - Fix a bug that service safe points with infinite TTL may disappear. [#3143](https://github.com/pingcap/pd/pull/3143) -+ TiFlash - - - Implement `batch_read_index` to reduce latency about replica read. [#1236](https://github.com/pingcap/tics/pull/1236) - - Refine TiFlash's error message [#1231](https://github.com/pingcap/tics/pull/1231) - - Limit the memory usage of cache data under huge volume data. [#1229](https://github.com/pingcap/tics/pull/1229) - - > [#1227](https://github.com/pingcap/tics/pull/1227) - - Add metric "number of handling cop task". [#1183](https://github.com/pingcap/tics/pull/1183) - + Tools - TiCDC From 2f2062f6e3ee13e82c10bbbd386f888d11c23c94 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 30 Nov 2020 15:50:02 +0800 Subject: [PATCH 05/34] Apply suggestions from JaySon-Huang Co-authored-by: JaySon --- releases/release-4.0.9.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 7e09fa51a83a6..75c0ddbec9fe7 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -12,7 +12,7 @@ TiDB version: 4.0.9 + TiFlash - - Support multi-disks for storing latest data [#1159](https://github.com/pingcap/tics/pull/1159) + - Support storing the latest data of the storage engine on multiple disks [#1159](https://github.com/pingcap/tics/pull/1159) ## Improvements @@ -28,11 +28,11 @@ TiDB version: 4.0.9 + TiFlash - - Implement `batch_read_index` to reduce latency about replica read. [#1236](https://github.com/pingcap/tics/pull/1236) + - Reduce the latency of replica reads [#1236](https://github.com/pingcap/tics/pull/1236) - Refine TiFlash's error message [#1231](https://github.com/pingcap/tics/pull/1231) - Limit the memory usage of cache data under huge volume data. [#1229](https://github.com/pingcap/tics/pull/1229) - [#1227](https://github.com/pingcap/tics/pull/1227) - - Add metric "number of handling cop task". [#1183](https://github.com/pingcap/tics/pull/1183) + - Add a metric for the number of handling coprocessor tasks [#1183](https://github.com/pingcap/tics/pull/1183) ## Bug Fixes @@ -78,7 +78,7 @@ TiDB version: 4.0.9 + TiFlash - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use. [#1248](https://github.com/pingcap/tics/pull/1248) - - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual usage. [#1212](https://github.com/pingcap/tics/pull/1212) + - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual the usage. [#1212](https://github.com/pingcap/tics/pull/1212) ## Others From 68de6db8c7e09deeaae3f6a7db45b60ed16f0ef7 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 30 Nov 2020 17:19:39 +0800 Subject: [PATCH 06/34] add tools --- releases/release-4.0.9.md | 65 +++++++++++++++++++++++++++++++++------ 1 file changed, 55 insertions(+), 10 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 75c0ddbec9fe7..13176ef7f4844 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -34,6 +34,38 @@ TiDB version: 4.0.9 - [#1227](https://github.com/pingcap/tics/pull/1227) - Add a metric for the number of handling coprocessor tasks [#1183](https://github.com/pingcap/tics/pull/1183) ++ Tools + + + Backup & Restore (BR) + + - BR no longer accepts --checksum false in command line, which did not disable checksum. The correct usage always include the = sign: --checksum=false [#588](https://github.com/pingcap/br/pull/588) + - Support change PD config temporary [#596](https://github.com/pingcap/br/pull/596) + - Support analyze table after restore [#622](https://github.com/pingcap/br/pull/622) + - Retry for read index not ready and proposal in merging mode [#626](https://github.com/pingcap/br/pull/626) + + + TiCDC + + - Metrics: add alert for tikv hibernate regions [#1120](https://github.com/pingcap/ticdc/pull/1120) + - Reduce memory usage in schema storage by avoiding table info replication [#1127](https://github.com/pingcap/ticdc/pull/1127) + + + Dumpling + + - Retry dumping on failed chunks [#182](https://github.com/pingcap/dumpling/pull/182) + - Support configuring both -F and -r arguments at the same time [#177](https://github.com/pingcap/dumpling/pull/177) + - Exclude system databases in --filter parameter by default [#194](https://github.com/pingcap/dumpling/pull/194) + - Support --transactional-consistency parameter and support rebuild mysql connections during retry [#199](https://github.com/pingcap/dumpling/pull/199) + + + TiDB Lightning + + - Filter out all system schemas by default [#459](https://github.com/pingcap/tidb-lightning/pull/459) + - Support set a default value for auto random primary key for local/importer backend [#457](https://github.com/pingcap/tidb-lightning/pull/457) + - Use range properties to make range split more precise with local backend [#422](https://github.com/pingcap/tidb-lightning/pull/422) + - `tikv-importer.region-split-size`, `mydumper.read-block-size`, `mydumper.batch-size` and `mydumper.max-region-size` can now accept human-readable format in the form "2.5 GiB" [#471](https://github.com/pingcap/tidb-lightning/pull/471) + + + TiDB Binlog + + - Exit Drainer process with non-zero code if upstream PD is down or apply DDL/DML to downstream failed [#1012](https://github.com/pingcap/tidb-binlog/pull/1012) + ## Bug Fixes + TiDB @@ -77,8 +109,29 @@ TiDB version: 4.0.9 + TiFlash - - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use. [#1248](https://github.com/pingcap/tics/pull/1248) - - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual the usage. [#1212](https://github.com/pingcap/tics/pull/1212) + - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use [#1248](https://github.com/pingcap/tics/pull/1248) + - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual the usage [#1212](https://github.com/pingcap/tics/pull/1212) + ++ Tools + + + Backup & Restore (BR) + + - Fix special characters in S3 secret access keys [#617](https://github.com/pingcap/br/pull/617) + + + TiCDC + + - Fix the bug that multiple owners could exist when owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) + - Kafka_consumer: fix wrong timezone when 'TZ' env is not set and downstream is mysql [#1095](https://github.com/pingcap/ticdc/pull/1095) + + + Dumpling + + - Fix the problem that dumpling may get blocked when its connection to database server is closed [#190](https://github.com/pingcap/dumpling/pull/190) + + + TiDB Lightning + + - Fix a bug about encoding data with wrong field info [#437](https://github.com/pingcap/tidb-lightning/pull/437) + - Fix a bug that gc life time ttl does not take effect [#448](https://github.com/pingcap/tidb-lightning/pull/448) + - Fix a bug that causes panic when manually stops Lightning import in Local-backend mode [#484](https://github.com/pingcap/tidb-lightning/pull/484) ## Others @@ -117,11 +170,3 @@ TiDB version: 4.0.9 - Check cluster version on stores become tombstone [#3213](https://github.com/pingcap/pd/pull/3213) - The store of lower version is no longer allowed to change from `Tombstone` back to `Up`. [#3206](https://github.com/pingcap/pd/pull/3206) - Fix a bug that service safe points with infinite TTL may disappear. [#3143](https://github.com/pingcap/pd/pull/3143) - -+ Tools - - - TiCDC - - * Metrics: add alert for tikv hibernate regions [#1120](https://github.com/pingcap/ticdc/pull/1120) - * Fix the bug that multiple owners could exist when owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) - * Kafka_consumer: fix wrong timezone when 'TZ' env is not set and downstream is mysql [#1095](https://github.com/pingcap/ticdc/pull/1095) From 62846ac0b2dfacbd6c6228fa8ff47d8405ae55f4 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 30 Nov 2020 18:54:03 +0800 Subject: [PATCH 07/34] update tidb notes --- releases/release-4.0.9.md | 54 ++++++++++++++++++--------------------- 1 file changed, 25 insertions(+), 29 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 13176ef7f4844..6aaa12bc8a523 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -18,9 +18,17 @@ TiDB version: 4.0.9 + TiDB - - Ban (index) merge join heuristically when convert equal conditions to other conditions. [#21146](https://github.com/pingcap/tidb/pull/21146) + - Ban (index) merge join heuristically when converting equal conditions to other conditions. [#21146](https://github.com/pingcap/tidb/pull/21146) - Differentiate types for user variables [#21107](https://github.com/pingcap/tidb/pull/21107) - - Allow set GOGC in config file. [#20922](https://github.com/pingcap/tidb/pull/20922) + - Allow set GOGC in the config file. [#20922](https://github.com/pingcap/tidb/pull/20922) + - Make dump binary time more compatible with MySQL [#21135](https://github.com/pingcap/tidb/pull/21135) + - TiDB now provides an error for statements that use the syntax `LOCK IN SHARE MODE`. This helps alert users that this feature is not implemented by TiDB, but a workaround to restore the previous behavior is available by setting `tidb_enable_noop_functions=1`. [#21005](https://github.com/pingcap/tidb/pull/21005) + - Avoid unnecessary warnings/errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) + - Raise an error when preparing the `load data` statement. [#21199](https://github.com/pingcap/tidb/pull/21199) + - Ignore integer zero-fill size attribute when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) + - Add runtime information for DML in explain analyze [#21066](https://github.com/pingcap/tidb/pull/21066) + - Disallow multi-updates on the primary key (i.e. updating primary key of the same table with different alias) [#21113](https://github.com/pingcap/tidb/pull/21113) + - Add metric for connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) + TiKV @@ -71,26 +79,31 @@ TiDB version: 4.0.9 + TiDB - Fix incorrect results when using a prefix index with OR condition [#21287](https://github.com/pingcap/tidb/pull/21287) - - Fix a bug cause panic when retry is enable. [#21285](https://github.com/pingcap/tidb/pull/21285) - - Fix a bug that checks partition definition according to column type [#21273](https://github.com/pingcap/tidb/pull/21273) + - Fix a bug that causes panic when `retry` is enabled. [#21285](https://github.com/pingcap/tidb/pull/21285) + - Fix a bug of partition definition checking. The value comparison should be in accord with column type [#21273](https://github.com/pingcap/tidb/pull/21273) + - Fix a bug of partition table's partition column values type check [#21136](https://github.com/pingcap/tidb/pull/21136) - Fix a bug that hash type partition does not check partition name is unique [#21257](https://github.com/pingcap/tidb/pull/21257) - - Fix unexpected error when `INSERT` meets index join in some cases. [#21249](https://github.com/pingcap/tidb/pull/21249) - Fix insert value into hash partition table which not int [#21238](https://github.com/pingcap/tidb/pull/21238) - - Fix Bigint unsigned column value in CASE WHEN operator is converted to bigint signed #9869 [#21236](https://github.com/pingcap/tidb/pull/21236) + - Fix unexpected error when `INSERT` meets index join in some cases. [#21249](https://github.com/pingcap/tidb/pull/21249) + - Fix bigint unsigned column value in CASE WHEN operator is converted to bigint signed [#21236](https://github.com/pingcap/tidb/pull/21236) - Fix a bug that index-hash-join and index-merge-join doesn't consider collation [#21219](https://github.com/pingcap/tidb/pull/21219) + - Fix a bug that partition table does not consider collation in `create table` and `select` sentence. [#21181](https://github.com/pingcap/tidb/pull/21181) - Fix issue of the query result of slow_query maybe miss some rows. [#21211](https://github.com/pingcap/tidb/pull/21211) - `DELETE` may not delete data correctly when the database name is not in pure lower representation. [#21206](https://github.com/pingcap/tidb/pull/21206) - - Raise an error when preparing the `load data` statement. [#21199](https://github.com/pingcap/tidb/pull/21199) - - Fix a bug that partition table does not consider collation in `create table` and `select` sentence. [#21181](https://github.com/pingcap/tidb/pull/21181) - - Disallow multi-updates on primary key [#21113](https://github.com/pingcap/tidb/pull/21113) - Fix a bug causes schema change after DML [#21050](https://github.com/pingcap/tidb/pull/21050) - Fix the bug that can not query the coalesced column when use using-join. [#21021](https://github.com/pingcap/tidb/pull/21021) - - Fix wrong results for some semi join queries. [#21019](https://github.com/pingcap/tidb/pull/21019) + - Fix wrong results for some semi-join queries. [#21019](https://github.com/pingcap/tidb/pull/21019) - Fix table lock for update statement. [#21002](https://github.com/pingcap/tidb/pull/21002) - Fix stack overflow when building recursive view. [#21001](https://github.com/pingcap/tidb/pull/21001) - - Ddl: ignore integer zerofill size attribute when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) - Fix unexpected results when do merge join on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) - - Fix the issue that sometimes a transaction that has undetermined result may be treated as failed. [#20925](https://github.com/pingcap/tidb/pull/20925) + - Fix the issue that sometimes a transaction that has an undetermined result may be treated as failed. [#20925](https://github.com/pingcap/tidb/pull/20925) + - Fix issue `explain for connection` can't show the last query plan/ [#21315](https://github.com/pingcap/tidb/pull/21315) + - Fix the issue that when Index Merge is used in a transaction with RC isolation level, the result may be incorrect. [#21253](https://github.com/pingcap/tidb/pull/21253) + - Fix auto-id allocation failed because of the transaction's write-conflict retry. [#21079](https://github.com/pingcap/tidb/pull/21079) + - Fix The JSON Data can not import to TiDB correctly by `load data` [#21074](https://github.com/pingcap/tidb/pull/21074) + - Set correct default value for new added enum column. [#20998](https://github.com/pingcap/tidb/pull/20998) + - Expression: keep the original data type when doing date arithmetic operations [#21176](https://github.com/pingcap/tidb/pull/21176) + - Fix the wrong point get plan generation in fast plan code path [#21244](https://github.com/pingcap/tidb/pull/21244) + TiKV @@ -135,23 +148,6 @@ TiDB version: 4.0.9 ## Others -+ TiDB - - - Fix issue of explain for connection can't show the last query plan/ [#21315](https://github.com/pingcap/tidb/pull/21315) - - Add metric for connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) - - Fix the issue that when Index Merge is used in a transaction with RC isolation level, the result may be incorrect. [#21253](https://github.com/pingcap/tidb/pull/21253) - - Planner: fix wrong point get plan generation in fast plan code path [#21244](https://github.com/pingcap/tidb/pull/21244) - - Expression: keep the original data type when doing date arithmetic operations [#21176](https://github.com/pingcap/tidb/pull/21176) - - Ddl: Fix partition table's partition column values type check [#21136](https://github.com/pingcap/tidb/pull/21136) - - Make dump binary time more compatible with MySQL [#21135](https://github.com/pingcap/tidb/pull/21135) - - Fix auto-id allocation failed because of transaction's write-conflict retry. [#21079](https://github.com/pingcap/tidb/pull/21079) - - Fix The JSON Data can not import to TiDB correctly by `load data` [#21074](https://github.com/pingcap/tidb/pull/21074) - - Fix up displaying executor runtime info & Add runtime information for DML in explain analyze [#21066](https://github.com/pingcap/tidb/pull/21066) - - Deprecate `enable-streaming`. [#21055](https://github.com/pingcap/tidb/pull/21055) - - Avoid unnecessary warnings/errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) - - TiDB now provides an error for statements that use the syntax `LOCK IN SHARE MODE`. This helps alert users that this feature is not implemented by TiDB, but a workaround to restore the previous behavior is available by setting `tidb_enable_noop_functions=1`. [#21005](https://github.com/pingcap/tidb/pull/21005) - - Set correct default value for new added enum column. [#20998](https://github.com/pingcap/tidb/pull/20998) - + TiKV - Enable dynamically change config pessimistic-txn.pipelined. [#9100](https://github.com/tikv/tikv/pull/9100) From 341657f4046911718be9b606744af44e4ef71432 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 1 Dec 2020 10:42:17 +0800 Subject: [PATCH 08/34] add PD notes --- releases/release-4.0.9.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 6aaa12bc8a523..1925f6cc4799d 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -34,6 +34,12 @@ TiDB version: 4.0.9 - Add tag to split command to trace its source [#8936](https://github.com/tikv/tikv/pull/8936) ++ PD + + - Check cluster version on stores become tombstone [#3213](https://github.com/pingcap/pd/pull/3213) + - The store of lower version is no longer allowed to change from `Tombstone` back to `Up`.[#3206](https://github.com/pingcap/pd/pull/3206) + - Dashboard: update to v2020.11.26.1 [#3219](https://github.com/pingcap/pd/pull/3219) + + TiFlash - Reduce the latency of replica reads [#1236](https://github.com/pingcap/tics/pull/1236) @@ -119,6 +125,7 @@ TiDB version: 4.0.9 - Fix the issue that the leader role does not take effect when using the replacement rule in some cases [#3208](https://github.com/pingcap/pd/pull/3208) - Fix the bug that `trace-region-flow` will be accidentally changed to `false`. [#3120](https://github.com/pingcap/pd/pull/3120) + - Fix a bug that service safe points with infinite TTL may disappear. [#3143](https://github.com/pingcap/pd/pull/3143) + TiFlash @@ -159,10 +166,3 @@ TiDB version: 4.0.9 - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to 1024 [#9020](https://github.com/tikv/tikv/pull/9020) - Add config for max-background-flushes [#8947](https://github.com/tikv/tikv/pull/8947) - Enable the unified read pool for the storage module by default. [#8887](https://github.com/tikv/tikv/pull/8887) - -+ PD - - - Dashboard: update to v2020.11.26.1 [#3219](https://github.com/pingcap/pd/pull/3219) - - Check cluster version on stores become tombstone [#3213](https://github.com/pingcap/pd/pull/3213) - - The store of lower version is no longer allowed to change from `Tombstone` back to `Up`. [#3206](https://github.com/pingcap/pd/pull/3206) - - Fix a bug that service safe points with infinite TTL may disappear. [#3143](https://github.com/pingcap/pd/pull/3143) From 1e8985e2512efaf3042478407164185a7fd40fa4 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 1 Dec 2020 17:05:05 +0800 Subject: [PATCH 09/34] Update releases/release-4.0.9.md Co-authored-by: JaySon --- releases/release-4.0.9.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 1925f6cc4799d..28f1482d9dc70 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -45,7 +45,6 @@ TiDB version: 4.0.9 - Reduce the latency of replica reads [#1236](https://github.com/pingcap/tics/pull/1236) - Refine TiFlash's error message [#1231](https://github.com/pingcap/tics/pull/1231) - Limit the memory usage of cache data under huge volume data. [#1229](https://github.com/pingcap/tics/pull/1229) - - [#1227](https://github.com/pingcap/tics/pull/1227) - Add a metric for the number of handling coprocessor tasks [#1183](https://github.com/pingcap/tics/pull/1183) + Tools From 49e3f11af4ef2f61d9956bb8791022d80a7376c5 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 1 Dec 2020 18:03:54 +0800 Subject: [PATCH 10/34] add TiKV notes --- releases/release-4.0.9.md | 43 ++++++++++++++++++++------------------- 1 file changed, 22 insertions(+), 21 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 28f1482d9dc70..058077412d1c4 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -8,11 +8,17 @@ Release date: December 3, 2020 TiDB version: 4.0.9 +## Compatibility changes + ++ TiDB + + - Deprecate `enable-streaming` [#21055](https://github.com/pingcap/tidb/pull/21055) + ## New Features + TiFlash - - Support storing the latest data of the storage engine on multiple disks [#1159](https://github.com/pingcap/tics/pull/1159) + - Support storing the latest data of the storage engine on multiple disks ## Improvements @@ -33,6 +39,14 @@ TiDB version: 4.0.9 + TiKV - Add tag to split command to trace its source [#8936](https://github.com/tikv/tikv/pull/8936) + - Support changing config pessimistic-txn.pipelined dynamically [#9100](https://github.com/tikv/tikv/pull/9100) + - Running checksum in BR and Lightning should have less influence on the cluster performance. [#9098](https://github.com/tikv/tikv/pull/9098) + - Add a metrics for ingesting sst errors [#9096](https://github.com/tikv/tikv/pull/9096) + - Prevent hibernation when there are still peers catching up logs [#9093](https://github.com/tikv/tikv/pull/9093) + - Increase the success rate of pipelined pessimistic locking. [#9086](https://github.com/tikv/tikv/pull/9086) + - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to 1024 [#9020](https://github.com/tikv/tikv/pull/9020) + - Add config for max-background-flushes [#8947](https://github.com/tikv/tikv/pull/8947) + - Enable the unified read pool for the storage module by default. [#8887](https://github.com/tikv/tikv/pull/8887) + PD @@ -42,10 +56,10 @@ TiDB version: 4.0.9 + TiFlash - - Reduce the latency of replica reads [#1236](https://github.com/pingcap/tics/pull/1236) - - Refine TiFlash's error message [#1231](https://github.com/pingcap/tics/pull/1231) - - Limit the memory usage of cache data under huge volume data. [#1229](https://github.com/pingcap/tics/pull/1229) - - Add a metric for the number of handling coprocessor tasks [#1183](https://github.com/pingcap/tics/pull/1183) + - Reduce the latency of replica reads + - Refine TiFlash's error message + - Limit the memory usage of cache data under huge volume data + - Add a metric for the number of handling coprocessor tasks + Tools @@ -119,6 +133,7 @@ TiDB version: 4.0.9 - Fix the bug that lightning fails to ingest sst files to tikv with importer/local backend when TDE is enabled [#8995](https://github.com/tikv/tikv/pull/8995) - Config: fix invalid advertise-status-addr [#9036](https://github.com/tikv/tikv/pull/9036) - Fix the issue that reports a key-exist error when a key is locked and deleted by a committed transaction. [#8930](https://github.com/tikv/tikv/pull/8930) + - Add check to avoid corruption due to RocksDB block cache error #8243. Also disable `force-consistency-checks` by default to improve performance. [#9029](https://github.com/tikv/tikv/pull/9029) + PD @@ -128,8 +143,8 @@ TiDB version: 4.0.9 + TiFlash - - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use [#1248](https://github.com/pingcap/tics/pull/1248) - - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual the usage [#1212](https://github.com/pingcap/tics/pull/1212) + - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use + - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual the usage + Tools @@ -151,17 +166,3 @@ TiDB version: 4.0.9 - Fix a bug about encoding data with wrong field info [#437](https://github.com/pingcap/tidb-lightning/pull/437) - Fix a bug that gc life time ttl does not take effect [#448](https://github.com/pingcap/tidb-lightning/pull/448) - Fix a bug that causes panic when manually stops Lightning import in Local-backend mode [#484](https://github.com/pingcap/tidb-lightning/pull/484) - -## Others - -+ TiKV - - - Enable dynamically change config pessimistic-txn.pipelined. [#9100](https://github.com/tikv/tikv/pull/9100) - - Running checksum in BR and Lightning should have less influence on the cluster performance. [#9098](https://github.com/tikv/tikv/pull/9098) - - Add a metrics for ingest sst errors [#9096](https://github.com/tikv/tikv/pull/9096) - - Prevent hibernation when there are still peers catching up logs [#9093](https://github.com/tikv/tikv/pull/9093) - - Increase the success rate of pipelined pessimistic locking. [#9086](https://github.com/tikv/tikv/pull/9086) - - Add check to avoid corruption due to RocksDB block cache error #8243. Also disable `force-consistency-checks` by default to improve performance. [#9029](https://github.com/tikv/tikv/pull/9029) - - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to 1024 [#9020](https://github.com/tikv/tikv/pull/9020) - - Add config for max-background-flushes [#8947](https://github.com/tikv/tikv/pull/8947) - - Enable the unified read pool for the storage module by default. [#8887](https://github.com/tikv/tikv/pull/8887) From dfaaab2035921b69199733513e6fbcac66ac79a8 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 1 Dec 2020 19:19:32 +0800 Subject: [PATCH 11/34] Update releases/release-4.0.9.md Co-authored-by: Neil Shen --- releases/release-4.0.9.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 058077412d1c4..28e67ee84e7cd 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -155,7 +155,6 @@ TiDB version: 4.0.9 + TiCDC - Fix the bug that multiple owners could exist when owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) - - Kafka_consumer: fix wrong timezone when 'TZ' env is not set and downstream is mysql [#1095](https://github.com/pingcap/ticdc/pull/1095) + Dumpling From efcc24019c4ef24f873875b38a667ffb53e71c90 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 2 Dec 2020 10:47:14 +0800 Subject: [PATCH 12/34] change release date --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 28e67ee84e7cd..7e55b56d78eff 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -4,7 +4,7 @@ title: TiDB 4.0.9 Release Notes # TiDB 4.0.9 Release Notes -Release date: December 3, 2020 +Release date: December 10, 2020 TiDB version: 4.0.9 From db3dee8b440bff588f9847eace740409290e45ec Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 4 Dec 2020 12:57:19 +0800 Subject: [PATCH 13/34] Update releases/release-4.0.9.md Co-authored-by: JaySon --- releases/release-4.0.9.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 7e55b56d78eff..9459199e0faa3 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -145,6 +145,7 @@ TiDB version: 4.0.9 - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual the usage + - Fix memory leak about thread info statistics + Tools From 6725f156ca70b131c871d1e18ea912136c7acedd Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 10 Dec 2020 16:00:20 +0800 Subject: [PATCH 14/34] Update releases/release-4.0.9.md --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 9459199e0faa3..8bb17427848bb 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -18,7 +18,7 @@ TiDB version: 4.0.9 + TiFlash - - Support storing the latest data of the storage engine on multiple disks + - Support storing the latest data of the storage engine on multiple disks (experimental) ## Improvements From 7590037dd8b1006c5f860daf8b5add9a3de4cd12 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 11 Dec 2020 12:05:05 +0800 Subject: [PATCH 15/34] refine language --- releases/release-4.0.9.md | 109 +++++++++++++++++++------------------- 1 file changed, 55 insertions(+), 54 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 8bb17427848bb..422ac7334f551 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -12,7 +12,7 @@ TiDB version: 4.0.9 + TiDB - - Deprecate `enable-streaming` [#21055](https://github.com/pingcap/tidb/pull/21055) + - Deprecate the `enable-streaming` configuration [#21055](https://github.com/pingcap/tidb/pull/21055) ## New Features @@ -24,35 +24,37 @@ TiDB version: 4.0.9 + TiDB - - Ban (index) merge join heuristically when converting equal conditions to other conditions. [#21146](https://github.com/pingcap/tidb/pull/21146) - - Differentiate types for user variables [#21107](https://github.com/pingcap/tidb/pull/21107) - - Allow set GOGC in the config file. [#20922](https://github.com/pingcap/tidb/pull/20922) - - Make dump binary time more compatible with MySQL [#21135](https://github.com/pingcap/tidb/pull/21135) - - TiDB now provides an error for statements that use the syntax `LOCK IN SHARE MODE`. This helps alert users that this feature is not implemented by TiDB, but a workaround to restore the previous behavior is available by setting `tidb_enable_noop_functions=1`. [#21005](https://github.com/pingcap/tidb/pull/21005) - - Avoid unnecessary warnings/errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) - - Raise an error when preparing the `load data` statement. [#21199](https://github.com/pingcap/tidb/pull/21199) - - Ignore integer zero-fill size attribute when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) - - Add runtime information for DML in explain analyze [#21066](https://github.com/pingcap/tidb/pull/21066) - - Disallow multi-updates on the primary key (i.e. updating primary key of the same table with different alias) [#21113](https://github.com/pingcap/tidb/pull/21113) - - Add metric for connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) + - Avoid the (index) merge join heuristically when converting equal conditions to other conditions [#21146](https://github.com/pingcap/tidb/pull/21146) + - Differentiate the types of user variables [#21107](https://github.com/pingcap/tidb/pull/21107) + - Support setting the `GOGC` variable in the configuration file [#20922](https://github.com/pingcap/tidb/pull/20922) + - Make the dumped binary time (`Timestamp` and `Datetime`) more compatible with MySQL [#21135](https://github.com/pingcap/tidb/pull/21135) + - Provide an error message for statements that use the `LOCK IN SHARE MODE` syntax [#21005](https://github.com/pingcap/tidb/pull/21005) + - Avoid outputting unnecessary warnings or errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) + - Raise an error when preparing the `LOAD DATA` statement [#21199](https://github.com/pingcap/tidb/pull/21199) + - Ignore the size attribute of the integer zero-fill when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) + - Add the executor-related runtime information of DML statements in the result of `EXPLAIN ANALYZE` [#21066](https://github.com/pingcap/tidb/pull/21066) + - Disallow multiple updates on the primary key in a singe SQL statements [#21113](https://github.com/pingcap/tidb/pull/21113) + - Add a monitoring metric for the connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) + TiKV - - Add tag to split command to trace its source [#8936](https://github.com/tikv/tikv/pull/8936) - - Support changing config pessimistic-txn.pipelined dynamically [#9100](https://github.com/tikv/tikv/pull/9100) - - Running checksum in BR and Lightning should have less influence on the cluster performance. [#9098](https://github.com/tikv/tikv/pull/9098) - - Add a metrics for ingesting sst errors [#9096](https://github.com/tikv/tikv/pull/9096) - - Prevent hibernation when there are still peers catching up logs [#9093](https://github.com/tikv/tikv/pull/9093) - - Increase the success rate of pipelined pessimistic locking. [#9086](https://github.com/tikv/tikv/pull/9086) - - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to 1024 [#9020](https://github.com/tikv/tikv/pull/9020) - - Add config for max-background-flushes [#8947](https://github.com/tikv/tikv/pull/8947) - - Enable the unified read pool for the storage module by default. [#8887](https://github.com/tikv/tikv/pull/8887) + - Add the tag to trace the source of the `split` command [#8936](https://github.com/tikv/tikv/pull/8936) + - Support dynamically changing the `pessimistic-txn.pipelined` configuration [#9100](https://github.com/tikv/tikv/pull/9100) + - Reduce the impact on performance when running Backup & Restore and TiDB Lightning [#9098](https://github.com/tikv/tikv/pull/9098) + - Add monitoring metrics for the ingesting SST errors [#9096](https://github.com/tikv/tikv/pull/9096) + - Prevent hibernation when there are still peers catching up with logs [#9093](https://github.com/tikv/tikv/pull/9093) + - Increase the success rate of the pipelined pessimistic locking [#9086](https://github.com/tikv/tikv/pull/9086) + - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to `1024` [#9020](https://github.com/tikv/tikv/pull/9020) + - Add the `max-background-flushes` configuration item [#8947](https://github.com/tikv/tikv/pull/8947) + - Enable the unified read pool for the storage module by default [#8887](https://github.com/tikv/tikv/pull/8887) + - Add a check to avoid corruption caused by the RocksDB block cache error [#9029](https://github.com/tikv/tikv/pull/9029) + - Disable `force-consistency-checks` by default to improve performance [#9029](https://github.com/tikv/tikv/pull/9029) + PD - - Check cluster version on stores become tombstone [#3213](https://github.com/pingcap/pd/pull/3213) - - The store of lower version is no longer allowed to change from `Tombstone` back to `Up`.[#3206](https://github.com/pingcap/pd/pull/3206) - - Dashboard: update to v2020.11.26.1 [#3219](https://github.com/pingcap/pd/pull/3219) + - Check TiKV cluster version when a TiKV stores become tombstone [#3213](https://github.com/pingcap/pd/pull/3213) + - Disallow the TiKV store of a lower version to change from `Tombstone` back to `Up` [#3206](https://github.com/pingcap/pd/pull/3206) + - Update Dashboard to `v2020.11.26.1` [#3219](https://github.com/pingcap/pd/pull/3219) + TiFlash @@ -66,13 +68,13 @@ TiDB version: 4.0.9 + Backup & Restore (BR) - BR no longer accepts --checksum false in command line, which did not disable checksum. The correct usage always include the = sign: --checksum=false [#588](https://github.com/pingcap/br/pull/588) - - Support change PD config temporary [#596](https://github.com/pingcap/br/pull/596) + - Support change PD configuration temporary [#596](https://github.com/pingcap/br/pull/596) - Support analyze table after restore [#622](https://github.com/pingcap/br/pull/622) - Retry for read index not ready and proposal in merging mode [#626](https://github.com/pingcap/br/pull/626) + TiCDC - - Metrics: add alert for tikv hibernate regions [#1120](https://github.com/pingcap/ticdc/pull/1120) + - Metrics: add alert for tikv hibernate Regions [#1120](https://github.com/pingcap/ticdc/pull/1120) - Reduce memory usage in schema storage by avoiding table info replication [#1127](https://github.com/pingcap/ticdc/pull/1127) + Dumpling @@ -98,52 +100,51 @@ TiDB version: 4.0.9 + TiDB - Fix incorrect results when using a prefix index with OR condition [#21287](https://github.com/pingcap/tidb/pull/21287) - - Fix a bug that causes panic when `retry` is enabled. [#21285](https://github.com/pingcap/tidb/pull/21285) + - Fix a bug that causes panic when `retry` is enabled [#21285](https://github.com/pingcap/tidb/pull/21285) - Fix a bug of partition definition checking. The value comparison should be in accord with column type [#21273](https://github.com/pingcap/tidb/pull/21273) - Fix a bug of partition table's partition column values type check [#21136](https://github.com/pingcap/tidb/pull/21136) - Fix a bug that hash type partition does not check partition name is unique [#21257](https://github.com/pingcap/tidb/pull/21257) - Fix insert value into hash partition table which not int [#21238](https://github.com/pingcap/tidb/pull/21238) - - Fix unexpected error when `INSERT` meets index join in some cases. [#21249](https://github.com/pingcap/tidb/pull/21249) - - Fix bigint unsigned column value in CASE WHEN operator is converted to bigint signed [#21236](https://github.com/pingcap/tidb/pull/21236) - - Fix a bug that index-hash-join and index-merge-join doesn't consider collation [#21219](https://github.com/pingcap/tidb/pull/21219) - - Fix a bug that partition table does not consider collation in `create table` and `select` sentence. [#21181](https://github.com/pingcap/tidb/pull/21181) - - Fix issue of the query result of slow_query maybe miss some rows. [#21211](https://github.com/pingcap/tidb/pull/21211) - - `DELETE` may not delete data correctly when the database name is not in pure lower representation. [#21206](https://github.com/pingcap/tidb/pull/21206) + - Fix unexpected error when `INSERT` meets index join in some cases [#21249](https://github.com/pingcap/tidb/pull/21249) + - Fix bigint unsigned column value in CASE WHEN operator is converted to bigint signed [#21236](https://github.com/pingcap/tidb/pull/21236) + - Fix a bug that index-hash-join and index-merge-join does not consider collation [#21219](https://github.com/pingcap/tidb/pull/21219) + - Fix a bug that partition table does not consider collation in `create table` and `select` sentence [#21181](https://github.com/pingcap/tidb/pull/21181) + - Fix issue of the query result of slow_query might miss some rows [#21211](https://github.com/pingcap/tidb/pull/21211) + - `DELETE` might not delete data correctly when the database name is not in pure lower representation [#21206](https://github.com/pingcap/tidb/pull/21206) - Fix a bug causes schema change after DML [#21050](https://github.com/pingcap/tidb/pull/21050) - - Fix the bug that can not query the coalesced column when use using-join. [#21021](https://github.com/pingcap/tidb/pull/21021) - - Fix wrong results for some semi-join queries. [#21019](https://github.com/pingcap/tidb/pull/21019) - - Fix table lock for update statement. [#21002](https://github.com/pingcap/tidb/pull/21002) - - Fix stack overflow when building recursive view. [#21001](https://github.com/pingcap/tidb/pull/21001) + - Fix the bug that can not query the coalesced column when use using-join [#21021](https://github.com/pingcap/tidb/pull/21021) + - Fix wrong results for some semi-join queries [#21019](https://github.com/pingcap/tidb/pull/21019) + - Fix table lock for update statement [#21002](https://github.com/pingcap/tidb/pull/21002) + - Fix stack overflow when building recursive view [#21001](https://github.com/pingcap/tidb/pull/21001) - Fix unexpected results when do merge join on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) - - Fix the issue that sometimes a transaction that has an undetermined result may be treated as failed. [#20925](https://github.com/pingcap/tidb/pull/20925) - - Fix issue `explain for connection` can't show the last query plan/ [#21315](https://github.com/pingcap/tidb/pull/21315) - - Fix the issue that when Index Merge is used in a transaction with RC isolation level, the result may be incorrect. [#21253](https://github.com/pingcap/tidb/pull/21253) - - Fix auto-id allocation failed because of the transaction's write-conflict retry. [#21079](https://github.com/pingcap/tidb/pull/21079) + - Fix the issue that sometimes a transaction that has an undetermined result might be treated as failed [#20925](https://github.com/pingcap/tidb/pull/20925) + - Fix issue `explain for connection` cannot show the last query plan [#21315](https://github.com/pingcap/tidb/pull/21315) + - Fix the issue that when Index Merge is used in a transaction with RC isolation level, the result might be incorrect [#21253](https://github.com/pingcap/tidb/pull/21253) + - Fix auto-id allocation failed because of the transaction's write-conflict retry [#21079](https://github.com/pingcap/tidb/pull/21079) - Fix The JSON Data can not import to TiDB correctly by `load data` [#21074](https://github.com/pingcap/tidb/pull/21074) - - Set correct default value for new added enum column. [#20998](https://github.com/pingcap/tidb/pull/20998) + - Set correct default value for new added enum column [#20998](https://github.com/pingcap/tidb/pull/20998) - Expression: keep the original data type when doing date arithmetic operations [#21176](https://github.com/pingcap/tidb/pull/21176) - Fix the wrong point get plan generation in fast plan code path [#21244](https://github.com/pingcap/tidb/pull/21244) + TiKV - - Fix a bug that Coprocessor may return wrong result when there are > 255 columns. [#9131](https://github.com/tikv/tikv/pull/9131) - - Fix an issue that region merge may cause data loss during network partition. [#9108](https://github.com/tikv/tikv/pull/9108) - - Fix a bug may cause analyze statement panic when using the latin1 character set. [#9082](https://github.com/tikv/tikv/pull/9082) + - Fix a bug that Coprocessor might return wrong result when there are more than 255 columns [#9131](https://github.com/tikv/tikv/pull/9131) + - Fix an issue that Region merge might cause data loss during network partition [#9108](https://github.com/tikv/tikv/pull/9108) + - Fix a bug might cause analyze statement panic when using the latin1 character set [#9082](https://github.com/tikv/tikv/pull/9082) - Fix cast decimal as time expr get wrong result when deal with numbers argument [#9031](https://github.com/tikv/tikv/pull/9031) - - Fix the bug that lightning fails to ingest sst files to tikv with importer/local backend when TDE is enabled [#8995](https://github.com/tikv/tikv/pull/8995) + - Fix the bug that lightning fails to ingest sst files to TiKV with importer/local backend when TDE is enabled [#8995](https://github.com/tikv/tikv/pull/8995) - Config: fix invalid advertise-status-addr [#9036](https://github.com/tikv/tikv/pull/9036) - Fix the issue that reports a key-exist error when a key is locked and deleted by a committed transaction. [#8930](https://github.com/tikv/tikv/pull/8930) - - Add check to avoid corruption due to RocksDB block cache error #8243. Also disable `force-consistency-checks` by default to improve performance. [#9029](https://github.com/tikv/tikv/pull/9029) + PD - Fix the issue that the leader role does not take effect when using the replacement rule in some cases [#3208](https://github.com/pingcap/pd/pull/3208) - - Fix the bug that `trace-region-flow` will be accidentally changed to `false`. [#3120](https://github.com/pingcap/pd/pull/3120) - - Fix a bug that service safe points with infinite TTL may disappear. [#3143](https://github.com/pingcap/pd/pull/3143) + - Fix the bug that `trace-region-flow` will be accidentally changed to `false` [#3120](https://github.com/pingcap/pd/pull/3120) + - Fix a bug that service safe points with infinite TTL might disappear [#3143](https://github.com/pingcap/pd/pull/3143) + TiFlash - - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` may contain information about disks not in use + - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` might contain information about disks not in use - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual the usage - Fix memory leak about thread info statistics @@ -159,10 +160,10 @@ TiDB version: 4.0.9 + Dumpling - - Fix the problem that dumpling may get blocked when its connection to database server is closed [#190](https://github.com/pingcap/dumpling/pull/190) + - Fix the problem that dumpling might get blocked when its connection to database server is closed [#190](https://github.com/pingcap/dumpling/pull/190) + TiDB Lightning - - Fix a bug about encoding data with wrong field info [#437](https://github.com/pingcap/tidb-lightning/pull/437) - - Fix a bug that gc life time ttl does not take effect [#448](https://github.com/pingcap/tidb-lightning/pull/448) - - Fix a bug that causes panic when manually stops Lightning import in Local-backend mode [#484](https://github.com/pingcap/tidb-lightning/pull/484) + - Fix a bug about encoding data with wrong field information [#437](https://github.com/pingcap/tidb-lightning/pull/437) + - Fix a bug that GC life time ttl does not take effect [#448](https://github.com/pingcap/tidb-lightning/pull/448) + - Fix a bug that causes panic when manually stops TiDB Lightning import in Local-backend mode [#484](https://github.com/pingcap/tidb-lightning/pull/484) From 6b471163b02b1bbba89feebe7efca043e257b2c9 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 11 Dec 2020 17:08:40 +0800 Subject: [PATCH 16/34] refine language --- releases/release-4.0.9.md | 82 +++++++++++++++++++-------------------- 1 file changed, 41 insertions(+), 41 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 422ac7334f551..c06017278d462 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -59,72 +59,72 @@ TiDB version: 4.0.9 + TiFlash - Reduce the latency of replica reads - - Refine TiFlash's error message - - Limit the memory usage of cache data under huge volume data - - Add a metric for the number of handling coprocessor tasks + - Refine TiFlash's error messages + - Limit the memory usage of cache data when the data volume is huge + - Add a monitoring metric for the number of coprocessor tasks being handled + Tools + Backup & Restore (BR) - - BR no longer accepts --checksum false in command line, which did not disable checksum. The correct usage always include the = sign: --checksum=false [#588](https://github.com/pingcap/br/pull/588) - - Support change PD configuration temporary [#596](https://github.com/pingcap/br/pull/596) - - Support analyze table after restore [#622](https://github.com/pingcap/br/pull/622) - - Retry for read index not ready and proposal in merging mode [#626](https://github.com/pingcap/br/pull/626) + - Disallow the ambiguous `--checksum false` argument in the command line, which does not disable checksum. Only `--checksum=false` is accepted. [#588](https://github.com/pingcap/br/pull/588) + - Support changing the PD configuration temporarily [#596](https://github.com/pingcap/br/pull/596) + - Support analyzing tables after restore [#622](https://github.com/pingcap/br/pull/622) + - Retry for the `read index not ready` and `proposal in merging mode` errors [#626](https://github.com/pingcap/br/pull/626) + TiCDC - - Metrics: add alert for tikv hibernate Regions [#1120](https://github.com/pingcap/ticdc/pull/1120) - - Reduce memory usage in schema storage by avoiding table info replication [#1127](https://github.com/pingcap/ticdc/pull/1127) + - Add an alert for enabling TiKV's Hibernate Region feature [#1120](https://github.com/pingcap/ticdc/pull/1120) + - Reduce memory usage in the schema storage [#1127](https://github.com/pingcap/ticdc/pull/1127) + Dumpling - - Retry dumping on failed chunks [#182](https://github.com/pingcap/dumpling/pull/182) - - Support configuring both -F and -r arguments at the same time [#177](https://github.com/pingcap/dumpling/pull/177) - - Exclude system databases in --filter parameter by default [#194](https://github.com/pingcap/dumpling/pull/194) - - Support --transactional-consistency parameter and support rebuild mysql connections during retry [#199](https://github.com/pingcap/dumpling/pull/199) + - Retry dumping data on failed chunks [#182](https://github.com/pingcap/dumpling/pull/182) + - Support configuring both the `-F` and `-r` arguments at the same time [#177](https://github.com/pingcap/dumpling/pull/177) + - Exclude system databases in `--filter` by default [#194](https://github.com/pingcap/dumpling/pull/194) + - Support the `--transactional-consistency` parameter and support rebuilding MySQL connections during retry [#199](https://github.com/pingcap/dumpling/pull/199) + TiDB Lightning - Filter out all system schemas by default [#459](https://github.com/pingcap/tidb-lightning/pull/459) - - Support set a default value for auto random primary key for local/importer backend [#457](https://github.com/pingcap/tidb-lightning/pull/457) + - Support setting a default value for the auto-random primary key for the Local-backend or Importer-backend [#457](https://github.com/pingcap/tidb-lightning/pull/457) - Use range properties to make range split more precise with local backend [#422](https://github.com/pingcap/tidb-lightning/pull/422) - - `tikv-importer.region-split-size`, `mydumper.read-block-size`, `mydumper.batch-size` and `mydumper.max-region-size` can now accept human-readable format in the form "2.5 GiB" [#471](https://github.com/pingcap/tidb-lightning/pull/471) + - Support a human-readable format (such as "2.5 GiB") in `tikv-importer.region-split-size`, `mydumper.read-block-size`, `mydumper.batch-size`, and `mydumper.max-region-size` [#471](https://github.com/pingcap/tidb-lightning/pull/471) + TiDB Binlog - - Exit Drainer process with non-zero code if upstream PD is down or apply DDL/DML to downstream failed [#1012](https://github.com/pingcap/tidb-binlog/pull/1012) + - Exit the Drainer process with the non-zero code if the upstream PD is down or applying DDL or DML statements to the downstream fails [#1012](https://github.com/pingcap/tidb-binlog/pull/1012) ## Bug Fixes + TiDB - - Fix incorrect results when using a prefix index with OR condition [#21287](https://github.com/pingcap/tidb/pull/21287) - - Fix a bug that causes panic when `retry` is enabled [#21285](https://github.com/pingcap/tidb/pull/21285) - - Fix a bug of partition definition checking. The value comparison should be in accord with column type [#21273](https://github.com/pingcap/tidb/pull/21273) - - Fix a bug of partition table's partition column values type check [#21136](https://github.com/pingcap/tidb/pull/21136) - - Fix a bug that hash type partition does not check partition name is unique [#21257](https://github.com/pingcap/tidb/pull/21257) - - Fix insert value into hash partition table which not int [#21238](https://github.com/pingcap/tidb/pull/21238) - - Fix unexpected error when `INSERT` meets index join in some cases [#21249](https://github.com/pingcap/tidb/pull/21249) - - Fix bigint unsigned column value in CASE WHEN operator is converted to bigint signed [#21236](https://github.com/pingcap/tidb/pull/21236) - - Fix a bug that index-hash-join and index-merge-join does not consider collation [#21219](https://github.com/pingcap/tidb/pull/21219) - - Fix a bug that partition table does not consider collation in `create table` and `select` sentence [#21181](https://github.com/pingcap/tidb/pull/21181) - - Fix issue of the query result of slow_query might miss some rows [#21211](https://github.com/pingcap/tidb/pull/21211) - - `DELETE` might not delete data correctly when the database name is not in pure lower representation [#21206](https://github.com/pingcap/tidb/pull/21206) - - Fix a bug causes schema change after DML [#21050](https://github.com/pingcap/tidb/pull/21050) - - Fix the bug that can not query the coalesced column when use using-join [#21021](https://github.com/pingcap/tidb/pull/21021) - - Fix wrong results for some semi-join queries [#21019](https://github.com/pingcap/tidb/pull/21019) - - Fix table lock for update statement [#21002](https://github.com/pingcap/tidb/pull/21002) - - Fix stack overflow when building recursive view [#21001](https://github.com/pingcap/tidb/pull/21001) - - Fix unexpected results when do merge join on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) + - Fix the issue of incorrect results when using a prefix index with the `OR` condition [#21287](https://github.com/pingcap/tidb/pull/21287) + - Fix a bug that might cause panic when automatic retry is enabled [#21285](https://github.com/pingcap/tidb/pull/21285) + - Fix a bug that occurs when checking partition definition according to column type [#21273](https://github.com/pingcap/tidb/pull/21273) + - Fix a bug that value type of the partition expression is not consistent with the partition column type [#21136](https://github.com/pingcap/tidb/pull/21136) + - Fix a bug that hash-type partition does not check whether the partition name is unique [#21257](https://github.com/pingcap/tidb/pull/21257) + - Fix the wrong results returned after inserting a value of the non-`INT` type into the hash partitioned table [#21238](https://github.com/pingcap/tidb/pull/21238) + - Fix the unexpected errors when using index join in the `INSERT` statement in some cases [#21249](https://github.com/pingcap/tidb/pull/21249) + - Fix the issue that the `BigInt` unsigned column value in the `CASE WHEN` operator is incorrectly converted to the `BigInt` signed value [#21236](https://github.com/pingcap/tidb/pull/21236) + - Fix a bug that index hash join and index merge join do not consider collation [#21219](https://github.com/pingcap/tidb/pull/21219) + - Fix a bug that the partitioned table does not consider collation in the `CREATE TABLE` and `SELECT` syntax [#21181](https://github.com/pingcap/tidb/pull/21181) + - Fix the issue that the query result of `slow_query` might miss some rows [#21211](https://github.com/pingcap/tidb/pull/21211) + - Fix the issue that `DELETE` might not delete data correctly when the database name is not in a pure lower representation [#21206](https://github.com/pingcap/tidb/pull/21206) + - Fix a bug that causes schema change after DML operations [#21050](https://github.com/pingcap/tidb/pull/21050) + - Fix the bug that the coalesced column cannot be queried when using join [#21021](https://github.com/pingcap/tidb/pull/21021) + - Fix the wrong results of some semi-join queries [#21019](https://github.com/pingcap/tidb/pull/21019) + - Fix the issue that the table lock does not take effect on the `UPDATE` statement [#21002](https://github.com/pingcap/tidb/pull/21002) + - Fix the issue of stack overflow that occurs when building the recursive view [#21001](https://github.com/pingcap/tidb/pull/21001) + - Fix the unexpected results returned when performing index merge join operations on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) - Fix the issue that sometimes a transaction that has an undetermined result might be treated as failed [#20925](https://github.com/pingcap/tidb/pull/20925) - - Fix issue `explain for connection` cannot show the last query plan [#21315](https://github.com/pingcap/tidb/pull/21315) - - Fix the issue that when Index Merge is used in a transaction with RC isolation level, the result might be incorrect [#21253](https://github.com/pingcap/tidb/pull/21253) - - Fix auto-id allocation failed because of the transaction's write-conflict retry [#21079](https://github.com/pingcap/tidb/pull/21079) - - Fix The JSON Data can not import to TiDB correctly by `load data` [#21074](https://github.com/pingcap/tidb/pull/21074) - - Set correct default value for new added enum column [#20998](https://github.com/pingcap/tidb/pull/20998) - - Expression: keep the original data type when doing date arithmetic operations [#21176](https://github.com/pingcap/tidb/pull/21176) - - Fix the wrong point get plan generation in fast plan code path [#21244](https://github.com/pingcap/tidb/pull/21244) + - Fix the issue that `EXPLAIN FOR CONNECTION` cannot show the last query plan [#21315](https://github.com/pingcap/tidb/pull/21315) + - Fix the issue that when Index Merge is used in a transaction with the Read Committed isolation level, the result might be incorrect [#21253](https://github.com/pingcap/tidb/pull/21253) + - Fix the auto-ID allocation failure caused by the transaction retry after write conflict [#21079](https://github.com/pingcap/tidb/pull/21079) + - Fix the issue that JSON data cannot be correctly imported to TiDB using `LOAD DATA` [#21074](https://github.com/pingcap/tidb/pull/21074) + - Fix the issue that the default value of newly added `Enum`-type columns are incorrect [#20998](https://github.com/pingcap/tidb/pull/20998) + - Fix the issue that the `addata` function inserts invalid characters [#21176](https://github.com/pingcap/tidb/pull/21176) + - Fix the issue that the wrong PointGet plan generated in some situations causes wrong results [#21244](https://github.com/pingcap/tidb/pull/21244) + TiKV From dc31b440ca11540774be88ff9f5a780cb645d795 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 11 Dec 2020 17:46:13 +0800 Subject: [PATCH 17/34] refine language --- releases/release-4.0.9.md | 41 ++++++++++++++++++++------------------- 1 file changed, 21 insertions(+), 20 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index c06017278d462..6c871f847a6f1 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -47,7 +47,6 @@ TiDB version: 4.0.9 - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to `1024` [#9020](https://github.com/tikv/tikv/pull/9020) - Add the `max-background-flushes` configuration item [#8947](https://github.com/tikv/tikv/pull/8947) - Enable the unified read pool for the storage module by default [#8887](https://github.com/tikv/tikv/pull/8887) - - Add a check to avoid corruption caused by the RocksDB block cache error [#9029](https://github.com/tikv/tikv/pull/9029) - Disable `force-consistency-checks` by default to improve performance [#9029](https://github.com/tikv/tikv/pull/9029) + PD @@ -128,42 +127,44 @@ TiDB version: 4.0.9 + TiKV - - Fix a bug that Coprocessor might return wrong result when there are more than 255 columns [#9131](https://github.com/tikv/tikv/pull/9131) - - Fix an issue that Region merge might cause data loss during network partition [#9108](https://github.com/tikv/tikv/pull/9108) - - Fix a bug might cause analyze statement panic when using the latin1 character set [#9082](https://github.com/tikv/tikv/pull/9082) - - Fix cast decimal as time expr get wrong result when deal with numbers argument [#9031](https://github.com/tikv/tikv/pull/9031) - - Fix the bug that lightning fails to ingest sst files to TiKV with importer/local backend when TDE is enabled [#8995](https://github.com/tikv/tikv/pull/8995) - - Config: fix invalid advertise-status-addr [#9036](https://github.com/tikv/tikv/pull/9036) - - Fix the issue that reports a key-exist error when a key is locked and deleted by a committed transaction. [#8930](https://github.com/tikv/tikv/pull/8930) + - Fix the issue that Coprocessor might return wrong results when there are more than 255 columns [#9131](https://github.com/tikv/tikv/pull/9131) + - Fix the issue that Region Merge might cause data loss during network partition [#9108](https://github.com/tikv/tikv/pull/9108) + - Fix the issue that the `ANALYZE` statement might cause panic when using the `latin1` character set [#9082](https://github.com/tikv/tikv/pull/9082) + - Fix the wrong results returned when converting the numeric type to the time type [#9031](https://github.com/tikv/tikv/pull/9031) + - Fix the bug that TiDB Lightning fails to ingest SST files to TiKV with the Importer-backend or Local-backend when + Transparent Data Encryption (TDE) is enabled [#8995](https://github.com/tikv/tikv/pull/8995) + - Fix the invalid `advertise-status-addr` value `0.0.0.0` [#9036](https://github.com/tikv/tikv/pull/9036) + - Fix the issue that an error is returned indicating that a key exists when this key is locked and deleted in a committed transaction [#8930](https://github.com/tikv/tikv/pull/8930) + - Fix the issue that the RocksDB mapping error causes data corruption [#9029](https://github.com/tikv/tikv/pull/9029) + PD - - Fix the issue that the leader role does not take effect when using the replacement rule in some cases [#3208](https://github.com/pingcap/pd/pull/3208) - - Fix the bug that `trace-region-flow` will be accidentally changed to `false` [#3120](https://github.com/pingcap/pd/pull/3120) - - Fix a bug that service safe points with infinite TTL might disappear [#3143](https://github.com/pingcap/pd/pull/3143) + - Fix the issue that the leader roles specified using placement rules do not take effect in some cases [#3208](https://github.com/pingcap/pd/pull/3208) + - Fix the issue that the `trace-region-flow` value is unexpectedly set to `false` [#3120](https://github.com/pingcap/pd/pull/3120) + - Fix a bug that the service safepoint with infinite Time To Live (TTL) does not work [#3143](https://github.com/pingcap/pd/pull/3143) + TiFlash - - Fix the problem that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` might contain information about disks not in use - - Fix the issue that the memory consumption statistic of Delta Cache is smaller than actual the usage - - Fix memory leak about thread info statistics + - Fix the issue that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` might contain the information of disks that are not in use + - Fix the issue that the estimate on memory usage of Delta Cache is smaller than the actual usage + - Fix the memory leak caused by thread information statistics + Tools + Backup & Restore (BR) - - Fix special characters in S3 secret access keys [#617](https://github.com/pingcap/br/pull/617) + - Fix the failure caused by special characters in S3 secret access keys [#617](https://github.com/pingcap/br/pull/617) + TiCDC - - Fix the bug that multiple owners could exist when owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) + - Fix the issue that multiple owners might exist when the owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) + Dumpling - - Fix the problem that dumpling might get blocked when its connection to database server is closed [#190](https://github.com/pingcap/dumpling/pull/190) + - Fix the issue that Dumpling might get blocked when its connection to the MySQL database server is closed [#190](https://github.com/pingcap/dumpling/pull/190) + TiDB Lightning - - Fix a bug about encoding data with wrong field information [#437](https://github.com/pingcap/tidb-lightning/pull/437) - - Fix a bug that GC life time ttl does not take effect [#448](https://github.com/pingcap/tidb-lightning/pull/448) - - Fix a bug that causes panic when manually stops TiDB Lightning import in Local-backend mode [#484](https://github.com/pingcap/tidb-lightning/pull/484) + - Fix the issue that keys are encoded using the wrong field information [#437](https://github.com/pingcap/tidb-lightning/pull/437) + - Fix the issue that GC life time TTL does not take effect [#448](https://github.com/pingcap/tidb-lightning/pull/448) + - Fix the issue that causes panic when manually stops the running TiDB Lightning in the Local-backend mode [#484](https://github.com/pingcap/tidb-lightning/pull/484) From 370efa0d6f5b399fe007a99172b3eb26e0e8faa0 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 11 Dec 2020 17:47:06 +0800 Subject: [PATCH 18/34] change date --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 6c871f847a6f1..0f94a8f2edcf9 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -4,7 +4,7 @@ title: TiDB 4.0.9 Release Notes # TiDB 4.0.9 Release Notes -Release date: December 10, 2020 +Release date: December 15, 2020 TiDB version: 4.0.9 From 09f64f06bbbdf278f921e72d5229aa36c465b748 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 14 Dec 2020 12:20:23 +0800 Subject: [PATCH 19/34] Update releases/release-4.0.9.md Co-authored-by: Liqi Geng --- releases/release-4.0.9.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 0f94a8f2edcf9..ce3c3458d9e2e 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -136,6 +136,7 @@ TiDB version: 4.0.9 - Fix the invalid `advertise-status-addr` value `0.0.0.0` [#9036](https://github.com/tikv/tikv/pull/9036) - Fix the issue that an error is returned indicating that a key exists when this key is locked and deleted in a committed transaction [#8930](https://github.com/tikv/tikv/pull/8930) - Fix the issue that the RocksDB mapping error causes data corruption [#9029](https://github.com/tikv/tikv/pull/9029) +- Fix the bug that Follower Read might return stale data after the leader is transferred [#9240](https://github.com/tikv/tikv/pull/9240) + PD From 0a1a8dac4bc6fa57ee4e2f1cee1ef86a80b8fddc Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 14 Dec 2020 13:55:49 +0800 Subject: [PATCH 20/34] Update releases/release-4.0.9.md --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index ce3c3458d9e2e..4b19b04ce5379 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -136,7 +136,7 @@ TiDB version: 4.0.9 - Fix the invalid `advertise-status-addr` value `0.0.0.0` [#9036](https://github.com/tikv/tikv/pull/9036) - Fix the issue that an error is returned indicating that a key exists when this key is locked and deleted in a committed transaction [#8930](https://github.com/tikv/tikv/pull/8930) - Fix the issue that the RocksDB mapping error causes data corruption [#9029](https://github.com/tikv/tikv/pull/9029) -- Fix the bug that Follower Read might return stale data after the leader is transferred [#9240](https://github.com/tikv/tikv/pull/9240) + - Fix the bug that Follower Read might return stale data after the leader is transferred [#9240](https://github.com/tikv/tikv/pull/9240) + PD From b70ffb0ee369588604591d3fcaba8911071b9d4c Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 14 Dec 2020 15:30:15 +0800 Subject: [PATCH 21/34] Apply suggestions from code review Co-authored-by: amyangfei --- releases/release-4.0.9.md | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 4b19b04ce5379..42f928fb13edb 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -75,7 +75,9 @@ TiDB version: 4.0.9 - Add an alert for enabling TiKV's Hibernate Region feature [#1120](https://github.com/pingcap/ticdc/pull/1120) - Reduce memory usage in the schema storage [#1127](https://github.com/pingcap/ticdc/pull/1127) - + - Add unified sorter, which accelerates replication when the data size of the incremental scan is large (experimental) [#1122](https://github.com/pingcap/ticdc/pull/1122) + - Support configuring the maximum message size and the maximum message batch in the TiCDC Open Protocol message (only for Kafka sink) [#1079](https://github.com/pingcap/ticdc/pull/1079) + + Dumpling - Retry dumping data on failed chunks [#182](https://github.com/pingcap/dumpling/pull/182) @@ -159,6 +161,13 @@ TiDB version: 4.0.9 + TiCDC - Fix the issue that multiple owners might exist when the owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) + - Fix a bug that TiCDC might fail to continue replicating data when a TiKV node crashes or recovers from a crash. This bug only exists in v4.0.8. [#1198](https://github.com/pingcap/ticdc/pull/1198) + - Fix the issue that the metadata is repeatedly flushed to etcd before a table is initialized [#1191](https://github.com/pingcap/ticdc/pull/1191) + - Fix an issue of replication interruption caused by early GC or the latency of updating `TableInfo` when the schema storage caches TiDB tables [#1114](https://github.com/pingcap/ticdc/pull/1114) + - Fix the issue that the schema storage costs too much memory when DDL operations are frequent [#1127](https://github.com/pingcap/ticdc/pull/1127) + - Fix the goroutine leak when a changefeed is paused or stopped [#1075](https://github.com/pingcap/ticdc/pull/1075) + - Increase the maximum retry timeout to 60 seconds in Kafka producer to prevent replication interruption caused by the service or network jitter in the downstream Kafka [#1118](https://github.com/pingcap/ticdc/pull/1118) + - Fix a bug that the Kafka batch size does not take effect [#1112](https://github.com/pingcap/ticdc/pull/1112) + Dumpling From 2a20831ecfa923e6ba9829fc33c1b22c51feea2e Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 14 Dec 2020 16:17:55 +0800 Subject: [PATCH 22/34] refine language and format --- releases/release-4.0.9.md | 57 +++++++++++++++++++-------------------- 1 file changed, 28 insertions(+), 29 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 42f928fb13edb..091640364f99c 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -8,11 +8,11 @@ Release date: December 15, 2020 TiDB version: 4.0.9 -## Compatibility changes +## Compatibility Changes + TiDB - - Deprecate the `enable-streaming` configuration [#21055](https://github.com/pingcap/tidb/pull/21055) + - Deprecate the `enable-streaming` configuration item [#21055](https://github.com/pingcap/tidb/pull/21055) ## New Features @@ -24,14 +24,14 @@ TiDB version: 4.0.9 + TiDB - - Avoid the (index) merge join heuristically when converting equal conditions to other conditions [#21146](https://github.com/pingcap/tidb/pull/21146) + - Avoid the (index) merge join in a heuristical way when converting equal conditions to other conditions [#21146](https://github.com/pingcap/tidb/pull/21146) - Differentiate the types of user variables [#21107](https://github.com/pingcap/tidb/pull/21107) - Support setting the `GOGC` variable in the configuration file [#20922](https://github.com/pingcap/tidb/pull/20922) - Make the dumped binary time (`Timestamp` and `Datetime`) more compatible with MySQL [#21135](https://github.com/pingcap/tidb/pull/21135) - Provide an error message for statements that use the `LOCK IN SHARE MODE` syntax [#21005](https://github.com/pingcap/tidb/pull/21005) - Avoid outputting unnecessary warnings or errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) - Raise an error when preparing the `LOAD DATA` statement [#21199](https://github.com/pingcap/tidb/pull/21199) - - Ignore the size attribute of the integer zero-fill when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) + - Ignore the attribute of the integer zero-fill size when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) - Add the executor-related runtime information of DML statements in the result of `EXPLAIN ANALYZE` [#21066](https://github.com/pingcap/tidb/pull/21066) - Disallow multiple updates on the primary key in a singe SQL statements [#21113](https://github.com/pingcap/tidb/pull/21113) - Add a monitoring metric for the connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) @@ -42,7 +42,7 @@ TiDB version: 4.0.9 - Support dynamically changing the `pessimistic-txn.pipelined` configuration [#9100](https://github.com/tikv/tikv/pull/9100) - Reduce the impact on performance when running Backup & Restore and TiDB Lightning [#9098](https://github.com/tikv/tikv/pull/9098) - Add monitoring metrics for the ingesting SST errors [#9096](https://github.com/tikv/tikv/pull/9096) - - Prevent hibernation when there are still peers catching up with logs [#9093](https://github.com/tikv/tikv/pull/9093) + - Prevent hibernation when some peers are still catching up with logs [#9093](https://github.com/tikv/tikv/pull/9093) - Increase the success rate of the pipelined pessimistic locking [#9086](https://github.com/tikv/tikv/pull/9086) - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to `1024` [#9020](https://github.com/tikv/tikv/pull/9020) - Add the `max-background-flushes` configuration item [#8947](https://github.com/tikv/tikv/pull/8947) @@ -51,7 +51,7 @@ TiDB version: 4.0.9 + PD - - Check TiKV cluster version when a TiKV stores become tombstone [#3213](https://github.com/pingcap/pd/pull/3213) + - Check the TiKV cluster version when a TiKV stores become `Tombstone` [#3213](https://github.com/pingcap/pd/pull/3213) - Disallow the TiKV store of a lower version to change from `Tombstone` back to `Up` [#3206](https://github.com/pingcap/pd/pull/3206) - Update Dashboard to `v2020.11.26.1` [#3219](https://github.com/pingcap/pd/pull/3219) @@ -66,7 +66,7 @@ TiDB version: 4.0.9 + Backup & Restore (BR) - - Disallow the ambiguous `--checksum false` argument in the command line, which does not disable checksum. Only `--checksum=false` is accepted. [#588](https://github.com/pingcap/br/pull/588) + - Disallow the ambiguous `--checksum false` argument in the command line, which does not disable checksum. Accept `--checksum=false` only. [#588](https://github.com/pingcap/br/pull/588) - Support changing the PD configuration temporarily [#596](https://github.com/pingcap/br/pull/596) - Support analyzing tables after restore [#622](https://github.com/pingcap/br/pull/622) - Retry for the `read index not ready` and `proposal in merging mode` errors [#626](https://github.com/pingcap/br/pull/626) @@ -75,9 +75,9 @@ TiDB version: 4.0.9 - Add an alert for enabling TiKV's Hibernate Region feature [#1120](https://github.com/pingcap/ticdc/pull/1120) - Reduce memory usage in the schema storage [#1127](https://github.com/pingcap/ticdc/pull/1127) - - Add unified sorter, which accelerates replication when the data size of the incremental scan is large (experimental) [#1122](https://github.com/pingcap/ticdc/pull/1122) + - Add the feature of unified sorter, which accelerates replication when the data size of the incremental scan is large (experimental) [#1122](https://github.com/pingcap/ticdc/pull/1122) - Support configuring the maximum message size and the maximum message batch in the TiCDC Open Protocol message (only for Kafka sink) [#1079](https://github.com/pingcap/ticdc/pull/1079) - + + Dumpling - Retry dumping data on failed chunks [#182](https://github.com/pingcap/dumpling/pull/182) @@ -89,12 +89,12 @@ TiDB version: 4.0.9 - Filter out all system schemas by default [#459](https://github.com/pingcap/tidb-lightning/pull/459) - Support setting a default value for the auto-random primary key for the Local-backend or Importer-backend [#457](https://github.com/pingcap/tidb-lightning/pull/457) - - Use range properties to make range split more precise with local backend [#422](https://github.com/pingcap/tidb-lightning/pull/422) + - Use range properties to make the range split more precise in Local-backend [#422](https://github.com/pingcap/tidb-lightning/pull/422) - Support a human-readable format (such as "2.5 GiB") in `tikv-importer.region-split-size`, `mydumper.read-block-size`, `mydumper.batch-size`, and `mydumper.max-region-size` [#471](https://github.com/pingcap/tidb-lightning/pull/471) + TiDB Binlog - - Exit the Drainer process with the non-zero code if the upstream PD is down or applying DDL or DML statements to the downstream fails [#1012](https://github.com/pingcap/tidb-binlog/pull/1012) + - Exit the Drainer process with the non-zero code if the upstream PD is down or if applying DDL or DML statements to the downstream fails [#1012](https://github.com/pingcap/tidb-binlog/pull/1012) ## Bug Fixes @@ -103,10 +103,10 @@ TiDB version: 4.0.9 - Fix the issue of incorrect results when using a prefix index with the `OR` condition [#21287](https://github.com/pingcap/tidb/pull/21287) - Fix a bug that might cause panic when automatic retry is enabled [#21285](https://github.com/pingcap/tidb/pull/21285) - Fix a bug that occurs when checking partition definition according to column type [#21273](https://github.com/pingcap/tidb/pull/21273) - - Fix a bug that value type of the partition expression is not consistent with the partition column type [#21136](https://github.com/pingcap/tidb/pull/21136) - - Fix a bug that hash-type partition does not check whether the partition name is unique [#21257](https://github.com/pingcap/tidb/pull/21257) + - Fix a bug that the value type of the partition expression is not consistent with the partition column type [#21136](https://github.com/pingcap/tidb/pull/21136) + - Fix a bug that the hash-type partition does not check whether the partition name is unique [#21257](https://github.com/pingcap/tidb/pull/21257) - Fix the wrong results returned after inserting a value of the non-`INT` type into the hash partitioned table [#21238](https://github.com/pingcap/tidb/pull/21238) - - Fix the unexpected errors when using index join in the `INSERT` statement in some cases [#21249](https://github.com/pingcap/tidb/pull/21249) + - Fix the unexpected error when using index join in the `INSERT` statement in some cases [#21249](https://github.com/pingcap/tidb/pull/21249) - Fix the issue that the `BigInt` unsigned column value in the `CASE WHEN` operator is incorrectly converted to the `BigInt` signed value [#21236](https://github.com/pingcap/tidb/pull/21236) - Fix a bug that index hash join and index merge join do not consider collation [#21219](https://github.com/pingcap/tidb/pull/21219) - Fix a bug that the partitioned table does not consider collation in the `CREATE TABLE` and `SELECT` syntax [#21181](https://github.com/pingcap/tidb/pull/21181) @@ -117,15 +117,15 @@ TiDB version: 4.0.9 - Fix the wrong results of some semi-join queries [#21019](https://github.com/pingcap/tidb/pull/21019) - Fix the issue that the table lock does not take effect on the `UPDATE` statement [#21002](https://github.com/pingcap/tidb/pull/21002) - Fix the issue of stack overflow that occurs when building the recursive view [#21001](https://github.com/pingcap/tidb/pull/21001) - - Fix the unexpected results returned when performing index merge join operations on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) + - Fix the unexpected result returned when performing index merge join operations on outer join [#20954](https://github.com/pingcap/tidb/pull/20954) - Fix the issue that sometimes a transaction that has an undetermined result might be treated as failed [#20925](https://github.com/pingcap/tidb/pull/20925) - Fix the issue that `EXPLAIN FOR CONNECTION` cannot show the last query plan [#21315](https://github.com/pingcap/tidb/pull/21315) - Fix the issue that when Index Merge is used in a transaction with the Read Committed isolation level, the result might be incorrect [#21253](https://github.com/pingcap/tidb/pull/21253) - - Fix the auto-ID allocation failure caused by the transaction retry after write conflict [#21079](https://github.com/pingcap/tidb/pull/21079) + - Fix the auto-ID allocation failure caused by the transaction retry after the write conflict [#21079](https://github.com/pingcap/tidb/pull/21079) - Fix the issue that JSON data cannot be correctly imported to TiDB using `LOAD DATA` [#21074](https://github.com/pingcap/tidb/pull/21074) - - Fix the issue that the default value of newly added `Enum`-type columns are incorrect [#20998](https://github.com/pingcap/tidb/pull/20998) + - Fix the issue that the default value of newly added `Enum`-type columns is incorrect [#20998](https://github.com/pingcap/tidb/pull/20998) - Fix the issue that the `addata` function inserts invalid characters [#21176](https://github.com/pingcap/tidb/pull/21176) - - Fix the issue that the wrong PointGet plan generated in some situations causes wrong results [#21244](https://github.com/pingcap/tidb/pull/21244) + - Fix the issue that the wrong `PointGet` plan generated in some situations causes wrong results [#21244](https://github.com/pingcap/tidb/pull/21244) + TiKV @@ -133,12 +133,11 @@ TiDB version: 4.0.9 - Fix the issue that Region Merge might cause data loss during network partition [#9108](https://github.com/tikv/tikv/pull/9108) - Fix the issue that the `ANALYZE` statement might cause panic when using the `latin1` character set [#9082](https://github.com/tikv/tikv/pull/9082) - Fix the wrong results returned when converting the numeric type to the time type [#9031](https://github.com/tikv/tikv/pull/9031) - - Fix the bug that TiDB Lightning fails to ingest SST files to TiKV with the Importer-backend or Local-backend when - Transparent Data Encryption (TDE) is enabled [#8995](https://github.com/tikv/tikv/pull/8995) - - Fix the invalid `advertise-status-addr` value `0.0.0.0` [#9036](https://github.com/tikv/tikv/pull/9036) + - Fix a bug that TiDB Lightning fails to ingest SST files to TiKV with the Importer-backend or Local-backend when Transparent Data Encryption (TDE) is enabled [#8995](https://github.com/tikv/tikv/pull/8995) + - Fix the invalid `advertise-status-addr` value (`0.0.0.0`) [#9036](https://github.com/tikv/tikv/pull/9036) - Fix the issue that an error is returned indicating that a key exists when this key is locked and deleted in a committed transaction [#8930](https://github.com/tikv/tikv/pull/8930) - - Fix the issue that the RocksDB mapping error causes data corruption [#9029](https://github.com/tikv/tikv/pull/9029) - - Fix the bug that Follower Read might return stale data after the leader is transferred [#9240](https://github.com/tikv/tikv/pull/9240) + - Fix the issue that the RocksDB cache mapping error causes data corruption [#9029](https://github.com/tikv/tikv/pull/9029) + - Fix a bug that Follower Read might return stale data after the leader is transferred [#9240](https://github.com/tikv/tikv/pull/9240) + PD @@ -162,12 +161,12 @@ TiDB version: 4.0.9 - Fix the issue that multiple owners might exist when the owner campaign key is deleted [#1104](https://github.com/pingcap/ticdc/pull/1104) - Fix a bug that TiCDC might fail to continue replicating data when a TiKV node crashes or recovers from a crash. This bug only exists in v4.0.8. [#1198](https://github.com/pingcap/ticdc/pull/1198) - - Fix the issue that the metadata is repeatedly flushed to etcd before a table is initialized [#1191](https://github.com/pingcap/ticdc/pull/1191) - - Fix an issue of replication interruption caused by early GC or the latency of updating `TableInfo` when the schema storage caches TiDB tables [#1114](https://github.com/pingcap/ticdc/pull/1114) - - Fix the issue that the schema storage costs too much memory when DDL operations are frequent [#1127](https://github.com/pingcap/ticdc/pull/1127) - - Fix the goroutine leak when a changefeed is paused or stopped [#1075](https://github.com/pingcap/ticdc/pull/1075) - - Increase the maximum retry timeout to 60 seconds in Kafka producer to prevent replication interruption caused by the service or network jitter in the downstream Kafka [#1118](https://github.com/pingcap/ticdc/pull/1118) - - Fix a bug that the Kafka batch size does not take effect [#1112](https://github.com/pingcap/ticdc/pull/1112) + - Fix the issue that the metadata is repeatedly flushed to etcd before a table is initialized [#1191](https://github.com/pingcap/ticdc/pull/1191) + - Fix an issue of replication interruption caused by early GC or the latency of updating `TableInfo` when the schema storage caches TiDB tables [#1114](https://github.com/pingcap/ticdc/pull/1114) + - Fix the issue that the schema storage costs too much memory when DDL operations are frequent [#1127](https://github.com/pingcap/ticdc/pull/1127) + - Fix the goroutine leak when a changefeed is paused or stopped [#1075](https://github.com/pingcap/ticdc/pull/1075) + - Increase the maximum retry timeout to 60 seconds in Kafka producer to prevent replication interruption caused by the service or network jitter in the downstream Kafka [#1118](https://github.com/pingcap/ticdc/pull/1118) + - Fix a bug that the Kafka batch size does not take effect [#1112](https://github.com/pingcap/ticdc/pull/1112) + Dumpling From ca6c4b8550d988588d4f2825973aa3dc9070e530 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 14 Dec 2020 17:05:38 +0800 Subject: [PATCH 23/34] Update releases/release-4.0.9.md Co-authored-by: tiancaiamao --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 091640364f99c..5745d7ee88d39 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -124,7 +124,7 @@ TiDB version: 4.0.9 - Fix the auto-ID allocation failure caused by the transaction retry after the write conflict [#21079](https://github.com/pingcap/tidb/pull/21079) - Fix the issue that JSON data cannot be correctly imported to TiDB using `LOAD DATA` [#21074](https://github.com/pingcap/tidb/pull/21074) - Fix the issue that the default value of newly added `Enum`-type columns is incorrect [#20998](https://github.com/pingcap/tidb/pull/20998) - - Fix the issue that the `addata` function inserts invalid characters [#21176](https://github.com/pingcap/tidb/pull/21176) + - Fix the issue that the `adddate` function inserts invalid characters [#21176](https://github.com/pingcap/tidb/pull/21176) - Fix the issue that the wrong `PointGet` plan generated in some situations causes wrong results [#21244](https://github.com/pingcap/tidb/pull/21244) + TiKV From 0e28369fa2dea80fd0b585a3adff4e3a9529b021 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 15 Dec 2020 11:41:04 +0800 Subject: [PATCH 24/34] add new notes from ichn-hu, Win-Man, and you06 --- releases/release-4.0.9.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 5745d7ee88d39..f24b9e26527f0 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -126,6 +126,12 @@ TiDB version: 4.0.9 - Fix the issue that the default value of newly added `Enum`-type columns is incorrect [#20998](https://github.com/pingcap/tidb/pull/20998) - Fix the issue that the `adddate` function inserts invalid characters [#21176](https://github.com/pingcap/tidb/pull/21176) - Fix the issue that the wrong `PointGet` plan generated in some situations causes wrong results [#21244](https://github.com/pingcap/tidb/pull/21244) + - Ignore the conversion of daylight saving time in the `ADD_DATE` function to be compatible with MySQL [#20888](https://github.com/pingcap/tidb/pull/20888) + - Fix a bug that prevents inserting strings with trailing spaces that exceed `varchar` or `char`'s length constraint [#21282](https://github.com/pingcap/tidb/pull/21282) + - Fix a bug that does not converting the integer from `[1, 69]` to `[2001, 2069]` or from `[70, 99]` to `[1970, 1999]` when comparing `int` with `year` [#21283](https://github.com/pingcap/tidb/pull/21283) + - Fix the panic caused by the overflowing result of the `sum()` function when calculating the `Double` type field [#21272](https://github.com/pingcap/tidb/pull/21272) + - Fix a bug that `DELETE` fails to add lock on the unique key [#20705](https://github.com/pingcap/tidb/pull/20705) + - Fix a bug that snapshot reads hits the lock cache [#21539](https://github.com/pingcap/tidb/pull/21539) + TiKV From 50e46979bc1c20203cd41a3b4bc3e3087c91d700 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 15 Dec 2020 17:25:13 +0800 Subject: [PATCH 25/34] change date --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index f24b9e26527f0..7a8a8cd03c4d7 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -4,7 +4,7 @@ title: TiDB 4.0.9 Release Notes # TiDB 4.0.9 Release Notes -Release date: December 15, 2020 +Release date: December 18, 2020 TiDB version: 4.0.9 From 3caf11ffa8974f4c374536e4ac6ed477c459c4c7 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 17 Dec 2020 13:51:32 +0800 Subject: [PATCH 26/34] add 6 notes from bobotu, amyangfei and tangenta --- releases/release-4.0.9.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 7a8a8cd03c4d7..e4400a5694df9 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -35,6 +35,7 @@ TiDB version: 4.0.9 - Add the executor-related runtime information of DML statements in the result of `EXPLAIN ANALYZE` [#21066](https://github.com/pingcap/tidb/pull/21066) - Disallow multiple updates on the primary key in a singe SQL statements [#21113](https://github.com/pingcap/tidb/pull/21113) - Add a monitoring metric for the connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) + - Temporarily enable the slow log when the `runtime/trace` tool is running [#20578](https://github.com/pingcap/tidb/pull/20578) + TiKV @@ -132,6 +133,8 @@ TiDB version: 4.0.9 - Fix the panic caused by the overflowing result of the `sum()` function when calculating the `Double` type field [#21272](https://github.com/pingcap/tidb/pull/21272) - Fix a bug that `DELETE` fails to add lock on the unique key [#20705](https://github.com/pingcap/tidb/pull/20705) - Fix a bug that snapshot reads hits the lock cache [#21539](https://github.com/pingcap/tidb/pull/21539) + - Fix an issue of potential memory leak after reading a lot of data in a long-lived transaction [#21129](https://github.com/pingcap/tidb/pull/21129) + - Fix the issue that omitting the table alias in a subquery will have a syntax error returned [#20367](https://github.com/pingcap/tidb/pull/20367) + TiKV @@ -173,6 +176,9 @@ TiDB version: 4.0.9 - Fix the goroutine leak when a changefeed is paused or stopped [#1075](https://github.com/pingcap/ticdc/pull/1075) - Increase the maximum retry timeout to 60 seconds in Kafka producer to prevent replication interruption caused by the service or network jitter in the downstream Kafka [#1118](https://github.com/pingcap/ticdc/pull/1118) - Fix a bug that the Kafka batch size does not take effect [#1112](https://github.com/pingcap/ticdc/pull/1112) + - Fix a bug that some tables' row change might be lost when the network between TiCDC and PD has jitter and when there are paused changefeeds being resumed at the same time [#1213](https://github.com/pingcap/ticdc/pull/1213) + - Fix a bug that the TiCDC process might exit when the network between TiCDC and PD is not stable [#1218](https://github.com/pingcap/ticdc/pull/1218) + - Use a singleton PD client in TiCDC and fix a bug that TiCDC closes PD client by accident which causes replication block [#1217](https://github.com/pingcap/ticdc/pull/1217) + Dumpling From 502c5e43f4d81d7288d2fba95af9ea0ae81b1cd2 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 18 Dec 2020 17:06:39 +0800 Subject: [PATCH 27/34] Update release-4.0.9.md --- releases/release-4.0.9.md | 9 ++++----- 1 file changed, 4 insertions(+), 5 deletions(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index e4400a5694df9..37659cb9eeb3e 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -31,7 +31,7 @@ TiDB version: 4.0.9 - Provide an error message for statements that use the `LOCK IN SHARE MODE` syntax [#21005](https://github.com/pingcap/tidb/pull/21005) - Avoid outputting unnecessary warnings or errors when folding constants in shortcut-able expressions [#21040](https://github.com/pingcap/tidb/pull/21040) - Raise an error when preparing the `LOAD DATA` statement [#21199](https://github.com/pingcap/tidb/pull/21199) - - Ignore the attribute of the integer zero-fill size when changing the column types [#20986](https://github.com/pingcap/tidb/pull/20986) + - Ignore the attribute of the integer zero-fill size when changing the integer column types [#20986](https://github.com/pingcap/tidb/pull/20986) - Add the executor-related runtime information of DML statements in the result of `EXPLAIN ANALYZE` [#21066](https://github.com/pingcap/tidb/pull/21066) - Disallow multiple updates on the primary key in a singe SQL statements [#21113](https://github.com/pingcap/tidb/pull/21113) - Add a monitoring metric for the connection idle time [#21301](https://github.com/pingcap/tidb/pull/21301) @@ -43,16 +43,15 @@ TiDB version: 4.0.9 - Support dynamically changing the `pessimistic-txn.pipelined` configuration [#9100](https://github.com/tikv/tikv/pull/9100) - Reduce the impact on performance when running Backup & Restore and TiDB Lightning [#9098](https://github.com/tikv/tikv/pull/9098) - Add monitoring metrics for the ingesting SST errors [#9096](https://github.com/tikv/tikv/pull/9096) - - Prevent hibernation when some peers are still catching up with logs [#9093](https://github.com/tikv/tikv/pull/9093) + - Prevent the leader from being hibernated when some peers still need to replicate logs [#9093](https://github.com/tikv/tikv/pull/9093) - Increase the success rate of the pipelined pessimistic locking [#9086](https://github.com/tikv/tikv/pull/9086) - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to `1024` [#9020](https://github.com/tikv/tikv/pull/9020) - Add the `max-background-flushes` configuration item [#8947](https://github.com/tikv/tikv/pull/8947) - - Enable the unified read pool for the storage module by default [#8887](https://github.com/tikv/tikv/pull/8887) - Disable `force-consistency-checks` by default to improve performance [#9029](https://github.com/tikv/tikv/pull/9029) + PD - - Check the TiKV cluster version when a TiKV stores become `Tombstone` [#3213](https://github.com/pingcap/pd/pull/3213) + - Check the TiKV cluster version when a TiKV stores become `Tombstone`, which prevents users from enabling incompatible features during the process of downgrade or upgrade [#3213](https://github.com/pingcap/pd/pull/3213) - Disallow the TiKV store of a lower version to change from `Tombstone` back to `Up` [#3206](https://github.com/pingcap/pd/pull/3206) - Update Dashboard to `v2020.11.26.1` [#3219](https://github.com/pingcap/pd/pull/3219) @@ -67,7 +66,7 @@ TiDB version: 4.0.9 + Backup & Restore (BR) - - Disallow the ambiguous `--checksum false` argument in the command line, which does not disable checksum. Accept `--checksum=false` only. [#588](https://github.com/pingcap/br/pull/588) + - Disallow the ambiguous `--checksum false` argument in the command line, which does not correctly disable checksum. Only `--checksum=false` is accepted. [#588](https://github.com/pingcap/br/pull/588) - Support changing the PD configuration temporarily [#596](https://github.com/pingcap/br/pull/596) - Support analyzing tables after restore [#622](https://github.com/pingcap/br/pull/622) - Retry for the `read index not ready` and `proposal in merging mode` errors [#626](https://github.com/pingcap/br/pull/626) From f5a2c1d61e9d75b52a019452b246b35cfa88a80d Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 18 Dec 2020 17:12:03 +0800 Subject: [PATCH 28/34] add a ticdc note --- releases/release-4.0.9.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 37659cb9eeb3e..a2d3c68271dd2 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -178,6 +178,7 @@ TiDB version: 4.0.9 - Fix a bug that some tables' row change might be lost when the network between TiCDC and PD has jitter and when there are paused changefeeds being resumed at the same time [#1213](https://github.com/pingcap/ticdc/pull/1213) - Fix a bug that the TiCDC process might exit when the network between TiCDC and PD is not stable [#1218](https://github.com/pingcap/ticdc/pull/1218) - Use a singleton PD client in TiCDC and fix a bug that TiCDC closes PD client by accident which causes replication block [#1217](https://github.com/pingcap/ticdc/pull/1217) + - Fix a bug that the cdc owner might consume too much memory in the etcd watch client + Dumpling From 6a5143e9752ec5c23305d794be81133fa943b1ab Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 18 Dec 2020 17:27:38 +0800 Subject: [PATCH 29/34] Update release-4.0.9.md --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index a2d3c68271dd2..841d1c8e7b5a6 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -67,7 +67,7 @@ TiDB version: 4.0.9 + Backup & Restore (BR) - Disallow the ambiguous `--checksum false` argument in the command line, which does not correctly disable checksum. Only `--checksum=false` is accepted. [#588](https://github.com/pingcap/br/pull/588) - - Support changing the PD configuration temporarily [#596](https://github.com/pingcap/br/pull/596) + - Support changing the PD configuration temporarily so that PD can recover the original configuration after BR accidentally exists [#596](https://github.com/pingcap/br/pull/596) - Support analyzing tables after restore [#622](https://github.com/pingcap/br/pull/622) - Retry for the `read index not ready` and `proposal in merging mode` errors [#626](https://github.com/pingcap/br/pull/626) From 456b3d4334de4d15fb3c5ebd5a768d8875f8f55e Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 18 Dec 2020 17:33:50 +0800 Subject: [PATCH 30/34] Update releases/release-4.0.9.md Co-authored-by: amyangfei --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 841d1c8e7b5a6..2deb5c3dcca45 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -178,7 +178,7 @@ TiDB version: 4.0.9 - Fix a bug that some tables' row change might be lost when the network between TiCDC and PD has jitter and when there are paused changefeeds being resumed at the same time [#1213](https://github.com/pingcap/ticdc/pull/1213) - Fix a bug that the TiCDC process might exit when the network between TiCDC and PD is not stable [#1218](https://github.com/pingcap/ticdc/pull/1218) - Use a singleton PD client in TiCDC and fix a bug that TiCDC closes PD client by accident which causes replication block [#1217](https://github.com/pingcap/ticdc/pull/1217) - - Fix a bug that the cdc owner might consume too much memory in the etcd watch client + - Fix a bug that the TiCDC owner might consume too much memory in the etcd watch client [#1224](https://github.com/pingcap/ticdc/pull/1224) + Dumpling From 95d46275fb223bb77f6733db7e7b62e89429be7d Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 18 Dec 2020 17:34:36 +0800 Subject: [PATCH 31/34] Update releases/release-4.0.9.md --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 2deb5c3dcca45..97b5ee4d6f24d 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -173,7 +173,7 @@ TiDB version: 4.0.9 - Fix an issue of replication interruption caused by early GC or the latency of updating `TableInfo` when the schema storage caches TiDB tables [#1114](https://github.com/pingcap/ticdc/pull/1114) - Fix the issue that the schema storage costs too much memory when DDL operations are frequent [#1127](https://github.com/pingcap/ticdc/pull/1127) - Fix the goroutine leak when a changefeed is paused or stopped [#1075](https://github.com/pingcap/ticdc/pull/1075) - - Increase the maximum retry timeout to 60 seconds in Kafka producer to prevent replication interruption caused by the service or network jitter in the downstream Kafka [#1118](https://github.com/pingcap/ticdc/pull/1118) + - Increase the maximum retry timeout to 600 seconds in Kafka producer to prevent replication interruption caused by the service or network jitter in the downstream Kafka [#1118](https://github.com/pingcap/ticdc/pull/1118) - Fix a bug that the Kafka batch size does not take effect [#1112](https://github.com/pingcap/ticdc/pull/1112) - Fix a bug that some tables' row change might be lost when the network between TiCDC and PD has jitter and when there are paused changefeeds being resumed at the same time [#1213](https://github.com/pingcap/ticdc/pull/1213) - Fix a bug that the TiCDC process might exit when the network between TiCDC and PD is not stable [#1218](https://github.com/pingcap/ticdc/pull/1218) From 46d4e8b4284986aad25dd2dbcc6158aa3ab9e1e3 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 18 Dec 2020 18:14:29 +0800 Subject: [PATCH 32/34] add tikv notes from jay --- releases/release-4.0.9.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 97b5ee4d6f24d..8f37fad46701b 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -14,6 +14,10 @@ TiDB version: 4.0.9 - Deprecate the `enable-streaming` configuration item [#21055](https://github.com/pingcap/tidb/pull/21055) ++ TiKV + + - Reduce I/O and mutex contention when encryption at rest is enabled. The change is backwardly incompatible. If users need to downgrade the cluster to a version earlier than v4.0.9, `security.encryption.enable-file-dictionary-log` must be disabled and TiKV must be restarted before the downgrade. [#9195](https://github.com/tikv/tikv/pull/9195) + ## New Features + TiFlash @@ -48,6 +52,7 @@ TiDB version: 4.0.9 - Change the default value of `apply-max-batch-size` and `store-max-batch-size` to `1024` [#9020](https://github.com/tikv/tikv/pull/9020) - Add the `max-background-flushes` configuration item [#8947](https://github.com/tikv/tikv/pull/8947) - Disable `force-consistency-checks` by default to improve performance [#9029](https://github.com/tikv/tikv/pull/9029) + - Offload the queries on the Region size from `pd heartbeat worker` to `split check worker` [#9185](https://github.com/tikv/tikv/pull/9185) + PD @@ -146,6 +151,9 @@ TiDB version: 4.0.9 - Fix the issue that an error is returned indicating that a key exists when this key is locked and deleted in a committed transaction [#8930](https://github.com/tikv/tikv/pull/8930) - Fix the issue that the RocksDB cache mapping error causes data corruption [#9029](https://github.com/tikv/tikv/pull/9029) - Fix a bug that Follower Read might return stale data after the leader is transferred [#9240](https://github.com/tikv/tikv/pull/9240) + - Fix the issue that stale old values might be read in the pessimistic lock [#9282](https://github.com/tikv/tikv/pull/9282) + - Fix a bug that replica read might get stale data after the leader transfer [#9240](https://github.com/tikv/tikv/pull/9240) + - Fix the issue of TiKV crash that occurs when receiving `SIGPROF` after profiling [#9229](https://github.com/tikv/tikv/pull/9229) + PD From 0215432c028ffe641ad6f80622b151cb34f2ad29 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 18 Dec 2020 19:29:32 +0800 Subject: [PATCH 33/34] add tidb dashboard related notes --- releases/release-4.0.9.md | 25 ++++++++++++++++++++++++- 1 file changed, 24 insertions(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index 8f37fad46701b..b6039fda113d9 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -24,6 +24,16 @@ TiDB version: 4.0.9 - Support storing the latest data of the storage engine on multiple disks (experimental) ++ TiDB Dashboard + + - Support displaying and sorting by all fields in the **SQL Statements** page [#749](https://github.com/pingcap/tidb-dashboard/pull/749) + - Support zooming and panning the topology graph [#772](https://github.com/pingcap/tidb-dashboard/pull/772) + - Support displaying the disk usage information in the **SQL Statements** and **Slow Queries** pages [#777](https://github.com/pingcap/tidb-dashboard/pull/777) + - Support exporting list data in the **SQL Statements** and **Slow Queries** pages [#778](https://github.com/pingcap/tidb-dashboard/pull/778) + - Support customizing the Prometheus address [#808](https://github.com/pingcap/tidb-dashboard/pull/808) + - Add a page for cluster statistics [#815](https://github.com/pingcap/tidb-dashboard/pull/815) + - Add more time-related fields in the **Slow Queries** details [#810](https://github.com/pingcap/tidb-dashboard/pull/810) + ## Improvements + TiDB @@ -58,7 +68,13 @@ TiDB version: 4.0.9 - Check the TiKV cluster version when a TiKV stores become `Tombstone`, which prevents users from enabling incompatible features during the process of downgrade or upgrade [#3213](https://github.com/pingcap/pd/pull/3213) - Disallow the TiKV store of a lower version to change from `Tombstone` back to `Up` [#3206](https://github.com/pingcap/pd/pull/3206) - - Update Dashboard to `v2020.11.26.1` [#3219](https://github.com/pingcap/pd/pull/3219) + ++ TiDB Dashboard + + - Keep expanding when "Expand" is clicked for SQL statements [#775](https://github.com/pingcap/tidb-dashboard/pull/775) + - Open detail pages in new windows for **SQL Statements** and **Slow Queries** [#816](https://github.com/pingcap/tidb-dashboard/pull/816) + - Improve descriptions for time-related fields in **Slow Queries** details [#817](https://github.com/pingcap/tidb-dashboard/pull/817) + - Display detailed error messages [#794](https://github.com/pingcap/tidb-dashboard/pull/794) + TiFlash @@ -161,6 +177,13 @@ TiDB version: 4.0.9 - Fix the issue that the `trace-region-flow` value is unexpectedly set to `false` [#3120](https://github.com/pingcap/pd/pull/3120) - Fix a bug that the service safepoint with infinite Time To Live (TTL) does not work [#3143](https://github.com/pingcap/pd/pull/3143) ++ TiDB Dashboard + + - Fix a display issue of time in the Chinese language [#755](https://github.com/pingcap/tidb-dashboard/pull/755) + - Fix a bug that the browser compatibility notice does not work [#776](https://github.com/pingcap/tidb-dashboard/pull/776) + - Fix the issue that the transaction `start_ts` is incorrectly displayed in some scenarios [#793](https://github.com/pingcap/tidb-dashboard/pull/793) + - Fix the issue that some SQL texts are incorrectly formatted [#805](https://github.com/pingcap/tidb-dashboard/pull/805) + + TiFlash - Fix the issue that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` might contain the information of disks that are not in use From 382843378ddf71889645419e737e2142e7c25439 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 21 Dec 2020 19:01:13 +0800 Subject: [PATCH 34/34] Update releases/release-4.0.9.md --- releases/release-4.0.9.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.9.md b/releases/release-4.0.9.md index b6039fda113d9..4fbb286714bee 100644 --- a/releases/release-4.0.9.md +++ b/releases/release-4.0.9.md @@ -4,7 +4,7 @@ title: TiDB 4.0.9 Release Notes # TiDB 4.0.9 Release Notes -Release date: December 18, 2020 +Release date: December 21, 2020 TiDB version: 4.0.9