From 68ecefcfec03b62e5ad3db3c739ba197fc24bb1c Mon Sep 17 00:00:00 2001 From: ti-srebot <66930949+ti-srebot@users.noreply.github.com> Date: Mon, 26 Jul 2021 13:51:53 +0800 Subject: [PATCH 01/15] releases: add TiDB 5.1.1-13-51-50 release notes * releases: add TiDB 5.1.1-13-51-50 release notes * Update releases/release-5.1.1-13-51-50.md --- releases/release-5.1.1-13-51-50.md | 125 +++++++++++++++++++++++++++++ 1 file changed, 125 insertions(+) create mode 100644 releases/release-5.1.1-13-51-50.md diff --git a/releases/release-5.1.1-13-51-50.md b/releases/release-5.1.1-13-51-50.md new file mode 100644 index 000000000000..c7dbc57d30cc --- /dev/null +++ b/releases/release-5.1.1-13-51-50.md @@ -0,0 +1,125 @@ +--- +title: TiDB 5.1.1 Release Notes +category: Releases +--- + + + +# TiDB 5.1.1 Release Notes + +Release Date: July 26, 2021 + +TiDB version: 5.1.1 + +## __unsorted + ++ PingCAP/TiDB + + - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26482](https://github.com/pingcap/tidb/pull/26482) + - store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480) + - planner: fix the risk of integer overflow when locating partitions [#26471](https://github.com/pingcap/tidb/pull/26471) + - ddl: fix cast date as timestamp will write invalid value [#26395](https://github.com/pingcap/tidb/pull/26395) + - exec: access the table_storage_stats need super privilege [#26352](https://github.com/pingcap/tidb/pull/26352) + - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26344](https://github.com/pingcap/tidb/pull/26344) + - Accessing information_schema.user_privileges will now requires the SELECT privilege on mysql.user in order to show other user's privileges. [#26311](https://github.com/pingcap/tidb/pull/26311) + - Reading from the table information_schema.cluster_hardware now requires the CONFIG privilege. +- Reading from the table information_schema.cluster_info now requires the Process privilege. +- Reading from the table information_schema.cluster_load now requires the Process privilege. +- Reading from the table information_schema.cluster_systeminfo now requires the Process privilege. +- Reading from the table information_schema.cluster_log now requires the Process privilege. [#26297](https://github.com/pingcap/tidb/pull/26297) + - fix the bug of annoying logs caused by telemetry [#26284](https://github.com/pingcap/tidb/pull/26284) + - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265) + - fix a bug on the query range of prefix index [#26262](https://github.com/pingcap/tidb/pull/26262) + - Fix the issue that concurrently truncating the same partition hangs DDL. [#26239](https://github.com/pingcap/tidb/pull/26239) + - Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225) + - planner/core: fix duplicate enum items [#26202](https://github.com/pingcap/tidb/pull/26202) + - Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200) + - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194) + - mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192) + - Reading from the table information_schema.cluster_config now requires the CONFIG privilege. [#26150](https://github.com/pingcap/tidb/pull/26150) + - executor: fix a bug that cte.iterOutTbl did not close correctly [#26148](https://github.com/pingcap/tidb/pull/26148) + - load: fix load data with non-utf8 can succeed [#26144](https://github.com/pingcap/tidb/pull/26144) + - fix unsigned int window function error [#26027](https://github.com/pingcap/tidb/pull/26027) + - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874) + - Fix the issue that TiDB may panic when resolving async-commit locks. [#25862](https://github.com/pingcap/tidb/pull/25862) + - Make Stale Read fully support prepare statement [#25800](https://github.com/pingcap/tidb/pull/25800) + - Improve the MySQL compatibility of str_to_date for %b/%M/%r/%T [#25768](https://github.com/pingcap/tidb/pull/25768) + - Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763) + - Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737) + - Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587) + - Fix the issue that ODBC-styled literal(like {d '2020-01-01'}...) cannot be used as the expression. [#25578](https://github.com/pingcap/tidb/pull/25578) + - fix the bug about unnecessary error when run tidb only [#25555](https://github.com/pingcap/tidb/pull/25555) + + ++ TiKV/TiKV + + - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10586](https://github.com/tikv/tikv/pull/10586) + - Fix duration calculation panics on certain platforms [#10569](https://github.com/tikv/tikv/pull/10569) + - Fix unencoded keys of `batch_get_command` in load-base-split [#10565](https://github.com/tikv/tikv/pull/10565) + - Prevent the risk of stack overflow when handling many expired commands. [#10502](https://github.com/tikv/tikv/pull/10502) + - Fix online changing `resolved-ts.advance-ts-interval` can't take effect immediately [#10494](https://github.com/tikv/tikv/pull/10494) + - - fix follower meta corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486) + - ```release-note [#10466](https://github.com/tikv/tikv/pull/10466) + - Avoid panic when building a snapshot twice if encryption enabled [#10464](https://github.com/tikv/tikv/pull/10464) + - Not use the stale read request's `start_ts` to update `max_ts` to avoid commit request keep retrying [#10451](https://github.com/tikv/tikv/pull/10451) + - Fix wrong tikv_raftstore_hibernated_peer_state metric. [#10432](https://github.com/tikv/tikv/pull/10432) + - copr: fix the wrong arguments type of json_unquote [#10428](https://github.com/tikv/tikv/pull/10428) + - ```release-note [#10382](https://github.com/tikv/tikv/pull/10382) + + ++ PD + + - TiDB Dashboard: Add OIDC based SSO support [#3883](https://github.com/tikv/pd/pull/3883) + - Reduce the conflict due to multiple scheduler running in same time [#3857](https://github.com/tikv/pd/pull/3857) + - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3824](https://github.com/tikv/pd/pull/3824) + + ++ Tools + + + PingCAP/TiCDC + + - Remove file sorter. [#2327](https://github.com/pingcap/ticdc/pull/2327) + - puller,mounter,processor: always pull the old value internally [#2306](https://github.com/pingcap/ticdc/pull/2306) + - Fix minor runtime panic risk [#2300](https://github.com/pingcap/ticdc/pull/2300) + - Fix potential DDL loss when owner crashes while executing DDL [#2290](https://github.com/pingcap/ticdc/pull/2290) + - Don't resolve lock immediately after a region is initialized. [#2266](https://github.com/pingcap/ticdc/pull/2266) + - Fix potential DDL loss when owner crashes while executing DDL [#2252](https://github.com/pingcap/ticdc/pull/2252) + - Don't resolve lock immediately after a region is initialized. [#2235](https://github.com/pingcap/ticdc/pull/2235) + - Better err msg when PD endpoint missing certificate [#2186](https://github.com/pingcap/ticdc/pull/2186) + - Fix a bug that could cause data losses if a TiCDC node is kills immediate after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) + - Fix changefeed update to properly handle --sort-dir and --start-ts. [#1921](https://github.com/pingcap/ticdc/pull/1921) + + +## Bug Fixes + ++ PingCAP/TiDB + + - amend transactions correctly when "modify column" needs reorg data with tidb_enable_amend_pessimistic_txn=on. [#26273](https://github.com/pingcap/tidb/pull/26273) + - fix incompatible last_day func behavior in sql mode [#26001](https://github.com/pingcap/tidb/pull/26001) + - Make sure limit outputs no more columns than its child [#25980](https://github.com/pingcap/tidb/pull/25980) + - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25973](https://github.com/pingcap/tidb/pull/25973) + - planner: handle other-conditions from subqueries correctly when constructing IndexJoin [#25819](https://github.com/pingcap/tidb/pull/25819) + - Fix the bug that successful optimistic transactions may report commit errors. [#25803](https://github.com/pingcap/tidb/pull/25803) + - Fix incorrect result of set type for merge join [#25695](https://github.com/pingcap/tidb/pull/25695) + + +## Improvements + ++ PingCAP/TiDB + + - avoid alloc for paramMarker in buildValuesListOfInsert [#26076](https://github.com/pingcap/tidb/pull/26076) + - planner: support stable result mode [#25995](https://github.com/pingcap/tidb/pull/25995) + + ++ TiKV/TiKV + + - - separate read write ready to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592) + + +## Compatibility Changes + ++ PingCAP/TiDB + + - For users upgrading from TiDB 4.0, the value of tidb_multi_statement_mode is now OFF. It is recommended to use the multi-statement feature of your client library instead, see the documentation on tidb_multi_statement_mode for additional details. [#25751](https://github.com/pingcap/tidb/pull/25751) + + From 8c96e02157d88a43d11b2ac0a48668d2489a6dd1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 26 Jul 2021 15:37:46 +0800 Subject: [PATCH 02/15] add toc --- TOC.md | 1 + ...ase-5.1.1-13-51-50.md => release-5.1.1.md} | 238 +++++++++--------- releases/release-notes.md | 1 + 3 files changed, 115 insertions(+), 125 deletions(-) rename releases/{release-5.1.1-13-51-50.md => release-5.1.1.md} (87%) diff --git a/TOC.md b/TOC.md index c6f1eb4005d7..edebe8c36d3a 100644 --- a/TOC.md +++ b/TOC.md @@ -549,6 +549,7 @@ + [All Releases](/releases/release-notes.md) + [TiDB Roadmap](/roadmap.md) + v5.1 + + [5.1.1](/releases/release-5.1.1.md) + [5.1.0](/releases/release-5.1.0.md) + v5.0 + [5.0.3](/releases/release-5.0.3.md) diff --git a/releases/release-5.1.1-13-51-50.md b/releases/release-5.1.1.md similarity index 87% rename from releases/release-5.1.1-13-51-50.md rename to releases/release-5.1.1.md index c7dbc57d30cc..818243304228 100644 --- a/releases/release-5.1.1-13-51-50.md +++ b/releases/release-5.1.1.md @@ -1,125 +1,113 @@ ---- -title: TiDB 5.1.1 Release Notes -category: Releases ---- - - - -# TiDB 5.1.1 Release Notes - -Release Date: July 26, 2021 - -TiDB version: 5.1.1 - -## __unsorted - -+ PingCAP/TiDB - - - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26482](https://github.com/pingcap/tidb/pull/26482) - - store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480) - - planner: fix the risk of integer overflow when locating partitions [#26471](https://github.com/pingcap/tidb/pull/26471) - - ddl: fix cast date as timestamp will write invalid value [#26395](https://github.com/pingcap/tidb/pull/26395) - - exec: access the table_storage_stats need super privilege [#26352](https://github.com/pingcap/tidb/pull/26352) - - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26344](https://github.com/pingcap/tidb/pull/26344) - - Accessing information_schema.user_privileges will now requires the SELECT privilege on mysql.user in order to show other user's privileges. [#26311](https://github.com/pingcap/tidb/pull/26311) - - Reading from the table information_schema.cluster_hardware now requires the CONFIG privilege. -- Reading from the table information_schema.cluster_info now requires the Process privilege. -- Reading from the table information_schema.cluster_load now requires the Process privilege. -- Reading from the table information_schema.cluster_systeminfo now requires the Process privilege. -- Reading from the table information_schema.cluster_log now requires the Process privilege. [#26297](https://github.com/pingcap/tidb/pull/26297) - - fix the bug of annoying logs caused by telemetry [#26284](https://github.com/pingcap/tidb/pull/26284) - - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265) - - fix a bug on the query range of prefix index [#26262](https://github.com/pingcap/tidb/pull/26262) - - Fix the issue that concurrently truncating the same partition hangs DDL. [#26239](https://github.com/pingcap/tidb/pull/26239) - - Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225) - - planner/core: fix duplicate enum items [#26202](https://github.com/pingcap/tidb/pull/26202) - - Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200) - - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194) - - mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192) - - Reading from the table information_schema.cluster_config now requires the CONFIG privilege. [#26150](https://github.com/pingcap/tidb/pull/26150) - - executor: fix a bug that cte.iterOutTbl did not close correctly [#26148](https://github.com/pingcap/tidb/pull/26148) - - load: fix load data with non-utf8 can succeed [#26144](https://github.com/pingcap/tidb/pull/26144) - - fix unsigned int window function error [#26027](https://github.com/pingcap/tidb/pull/26027) - - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874) - - Fix the issue that TiDB may panic when resolving async-commit locks. [#25862](https://github.com/pingcap/tidb/pull/25862) - - Make Stale Read fully support prepare statement [#25800](https://github.com/pingcap/tidb/pull/25800) - - Improve the MySQL compatibility of str_to_date for %b/%M/%r/%T [#25768](https://github.com/pingcap/tidb/pull/25768) - - Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763) - - Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737) - - Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587) - - Fix the issue that ODBC-styled literal(like {d '2020-01-01'}...) cannot be used as the expression. [#25578](https://github.com/pingcap/tidb/pull/25578) - - fix the bug about unnecessary error when run tidb only [#25555](https://github.com/pingcap/tidb/pull/25555) - - -+ TiKV/TiKV - - - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10586](https://github.com/tikv/tikv/pull/10586) - - Fix duration calculation panics on certain platforms [#10569](https://github.com/tikv/tikv/pull/10569) - - Fix unencoded keys of `batch_get_command` in load-base-split [#10565](https://github.com/tikv/tikv/pull/10565) - - Prevent the risk of stack overflow when handling many expired commands. [#10502](https://github.com/tikv/tikv/pull/10502) - - Fix online changing `resolved-ts.advance-ts-interval` can't take effect immediately [#10494](https://github.com/tikv/tikv/pull/10494) - - - fix follower meta corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486) - - ```release-note [#10466](https://github.com/tikv/tikv/pull/10466) - - Avoid panic when building a snapshot twice if encryption enabled [#10464](https://github.com/tikv/tikv/pull/10464) - - Not use the stale read request's `start_ts` to update `max_ts` to avoid commit request keep retrying [#10451](https://github.com/tikv/tikv/pull/10451) - - Fix wrong tikv_raftstore_hibernated_peer_state metric. [#10432](https://github.com/tikv/tikv/pull/10432) - - copr: fix the wrong arguments type of json_unquote [#10428](https://github.com/tikv/tikv/pull/10428) - - ```release-note [#10382](https://github.com/tikv/tikv/pull/10382) - - -+ PD - - - TiDB Dashboard: Add OIDC based SSO support [#3883](https://github.com/tikv/pd/pull/3883) - - Reduce the conflict due to multiple scheduler running in same time [#3857](https://github.com/tikv/pd/pull/3857) - - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3824](https://github.com/tikv/pd/pull/3824) - - -+ Tools - - + PingCAP/TiCDC - - - Remove file sorter. [#2327](https://github.com/pingcap/ticdc/pull/2327) - - puller,mounter,processor: always pull the old value internally [#2306](https://github.com/pingcap/ticdc/pull/2306) - - Fix minor runtime panic risk [#2300](https://github.com/pingcap/ticdc/pull/2300) - - Fix potential DDL loss when owner crashes while executing DDL [#2290](https://github.com/pingcap/ticdc/pull/2290) - - Don't resolve lock immediately after a region is initialized. [#2266](https://github.com/pingcap/ticdc/pull/2266) - - Fix potential DDL loss when owner crashes while executing DDL [#2252](https://github.com/pingcap/ticdc/pull/2252) - - Don't resolve lock immediately after a region is initialized. [#2235](https://github.com/pingcap/ticdc/pull/2235) - - Better err msg when PD endpoint missing certificate [#2186](https://github.com/pingcap/ticdc/pull/2186) - - Fix a bug that could cause data losses if a TiCDC node is kills immediate after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) - - Fix changefeed update to properly handle --sort-dir and --start-ts. [#1921](https://github.com/pingcap/ticdc/pull/1921) - - -## Bug Fixes - -+ PingCAP/TiDB - - - amend transactions correctly when "modify column" needs reorg data with tidb_enable_amend_pessimistic_txn=on. [#26273](https://github.com/pingcap/tidb/pull/26273) - - fix incompatible last_day func behavior in sql mode [#26001](https://github.com/pingcap/tidb/pull/26001) - - Make sure limit outputs no more columns than its child [#25980](https://github.com/pingcap/tidb/pull/25980) - - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25973](https://github.com/pingcap/tidb/pull/25973) - - planner: handle other-conditions from subqueries correctly when constructing IndexJoin [#25819](https://github.com/pingcap/tidb/pull/25819) - - Fix the bug that successful optimistic transactions may report commit errors. [#25803](https://github.com/pingcap/tidb/pull/25803) - - Fix incorrect result of set type for merge join [#25695](https://github.com/pingcap/tidb/pull/25695) - - -## Improvements - -+ PingCAP/TiDB - - - avoid alloc for paramMarker in buildValuesListOfInsert [#26076](https://github.com/pingcap/tidb/pull/26076) - - planner: support stable result mode [#25995](https://github.com/pingcap/tidb/pull/25995) - - -+ TiKV/TiKV - - - - separate read write ready to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592) - - -## Compatibility Changes - -+ PingCAP/TiDB - - - For users upgrading from TiDB 4.0, the value of tidb_multi_statement_mode is now OFF. It is recommended to use the multi-statement feature of your client library instead, see the documentation on tidb_multi_statement_mode for additional details. [#25751](https://github.com/pingcap/tidb/pull/25751) - - +--- +title: TiDB 5.1.1 Release Notes +--- + +# TiDB 5.1.1 Release Notes + +Release Date: July 30, 2021 + +TiDB version: 5.1.1 + +## Compatibility change + ++ TiDB + + - For users upgrading from TiDB 4.0, the value of tidb_multi_statement_mode is now OFF. It is recommended to use the multi-statement feature of your client library instead, see the documentation on tidb_multi_statement_mode for additional details. [#25751](https://github.com/pingcap/tidb/pull/25751) + +## Feature enhancements + +## Improvements + ++ TiDB + + - avoid alloc for paramMarker in buildValuesListOfInsert [#26076](https://github.com/pingcap/tidb/pull/26076) + - planner: support stable result mode [#25995](https://github.com/pingcap/tidb/pull/25995) + ++ TiKV + + - separate read write ready to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592) + +## Bug fixes + ++ TiDB + + - amend transactions correctly when "modify column" needs reorg data with tidb_enable_amend_pessimistic_txn=on. [#26273](https://github.com/pingcap/tidb/pull/26273) + - fix incompatible last_day func behavior in sql mode [#26001](https://github.com/pingcap/tidb/pull/26001) + - Make sure limit outputs no more columns than its child [#25980](https://github.com/pingcap/tidb/pull/25980) + - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25973](https://github.com/pingcap/tidb/pull/25973) + - planner: handle other-conditions from subqueries correctly when constructing IndexJoin [#25819](https://github.com/pingcap/tidb/pull/25819) + - Fix the bug that successful optimistic transactions may report commit errors. [#25803](https://github.com/pingcap/tidb/pull/25803) + - Fix incorrect result of set type for merge join [#25695](https://github.com/pingcap/tidb/pull/25695) + +## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 + ++ TiDB + + - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26482](https://github.com/pingcap/tidb/pull/26482) + - store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480) + - planner: fix the risk of integer overflow when locating partitions [#26471](https://github.com/pingcap/tidb/pull/26471) + - ddl: fix cast date as timestamp will write invalid value [#26395](https://github.com/pingcap/tidb/pull/26395) + - exec: access the table_storage_stats need super privilege [#26352](https://github.com/pingcap/tidb/pull/26352) + - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26344](https://github.com/pingcap/tidb/pull/26344) + - Accessing information_schema.user_privileges will now requires the SELECT privilege on mysql.user in order to show other user's privileges. [#26311](https://github.com/pingcap/tidb/pull/26311) + - Reading from the table information_schema.cluster_hardware now requires the CONFIG privilege. + - Reading from the table information_schema.cluster_info now requires the Process privilege. + - Reading from the table information_schema.cluster_load now requires the Process privilege. + - Reading from the table information_schema.cluster_systeminfo now requires the Process privilege. + - Reading from the table information_schema.cluster_log now requires the Process privilege. [#26297](https://github.com/pingcap/tidb/pull/26297) + - fix the bug of annoying logs caused by telemetry [#26284](https://github.com/pingcap/tidb/pull/26284) + - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265) + - fix a bug on the query range of prefix index [#26262](https://github.com/pingcap/tidb/pull/26262) + - Fix the issue that concurrently truncating the same partition hangs DDL. [#26239](https://github.com/pingcap/tidb/pull/26239) + - Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225) + - planner/core: fix duplicate enum items [#26202](https://github.com/pingcap/tidb/pull/26202) + - Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200) + - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194) + - mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192) + - Reading from the table information_schema.cluster_config now requires the CONFIG privilege. [#26150](https://github.com/pingcap/tidb/pull/26150) + - executor: fix a bug that cte.iterOutTbl did not close correctly [#26148](https://github.com/pingcap/tidb/pull/26148) + - load: fix load data with non-utf8 can succeed [#26144](https://github.com/pingcap/tidb/pull/26144) + - fix unsigned int window function error [#26027](https://github.com/pingcap/tidb/pull/26027) + - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874) + - Fix the issue that TiDB may panic when resolving async-commit locks. [#25862](https://github.com/pingcap/tidb/pull/25862) + - Make Stale Read fully support prepare statement [#25800](https://github.com/pingcap/tidb/pull/25800) + - Improve the MySQL compatibility of str_to_date for %b/%M/%r/%T [#25768](https://github.com/pingcap/tidb/pull/25768) + - Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763) + - Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737) + - Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587) + - Fix the issue that ODBC-styled literal(like {d '2020-01-01'}...) cannot be used as the expression. [#25578](https://github.com/pingcap/tidb/pull/25578) + - fix the bug about unnecessary error when run tidb only [#25555](https://github.com/pingcap/tidb/pull/25555) + ++ TiKV + + - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10586](https://github.com/tikv/tikv/pull/10586) + - Fix duration calculation panics on certain platforms [#10569](https://github.com/tikv/tikv/pull/10569) + - Fix unencoded keys of `batch_get_command` in load-base-split [#10565](https://github.com/tikv/tikv/pull/10565) + - Prevent the risk of stack overflow when handling many expired commands. [#10502](https://github.com/tikv/tikv/pull/10502) + - Fix online changing `resolved-ts.advance-ts-interval` can't take effect immediately [#10494](https://github.com/tikv/tikv/pull/10494) + - fix follower meta corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486) + - Avoid panic when building a snapshot twice if encryption enabled [#10464](https://github.com/tikv/tikv/pull/10464) + - Not use the stale read request's `start_ts` to update `max_ts` to avoid commit request keep retrying [#10451](https://github.com/tikv/tikv/pull/10451) + - Fix wrong tikv_raftstore_hibernated_peer_state metric. [#10432](https://github.com/tikv/tikv/pull/10432) + - copr: fix the wrong arguments type of json_unquote [#10428](https://github.com/tikv/tikv/pull/10428) + ++ PD + + - TiDB Dashboard: Add OIDC based SSO support [#3883](https://github.com/tikv/pd/pull/3883) + - Reduce the conflict due to multiple scheduler running in same time [#3857](https://github.com/tikv/pd/pull/3857) + - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3824](https://github.com/tikv/pd/pull/3824) + ++ Tools + + + TiCDC + + - Remove file sorter. [#2327](https://github.com/pingcap/ticdc/pull/2327) + - puller,mounter,processor: always pull the old value internally [#2306](https://github.com/pingcap/ticdc/pull/2306) + - Fix minor runtime panic risk [#2300](https://github.com/pingcap/ticdc/pull/2300) + - Fix potential DDL loss when owner crashes while executing DDL [#2290](https://github.com/pingcap/ticdc/pull/2290) + - Don't resolve lock immediately after a region is initialized. [#2266](https://github.com/pingcap/ticdc/pull/2266) + - Fix potential DDL loss when owner crashes while executing DDL [#2252](https://github.com/pingcap/ticdc/pull/2252) + - Don't resolve lock immediately after a region is initialized. [#2235](https://github.com/pingcap/ticdc/pull/2235) + - Better err msg when PD endpoint missing certificate [#2186](https://github.com/pingcap/ticdc/pull/2186) + - Fix a bug that could cause data losses if a TiCDC node is kills immediate after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) + - Fix changefeed update to properly handle --sort-dir and --start-ts. [#1921](https://github.com/pingcap/ticdc/pull/1921) diff --git a/releases/release-notes.md b/releases/release-notes.md index ca02d43d472e..dd6f32e37872 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -7,6 +7,7 @@ aliases: ['/docs/dev/releases/release-notes/','/docs/dev/releases/rn/'] ## 5.1 +- [5.1.1](/releases/release-5.1.1.md) - [5.1.0](/releases/release-5.1.0.md) ## 5.0 From df11799f5d3c9ab82fe09c82ecabc4955f2bd7a0 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 28 Jul 2021 11:04:42 +0800 Subject: [PATCH 03/15] add tidb, tikv, tiflash, pd, and tools notes according to comments --- releases/release-5.1.1.md | 127 ++++++++++++++++++++++++++------------ 1 file changed, 86 insertions(+), 41 deletions(-) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 818243304228..95b993591ec7 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -13,19 +13,71 @@ TiDB version: 5.1.1 + TiDB - For users upgrading from TiDB 4.0, the value of tidb_multi_statement_mode is now OFF. It is recommended to use the multi-statement feature of your client library instead, see the documentation on tidb_multi_statement_mode for additional details. [#25751](https://github.com/pingcap/tidb/pull/25751) + - exec: access the table_storage_stats need super privilege [#26352](https://github.com/pingcap/tidb/pull/26352) + - Accessing information_schema.user_privileges will now requires the SELECT privilege on mysql.user in order to show other user's privileges. [#26311](https://github.com/pingcap/tidb/pull/26311) + - Reading from the table information_schema.cluster_hardware now requires the CONFIG privilege. + - Reading from the table information_schema.cluster_info now requires the Process privilege. + - Reading from the table information_schema.cluster_load now requires the Process privilege. + - Reading from the table information_schema.cluster_systeminfo now requires the Process privilege. + - Reading from the table information_schema.cluster_log now requires the Process privilege. [#26297](https://github.com/pingcap/tidb/pull/26297) + - Reading from the table information_schema.cluster_config now requires the CONFIG privilege. [#26150](https://github.com/pingcap/tidb/pull/26150) + - Improve the MySQL compatibility of str_to_date for %b/%M/%r/%T [#25768](https://github.com/pingcap/tidb/pull/25768) ## Feature enhancements ++ TiDB Dashboard + + - TiDB Dashboard: Add OIDC based SSO support [#3883](https://github.com/tikv/pd/pull/3883) + ++ TiFlash + + - Support the `HAVING()` function in DAG request + ## Improvements + TiDB - avoid alloc for paramMarker in buildValuesListOfInsert [#26076](https://github.com/pingcap/tidb/pull/26076) - planner: support stable result mode [#25995](https://github.com/pingcap/tidb/pull/25995) + - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265) + - store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480) + - Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225) + - Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200) + - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194) + - mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192) + - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874) + - Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763) + - Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737) + - Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587) - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265) + - store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480) + - Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225) + - Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200) + - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194) + - mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192) + - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874) + - Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763) + - Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737) + - Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587) + TiKV - - separate read write ready to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592) + - Make prewrite as idempotent as possible to reduce the chance of undetermined errors [#10586](https://github.com/tikv/tikv/pull/10586) + - Prevent the risk of stack overflow when handling many expired commands [#10502](https://github.com/tikv/tikv/pull/10502) + - Avoid excessive commit request retrying by not updating `max_ts` with the stale read request's `start_ts` [#10451](https://github.com/tikv/tikv/pull/10451) + - Separate read write ready to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592) + - Reduce impact on data import speed with I/O rate limiting enabled [#10390](https://github.com/tikv/tikv/pull/10390) + - Improve load balance between Raft gRPC connections [#10495](https://github.com/tikv/tikv/pull/10495) + ++ Tools + + + TiCDC + + - Remove file sorter. [#2327](https://github.com/pingcap/ticdc/pull/2327) + - Better err msg when PD endpoint missing certificate [#2186](https://github.com/pingcap/ticdc/pull/2186) + + + TiDB Lightning + + - Add retry for restoring schemas [#1294](https://github.com/pingcap/br/pull/1294) ## Bug fixes @@ -38,76 +90,69 @@ TiDB version: 5.1.1 - planner: handle other-conditions from subqueries correctly when constructing IndexJoin [#25819](https://github.com/pingcap/tidb/pull/25819) - Fix the bug that successful optimistic transactions may report commit errors. [#25803](https://github.com/pingcap/tidb/pull/25803) - Fix incorrect result of set type for merge join [#25695](https://github.com/pingcap/tidb/pull/25695) - -## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 - -+ TiDB - - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26482](https://github.com/pingcap/tidb/pull/26482) - - store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480) - planner: fix the risk of integer overflow when locating partitions [#26471](https://github.com/pingcap/tidb/pull/26471) - ddl: fix cast date as timestamp will write invalid value [#26395](https://github.com/pingcap/tidb/pull/26395) - - exec: access the table_storage_stats need super privilege [#26352](https://github.com/pingcap/tidb/pull/26352) - - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26344](https://github.com/pingcap/tidb/pull/26344) - - Accessing information_schema.user_privileges will now requires the SELECT privilege on mysql.user in order to show other user's privileges. [#26311](https://github.com/pingcap/tidb/pull/26311) - - Reading from the table information_schema.cluster_hardware now requires the CONFIG privilege. - - Reading from the table information_schema.cluster_info now requires the Process privilege. - - Reading from the table information_schema.cluster_load now requires the Process privilege. - - Reading from the table information_schema.cluster_systeminfo now requires the Process privilege. - - Reading from the table information_schema.cluster_log now requires the Process privilege. [#26297](https://github.com/pingcap/tidb/pull/26297) + - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26344](https://github.com/pingcap/tidb/pull/26344) - fix the bug of annoying logs caused by telemetry [#26284](https://github.com/pingcap/tidb/pull/26284) - - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265) - fix a bug on the query range of prefix index [#26262](https://github.com/pingcap/tidb/pull/26262) - Fix the issue that concurrently truncating the same partition hangs DDL. [#26239](https://github.com/pingcap/tidb/pull/26239) - - Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225) - planner/core: fix duplicate enum items [#26202](https://github.com/pingcap/tidb/pull/26202) - - Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200) - - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194) - - mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192) - - Reading from the table information_schema.cluster_config now requires the CONFIG privilege. [#26150](https://github.com/pingcap/tidb/pull/26150) - executor: fix a bug that cte.iterOutTbl did not close correctly [#26148](https://github.com/pingcap/tidb/pull/26148) - load: fix load data with non-utf8 can succeed [#26144](https://github.com/pingcap/tidb/pull/26144) - fix unsigned int window function error [#26027](https://github.com/pingcap/tidb/pull/26027) - - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874) - Fix the issue that TiDB may panic when resolving async-commit locks. [#25862](https://github.com/pingcap/tidb/pull/25862) - Make Stale Read fully support prepare statement [#25800](https://github.com/pingcap/tidb/pull/25800) - - Improve the MySQL compatibility of str_to_date for %b/%M/%r/%T [#25768](https://github.com/pingcap/tidb/pull/25768) - - Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763) - - Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737) - - Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587) - Fix the issue that ODBC-styled literal(like {d '2020-01-01'}...) cannot be used as the expression. [#25578](https://github.com/pingcap/tidb/pull/25578) - fix the bug about unnecessary error when run tidb only [#25555](https://github.com/pingcap/tidb/pull/25555) + TiKV - - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10586](https://github.com/tikv/tikv/pull/10586) - Fix duration calculation panics on certain platforms [#10569](https://github.com/tikv/tikv/pull/10569) - Fix unencoded keys of `batch_get_command` in load-base-split [#10565](https://github.com/tikv/tikv/pull/10565) - - Prevent the risk of stack overflow when handling many expired commands. [#10502](https://github.com/tikv/tikv/pull/10502) - Fix online changing `resolved-ts.advance-ts-interval` can't take effect immediately [#10494](https://github.com/tikv/tikv/pull/10494) - - fix follower meta corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486) - - Avoid panic when building a snapshot twice if encryption enabled [#10464](https://github.com/tikv/tikv/pull/10464) - - Not use the stale read request's `start_ts` to update `max_ts` to avoid commit request keep retrying [#10451](https://github.com/tikv/tikv/pull/10451) - - Fix wrong tikv_raftstore_hibernated_peer_state metric. [#10432](https://github.com/tikv/tikv/pull/10432) - - copr: fix the wrong arguments type of json_unquote [#10428](https://github.com/tikv/tikv/pull/10428) + - Fix follower meta corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486) + - Fix panic when building a snapshot twice with encryption enabled [#10464](https://github.com/tikv/tikv/pull/10464) + - Fix wrong `tikv_raftstore_hibernated_peer_state` metric [#10432](https://github.com/tikv/tikv/pull/10432) + - Fix the wrong arguments type of `json_unquote` [#10428](https://github.com/tikv/tikv/pull/10428) + - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed [#10586](https://github.com/tikv/tikv/pull/10586) + - Fix `ReadIndex` command returning stale result right after leader is transferred [#10474](https://github.com/tikv/tikv/pull/10474) + PD - - TiDB Dashboard: Add OIDC based SSO support [#3883](https://github.com/tikv/pd/pull/3883) - Reduce the conflict due to multiple scheduler running in same time [#3857](https://github.com/tikv/pd/pull/3857) - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3824](https://github.com/tikv/pd/pull/3824) ++ TiFlash + + - Fix the potential panic issue that occurs when running table scan tasks + - Fix a bug that TiFlash raises error about `duplicated region` when handling DAQ request + - Fix the panic issue that occurs when the read load is heavy + - Fix the potential panic issue that occures when executing `DateFormat` function + - Fix the potential memory leak issue that occurs when executing MPP tasks + - Fix the issue of unexpected results when executing aggregation functions `COUNT` or `COUNT DISTINCT` + - Fix a potential bug that TiFlash can not restore data when deployed on multi disks + - Fix the issue that TiDB Dashboard can not display disk information of TiFlash correctly + - Fix the potential panic issue that occures when deconstructing `SharedQueryBlockInputStream` + - Fix the potential panic issue that occures when deconstructing `MPPTask` + + Tools + TiCDC - - Remove file sorter. [#2327](https://github.com/pingcap/ticdc/pull/2327) - - puller,mounter,processor: always pull the old value internally [#2306](https://github.com/pingcap/ticdc/pull/2306) + - Fix support for new collation [#2306](https://github.com/pingcap/ticdc/pull/2306) - Fix minor runtime panic risk [#2300](https://github.com/pingcap/ticdc/pull/2300) - Fix potential DDL loss when owner crashes while executing DDL [#2290](https://github.com/pingcap/ticdc/pull/2290) - - Don't resolve lock immediately after a region is initialized. [#2266](https://github.com/pingcap/ticdc/pull/2266) - - Fix potential DDL loss when owner crashes while executing DDL [#2252](https://github.com/pingcap/ticdc/pull/2252) - - Don't resolve lock immediately after a region is initialized. [#2235](https://github.com/pingcap/ticdc/pull/2235) - - Better err msg when PD endpoint missing certificate [#2186](https://github.com/pingcap/ticdc/pull/2186) - - Fix a bug that could cause data losses if a TiCDC node is kills immediate after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) + - Fix trying to resolve locks prematurely [#2266](https://github.com/pingcap/ticdc/pull/2266) + - Fix a bug that could cause data losses if a TiCDC node is killed immediately after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) - Fix changefeed update to properly handle --sort-dir and --start-ts. [#1921](https://github.com/pingcap/ticdc/pull/1921) + + + Backup & Restore + + - Fix incorrectly calculating the size of data to restore [#1285](https://github.com/pingcap/br/pull/1285) + - Fix missed DDL events when restoring from cdclog [#1094](https://github.com/pingcap/br/pull/1094) + + + TiDB Lightning + + - Fix parquet parser for decimal type [#1272](https://github.com/pingcap/br/pull/1272) + - Fix integer overflows when calculating key intervals [#1294](https://github.com/pingcap/br/pull/1294) From 599de7a31df38e6913903657b45331cedcc1cb9b Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 28 Jul 2021 13:31:29 +0800 Subject: [PATCH 04/15] add two dumpling notes --- releases/release-5.1.1.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 95b993591ec7..51814fa594cd 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -79,6 +79,11 @@ TiDB version: 5.1.1 - Add retry for restoring schemas [#1294](https://github.com/pingcap/br/pull/1294) + + Dumpling + + - Always split tables using _tidb_rowid when the upstream is a TiDB v3.x cluster, which helps reduce TiDB's memory [#308](https://github.com/pingcap/dumpling/pull/308) + - Reduce dumpling accessing database and information_schema usage and improve dumpling's stability. [#315](https://github.com/pingcap/dumpling/pull/315) + ## Bug fixes + TiDB From 41a9ecef72e9855847514c819a33238abb9c6f0f Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 28 Jul 2021 19:41:59 +0800 Subject: [PATCH 05/15] Update release-5.1.1.md --- releases/release-5.1.1.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 51814fa594cd..3909dfde902a 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -37,6 +37,7 @@ TiDB version: 5.1.1 + TiDB + - Announce the general availability (GA) of the Stale Read feature - avoid alloc for paramMarker in buildValuesListOfInsert [#26076](https://github.com/pingcap/tidb/pull/26076) - planner: support stable result mode [#25995](https://github.com/pingcap/tidb/pull/25995) - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265) From cf6548fc01735dde43440eb2152cd08f508b4255 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 29 Jul 2021 11:22:30 +0800 Subject: [PATCH 06/15] add a tiflash notes --- releases/release-5.1.1.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 3909dfde902a..0019cee7cec6 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -141,6 +141,7 @@ TiDB version: 5.1.1 - Fix the issue that TiDB Dashboard can not display disk information of TiFlash correctly - Fix the potential panic issue that occures when deconstructing `SharedQueryBlockInputStream` - Fix the potential panic issue that occures when deconstructing `MPPTask` + - Fix the potential data inconsistency after synchronizing data via snapshot + Tools From c0cbf6128f78b826200c583f9186222e750ca1f3 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 29 Jul 2021 11:38:24 +0800 Subject: [PATCH 07/15] refine --- releases/release-5.1.1.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 0019cee7cec6..4fd8e0fa342f 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -31,7 +31,7 @@ TiDB version: 5.1.1 + TiFlash - - Support the `HAVING()` function in DAG request + - Support the `HAVING()` function in DAG requests ## Improvements @@ -62,18 +62,18 @@ TiDB version: 5.1.1 + TiKV - - Make prewrite as idempotent as possible to reduce the chance of undetermined errors [#10586](https://github.com/tikv/tikv/pull/10586) + - Make the prewrite requests as idempotent as possible to reduce the chance of undetermined errors [#10586](https://github.com/tikv/tikv/pull/10586) - Prevent the risk of stack overflow when handling many expired commands [#10502](https://github.com/tikv/tikv/pull/10502) - - Avoid excessive commit request retrying by not updating `max_ts` with the stale read request's `start_ts` [#10451](https://github.com/tikv/tikv/pull/10451) - - Separate read write ready to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592) - - Reduce impact on data import speed with I/O rate limiting enabled [#10390](https://github.com/tikv/tikv/pull/10390) - - Improve load balance between Raft gRPC connections [#10495](https://github.com/tikv/tikv/pull/10495) + - Avoid excessive commit request retrying by not updating `max_ts` using the Stale Read request's `start_ts` [#10451](https://github.com/tikv/tikv/pull/10451) + - Handle read ready and write ready separately to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592) + - Reduce the impact on data import speed when the I/O rate limiting is enabled [#10390](https://github.com/tikv/tikv/pull/10390) + - Improve the load balance between Raft gRPC connections [#10495](https://github.com/tikv/tikv/pull/10495) + Tools + TiCDC - - Remove file sorter. [#2327](https://github.com/pingcap/ticdc/pull/2327) + - Remove `file sorter` [#2327](https://github.com/pingcap/ticdc/pull/2327) - Better err msg when PD endpoint missing certificate [#2186](https://github.com/pingcap/ticdc/pull/2186) + TiDB Lightning From 3be0199baa7a7dfc880529ed78430b6e825653fc Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 29 Jul 2021 14:14:26 +0800 Subject: [PATCH 08/15] refine tikv, pd, tools, tiflash notes --- releases/release-4.0.14.md | 2 +- releases/release-5.1.1.md | 66 +++++++++++++++++++------------------- 2 files changed, 34 insertions(+), 34 deletions(-) diff --git a/releases/release-4.0.14.md b/releases/release-4.0.14.md index 00c5ab903a32..69e680504a18 100644 --- a/releases/release-4.0.14.md +++ b/releases/release-4.0.14.md @@ -70,7 +70,7 @@ TiDB version: 4.0.14 + TiCDC - - Improve the error message returned when a PD endpoint misses the certificate [#2184](https://github.com/pingcap/ticdc/pull/2184) + - Improve the error message returned when a PD endpoint misses the certificate [#1973](https://github.com/pingcap/ticdc/issues/1973) - Make the sorter I/O errors more user-friendly [#1976](https://github.com/pingcap/ticdc/pull/1976) - Add a concurrency limit on the Region incremental scan in the KV client to reduce the pressure of TiKV [#1926](https://github.com/pingcap/ticdc/pull/1926) - Add metrics for the table memory consumption [#1884](https://github.com/pingcap/ticdc/pull/1884) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 4fd8e0fa342f..0cbbce0c653a 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -27,7 +27,7 @@ TiDB version: 5.1.1 + TiDB Dashboard - - TiDB Dashboard: Add OIDC based SSO support [#3883](https://github.com/tikv/pd/pull/3883) + - Support OIDC SSO. By setting the OIDC-compatible SSO services (such as Okta and Auth0), users can log into TiDB Dashboard without entering the SQL password. [#3883](https://github.com/tikv/pd/pull/3883) + TiFlash @@ -74,16 +74,16 @@ TiDB version: 5.1.1 + TiCDC - Remove `file sorter` [#2327](https://github.com/pingcap/ticdc/pull/2327) - - Better err msg when PD endpoint missing certificate [#2186](https://github.com/pingcap/ticdc/pull/2186) + - Improve the error message returned when a PD endpoint misses the certificate [#1973](https://github.com/pingcap/ticdc/issues/1973) + TiDB Lightning - - Add retry for restoring schemas [#1294](https://github.com/pingcap/br/pull/1294) + - Add a retry mechanism for restoring schemas [#1294](https://github.com/pingcap/br/pull/1294) + Dumpling - - Always split tables using _tidb_rowid when the upstream is a TiDB v3.x cluster, which helps reduce TiDB's memory [#308](https://github.com/pingcap/dumpling/pull/308) - - Reduce dumpling accessing database and information_schema usage and improve dumpling's stability. [#315](https://github.com/pingcap/dumpling/pull/315) + - Always split tables using `_tidb_rowid` when the upstream is a TiDB v3.x cluster, which helps reduce TiDB's memory usage [#295](https://github.com/pingcap/dumpling/issues/295) + - Reduce the frequency of accessing the database metadata to improve Dumpling's performance and stability [#315](https://github.com/pingcap/dumpling/pull/315) ## Bug fixes @@ -114,52 +114,52 @@ TiDB version: 5.1.1 + TiKV - - Fix duration calculation panics on certain platforms [#10569](https://github.com/tikv/tikv/pull/10569) - - Fix unencoded keys of `batch_get_command` in load-base-split [#10565](https://github.com/tikv/tikv/pull/10565) - - Fix online changing `resolved-ts.advance-ts-interval` can't take effect immediately [#10494](https://github.com/tikv/tikv/pull/10494) - - Fix follower meta corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486) - - Fix panic when building a snapshot twice with encryption enabled [#10464](https://github.com/tikv/tikv/pull/10464) - - Fix wrong `tikv_raftstore_hibernated_peer_state` metric [#10432](https://github.com/tikv/tikv/pull/10432) - - Fix the wrong arguments type of `json_unquote` [#10428](https://github.com/tikv/tikv/pull/10428) - - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed [#10586](https://github.com/tikv/tikv/pull/10586) - - Fix `ReadIndex` command returning stale result right after leader is transferred [#10474](https://github.com/tikv/tikv/pull/10474) + - Fix the issue that the duration calculation might panic on certain platforms [#10569](https://github.com/tikv/tikv/pull/10569) + - Fix the issue that Load Base Split mistakenly uses the unencoded keys of `batch_get_command` [#10565](https://github.com/tikv/tikv/pull/10565) + - Fix the issue that changing the `resolved-ts.advance-ts-interval` configuration online cannot take effect immediately [#10494](https://github.com/tikv/tikv/pull/10494) + - Fix the issue of follower metadata corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486) + - Fix the panic issue that occurs when building a snapshot twice if encryption is enabled [#9786](https://github.com/tikv/tikv/issues/9786) [#10407](https://github.com/tikv/tikv/issues/10407) + - Fix the wrong `tikv_raftstore_hibernated_peer_state` metric [#10432](https://github.com/tikv/tikv/pull/10432) + - Fix the wrong arguments type of the `json_unquote()` function in the coprocessor [#10176](https://github.com/tikv/tikv/issues/10176) + - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#10586](https://github.com/tikv/tikv/pull/10586) + - Fix the issue that the `ReadIndex` request returns stale result right after the leader is transferred [#10474](https://github.com/tikv/tikv/pull/10474) + PD - - Reduce the conflict due to multiple scheduler running in same time [#3857](https://github.com/tikv/pd/pull/3857) - - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3824](https://github.com/tikv/pd/pull/3824) + - Fix the issue the expected scheduling cannot be generated when the conflict occurs due to multiple schedulers running at the same time [#3857](https://github.com/tikv/pd/pull/3857) + - Fix the issue that the scheduler might appear again even if the scheduler is already deleted [#3824](https://github.com/tikv/pd/pull/3824) + TiFlash - Fix the potential panic issue that occurs when running table scan tasks - - Fix a bug that TiFlash raises error about `duplicated region` when handling DAQ request + - Fix a bug that TiFlash raises the error about `duplicated region` when handling DAQ requests - Fix the panic issue that occurs when the read load is heavy - - Fix the potential panic issue that occures when executing `DateFormat` function + - Fix the potential panic issue that occurs when executing the `DateFormat` function - Fix the potential memory leak issue that occurs when executing MPP tasks - - Fix the issue of unexpected results when executing aggregation functions `COUNT` or `COUNT DISTINCT` - - Fix a potential bug that TiFlash can not restore data when deployed on multi disks - - Fix the issue that TiDB Dashboard can not display disk information of TiFlash correctly - - Fix the potential panic issue that occures when deconstructing `SharedQueryBlockInputStream` - - Fix the potential panic issue that occures when deconstructing `MPPTask` - - Fix the potential data inconsistency after synchronizing data via snapshot + - Fix the issue of unexpected results when executing the aggregation functions `COUNT` or `COUNT DISTINCT` + - Fix a potential bug that TiFlash cannot restore data when deployed on multiple disks + - Fix the issue that TiDB Dashboard cannot display the disk information of TiFlash correctly + - Fix the potential panic issue that occurs when deconstructing `SharedQueryBlockInputStream` + - Fix the potential panic issue that occurs when deconstructing `MPPTask` + - Fix the potential issue of data inconsistency after synchronizing data via snapshot + Tools + TiCDC - - Fix support for new collation [#2306](https://github.com/pingcap/ticdc/pull/2306) - - Fix minor runtime panic risk [#2300](https://github.com/pingcap/ticdc/pull/2300) - - Fix potential DDL loss when owner crashes while executing DDL [#2290](https://github.com/pingcap/ticdc/pull/2290) - - Fix trying to resolve locks prematurely [#2266](https://github.com/pingcap/ticdc/pull/2266) - - Fix a bug that could cause data losses if a TiCDC node is killed immediately after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) - - Fix changefeed update to properly handle --sort-dir and --start-ts. [#1921](https://github.com/pingcap/ticdc/pull/1921) + - Fix the support for the new collation feature [#2301](https://github.com/pingcap/ticdc/issues/2301) + - Fix the issue that an unsynchronized access to a shared map at runtime might cause panic [#2300](https://github.com/pingcap/ticdc/pull/2300) + - Fix the potential DDL loss issue that occurs when the owner crashes while executing the DDL statement [#2290](https://github.com/pingcap/ticdc/pull/2290) + - Fix the issue of trying to resolve locks in TiDB prematurely [#2266](https://github.com/pingcap/ticdc/pull/2266) + - Fix a bug that might cause data loss if a TiCDC node is killed immediately after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) + - Fix the handling logic of `changefeed update` to `--sort-dir` and `--start-ts` [#1921](https://github.com/pingcap/ticdc/pull/1921) + Backup & Restore - - Fix incorrectly calculating the size of data to restore [#1285](https://github.com/pingcap/br/pull/1285) - - Fix missed DDL events when restoring from cdclog [#1094](https://github.com/pingcap/br/pull/1094) + - Fix the issue that the size of the data to restore is incorrectly calculated [#1285](https://github.com/pingcap/br/pull/1285) + - Fix the issue of missed DDL events that occurs when restoring from cdclog [#1094](https://github.com/pingcap/br/pull/1094) + TiDB Lightning - Fix parquet parser for decimal type [#1272](https://github.com/pingcap/br/pull/1272) - - Fix integer overflows when calculating key intervals [#1294](https://github.com/pingcap/br/pull/1294) + - Fix the issue of integer overflow when calculating key intervals [#1294](https://github.com/pingcap/br/pull/1294) From ded0b2b53d706b04338f21a859652a71612f19e3 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 29 Jul 2021 14:35:57 +0800 Subject: [PATCH 09/15] remove duplicated tidb notes --- releases/release-5.1.1.md | 10 ---------- 1 file changed, 10 deletions(-) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 0cbbce0c653a..ab255d98cd2c 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -49,16 +49,6 @@ TiDB version: 5.1.1 - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874) - Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763) - Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737) - - Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587) - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265) - - store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480) - - Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225) - - Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200) - - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194) - - mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192) - - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874) - - Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763) - - Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737) - - Add cluster information of evicted count. [#25587](https://github.com/pingcap/tidb/pull/25587) + TiKV From b36114aeb5d5457038e5e8b20d3b94ab6b5b96f1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 29 Jul 2021 18:10:49 +0800 Subject: [PATCH 10/15] review and rewrite for tidb notes --- releases/release-5.1.1.md | 87 ++++++++++++++++++++------------------- 1 file changed, 44 insertions(+), 43 deletions(-) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index ab255d98cd2c..53209608fc12 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -12,16 +12,16 @@ TiDB version: 5.1.1 + TiDB - - For users upgrading from TiDB 4.0, the value of tidb_multi_statement_mode is now OFF. It is recommended to use the multi-statement feature of your client library instead, see the documentation on tidb_multi_statement_mode for additional details. [#25751](https://github.com/pingcap/tidb/pull/25751) - - exec: access the table_storage_stats need super privilege [#26352](https://github.com/pingcap/tidb/pull/26352) - - Accessing information_schema.user_privileges will now requires the SELECT privilege on mysql.user in order to show other user's privileges. [#26311](https://github.com/pingcap/tidb/pull/26311) - - Reading from the table information_schema.cluster_hardware now requires the CONFIG privilege. - - Reading from the table information_schema.cluster_info now requires the Process privilege. - - Reading from the table information_schema.cluster_load now requires the Process privilege. - - Reading from the table information_schema.cluster_systeminfo now requires the Process privilege. - - Reading from the table information_schema.cluster_log now requires the Process privilege. [#26297](https://github.com/pingcap/tidb/pull/26297) - - Reading from the table information_schema.cluster_config now requires the CONFIG privilege. [#26150](https://github.com/pingcap/tidb/pull/26150) - - Improve the MySQL compatibility of str_to_date for %b/%M/%r/%T [#25768](https://github.com/pingcap/tidb/pull/25768) + - For TiDB clusters upgrade from v4.0 to v5.1, the default value of `tidb_multi_statement_mode` is `OFF`. It is recommended to use the multi-statement feature of your client library instead. See [the documentation on `tidb_multi_statement_mode`](/system-variables.md#tidb_multi_statement_mode-new-in-v4011) for details. [#25751](https://github.com/pingcap/tidb/pull/25751) + - Change the default value of the `tidb_stmt_summary_max_stmt_count` variable from `200` to `3000` [#25874](https://github.com/pingcap/tidb/pull/25874) + - Require the `SUPER` privilege to access the `table_storage_stats` table [#26352](https://github.com/pingcap/tidb/pull/26352) + - Require the `SELECT` privilege on `mysql.user` to access the `information_schema.user_privileges` table to show other user's privileges [#26311](https://github.com/pingcap/tidb/pull/26311) + - Require the `CONFIG` privilege to access the `information_schema.cluster_hardware` table [#26297](https://github.com/pingcap/tidb/pull/26297) + - Require the `PROCESS` privilege to access the `information_schema.cluster_info` table [#26297](https://github.com/pingcap/tidb/pull/26297) + - Require the `PROCESS` privilege to access the `information_schema.cluster_load` table [#26297](https://github.com/pingcap/tidb/pull/26297) + - Require the `PROCESS` privilege to access the `information_schema.cluster_systeminfo` table [#26297](https://github.com/pingcap/tidb/pull/26297) + - Require the `PROCESS` privilege to access the `information_schema.cluster_log` table [#26297](https://github.com/pingcap/tidb/pull/26297) + - Require the `CONFIG` privilege to access the `information_schema.cluster_config` table [#26150](https://github.com/pingcap/tidb/pull/26150) ## Feature enhancements @@ -38,17 +38,18 @@ TiDB version: 5.1.1 + TiDB - Announce the general availability (GA) of the Stale Read feature - - avoid alloc for paramMarker in buildValuesListOfInsert [#26076](https://github.com/pingcap/tidb/pull/26076) - - planner: support stable result mode [#25995](https://github.com/pingcap/tidb/pull/25995) - - Enable the pushdown of builtin function json_unquote() to TiKV. [#26265](https://github.com/pingcap/tidb/pull/26265) - - store/copr: support retry for mpp query [#26480](https://github.com/pingcap/tidb/pull/26480) - - Change the lock record into put record for the index keys using point/batch point get for update read. [#26225](https://github.com/pingcap/tidb/pull/26225) - - Forbid creating view from stale query [#26200](https://github.com/pingcap/tidb/pull/26200) - - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#26194](https://github.com/pingcap/tidb/pull/26194) - - mpp: check the tiflash availabilities before launching mpp queries. [#26192](https://github.com/pingcap/tidb/pull/26192) - - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25874](https://github.com/pingcap/tidb/pull/25874) - - Do not allow setting read timestamp to a future time. [#25763](https://github.com/pingcap/tidb/pull/25763) - - Log warnings when agg function can not be pushdown in explain statement [#25737](https://github.com/pingcap/tidb/pull/25737) + - Avoid allocation for `paramMarker` to speed up data insertion [#26076](https://github.com/pingcap/tidb/pull/26076) + - Support the stable result mode to make the query results more stable [#25995](https://github.com/pingcap/tidb/pull/25995) + - Support pushing down the built-in function `json_unquote()` to TiKV [#26265](https://github.com/pingcap/tidb/pull/26265) + - Support retrying MPP queries [#26480](https://github.com/pingcap/tidb/pull/26480) + - Change the `LOCK` record into the `PUT` record for the index keys using `point get` or `batch point get` for `UPDATE` reads [#26225](https://github.com/pingcap/tidb/pull/26225) + - Forbid creating views from stale queries [#26200](https://github.com/pingcap/tidb/pull/26200) + - Thoroughly push down the `COUNT(DISTINCT)` aggregation function in the MPP mode [#26194](https://github.com/pingcap/tidb/pull/26194) + - Check the availability of TiFlash before launching MPP queries [#26192](https://github.com/pingcap/tidb/pull/26192) + - Do not allow setting the read timestamp to a future time [#25763](https://github.com/pingcap/tidb/pull/25763) + - Print log warnings when aggregation functions cannot be pushed down in `EXPLAIN` statements [#25737](https://github.com/pingcap/tidb/pull/25737) + - Add the `statements_summary_evicted` table to record the evicted count information of a cluster [#25587](https://github.com/pingcap/tidb/pull/25587) + - Improve the MySQL compatibility of the built-in function `str_to_date` for the format specifiers `%b/%M/%r/%T` [#25768](https://github.com/pingcap/tidb/pull/25768) + TiKV @@ -79,28 +80,28 @@ TiDB version: 5.1.1 + TiDB - - amend transactions correctly when "modify column" needs reorg data with tidb_enable_amend_pessimistic_txn=on. [#26273](https://github.com/pingcap/tidb/pull/26273) - - fix incompatible last_day func behavior in sql mode [#26001](https://github.com/pingcap/tidb/pull/26001) - - Make sure limit outputs no more columns than its child [#25980](https://github.com/pingcap/tidb/pull/25980) - - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25973](https://github.com/pingcap/tidb/pull/25973) - - planner: handle other-conditions from subqueries correctly when constructing IndexJoin [#25819](https://github.com/pingcap/tidb/pull/25819) - - Fix the bug that successful optimistic transactions may report commit errors. [#25803](https://github.com/pingcap/tidb/pull/25803) - - Fix incorrect result of set type for merge join [#25695](https://github.com/pingcap/tidb/pull/25695) - - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26482](https://github.com/pingcap/tidb/pull/26482) - - planner: fix the risk of integer overflow when locating partitions [#26471](https://github.com/pingcap/tidb/pull/26471) - - ddl: fix cast date as timestamp will write invalid value [#26395](https://github.com/pingcap/tidb/pull/26395) - - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26344](https://github.com/pingcap/tidb/pull/26344) - - fix the bug of annoying logs caused by telemetry [#26284](https://github.com/pingcap/tidb/pull/26284) - - fix a bug on the query range of prefix index [#26262](https://github.com/pingcap/tidb/pull/26262) - - Fix the issue that concurrently truncating the same partition hangs DDL. [#26239](https://github.com/pingcap/tidb/pull/26239) - - planner/core: fix duplicate enum items [#26202](https://github.com/pingcap/tidb/pull/26202) - - executor: fix a bug that cte.iterOutTbl did not close correctly [#26148](https://github.com/pingcap/tidb/pull/26148) - - load: fix load data with non-utf8 can succeed [#26144](https://github.com/pingcap/tidb/pull/26144) - - fix unsigned int window function error [#26027](https://github.com/pingcap/tidb/pull/26027) - - Fix the issue that TiDB may panic when resolving async-commit locks. [#25862](https://github.com/pingcap/tidb/pull/25862) - - Make Stale Read fully support prepare statement [#25800](https://github.com/pingcap/tidb/pull/25800) - - Fix the issue that ODBC-styled literal(like {d '2020-01-01'}...) cannot be used as the expression. [#25578](https://github.com/pingcap/tidb/pull/25578) - - fix the bug about unnecessary error when run tidb only [#25555](https://github.com/pingcap/tidb/pull/25555) + - Fix the data loss issue that might occur when changing the column type with `tidb_enable_amend_pessimistic_txn=on` [#26203](https://github.com/pingcap/tidb/issues/26203) + - Fix the issue that the behavior of the `last_day` function is incompatible in the SQL mode [#26001](https://github.com/pingcap/tidb/pull/26001) + ?- Fix the panic issue that might occur when `LIMIT` is on top of window functions [#25980](https://github.com/pingcap/tidb/pull/25980) + - Fix the issue that committing pessimistic transactions might cause write-conflict issues [#25973](https://github.com/pingcap/tidb/pull/25973) + - Fix the issue that the result of index join in correlated subqueries is wrong [#25819](https://github.com/pingcap/tidb/pull/25819) + - Fix a bug that the successfully committed optimistic transactions might report commit errors [#25803](https://github.com/pingcap/tidb/pull/25803) + - Fix the issue that an incorrect result is returned when using merge join on the `SET` type column [#25669](https://github.com/pingcap/tidb/issues/25669) + - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#26482](https://github.com/pingcap/tidb/pull/26482) + - Fix the risk of integer overflow when the optimizer is locating partitions [#26471](https://github.com/pingcap/tidb/pull/26471) + - Fix the issue that invalid values might be written when casting `DATE` to timestamp [#26395](https://github.com/pingcap/tidb/pull/26395) + - Fix the issue that the Coprocessor Cache metrics are not displayed on Grafana [#26344](https://github.com/pingcap/tidb/pull/26344) + - Fix the issue of annoying logs caused by telemetry [#26284](https://github.com/pingcap/tidb/pull/26284) + - Fix a bug on the query range of prefix index [#26262](https://github.com/pingcap/tidb/pull/26262) + - Fix the issue that concurrently truncating the same partition hangs DDL executions [#26239](https://github.com/pingcap/tidb/pull/26239) + - Fix the issue of duplicate `ENUM` items [#26202](https://github.com/pingcap/tidb/pull/26202) + - Fix a bug that the CTE iterator is not correctly closed [#26148](https://github.com/pingcap/tidb/pull/26148) + - Fix the issue that the `LOAD DATA` statement can abnormally import non-utf8 data [#25979](https://github.com/pingcap/tidb/issues/25979) + - Fix the panic issue that might occur when using the window function on the unsigned integer columns [#26027](https://github.com/pingcap/tidb/pull/26027) + - Fix the issue that TiDB might panic when resolving async commit locks [#25862](https://github.com/pingcap/tidb/pull/25862) + - Fix the issue that Stale Read is not fully compatible with the `PREPARE` statements [#25800](https://github.com/pingcap/tidb/pull/25800) + - Fix the issue that the ODBC-styled constant (for example, `{d '2020-01-01'}`) cannot be used as the expression [#25531](https://github.com/pingcap/tidb/issues/25531) + - Fix an error that occurs when running TiDB alone [#25555](https://github.com/pingcap/tidb/pull/25555) + TiKV From 0a180c48148c097bf7eed224a4dac6d6cb91ddb1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 30 Jul 2021 10:24:59 +0800 Subject: [PATCH 11/15] Update release-5.1.1.md --- releases/release-5.1.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 53209608fc12..0db6d24cb3f0 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -82,7 +82,7 @@ TiDB version: 5.1.1 - Fix the data loss issue that might occur when changing the column type with `tidb_enable_amend_pessimistic_txn=on` [#26203](https://github.com/pingcap/tidb/issues/26203) - Fix the issue that the behavior of the `last_day` function is incompatible in the SQL mode [#26001](https://github.com/pingcap/tidb/pull/26001) - ?- Fix the panic issue that might occur when `LIMIT` is on top of window functions [#25980](https://github.com/pingcap/tidb/pull/25980) + - Fix the panic issue that might occur when `LIMIT` is on top of window functions [#25980](https://github.com/pingcap/tidb/pull/25980) - Fix the issue that committing pessimistic transactions might cause write-conflict issues [#25973](https://github.com/pingcap/tidb/pull/25973) - Fix the issue that the result of index join in correlated subqueries is wrong [#25819](https://github.com/pingcap/tidb/pull/25819) - Fix a bug that the successfully committed optimistic transactions might report commit errors [#25803](https://github.com/pingcap/tidb/pull/25803) From 4f29d5c31bdcb046fb48d492c252f75e2247fbd5 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 30 Jul 2021 11:00:44 +0800 Subject: [PATCH 12/15] change pr to issue --- releases/release-5.1.1.md | 42 +++++++++++++++++++-------------------- 1 file changed, 21 insertions(+), 21 deletions(-) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 0db6d24cb3f0..d400f83f256e 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -82,23 +82,23 @@ TiDB version: 5.1.1 - Fix the data loss issue that might occur when changing the column type with `tidb_enable_amend_pessimistic_txn=on` [#26203](https://github.com/pingcap/tidb/issues/26203) - Fix the issue that the behavior of the `last_day` function is incompatible in the SQL mode [#26001](https://github.com/pingcap/tidb/pull/26001) - - Fix the panic issue that might occur when `LIMIT` is on top of window functions [#25980](https://github.com/pingcap/tidb/pull/25980) - - Fix the issue that committing pessimistic transactions might cause write-conflict issues [#25973](https://github.com/pingcap/tidb/pull/25973) - - Fix the issue that the result of index join in correlated subqueries is wrong [#25819](https://github.com/pingcap/tidb/pull/25819) - - Fix a bug that the successfully committed optimistic transactions might report commit errors [#25803](https://github.com/pingcap/tidb/pull/25803) + - Fix the panic issue that might occur when `LIMIT` is on top of window functions [#25344](https://github.com/pingcap/tidb/issues/25344) + - Fix the issue that committing pessimistic transactions might cause write-conflict issues [#25964](https://github.com/pingcap/tidb/issues/25964) + - Fix the issue that the result of index join in correlated subqueries is wrong [#25799](https://github.com/pingcap/tidb/issues/25799) + - Fix a bug that the successfully committed optimistic transactions might report commit errors [#10468](https://github.com/tikv/tikv/issues/10468) - Fix the issue that an incorrect result is returned when using merge join on the `SET` type column [#25669](https://github.com/pingcap/tidb/issues/25669) - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#26482](https://github.com/pingcap/tidb/pull/26482) - - Fix the risk of integer overflow when the optimizer is locating partitions [#26471](https://github.com/pingcap/tidb/pull/26471) - - Fix the issue that invalid values might be written when casting `DATE` to timestamp [#26395](https://github.com/pingcap/tidb/pull/26395) - - Fix the issue that the Coprocessor Cache metrics are not displayed on Grafana [#26344](https://github.com/pingcap/tidb/pull/26344) - - Fix the issue of annoying logs caused by telemetry [#26284](https://github.com/pingcap/tidb/pull/26284) - - Fix a bug on the query range of prefix index [#26262](https://github.com/pingcap/tidb/pull/26262) - - Fix the issue that concurrently truncating the same partition hangs DDL executions [#26239](https://github.com/pingcap/tidb/pull/26239) - - Fix the issue of duplicate `ENUM` items [#26202](https://github.com/pingcap/tidb/pull/26202) - - Fix a bug that the CTE iterator is not correctly closed [#26148](https://github.com/pingcap/tidb/pull/26148) + - Fix the risk of integer overflow when the optimizer is locating partitions [#26227](https://github.com/pingcap/tidb/issues/26227) + - Fix the issue that invalid values might be written when casting `DATE` to timestamp [#26292](https://github.com/pingcap/tidb/issues/26292) + - Fix the issue that the Coprocessor Cache metrics are not displayed on Grafana [#26338](https://github.com/pingcap/tidb/issues/26338) + - Fix the issue of annoying logs caused by telemetry [#25760](https://github.com/pingcap/tidb/issues/25760) + - Fix a bug on the query range of prefix index [#26029](https://github.com/pingcap/tidb/issues/26029) + - Fix the issue that concurrently truncating the same partition hangs DDL executions [#26229](https://github.com/pingcap/tidb/issues/26229) + - Fix the issue of duplicate `ENUM` items [#25955](https://github.com/pingcap/tidb/issues/25955) + - Fix a bug that the CTE iterator is not correctly closed [#26112](https://github.com/pingcap/tidb/issues/26112) - Fix the issue that the `LOAD DATA` statement can abnormally import non-utf8 data [#25979](https://github.com/pingcap/tidb/issues/25979) - - Fix the panic issue that might occur when using the window function on the unsigned integer columns [#26027](https://github.com/pingcap/tidb/pull/26027) - - Fix the issue that TiDB might panic when resolving async commit locks [#25862](https://github.com/pingcap/tidb/pull/25862) + - Fix the panic issue that might occur when using the window function on the unsigned integer columns [#25956](https://github.com/pingcap/tidb/issues/25956) + - Fix the issue that TiDB might panic when resolving async commit locks [#25778](https://github.com/pingcap/tidb/issues/25778) - Fix the issue that Stale Read is not fully compatible with the `PREPARE` statements [#25800](https://github.com/pingcap/tidb/pull/25800) - Fix the issue that the ODBC-styled constant (for example, `{d '2020-01-01'}`) cannot be used as the expression [#25531](https://github.com/pingcap/tidb/issues/25531) - Fix an error that occurs when running TiDB alone [#25555](https://github.com/pingcap/tidb/pull/25555) @@ -106,19 +106,19 @@ TiDB version: 5.1.1 + TiKV - Fix the issue that the duration calculation might panic on certain platforms [#10569](https://github.com/tikv/tikv/pull/10569) - - Fix the issue that Load Base Split mistakenly uses the unencoded keys of `batch_get_command` [#10565](https://github.com/tikv/tikv/pull/10565) - - Fix the issue that changing the `resolved-ts.advance-ts-interval` configuration online cannot take effect immediately [#10494](https://github.com/tikv/tikv/pull/10494) - - Fix the issue of follower metadata corruption in rare cases with more than 4 replicas [#10486](https://github.com/tikv/tikv/pull/10486) + - Fix the issue that Load Base Split mistakenly uses the unencoded keys of `batch_get_command` [#10542](https://github.com/tikv/tikv/issues/10542) + - Fix the issue that changing the `resolved-ts.advance-ts-interval` configuration online cannot take effect immediately [#10426](https://github.com/tikv/tikv/issues/10426) + - Fix the issue of follower metadata corruption in rare cases with more than 4 replicas [#10225](https://github.com/tikv/tikv/issues/10225) - Fix the panic issue that occurs when building a snapshot twice if encryption is enabled [#9786](https://github.com/tikv/tikv/issues/9786) [#10407](https://github.com/tikv/tikv/issues/10407) - - Fix the wrong `tikv_raftstore_hibernated_peer_state` metric [#10432](https://github.com/tikv/tikv/pull/10432) + - Fix the wrong `tikv_raftstore_hibernated_peer_state` metric [#10330](https://github.com/tikv/tikv/issues/10330) - Fix the wrong arguments type of the `json_unquote()` function in the coprocessor [#10176](https://github.com/tikv/tikv/issues/10176) - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#10586](https://github.com/tikv/tikv/pull/10586) - Fix the issue that the `ReadIndex` request returns stale result right after the leader is transferred [#10474](https://github.com/tikv/tikv/pull/10474) + PD - - Fix the issue the expected scheduling cannot be generated when the conflict occurs due to multiple schedulers running at the same time [#3857](https://github.com/tikv/pd/pull/3857) - - Fix the issue that the scheduler might appear again even if the scheduler is already deleted [#3824](https://github.com/tikv/pd/pull/3824) + - Fix the issue the expected scheduling cannot be generated when the conflict occurs due to multiple schedulers running at the same time [#3807](https://github.com/tikv/pd/issues/3807) + - Fix the issue that the scheduler might appear again even if the scheduler is already deleted [#2572](https://github.com/tikv/pd/issues/2572) + TiFlash @@ -141,7 +141,7 @@ TiDB version: 5.1.1 - Fix the support for the new collation feature [#2301](https://github.com/pingcap/ticdc/issues/2301) - Fix the issue that an unsynchronized access to a shared map at runtime might cause panic [#2300](https://github.com/pingcap/ticdc/pull/2300) - Fix the potential DDL loss issue that occurs when the owner crashes while executing the DDL statement [#2290](https://github.com/pingcap/ticdc/pull/2290) - - Fix the issue of trying to resolve locks in TiDB prematurely [#2266](https://github.com/pingcap/ticdc/pull/2266) + - Fix the issue of trying to resolve locks in TiDB prematurely [#2188](https://github.com/pingcap/ticdc/issues/2188) - Fix a bug that might cause data loss if a TiCDC node is killed immediately after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) - Fix the handling logic of `changefeed update` to `--sort-dir` and `--start-ts` [#1921](https://github.com/pingcap/ticdc/pull/1921) From 1cb6661e5bcd5d90ac9850857b86e6609d4ec8fe Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 30 Jul 2021 11:02:55 +0800 Subject: [PATCH 13/15] change pr to issue --- releases/release-5.1.1.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index d400f83f256e..45d0d6622109 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -87,11 +87,11 @@ TiDB version: 5.1.1 - Fix the issue that the result of index join in correlated subqueries is wrong [#25799](https://github.com/pingcap/tidb/issues/25799) - Fix a bug that the successfully committed optimistic transactions might report commit errors [#10468](https://github.com/tikv/tikv/issues/10468) - Fix the issue that an incorrect result is returned when using merge join on the `SET` type column [#25669](https://github.com/pingcap/tidb/issues/25669) - - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#26482](https://github.com/pingcap/tidb/pull/26482) + - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#26359](https://github.com/pingcap/tidb/issues/26359) - Fix the risk of integer overflow when the optimizer is locating partitions [#26227](https://github.com/pingcap/tidb/issues/26227) - Fix the issue that invalid values might be written when casting `DATE` to timestamp [#26292](https://github.com/pingcap/tidb/issues/26292) - Fix the issue that the Coprocessor Cache metrics are not displayed on Grafana [#26338](https://github.com/pingcap/tidb/issues/26338) - - Fix the issue of annoying logs caused by telemetry [#25760](https://github.com/pingcap/tidb/issues/25760) + - Fix the issue of annoying logs caused by telemetry [#25760](https://github.com/pingcap/tidb/issues/25760) [#25785](https://github.com/pingcap/tidb/issues/25785) - Fix a bug on the query range of prefix index [#26029](https://github.com/pingcap/tidb/issues/26029) - Fix the issue that concurrently truncating the same partition hangs DDL executions [#26229](https://github.com/pingcap/tidb/issues/26229) - Fix the issue of duplicate `ENUM` items [#25955](https://github.com/pingcap/tidb/issues/25955) @@ -112,12 +112,12 @@ TiDB version: 5.1.1 - Fix the panic issue that occurs when building a snapshot twice if encryption is enabled [#9786](https://github.com/tikv/tikv/issues/9786) [#10407](https://github.com/tikv/tikv/issues/10407) - Fix the wrong `tikv_raftstore_hibernated_peer_state` metric [#10330](https://github.com/tikv/tikv/issues/10330) - Fix the wrong arguments type of the `json_unquote()` function in the coprocessor [#10176](https://github.com/tikv/tikv/issues/10176) - - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#10586](https://github.com/tikv/tikv/pull/10586) - - Fix the issue that the `ReadIndex` request returns stale result right after the leader is transferred [#10474](https://github.com/tikv/tikv/pull/10474) + - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#10468](https://github.com/tikv/tikv/issues/10468#issuecomment-869491061) + - Fix the issue that the `ReadIndex` request returns stale result right after the leader is transferred [#9351](https://github.com/tikv/tikv/issues/9351) + PD - - Fix the issue the expected scheduling cannot be generated when the conflict occurs due to multiple schedulers running at the same time [#3807](https://github.com/tikv/pd/issues/3807) + - Fix the issue the expected scheduling cannot be generated when the conflict occurs due to multiple schedulers running at the same time [#3807](https://github.com/tikv/pd/issues/3807) [#3778](https://github.com/tikv/pd/issues/3778) - Fix the issue that the scheduler might appear again even if the scheduler is already deleted [#2572](https://github.com/tikv/pd/issues/2572) + TiFlash From 46e3fcc9ce5085c9378b94ff75c60dea9067928a Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 30 Jul 2021 11:30:01 +0800 Subject: [PATCH 14/15] Update release-5.1.1.md --- releases/release-5.1.1.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 45d0d6622109..4b748e693b90 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -55,7 +55,7 @@ TiDB version: 5.1.1 - Make the prewrite requests as idempotent as possible to reduce the chance of undetermined errors [#10586](https://github.com/tikv/tikv/pull/10586) - Prevent the risk of stack overflow when handling many expired commands [#10502](https://github.com/tikv/tikv/pull/10502) - - Avoid excessive commit request retrying by not updating `max_ts` using the Stale Read request's `start_ts` [#10451](https://github.com/tikv/tikv/pull/10451) + - Avoid excessive commit request retrying by not using the Stale Read request's `start_ts` to update `max_ts` [#10451](https://github.com/tikv/tikv/pull/10451) - Handle read ready and write ready separately to reduce read latency [#10592](https://github.com/tikv/tikv/pull/10592) - Reduce the impact on data import speed when the I/O rate limiting is enabled [#10390](https://github.com/tikv/tikv/pull/10390) - Improve the load balance between Raft gRPC connections [#10495](https://github.com/tikv/tikv/pull/10495) @@ -83,7 +83,7 @@ TiDB version: 5.1.1 - Fix the data loss issue that might occur when changing the column type with `tidb_enable_amend_pessimistic_txn=on` [#26203](https://github.com/pingcap/tidb/issues/26203) - Fix the issue that the behavior of the `last_day` function is incompatible in the SQL mode [#26001](https://github.com/pingcap/tidb/pull/26001) - Fix the panic issue that might occur when `LIMIT` is on top of window functions [#25344](https://github.com/pingcap/tidb/issues/25344) - - Fix the issue that committing pessimistic transactions might cause write-conflict issues [#25964](https://github.com/pingcap/tidb/issues/25964) + - Fix the issue that committing pessimistic transactions might cause write conflict [#25964](https://github.com/pingcap/tidb/issues/25964) - Fix the issue that the result of index join in correlated subqueries is wrong [#25799](https://github.com/pingcap/tidb/issues/25799) - Fix a bug that the successfully committed optimistic transactions might report commit errors [#10468](https://github.com/tikv/tikv/issues/10468) - Fix the issue that an incorrect result is returned when using merge join on the `SET` type column [#25669](https://github.com/pingcap/tidb/issues/25669) @@ -96,7 +96,7 @@ TiDB version: 5.1.1 - Fix the issue that concurrently truncating the same partition hangs DDL executions [#26229](https://github.com/pingcap/tidb/issues/26229) - Fix the issue of duplicate `ENUM` items [#25955](https://github.com/pingcap/tidb/issues/25955) - Fix a bug that the CTE iterator is not correctly closed [#26112](https://github.com/pingcap/tidb/issues/26112) - - Fix the issue that the `LOAD DATA` statement can abnormally import non-utf8 data [#25979](https://github.com/pingcap/tidb/issues/25979) + - Fix the issue that the `LOAD DATA` statement might abnormally import non-utf8 data [#25979](https://github.com/pingcap/tidb/issues/25979) - Fix the panic issue that might occur when using the window function on the unsigned integer columns [#25956](https://github.com/pingcap/tidb/issues/25956) - Fix the issue that TiDB might panic when resolving async commit locks [#25778](https://github.com/pingcap/tidb/issues/25778) - Fix the issue that Stale Read is not fully compatible with the `PREPARE` statements [#25800](https://github.com/pingcap/tidb/pull/25800) @@ -143,14 +143,14 @@ TiDB version: 5.1.1 - Fix the potential DDL loss issue that occurs when the owner crashes while executing the DDL statement [#2290](https://github.com/pingcap/ticdc/pull/2290) - Fix the issue of trying to resolve locks in TiDB prematurely [#2188](https://github.com/pingcap/ticdc/issues/2188) - Fix a bug that might cause data loss if a TiCDC node is killed immediately after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) - - Fix the handling logic of `changefeed update` to `--sort-dir` and `--start-ts` [#1921](https://github.com/pingcap/ticdc/pull/1921) + - Fix the handling logic of `changefeed update` on `--sort-dir` and `--start-ts` [#1921](https://github.com/pingcap/ticdc/pull/1921) + Backup & Restore - - Fix the issue that the size of the data to restore is incorrectly calculated [#1285](https://github.com/pingcap/br/pull/1285) - - Fix the issue of missed DDL events that occurs when restoring from cdclog [#1094](https://github.com/pingcap/br/pull/1094) + - Fix the issue that the size of the data to restore is incorrectly calculated [#1270](https://github.com/pingcap/br/issues/1270) + - Fix the issue of missed DDL events that occurs when restoring from cdclog [#870](https://github.com/pingcap/br/issues/870) + TiDB Lightning - - Fix parquet parser for decimal type [#1272](https://github.com/pingcap/br/pull/1272) - - Fix the issue of integer overflow when calculating key intervals [#1294](https://github.com/pingcap/br/pull/1294) + - Fix the issue that TiDB fails to parse the `DECIMAL` type data in Parquet files [#1275](https://github.com/pingcap/br/pull/1275) + - Fix the issue of integer overflow when calculating key intervals [#1291](https://github.com/pingcap/br/issues/1291) [#1290](https://github.com/pingcap/br/issues/1290) From 5a331bfa1e68920a2e04aaccc18ed30ce8300ab3 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 30 Jul 2021 14:07:46 +0800 Subject: [PATCH 15/15] Apply suggestions from code review --- releases/release-5.1.1.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.1.1.md b/releases/release-5.1.1.md index 4b748e693b90..9bde0fd1acd1 100644 --- a/releases/release-5.1.1.md +++ b/releases/release-5.1.1.md @@ -8,7 +8,7 @@ Release Date: July 30, 2021 TiDB version: 5.1.1 -## Compatibility change +## Compatibility changes + TiDB @@ -145,7 +145,7 @@ TiDB version: 5.1.1 - Fix a bug that might cause data loss if a TiCDC node is killed immediately after a table migration [#2033](https://github.com/pingcap/ticdc/pull/2033) - Fix the handling logic of `changefeed update` on `--sort-dir` and `--start-ts` [#1921](https://github.com/pingcap/ticdc/pull/1921) - + Backup & Restore + + Backup & Restore (BR) - Fix the issue that the size of the data to restore is incorrectly calculated [#1270](https://github.com/pingcap/br/issues/1270) - Fix the issue of missed DDL events that occurs when restoring from cdclog [#870](https://github.com/pingcap/br/issues/870)