From e5d7c9f0f948d578683a59b0d21cb31bd3a6570c Mon Sep 17 00:00:00 2001 From: Ti Chi Robot Date: Wed, 12 Oct 2022 21:55:51 +0800 Subject: [PATCH] backup: change the location for s3-multi-part-size (#10786) (#10791) --- tikv-configuration-file.md | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/tikv-configuration-file.md b/tikv-configuration-file.md index d009b96c001be..a56f35c961215 100644 --- a/tikv-configuration-file.md +++ b/tikv-configuration-file.md @@ -1417,6 +1417,16 @@ Configuration items related to BR backup. + Default value: `MIN(CPU * 0.75, 32)`. + Minimum value: `1` +### `s3-multi-part-size` New in v5.3.2 + +> **Note:** +> +> This configuration is introduced to address backup failures caused by S3 rate limiting. This problem has been fixed by [refining the backup data storage structure](https://docs.pingcap.com/tidb/stable/backup-and-restore-design#backup-file-structure). Therefore, this configuration is deprecated from v6.1.1 and is no longer recommended. + ++ The part size used when you perform multipart upload to S3 during backup. You can adjust the value of this configuration to control the number of requests sent to S3. ++ If data is backed up to S3 and the backup file is larger than the value of this configuration item, [multipart upload](https://docs.aws.amazon.com/AmazonS3/latest/API/API_UploadPart.html) is automatically enabled. Based on the compression ratio, the backup file generated by a 96-MiB Region is approximately 10 MiB to 30 MiB. ++ Default value: 5MiB + ## cdc Configuration items related to TiCDC. @@ -1490,13 +1500,3 @@ For pessimistic transaction usage, refer to [TiDB Pessimistic Transaction Mode]( - This configuration item enables the pipelined process of adding the pessimistic lock. With this feature enabled, after detecting that data can be locked, TiKV immediately notifies TiDB to execute the subsequent requests and write the pessimistic lock asynchronously, which reduces most of the latency and significantly improves the performance of pessimistic transactions. But there is a still low probability that the asynchronous write of the pessimistic lock fails, which might cause the failure of pessimistic transaction commits. - Default value: `true` - -### `s3-multi-part-size` New in v5.3.2 - -> **Note:** -> -> This configuration is introduced to address backup failures caused by S3 rate limiting. This problem has been fixed by [refining the backup data storage structure](https://docs.pingcap.com/tidb/stable/backup-and-restore-design#backup-file-structure). Therefore, this configuration is deprecated from v6.1.1 and is no longer recommended. - -+ The part size used when you perform multipart upload to S3 during backup. You can adjust the value of this configuration to control the number of requests sent to S3. -+ If data is backed up to S3 and the backup file is larger than the value of this configuration item, [multipart upload](https://docs.aws.amazon.com/AmazonS3/latest/API/API_UploadPart.html) is automatically enabled. Based on the compression ratio, the backup file generated by a 96-MiB Region is approximately 10 MiB to 30 MiB. -+ Default value: 5MiB