From 5219b3ee52f3494ce850cef70d01df6d13439de0 Mon Sep 17 00:00:00 2001 From: shichun-0415 Date: Wed, 12 Oct 2022 10:56:25 +0800 Subject: [PATCH] backup: change the location for s3-multi-part-size --- tikv-configuration-file.md | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/tikv-configuration-file.md b/tikv-configuration-file.md index dd9370e3efc7b..6dc25f545e4dc 100644 --- a/tikv-configuration-file.md +++ b/tikv-configuration-file.md @@ -1616,6 +1616,16 @@ Configuration items related to BR backup. + Controls whether to limit the resources used by backup tasks to reduce the impact on the cluster when the cluster resource utilization is high. For more information, refer to [BR Auto-Tune](/br/br-auto-tune.md). + Default value: `true` +### `s3-multi-part-size` New in v5.3.2 + +> **Note:** +> +> This configuration is introduced to address backup failures caused by S3 rate limiting. This problem has been fixed by [refining the backup data storage structure](/br/backup-and-restore-design.md#backup-file-structure). Therefore, this configuration is deprecated from v6.1.1 and is no longer recommended. + ++ The part size used when you perform multipart upload to S3 during backup. You can adjust the value of this configuration to control the number of requests sent to S3. ++ If data is backed up to S3 and the backup file is larger than the value of this configuration item, [multipart upload](https://docs.aws.amazon.com/AmazonS3/latest/API/API_UploadPart.html) is automatically enabled. Based on the compression ratio, the backup file generated by a 96-MiB Region is approximately 10 MiB to 30 MiB. ++ Default value: 5MiB + ## log-backup Configuration items related to log backup. @@ -1845,13 +1855,3 @@ To reduce write latency and avoid frequent access to PD, TiKV periodically fetch + TiKV adjusts the number of cached timestamps according to the timestamp consumption in the previous period. If the usage of locally cached timestamps is low, TiKV gradually reduces the number of cached timestamps until it reaches `renew-batch-min-size`. If large bursty write traffic often occurs in your application, you can set this parameter to a larger value as appropriate. Note that this parameter is the cache size for a single tikv-server. If you set the parameter to too large a value and the cluster contains many tikv-servers, the TSO consumption will be too fast. + In the **TiKV-RAW** \> **Causal timestamp** panel in Grafana, **TSO batch size** is the number of locally cached timestamps that has been dynamically adjusted according to the application workload. You can refer to this metric to adjust `renew-batch-min-size`. + Default value: `100` - -### `s3-multi-part-size` New in v5.3.2 - -> **Note:** -> -> This configuration is introduced to address backup failures caused by S3 rate limiting. This problem has been fixed by [refining the backup data storage structure](/br/backup-and-restore-design.md#backup-file-structure). Therefore, this configuration is deprecated from v6.1.1 and is no longer recommended. - -+ The part size used when you perform multipart upload to S3 during backup. You can adjust the value of this configuration to control the number of requests sent to S3. -+ If data is backed up to S3 and the backup file is larger than the value of this configuration item, [multipart upload](https://docs.aws.amazon.com/AmazonS3/latest/API/API_UploadPart.html) is automatically enabled. Based on the compression ratio, the backup file generated by a 96-MiB Region is approximately 10 MiB to 30 MiB. -+ Default value: 5MiB