Skip to content

Commit

Permalink
import: increase default region-split-size to 512 MiB (tikv#4347)
Browse files Browse the repository at this point in the history
This makes the SST size to upload larger, which reduces the number of SST
files needed to ingested, and improve overall speed.

Signed-off-by: kennytm <kennytm@gmail.com>
  • Loading branch information
kennytm authored and Connor1996 committed Mar 12, 2019
1 parent 2f4d23a commit 54c7f71
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 3 deletions.
2 changes: 1 addition & 1 deletion etc/tikv-importer.toml
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ num-import-jobs = 24
# maximum duration to prepare regions.
# max-prepare-duration = "5m"
# split regions into this size according to the importing data.
# region-split-size = "96MB"
# region-split-size = "512MB"
# stream channel window size, stream will be blocked on channel full.
# stream-channel-window = 128
# maximum number of open engines
Expand Down
3 changes: 1 addition & 2 deletions src/import/config.rs
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,6 @@
use std::error::Error;
use std::result::Result;

use crate::raftstore::coprocessor::config::SPLIT_SIZE_MB;
use crate::util::config::{ReadableDuration, ReadableSize};

#[derive(Clone, Serialize, Deserialize, PartialEq, Debug)]
Expand All @@ -39,7 +38,7 @@ impl Default for Config {
num_import_jobs: 8,
num_import_sst_jobs: 2,
max_prepare_duration: ReadableDuration::minutes(5),
region_split_size: ReadableSize::mb(SPLIT_SIZE_MB),
region_split_size: ReadableSize::mb(512),
stream_channel_window: 128,
max_open_engines: 8,
}
Expand Down

0 comments on commit 54c7f71

Please sign in to comment.