forked from tikv/tikv
-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Manually merge raftstore-proxy-6.0-try into raftstore-proxy #69
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…kv#11216) * wip Signed-off-by: pingyu <yuping@pingcap.com> * wip Signed-off-by: pingyu <yuping@pingcap.com> * ref tikv#10974: Add API V2 check for RawKV and TxnKV requests (txn) Signed-off-by: pingyu <yuping@pingcap.com> * ref tikv#10974: Add API V2 check for RawKV and TxnKV requests (txn) Signed-off-by: pingyu <yuping@pingcap.com> * ref tikv#10974: Add API V2 check for RawKV and TxnKV requests (txn) Signed-off-by: pingyu <yuping@pingcap.com> * ref tikv#10974: Add API V2 check for RawKV and TxnKV requests (txn) Signed-off-by: pingyu <yuping@pingcap.com> * ref tikv#10974: Add API V2 check for RawKV and TxnKV requests (txn) Signed-off-by: pingyu <yuping@pingcap.com> * ref tikv#10974: Add API V2 check for RawKV and TxnKV requests (txn) Signed-off-by: pingyu <yuping@pingcap.com> * fix enable_ttl Signed-off-by: andylokandy <andylokandy@hotmail.com> * simplify test Signed-off-by: andylokandy <andylokandy@hotmail.com> * ref tikv#10974: Add API V2 check for RawKV and TxnKV requests (txn) Signed-off-by: pingyu <yuping@pingcap.com> Co-authored-by: andylokandy <andylokandy@hotmail.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Signed-off-by: qupeng <qupeng@pingcap.com>
* close tikv#11642 Signed-off-by: qupeng <qupeng@pingcap.com> * a more comment Signed-off-by: qupeng <qupeng@pingcap.com>
* ctl: split into multiple modules ref tikv#10938 Signed-off-by: andylokandy <andylokandy@hotmail.com> * refactor if let to match Signed-off-by: andylokandy <andylokandy@hotmail.com> * address comment Signed-off-by: andylokandy <andylokandy@hotmail.com> * address comment Signed-off-by: andylokandy <andylokandy@hotmail.com> * address comment Signed-off-by: andylokandy <andylokandy@hotmail.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
* close tikv#11676 Signed-off-by: devillove084 <786537003@qq.com>
* Deprecation is planned for MIN,MAX,EPSLION,INFINITY,NEG_INFINITY of the (i|u|f)(8|16|32|64) types in standard. ref tikv#11678 ```release-note NONE ``` Signed-off-by: Harold Dost <harolddost@gmail.com>
Signed-off-by: zhangjinpeng1987 <zhangjinpeng@pingcap.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
close tikv#11690 Signed-off-by: mornyx <mornyx.z@gmail.com>
* file_system: support collect the read flow by proc Signed-off-by: MuZhou233 <muzhou233@outlook.com> * fix lint Signed-off-by: MuZhou233 <muzhou233@outlook.com> * fix clippy Signed-off-by: MuZhou233 <muzhou233@outlook.com> * Delete unused content & Adjust copyright text Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Add bench_fetch_io_bytes Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * fix lint Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Integrate thread_io Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * record bytes in request Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * fix logical bug Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Update test write_bytes Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Delete unused & Rename func Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Add test for read & Update test for write Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Add buffered thread io Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Replace DashMap with ThreadLocal Signed-off-by: MuZhou233 <muzhou233@outlook.com> * Rename variables and function & Remove unused call Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Change fetch logic. close tikv#10867 Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Add AtomicIOBytes Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Split ThreadIOSentinel Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * add THREAD_IO_TOTAL for metrics bytes fetcher Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * Adjust code style & fix Signed-off-by: MuZhou233 <MuZhou233@outlook.com> * improve write_bytes test Signed-off-by: MuZhou233 <muzhou233@outlook.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
…ocks (tikv#11591) ref tikv#11452 Signed-off-by: Yilin Chen <sticnarf@gmail.com>
* add datasink trait Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * RAII removes on_reporter_closing Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * fmt Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * fix build ref tikv#11691 Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * datasink -> data_sink Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * fmt Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * fix build Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
* clippy: Fixing up clippy errors. * Fix crate references * Fix anonymous lifetimes references. ref tikv#4301 Signed-off-by: Harold Dost <harolddost@gmail.com> * Test Revert of Iterations ref tikv#4301 Signed-off-by: Harold Dost <harolddost@gmail.com> * clippy: Enable check for rust-2018-idioms ref tikv#4301 Signed-off-by: Harold Dost <harolddost@gmail.com>
ref tikv#11691 Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Signed-off-by: linning <linningde25@gmail.com>
* Use generic for api version to reduce runtime branching ref tikv#10938 Signed-off-by: andylokandy <andylokandy@hotmail.com> * fix test Signed-off-by: andylokandy <andylokandy@hotmail.com> * add test Signed-off-by: andylokandy <andylokandy@hotmail.com> * fix clippy Signed-off-by: andylokandy <andylokandy@hotmail.com> * address comment Signed-off-by: andylokandy <andylokandy@hotmail.com> * fmt Signed-off-by: andylokandy <andylokandy@hotmail.com> * address comment Signed-off-by: andylokandy <andylokandy@hotmail.com> * address comment Signed-off-by: andylokandy <andylokandy@hotmail.com> * rename vars Signed-off-by: andylokandy <andylokandy@hotmail.com> * improve vars Signed-off-by: andylokandy <andylokandy@hotmail.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
* sst_importer: check api version when importing ref tikv#10938 Signed-off-by: Peng Guanwen <pg999w@outlook.com> * Fix bugs Signed-off-by: Peng Guanwen <pg999w@outlook.com> * fix bug of Iterator::{scan,scan_cf} Signed-off-by: Peng Guanwen <pg999w@outlook.com> * remove redundant log Signed-off-by: Peng Guanwen <pg999w@outlook.com> * Show the entire key Signed-off-by: Peng Guanwen <pg999w@outlook.com> * Fix lint issue Signed-off-by: Peng Guanwen <pg999w@outlook.com> * resolve conflict Signed-off-by: andylokandy <andylokandy@hotmail.com> Co-authored-by: Andy Lok <andylokandy@hotmail.com>
* br: sperate io and scan threads Signed-off-by: Yu Juncen <yu745514916@live.com> * br/stream: make clippy happy Signed-off-by: yujuncen <yujuncen@pingcap.com> * br/stream: fix tests Signed-off-by: Yu Juncen <yu745514916@live.com> * backup: fix a dummy bug Signed-off-by: Yu Juncen <yu745514916@live.com> * backup: add config of io-threads Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: ref tikv#11350: some minior change Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: added some metrics Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: better tuning concurrency, and added a metric Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: added some slow log and metrics Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: address comments Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: fix build Signed-off-by: yujuncen <yujuncen@pingcap.com> * Revert "backup: fix build" This reverts commit 74537be. Signed-off-by: yujuncen <yujuncen@pingcap.com> * Revert "backup: address comments" This reverts commit 77d7575. Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: address comments Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: always set IO type to Export Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup:make clippy happy Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: address comments Signed-off-by: yujuncen <yujuncen@pingcap.com>
ref tikv#11662 Signed-off-by: Ryan Leung <rleungx@gmail.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
* Update kvproto Signed-off-by: Peng Guanwen <pg999w@outlook.com> * Return api-version for br ref tikv#10938 Signed-off-by: Peng Guanwen <pg999w@outlook.com> * Reformat code Signed-off-by: Peng Guanwen <pg999w@outlook.com> * Update components/external_storage/export/src/export.rs Signed-off-by: Peng Guanwen <pg999w@outlook.com> Co-authored-by: Andy Lok <andylokandy@hotmail.com> * format code Signed-off-by: Peng Guanwen <pg999w@outlook.com> Co-authored-by: Andy Lok <andylokandy@hotmail.com>
* limit thread_io target os Signed-off-by: MuZhou233 <muzhou233@outlook.com> * limit thread_io target os. typo. close tikv#11698 Signed-off-by: MuZhou233 <muzhou233@outlook.com> Co-authored-by: Yilin Chen <sticnarf@gmail.com>
Close tikv#10688 Patch fs2 to https://github.com/tabokie/fs2-rs/tree/tikv. In which, `posix_fallocate` is replaced with `fallocate` (danburkert/fs2-rs#42). * bypass file allocate implementation in fs2 Signed-off-by: tabokie <xy.tao@outlook.com>
Minimum legend isn't very useful, and it occupied valuable visual real estate. Remove some min legends from Grafana metrics, except for the following: - Level 0 chance - Number files at each level - File Count - Entry Count - Allocator Stats - Encrypted files - Encryption meta files size Ref tikv#11119 Signed-off-by: tabokie <xy.tao@outlook.com>
…ation (tikv#11708) * not return rows when there is no input for simple aggregation Signed-off-by: xufei <xufeixw@mail.ustc.edu.cn> * close tikv#11735, and address comments Signed-off-by: xufei <xufeixw@mail.ustc.edu.cn>
…ne by default (tikv#11699) * backup: clamp auto tune values Signed-off-by: yujuncen <yujuncen@pingcap.com> * ref tikv#11000: change the default backup threads. Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: run tasks in background Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: run rustfmt Signed-off-by: yujuncen <yujuncen@pingcap.com> * backup: set remain threads to 20% of vcpu Signed-off-by: yujuncen <yujuncen@pingcap.com> * br-stream: fix build Signed-off-by: yujuncen <yujuncen@pingcap.com>
* s3: add request metrics for s3 storage Signed-off-by: 3pointer <luancheng@pingcap.com> * s3: add grafana json Signed-off-by: 3pointer <luancheng@pingcap.com> * br: add config for s3 multi part upload Signed-off-by: 3pointer <luancheng@pingcap.com> * update comment Signed-off-by: 3pointer <luancheng@pingcap.com> * update comment Signed-off-by: 3pointer <luancheng@pingcap.com> * address comment Signed-off-by: 3pointer <luancheng@pingcap.com> * hidden the new config Signed-off-by: 3pointer <luancheng@pingcap.com> * only hidden config in config-template.toml Signed-off-by: 3pointer <luancheng@pingcap.com> * address comment Signed-off-by: 3pointer <luancheng@pingcap.com> * close tikv#11727 && format Signed-off-by: 3pointer <luancheng@pingcap.com> * fix Signed-off-by: 3pointer <luancheng@pingcap.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
* rsmeter: support multiple datasinks Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * wrap config notifier Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * add unit tests Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * polish ref tikv#11691 Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * address comments Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * fix test Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> * fix outdated comments Signed-off-by: Zhenchi <zhongzc_arch@outlook.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
* properly estimate store size, ref tikv#11119 Signed-off-by: tabokie <xy.tao@outlook.com> * address comments Signed-off-by: tabokie <xy.tao@outlook.com>
* implement global config client close tikv#11686 Signed-off-by: lemonhx <lemonhx@lemonhx.tech> * implement unit test for global config in pd client Signed-off-by: lemonhx <lemonhx@lemonhx.tech> * resolved formatting issues Signed-off-by: lemonhx <lemonhx@lemonhx.tech> * impl pd client asyncly Signed-off-by: lemonhx <lemonhx@lemonhx.tech> * according to reviewer's opinion removing store method implementation Signed-off-by: lemonhx <lemonhx@lemonhx.tech> * Merge branch 'master' of https://github.com/tikv/tikv into global_conf Signed-off-by: lemonhx <lemonhx@lemonhx.tech> * write test case for watch global config when grpc server is closed. Signed-off-by: lemonhx <lemonhx@lemonhx.tech> * resove issues Signed-off-by: lemonhx <lemonhx@lemonhx.tech> * clippy Signed-off-by: lemonhx <lemonhx@lemonhx.tech> * watch global config rentry future in test deadlock just removed Signed-off-by: lemonhx <lemonhx@lemonhx.tech> Co-authored-by: Zhenchi <zhongzc_arch@outlook.com>
* skip scanning lock when using rc, ref tikv#11485 Signed-off-by: you06 <you1474600@gmail.com> * format code Signed-off-by: you06 <you1474600@gmail.com> * add test Signed-off-by: you06 <you1474600@gmail.com> * address comment Signed-off-by: you06 <you1474600@gmail.com> * add an integration test Signed-off-by: you06 <you1474600@gmail.com> * format code Signed-off-by: you06 <you1474600@gmail.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
* corp: pushdown substring to tikv Signed-off-by: guo-shaoge <shaoge1994@163.com> * fix case. close tikv#11495 Signed-off-by: guo-shaoge <shaoge1994@163.com> * fix comment Signed-off-by: guo-shaoge <shaoge1994@163.com>
…kv#12315) close tikv#12278, ref tikv#12309 Fix test_delegate_subscribe_unsubscribe flaking test. Use the corresponding id, otherwise there will be failures due to concurrent runs of the test. (We will assign downstream ids concurrently). Signed-off-by: ti-srebot <ti-srebot@pingcap.com> Co-authored-by: 二手掉包工程师 <rustin.liu@gmail.com> Co-authored-by: qupeng <qupeng@pingcap.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Signed-off-by: CalvinNeo <calvinneo1995@gmail.com>
Signed-off-by: CalvinNeo <calvinneo1995@gmail.com>
Signed-off-by: CalvinNeo <calvinneo1995@gmail.com>
Signed-off-by: Wish <breezewish@outlook.com>
…raftstore-proxy-6.0-try
Signed-off-by: mornyx <mornyx.z@gmail.com>
…g on ARM (pingcap#61) Signed-off-by: mornyx <mornyx.z@gmail.com>
Signed-off-by: CalvinNeo <calvinneo1995@gmail.com>
close tikv#11379, close tikv#11598, close tikv#12107 when memory usage is high water, add flow control on the append log entries. disable log entry cache evict functions. Signed-off-by: tier-cap <zhengxiaojin@pingcap.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io> Signed-off-by: CalvinNeo <calvinneo1995@gmail.com>
…ine-ext into raftstore-proxy-6.0-try
Signed-off-by: CalvinNeo <calvinneo1995@gmail.com>
close tikv#6107, ref tikv#10483 Signed-off-by: Connor1996 <zbk602423539@gmail.com>
…kv#12364) ref tikv#10483 Force leader is rejected on a peer who is already a leader. For the hibernated leader, it doesn't step down to follower when quorum is missing due to not ticking election. So wait ticks in force leader process for hibernated peers to make sure election ticking is performed. Signed-off-by: Connor1996 <zbk602423539@gmail.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
… ref tikv#10483 (tikv#12308) ref tikv#10483 Signed-off-by: v01dstar <yang.zhang@pingcap.com>
Signed-off-by: Connor1996 <zbk602423539@gmail.com>
* raftstore: Introduce force leader state (tikv#11932) close tikv#6107, ref tikv#10483 Signed-off-by: Connor1996 <zbk602423539@gmail.com> * raftstore: Wait ticks for hibernated peer when doing force leader (tikv#12364) ref tikv#10483 Force leader is rejected on a peer who is already a leader. For the hibernated leader, it doesn't step down to follower when quorum is missing due to not ticking election. So wait ticks in force leader process for hibernated peers to make sure election ticking is performed. Signed-off-by: Connor1996 <zbk602423539@gmail.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io> * raftstore: Make unsafe recovery wait apply cover snapshot apply cases ref tikv#10483 (tikv#12308) ref tikv#10483 Signed-off-by: v01dstar <yang.zhang@pingcap.com> * raftstore: Execute recovery plan via raft (tikv#12022) Signed-off-by: Connor1996 <zbk602423539@gmail.com> Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io> Co-authored-by: Yang Zhang <yang.zhang@pingcap.com>
Signed-off-by: mornyx <mornyx.z@gmail.com>
Signed-off-by: CalvinNeo <calvinneo1995@gmail.com>
|
breezewish
approved these changes
May 27, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What problem does this PR solve?
Issue Number: close #xxx
Problem Summary:
What is changed and how it works?
Check List
Tests
Side effects
Documentation
Release note