Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tools: add mixed read-write performance evaluation scripts #13038

Merged
merged 1 commit into from
May 25, 2021

Conversation

wilsonwang371
Copy link
Contributor

@wilsonwang371 wilsonwang371 commented May 25, 2021

This is the code change mentioned in issue #13001

It consists of three parts:

  1. New benchmark command "txn-mixed". This will run a mixed load of read(txn range request) and write(txn put request) operations.
  2. rw-benchmark.sh script. This will run txn-mixed benchmark with a range of different parameters and save the output to a csv file. This script will bring up only one etcd server.
  3. Python script plot_data.py. This python script will plot the data and generate a graph. If with two input csv data files, it will also generate a column of the delta between two csv data files.

Command: ~/etcd-master/tools/rw-heatmaps/rw-benchmark.sh -w /data00/etcd-tests/
result.csv

./plot_data.py ~/result.csv -t "Main Branch Mixed R/W Performance" -o single_result.jpg
single_result

./plot_data.py ~/result.csv ~/result.csv -t "Main Branch Mixed R/W vs. Itself Performance" -o two_results.jpg
two_results

@ptabor @gyuho

@wilsonwang371 wilsonwang371 force-pushed the perf-eval branch 2 times, most recently from d10596a to 4379c6b Compare May 25, 2021 18:38
@wilsonwang371
Copy link
Contributor Author

wilsonwang371 commented May 25, 2021

two_results

Just did a small change to update the delta color map

@hexfusion
Copy link
Contributor

This is great thank you!

@gyuho gyuho merged commit 99c8b4d into etcd-io:main May 25, 2021
@wilsonwang371 wilsonwang371 deleted the perf-eval branch May 27, 2021 00:58
ivanvc added a commit to ivanvc/etcd that referenced this pull request Jan 26, 2025
Backport tools/benchmark/cmd/txn_mixed.go from commit
79b2777, pull request etcd-io#13038.

Co-authored-by: Ivan Valdes <ivan@vald.es>
Signed-off-by: Ivan Valdes <ivan@vald.es>
ivanvc added a commit to ivanvc/etcd that referenced this pull request Jan 26, 2025
Backport tools/benchmark/cmd/txn_mixed.go from commit
79b2777, pull request etcd-io#13038.

Co-authored-by: Ivan Valdes <ivan@vald.es>
Signed-off-by: Ivan Valdes <ivan@vald.es>
ivanvc added a commit to ivanvc/etcd that referenced this pull request Jan 26, 2025
Backport tools/benchmark/cmd/txn_mixed.go from commit
79b2777, pull request etcd-io#13038.

Co-authored-by: Ivan Valdes <ivan@vald.es>
Signed-off-by: Ivan Valdes <ivan@vald.es>
ivanvc added a commit to ivanvc/etcd that referenced this pull request Jan 26, 2025
Backport tools/benchmark/cmd/txn_mixed.go from commit
79b2777, pull request etcd-io#13038.

Co-authored-by: Ivan Valdes <ivan@vald.es>
Signed-off-by: Ivan Valdes <ivan@vald.es>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants