Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create a test with comparison vshard.call() and CRUD performance #225

Closed
ligurio opened this issue Oct 18, 2021 · 1 comment · Fixed by #251
Closed

Create a test with comparison vshard.call() and CRUD performance #225

ligurio opened this issue Oct 18, 2021 · 1 comment · Fixed by #251
Assignees
@DifferentialOrange
Labels
performance

Comments

@ligurio
Copy link
Member

ligurio commented Oct 18, 2021 •
edited
Loading

CRUD uses vshard.call() for executing CRUD operations on storage. It would be interesting to compare running, for example, SELECT and INSERT via vshard.call() and crud:select() and crud:insert(). Comparison will show us an overhead that CRUD adds to operations on storage.

The outcome of the task is a test with at least inserts and selects using vshard.call() and CRUD.
@Totktonada Totktonada mentioned this issue Oct 19, 2021
Merged
@Totktonada
Copy link
Member

NB: Consider the test case provided by Dmitry in #220. I measured PR #222 and PR #226 using it.

@Totktonada Totktonada mentioned this issue Nov 11, 2021
Open
@DifferentialOrange DifferentialOrange mentioned this issue Dec 8, 2021
Merged
3 tasks
DifferentialOrange added a commit that referenced this issue Dec 15, 2021
@DifferentialOrange
Add performance tests to compare crud and vshard
a7d26e9 
This patch reworks existing performance tests and adds new cases:
select for equal conditions for primary and secondary indexes. It also
adds corresponding vshard test cases to compare performance.
Comparison may be not exactly precise since vshard test functions use
naive mergers, but should at least estimate basic differences.

Closes #225
@DifferentialOrange DifferentialOrange mentioned this issue Dec 15, 2021
Merged
1 task
DifferentialOrange added a commit that referenced this issue Dec 17, 2021
@DifferentialOrange
Add performance tests to compare crud and vshard
d1bfdbd 
This patch reworks existing performance tests and adds new cases:
select for equal conditions for primary and secondary indexes. It also
adds corresponding vshard test cases to compare performance.
Comparison may be not exactly precise since vshard test functions use
naive mergers, but should at least estimate basic differences.

Closes #225
DifferentialOrange added a commit that referenced this issue Dec 17, 2021
@DifferentialOrange
Add performance tests to compare crud and vshard
e976a4a 
This patch reworks existing performance tests and adds new cases:
select for equal conditions for primary and secondary indexes. It also
adds corresponding vshard test cases to compare performance.
Comparison may be not exactly precise since vshard test functions use
naive mergers, but should at least estimate basic differences.

Closes #225
DifferentialOrange added a commit that referenced this issue Dec 17, 2021
@DifferentialOrange
Add performance tests to compare crud and vshard
580ba0a 
This patch reworks existing performance tests and adds new cases:
select for equal conditions for primary and secondary indexes. It also
adds corresponding vshard test cases to compare performance.
Comparison may be not exactly precise since vshard test functions use
naive mergers, but should at least estimate basic differences.

Closes #225
DifferentialOrange added a commit that referenced this issue Dec 20, 2021
@DifferentialOrange
Add performance tests to compare crud and vshard
21420dd 
This patch reworks existing performance tests and adds new cases:
select for equal conditions for primary and secondary indexes
(including #220 case). It also adds corresponding vshard test cases
to compare performance. Comparison may be not exactly precise since
vshard test functions use naive mergers, but should at least estimate
basic differences.

Closes #225
DifferentialOrange added a commit that referenced this issue Dec 20, 2021
@DifferentialOrange
Add performance tests to compare crud and vshard
10733cb 
This patch reworks existing performance tests and adds new cases:
select for equal conditions for primary and secondary indexes
(including #220 case). It also adds corresponding vshard test cases
to compare performance. Comparison may be not exactly precise since
vshard test functions use naive mergers, but should at least estimate
basic differences.

Closes #225
DifferentialOrange added a commit that referenced this issue Dec 20, 2021
@DifferentialOrange
Add performance tests to compare crud and vshard
859a624 
This patch reworks existing performance tests and adds new cases:
select for equal conditions for primary and secondary indexes
(including #220 case). It also adds corresponding vshard test cases
to compare performance. Comparison may be not exactly precise since
vshard test functions use naive mergers, but should at least estimate
basic differences.

Closes #225
@Totktonada Totktonada added the 2sp label Feb 9, 2022
DifferentialOrange added a commit that referenced this issue Feb 25, 2022
@DifferentialOrange
tests: compare crud and vshard performance
efae10e 
This patch adds new cases for performance tests: select for equal
conditions for primary and secondary indexes (including known bucket_id
case from #220), and adds corresponding vshard test cases to compare
performance. Comparison may be not exactly precise since vshard test
functions use naive mergers, but should at least estimate basic
differences.

Test run on HP ProBook 440 G7 i7/16Gb/256SSD shows that CRUD module is
4-5 times slower than vshard calls for prepared functions for select and
2 times slower for insert.

Closes #225
DifferentialOrange added a commit that referenced this issue Feb 25, 2022
@DifferentialOrange
tests: compare crud and vshard performance
920523e 
This patch adds new cases for performance tests: select for equal
conditions for primary and secondary indexes (including known bucket_id
case from #220), and adds corresponding vshard test cases to compare
performance. Comparison may be not exactly precise since vshard test
functions use naive mergers, but should at least estimate basic
differences.

Test run on HP ProBook 440 G7 i7/16Gb/256SSD shows that CRUD module is
4-8 times slower than vshard calls for prepared functions for select and
2 times slower for insert.

Closes #225
DifferentialOrange added a commit that referenced this issue Mar 4, 2022
@DifferentialOrange
tests: compare crud and vshard performance
fc249e9 
This patch adds new cases for performance tests: select for equal
conditions for primary and secondary indexes (including known bucket_id
case from #220), and adds corresponding vshard test cases to compare
performance. Comparison may be not exactly precise since vshard test
functions use naive mergers, but should at least estimate basic
differences.

Test run on HP ProBook 440 G7 i7/16Gb/256SSD shows that CRUD module is
3-6 times slower than vshard calls for prepared functions for select and
1.6 times slower for insert.

Closes #225
DifferentialOrange added a commit that referenced this issue Mar 4, 2022
@DifferentialOrange
tests: compare crud and vshard performance
3c53164 
This patch adds new cases for performance tests: select for equal
conditions for primary and secondary indexes (including known bucket_id
case from #220), and adds corresponding vshard test cases to compare
performance. Comparison may be not exactly precise since approaches to
vshard stored procedures may vary, but it should at least estimate basic
differences.

Test run on HP ProBook 440 G7 i7/16Gb/256SSD shows that CRUD module is
3-6 times slower than vshard calls for prepared functions for select and
1.6 times slower for insert.

Closes #225
DifferentialOrange added a commit that referenced this issue Mar 4, 2022
@DifferentialOrange
tests: compare crud and vshard performance
a315a67 
This patch adds new cases for performance tests: select for equal
conditions for primary and secondary indexes (including known bucket_id
case from #220), and adds corresponding vshard test cases to compare
performance. Comparison may be not exactly precise since approaches to
vshard stored procedures may vary, but it should at least estimate basic
differences.

Test run on HP ProBook 440 G7 i7/16Gb/256SSD shows that CRUD module is
3-6 times slower than vshard calls for prepared functions for select and
1.6 times slower for insert.

Closes #225
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@DifferentialOrange DifferentialOrange

Labels
performance
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add performance tests to compare crud and vshard tarantool/crud
3 participants
@Totktonada @ligurio @DifferentialOrange