Skip to content

Commit 9fc6094

Browse files
CaitinChenCaitinChen
authored
benchmark: add TPC-H benchmark result (#443)
* benchmark: create tpch document via pingcap/docs-cn#698 * benchmark: update test result via pingcap/docs-cn@0878112 * Update tpch.md * Add files via upload * Update tpch.md * Update tpch.md * Update tpch.md * Update tpch.md * Update tpch.md * Update tpch.md * Update tpch.md * Update tpch.md * Update tpch.md * Update tpch.md
1 parent b856216 commit 9fc6094

File tree

2 files changed

+106
-0
lines changed

2 files changed

+106
-0
lines changed

‎benchmark/tpch.md‎

Lines changed: 106 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,106 @@
1+
---
2+
title: TiDB TPC-H 50G Performance Test Report V2.0
3+
category: benchmark
4+
---
5+
6+
# TiDB TPC-H 50G Performance Test Report
7+
8+
## Test purpose
9+
10+
This test aims to compare the performances of TiDB 1.0 and TiDB 2.0 in the OLAP scenario.
11+
12+
> **Note**: Different test environments might lead to different test results.
13+
14+
## Test environment
15+
16+
### Machine information
17+
18+
System information:
19+
20+
| Machine IP | Operation system | Kernel version | File system type |
21+
|--------------|------------------------|------------------------------|--------------|
22+
| 172.16.31.2 | Ubuntu 17.10 64bit | 4.13.0-16-generic | ext4 |
23+
| 172.16.31.3 | Ubuntu 17.10 64bit | 4.13.0-16-generic | ext4 |
24+
| 172.16.31.4 | Ubuntu 17.10 64bit | 4.13.0-16-generic | ext4 |
25+
| 172.16.31.6 | CentOS 7.4.1708 64bit | 3.10.0-693.11.6.el7.x86\_64 | ext4 |
26+
| 172.16.31.8 | CentOS 7.4.1708 64bit | 3.10.0-693.11.6.el7.x86\_64 | ext4 |
27+
| 172.16.31.10 | CentOS 7.4.1708 64bit | 3.10.0-693.11.6.el7.x86\_64 | ext4 |
28+
29+
Hardware information:
30+
31+
| Type | Name |
32+
|------------|------------------------------------------------------|
33+
| CPU | 40 vCPUs, Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz |
34+
| RAM | 128GB, 16GB RDIMM * 8, 2400MT/s, dual channel, x8 bitwidth |
35+
| DISK | Intel P4500 4T SSD * 2 |
36+
| Network Card | 10 Gigabit Ethernet |
37+
38+
### TPC-H
39+
40+
[tidb-bench/tpch](https://github.com/pingcap/tidb-bench/tree/master/tpch)
41+
42+
### Cluster topology
43+
44+
| Machine IP | Deployment Instance |
45+
|--------------|---------------------|
46+
| 172.16.31.2 | TiKV \* 2 |
47+
| 172.16.31.3 | TiKV \* 2 |
48+
| 172.16.31.6 | TiKV \* 2 |
49+
| 172.16.31.8 | TiKV \* 2 |
50+
| 172.16.31.10 | TiKV \* 2 |
51+
| 172.16.31.10 | PD \* 1 |
52+
| 172.16.31.4 | TiDB \* 1 |
53+
54+
### Corresponding TiDB version information
55+
56+
TiDB 1.0:
57+
58+
| Component | Version | Commit Hash |
59+
|--------|-------------|--------------------------------------------|
60+
| TiDB | v1.0.9 | 4c7ee3580cd0a69319b2c0c08abdc59900df7344 |
61+
| TiKV | v1.0.8 | 2bb923a4cd23dbf68f0d16169fd526dc5c1a9f4a |
62+
| PD | v1.0.8 | 137fa734472a76c509fbfd9cb9bc6d0dc804a3b7 |
63+
64+
TiDB 2.0:
65+
66+
| Component | Version | Commit Hash |
67+
|--------|-------------|--------------------------------------------|
68+
| TiDB | v2.0.0-rc.6 | 82d35f1b7f9047c478f4e1e82aa0002abc8107e7 |
69+
| TiKV | v2.0.0-rc.6 | 8bd5c54966c6ef42578a27519bce4915c5b0c81f |
70+
| PD | v2.0.0-rc.6 | 9b824d288126173a61ce7d51a71fc4cb12360201 |
71+
72+
## Test result
73+
74+
| Query ID | TiDB 2.0 | TiDB 1.0 |
75+
|-----------|--------------------|------------------|
76+
| 1 | 33.915s | 215.305s |
77+
| 2 | 25.575s | Nan |
78+
| 3 | 59.631s | 196.003s |
79+
| 4 | 30.234s | 249.919s |
80+
| 5 | 31.666s | OOM |
81+
| 6 | 13.111s | 118.709s |
82+
| 7 | 31.710s | OOM |
83+
| 8 | 31.734s | 800.546s |
84+
| 9 | 34.211s | 630.639s |
85+
| 10 | 30.774s | 133.547s |
86+
| 11 | 27.692s | 78.026s |
87+
| 12 | 27.962s | 124.641s |
88+
| 13 | 27.676s | 174.695s |
89+
| 14 | 19.676s | 110.602s |
90+
| 15 | NaN | Nan |
91+
| 16 | 24.890s | 40.529s |
92+
| 17 | 245.796s | NaN |
93+
| 18 | 91.256s | OOM |
94+
| 19 | 37.615s | NaN |
95+
| 20 | 44.167s | 212.201s |
96+
| 21 | 31.466s | OOM |
97+
| 22 | 31.539s | 125.471s |
98+
99+
![TPC-H Query Result](../media/tpch-query-result.png)
100+
101+
It should be notified that:
102+
103+
- In the diagram above, the orange bars represent the query result of Release 1.0 and the blue bars represent the query rersult of Release 2.0. The ordinate represents the processing time of queries, the shorter the better.
104+
- Query 15 is tagged with "NaN" because VIEW is not supported in both TiDB 1.0 and 2.0 releases.
105+
- Queries 2, 17, and 19 in the TiDB 1.0 column are tagged with "NaN" because TiDB 1.0 does not return a result for long.
106+
- Queries 5, 7, 18, and 21 in the TiDB 1.0 column are tagged with "OOM" because the memory consumption is too high and tidb-server is killed by oom-killer.

‎media/tpch-query-result.png‎

243 KB
Loading

0 commit comments

Comments
 (0)