Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix)(colocate join) fix wrong use of colocate join (#37361)(#37729) #37937

Merged
merged 2 commits into from
Jul 17, 2024
Merged

[fix)(colocate join) fix wrong use of colocate join (#37361)(#37729) #37937

merged 2 commits into from
Jul 17, 2024

Conversation

cambyzju
Copy link
Contributor

cherry-pick #37361 and #37729 to branch-2.0

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@cambyzju
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49894 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8be495d1a57c9a15238bfa609a2ba502afb6b56f, data reload: false

------ Round 1 ----------------------------------
q1	17708	4459	4338	4338
q2	2056	157	145	145
q3	10338	1927	1938	1927
q4	10098	1244	1326	1244
q5	8596	3905	3897	3897
q6	237	124	123	123
q7	2059	1600	1606	1600
q8	9533	2746	2750	2746
q9	13867	10308	10288	10288
q10	8631	3477	3535	3477
q11	423	235	242	235
q12	471	300	304	300
q13	18335	3978	4044	3978
q14	357	317	322	317
q15	500	457	463	457
q16	663	571	574	571
q17	1134	926	919	919
q18	7262	6905	7090	6905
q19	1785	1634	1598	1598
q20	530	295	291	291
q21	4426	4098	4099	4098
q22	533	451	440	440
Total cold run time: 119542 ms
Total hot run time: 49894 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4310	4288	4319	4288
q2	322	243	229	229
q3	4211	4163	4144	4144
q4	2771	2770	2750	2750
q5	7213	7124	7097	7097
q6	238	125	119	119
q7	3226	2836	2894	2836
q8	4343	4489	4496	4489
q9	17079	16791	16748	16748
q10	4238	4273	4279	4273
q11	762	702	693	693
q12	1024	863	876	863
q13	6695	3765	3720	3720
q14	453	437	416	416
q15	521	455	458	455
q16	755	688	693	688
q17	3906	3909	3861	3861
q18	8785	8703	8939	8703
q19	1743	1663	1718	1663
q20	2354	2128	2112	2112
q21	8517	8513	8464	8464
q22	1081	996	956	956
Total cold run time: 84547 ms
Total hot run time: 79567 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204914 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8be495d1a57c9a15238bfa609a2ba502afb6b56f, data reload: false

query1	939	429	379	379
query2	6526	3002	2744	2744
query3	6920	221	203	203
query4	21446	18044	18053	18044
query5	19734	6536	6511	6511
query6	299	221	227	221
query7	4157	305	313	305
query8	425	382	416	382
query9	3143	2701	2631	2631
query10	417	314	303	303
query11	11496	10809	10723	10723
query12	129	79	74	74
query13	5605	694	705	694
query14	17841	13250	13922	13250
query15	363	232	250	232
query16	6456	289	266	266
query17	1699	1448	871	871
query18	2315	411	411	411
query19	218	159	152	152
query20	73	78	84	78
query21	200	97	97	97
query22	5186	5153	5180	5153
query23	32578	31928	32031	31928
query24	7023	6589	6556	6556
query25	527	422	428	422
query26	528	168	164	164
query27	1905	306	305	305
query28	6093	2408	2343	2343
query29	2922	2701	2682	2682
query30	248	167	168	167
query31	906	716	739	716
query32	71	65	61	61
query33	407	271	266	266
query34	861	461	469	461
query35	1093	921	886	886
query36	1337	1406	1310	1310
query37	92	61	61	61
query38	3073	2955	2931	2931
query39	1385	1324	1329	1324
query40	211	92	94	92
query41	46	45	44	44
query42	83	81	79	79
query43	770	640	616	616
query44	1095	721	723	721
query45	246	231	233	231
query46	1247	969	989	969
query47	1807	1612	1891	1612
query48	1009	709	721	709
query49	630	379	387	379
query50	857	586	651	586
query51	4748	4666	4608	4608
query52	86	81	76	76
query53	443	327	325	325
query54	2657	2471	2450	2450
query55	103	89	77	77
query56	251	202	204	202
query57	1213	1218	1065	1065
query58	225	208	205	205
query59	4107	4079	3723	3723
query60	220	214	201	201
query61	98	95	99	95
query62	810	494	475	475
query63	490	352	345	345
query64	2628	1598	1333	1333
query65	3634	3580	3572	3572
query66	826	382	390	382
query67	15488	16741	16827	16741
query68	9164	667	670	667
query69	574	352	358	352
query70	1498	1333	1407	1333
query71	410	307	299	299
query72	6512	3497	3499	3497
query73	746	319	324	319
query74	6301	5864	5892	5864
query75	5302	3739	3623	3623
query76	5642	1137	1194	1137
query77	926	268	262	262
query78	12590	11612	11861	11612
query79	6238	657	656	656
query80	964	394	411	394
query81	502	234	243	234
query82	1526	102	98	98
query83	176	132	130	130
query84	261	72	75	72
query85	891	329	335	329
query86	339	294	290	290
query87	3240	3010	3022	3010
query88	4585	2314	2322	2314
query89	376	290	267	267
query90	1983	216	213	213
query91	180	154	157	154
query92	61	52	54	52
query93	4920	572	546	546
query94	705	211	206	206
query95	1125	1060	1057	1057
query96	642	330	328	328
query97	6442	6410	6404	6404
query98	187	175	172	172
query99	2875	868	803	803
Total cold run time: 310547 ms
Total hot run time: 204914 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.46 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8be495d1a57c9a15238bfa609a2ba502afb6b56f, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.24	0.05	0.06
query4	1.78	0.06	0.07
query5	0.54	0.52	0.52
query6	1.26	0.61	0.61
query7	0.02	0.01	0.01
query8	0.03	0.02	0.03
query9	0.52	0.46	0.48
query10	0.54	0.54	0.54
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.63	0.62	0.61
query14	0.78	0.80	0.81
query15	0.78	0.75	0.76
query16	0.35	0.36	0.37
query17	1.01	1.02	0.96
query18	0.23	0.23	0.24
query19	1.92	1.78	1.88
query20	0.01	0.01	0.02
query21	15.47	0.57	0.55
query22	2.01	1.96	1.67
query23	17.44	0.95	1.05
query24	5.26	4.68	1.79
query25	0.41	0.07	0.06
query26	1.03	0.17	0.17
query27	0.05	0.04	0.04
query28	3.65	0.78	0.73
query29	12.62	2.34	2.20
query30	0.58	0.53	0.53
query31	2.83	0.39	0.38
query32	3.35	0.50	0.50
query33	3.06	3.09	3.05
query34	15.27	4.81	4.77
query35	4.85	4.84	4.82
query36	1.06	1.01	1.02
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 100.3 s
Total hot run time: 31.46 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 8be495d1a57c9a15238bfa609a2ba502afb6b56f with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

@morrySnow morrySnow merged commit 3bb5291 into apache:branch-2.0 Jul 17, 2024
23 of 25 checks passed
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@cambyzju
[fix)(colocate join) fix wrong use of colocate join (apache#37361)(ap…
c443f97 
…ache#37729) (apache#37937)

cherry-pick from master apache#37361 apache#37729
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
area/nereids kind/test
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@cambyzju @doris-robot @morrySnow