Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[cherry-pick](branch-3.0)add SessionVariable for enableCooldownReplicaAffinity #42677

Merged
merged 4 commits into from
Nov 7, 2024
Merged

[cherry-pick](branch-3.0)add SessionVariable for enableCooldownReplicaAffinity #42677

merged 4 commits into from
Nov 7, 2024

Conversation

cjj2010
Copy link
Contributor

@cjj2010 cjj2010 commented Oct 29, 2024

pick from master :#41741

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@cjj2010
Copy link
Contributor Author

cjj2010 commented Oct 29, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40419 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 984f71ab96848da987e49a3b3c821fdff9255bf8, data reload: false

------ Round 1 ----------------------------------
q1	17571	7313	7231	7231
q2	2038	275	280	275
q3	12358	1026	1073	1026
q4	10558	755	790	755
q5	7743	2810	2756	2756
q6	230	150	147	147
q7	974	599	603	599
q8	9568	1882	1945	1882
q9	7887	6423	6327	6327
q10	6948	2263	2284	2263
q11	433	255	246	246
q12	390	209	207	207
q13	17771	2941	2993	2941
q14	238	205	207	205
q15	555	510	513	510
q16	676	603	607	603
q17	949	550	588	550
q18	7155	6611	6504	6504
q19	1375	1127	1035	1035
q20	475	201	192	192
q21	3881	3218	3188	3188
q22	1060	997	977	977
Total cold run time: 110833 ms
Total hot run time: 40419 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7274	7207	7221	7207
q2	323	233	224	224
q3	2967	2888	2851	2851
q4	2059	1771	1681	1681
q5	5643	5684	5653	5653
q6	215	145	149	145
q7	2161	1785	1732	1732
q8	3334	3493	3335	3335
q9	8835	8861	8776	8776
q10	3559	3807	3494	3494
q11	579	480	468	468
q12	813	614	605	605
q13	16075	3127	3160	3127
q14	312	301	266	266
q15	551	520	542	520
q16	708	682	668	668
q17	1827	1590	1585	1585
q18	8154	7732	7473	7473
q19	7067	1560	1394	1394
q20	2073	1878	1811	1811
q21	5385	5273	5215	5215
q22	1122	1044	1017	1017
Total cold run time: 81036 ms
Total hot run time: 59247 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190102 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 984f71ab96848da987e49a3b3c821fdff9255bf8, data reload: false

query1	884	400	430	400
query2	6265	2178	2060	2060
query3	8694	210	211	210
query4	33884	23946	23295	23295
query5	3793	453	428	428
query6	275	172	176	172
query7	4190	313	311	311
query8	298	245	234	234
query9	9404	2681	2654	2654
query10	448	258	265	258
query11	18103	15433	15184	15184
query12	147	100	102	100
query13	1518	430	399	399
query14	9793	7297	7220	7220
query15	229	174	179	174
query16	7726	523	516	516
query17	1499	594	561	561
query18	1868	322	320	320
query19	202	161	155	155
query20	120	113	124	113
query21	204	114	113	113
query22	4866	4627	4317	4317
query23	34549	36358	33621	33621
query24	12056	2852	2896	2852
query25	524	411	407	407
query26	1063	167	176	167
query27	2665	304	295	295
query28	7839	2489	2458	2458
query29	675	447	437	437
query30	268	155	159	155
query31	1037	792	799	792
query32	96	57	58	57
query33	770	282	307	282
query34	958	497	501	497
query35	854	735	727	727
query36	1103	942	948	942
query37	202	77	73	73
query38	4080	3869	3737	3737
query39	1522	1429	1429	1429
query40	273	100	105	100
query41	53	50	52	50
query42	111	99	100	99
query43	536	485	501	485
query44	1227	776	775	775
query45	186	169	167	167
query46	1127	733	754	733
query47	1877	1781	1790	1781
query48	439	363	374	363
query49	1063	421	400	400
query50	802	409	414	409
query51	6944	7027	6943	6943
query52	109	89	91	89
query53	267	188	194	188
query54	1129	449	444	444
query55	79	76	78	76
query56	259	249	261	249
query57	1185	1098	1118	1098
query58	238	231	218	218
query59	3233	2951	2967	2951
query60	298	271	262	262
query61	135	98	98	98
query62	860	648	653	648
query63	221	187	185	185
query64	4870	614	590	590
query65	3255	3138	3175	3138
query66	1254	328	304	304
query67	15820	15237	15280	15237
query68	5722	538	558	538
query69	428	257	266	257
query70	1189	1174	1148	1148
query71	459	258	263	258
query72	5791	3957	3935	3935
query73	754	339	344	339
query74	10379	9000	8886	8886
query75	3483	2611	2574	2574
query76	3424	925	1016	925
query77	415	270	280	270
query78	10658	9806	9412	9412
query79	7809	600	592	592
query80	2358	425	433	425
query81	588	251	265	251
query82	1210	123	117	117
query83	266	146	142	142
query84	293	79	74	74
query85	2359	297	284	284
query86	501	291	303	291
query87	4626	4204	4227	4204
query88	5818	2384	2402	2384
query89	554	294	292	292
query90	2203	185	186	185
query91	179	138	143	138
query92	67	51	46	46
query93	7172	531	537	531
query94	1064	297	270	270
query95	358	254	263	254
query96	621	277	278	277
query97	3338	3131	3108	3108
query98	216	207	204	204
query99	1646	1340	1289	1289
Total cold run time: 318469 ms
Total hot run time: 190102 ms

@cjj2010 cjj2010 mentioned this pull request Oct 30, 2024
Merged
6 tasks
morningman pushed a commit to apache/doris-website that referenced this pull request Nov 5, 2024
@cjj2010
[doc](cooldown)add enable_cooldown_replica_affinity config (#1245)
1b30789 
# Versions 

- [x] dev
- [x] 3.0
- [x] 2.1
- [x] 2.0

# Languages

- [x] Chinese
- [x] English
 cherry-pick apache/doris#42683;
apache/doris#42677;
apache/doris#42675
@cjj2010
Merge remote-tracking branch 'origin/branch-3.0' into sessionvar_4_co…
e7de6a5 
…oldown_3.0

# Conflicts:
#	fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java
@cjj2010
Copy link
Contributor Author

cjj2010 commented Nov 7, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40448 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e7de6a51b25029807f88367de2b11b7acf14a190, data reload: false

------ Round 1 ----------------------------------
q1	17570	7350	7256	7256
q2	2062	161	185	161
q3	10643	1048	1112	1048
q4	10564	750	809	750
q5	7730	2788	2780	2780
q6	235	148	143	143
q7	978	634	612	612
q8	9605	1952	1994	1952
q9	7942	6393	6352	6352
q10	6957	2247	2306	2247
q11	455	275	268	268
q12	401	206	205	205
q13	17766	2976	2943	2943
q14	240	219	226	219
q15	542	509	515	509
q16	661	606	602	602
q17	961	595	583	583
q18	7202	6598	6592	6592
q19	1368	993	936	936
q20	484	200	204	200
q21	3878	3172	3134	3134
q22	1076	991	956	956
Total cold run time: 109320 ms
Total hot run time: 40448 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7277	7218	7213	7213
q2	415	297	294	294
q3	2864	2809	2851	2809
q4	1991	1794	1767	1767
q5	5645	5675	5665	5665
q6	235	135	139	135
q7	2174	1763	1763	1763
q8	3306	3517	3465	3465
q9	8739	8820	8799	8799
q10	3527	3497	3470	3470
q11	590	492	498	492
q12	772	600	600	600
q13	16355	3254	3107	3107
q14	296	279	261	261
q15	582	543	543	543
q16	683	669	674	669
q17	1835	1612	1603	1603
q18	8258	7632	7535	7535
q19	6659	1768	1462	1462
q20	2057	1866	1826	1826
q21	5511	5276	5250	5250
q22	1101	991	1010	991
Total cold run time: 80872 ms
Total hot run time: 59719 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192575 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e7de6a51b25029807f88367de2b11b7acf14a190, data reload: false

query1	2446	2265	2251	2251
query2	6212	2105	2027	2027
query3	14424	7667	240	240
query4	33168	23358	23378	23358
query5	4724	450	426	426
query6	282	187	182	182
query7	3983	309	305	305
query8	292	233	230	230
query9	9341	2656	2647	2647
query10	495	272	263	263
query11	18031	15137	15159	15137
query12	151	102	102	102
query13	1550	427	418	418
query14	9624	7201	7305	7201
query15	234	189	182	182
query16	8018	500	520	500
query17	1408	594	570	570
query18	2404	633	646	633
query19	262	185	178	178
query20	116	117	114	114
query21	207	111	103	103
query22	4784	4519	3983	3983
query23	35265	33666	33604	33604
query24	11748	3363	3355	3355
query25	612	384	380	380
query26	1151	179	181	179
query27	2327	293	293	293
query28	7652	2467	2455	2455
query29	821	422	416	416
query30	384	298	300	298
query31	1001	785	778	778
query32	89	51	53	51
query33	768	270	270	270
query34	978	499	502	499
query35	833	719	708	708
query36	1101	945	916	916
query37	128	72	70	70
query38	3908	3904	3763	3763
query39	1491	1404	1418	1404
query40	194	96	95	95
query41	50	48	46	46
query42	106	95	97	95
query43	510	502	486	486
query44	1290	786	788	786
query45	179	162	160	160
query46	1122	738	706	706
query47	1891	1821	1803	1803
query48	456	366	360	360
query49	898	397	406	397
query50	823	421	411	411
query51	7163	7041	6992	6992
query52	108	88	91	88
query53	264	183	187	183
query54	1293	462	447	447
query55	77	80	78	78
query56	261	259	250	250
query57	1223	1097	1084	1084
query58	232	211	228	211
query59	3104	2868	2806	2806
query60	285	262	260	260
query61	147	124	131	124
query62	818	658	656	656
query63	213	187	187	187
query64	4119	682	678	678
query65	3241	3165	3207	3165
query66	744	317	305	305
query67	15981	15517	15316	15316
query68	4433	578	588	578
query69	421	264	261	261
query70	1192	1121	1108	1108
query71	353	288	265	265
query72	6405	3879	4092	3879
query73	755	340	340	340
query74	9948	8855	8963	8855
query75	3287	2614	2567	2567
query76	2663	990	999	990
query77	402	272	266	266
query78	10787	9689	9431	9431
query79	8819	601	605	601
query80	2640	432	420	420
query81	595	238	239	238
query82	1678	113	112	112
query83	266	162	155	155
query84	293	71	76	71
query85	2297	298	276	276
query86	502	311	293	293
query87	4426	4285	4176	4176
query88	5819	2392	2394	2392
query89	565	301	291	291
query90	2246	186	190	186
query91	174	142	144	142
query92	68	49	49	49
query93	7550	556	548	548
query94	1122	286	297	286
query95	352	258	249	249
query96	614	284	287	284
query97	3362	3150	3123	3123
query98	210	194	191	191
query99	1709	1309	1288	1288
Total cold run time: 325158 ms
Total hot run time: 192575 ms

@dataroaring dataroaring merged commit b4df680 into apache:branch-3.0 Nov 7, 2024
21 of 23 checks passed
@gavinchou gavinchou mentioned this pull request Nov 26, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
kind/behavior-changed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@cjj2010 @doris-robot @dataroaring