Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[chore](profile) Enable profile by default #41481

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

zhiqiang-hhhh
Copy link
Contributor

@zhiqiang-hhhh zhiqiang-hhhh commented Sep 29, 2024

Last step of #33744

Before GC:
image
After GC:
image

GC duration:
image

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41233 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 168d9f5ffe30eebbf32de73e9a5f15e98ac1204b, data reload: false

------ Round 1 ----------------------------------
q1	17611	7534	7337	7337
q2	2019	281	279	279
q3	12128	1113	1190	1113
q4	10548	794	714	714
q5	7755	2915	2908	2908
q6	241	156	152	152
q7	1008	648	635	635
q8	9378	1920	2027	1920
q9	6599	6420	6437	6420
q10	6954	2332	2306	2306
q11	465	249	250	249
q12	432	220	224	220
q13	17779	3053	2961	2961
q14	247	208	211	208
q15	586	531	518	518
q16	655	590	583	583
q17	995	535	498	498
q18	7293	6790	6737	6737
q19	1361	983	1037	983
q20	507	207	209	207
q21	4037	3320	3660	3320
q22	1100	965	1000	965
Total cold run time: 109698 ms
Total hot run time: 41233 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7321	7282	7256	7256
q2	331	231	228	228
q3	3087	2959	2977	2959
q4	2089	1816	1774	1774
q5	5805	5753	5721	5721
q6	231	150	151	150
q7	2305	1866	1806	1806
q8	3393	3516	3468	3468
q9	9018	8906	8881	8881
q10	3622	3580	3571	3571
q11	595	494	500	494
q12	862	629	591	591
q13	11544	3211	3184	3184
q14	306	275	278	275
q15	584	534	539	534
q16	702	641	633	633
q17	1872	1610	1606	1606
q18	8329	7794	7450	7450
q19	1752	1474	1453	1453
q20	2151	1863	1859	1859
q21	5570	5440	5325	5325
q22	1173	1004	1076	1004
Total cold run time: 72642 ms
Total hot run time: 60222 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192586 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 168d9f5ffe30eebbf32de73e9a5f15e98ac1204b, data reload: false

query1	870	430	428	428
query2	6241	2119	1979	1979
query3	8683	192	213	192
query4	33512	23602	23532	23532
query5	3934	489	483	483
query6	291	179	177	177
query7	4210	307	306	306
query8	293	246	243	243
query9	9333	2694	2680	2680
query10	462	290	302	290
query11	17767	15288	15241	15241
query12	164	110	100	100
query13	1581	473	447	447
query14	10548	7402	7748	7402
query15	290	175	182	175
query16	7835	506	513	506
query17	1723	599	582	582
query18	2243	358	308	308
query19	351	157	149	149
query20	122	116	118	116
query21	219	115	107	107
query22	4892	4742	4718	4718
query23	34630	34421	33978	33978
query24	9986	2808	2791	2791
query25	571	394	385	385
query26	722	157	179	157
query27	2000	302	297	297
query28	6466	2414	2395	2395
query29	721	432	410	410
query30	257	152	159	152
query31	1042	788	820	788
query32	99	52	54	52
query33	626	319	290	290
query34	960	503	524	503
query35	829	720	740	720
query36	1123	922	973	922
query37	150	92	87	87
query38	4013	3894	3902	3894
query39	1483	1463	1424	1424
query40	203	96	97	96
query41	66	43	45	43
query42	120	96	97	96
query43	540	488	475	475
query44	1147	806	805	805
query45	197	166	164	164
query46	1169	722	729	722
query47	1965	1868	1845	1845
query48	434	341	343	341
query49	867	405	399	399
query50	844	420	420	420
query51	7163	6988	6958	6958
query52	98	88	88	88
query53	251	180	179	179
query54	875	466	452	452
query55	82	74	75	74
query56	288	264	264	264
query57	1249	1136	1165	1136
query58	251	239	235	235
query59	3207	2955	2872	2872
query60	300	265	274	265
query61	108	104	104	104
query62	823	668	676	668
query63	218	187	186	186
query64	3566	641	611	611
query65	3350	3203	3163	3163
query66	729	302	313	302
query67	15776	15589	15569	15569
query68	4367	607	563	563
query69	518	300	294	294
query70	1207	1109	1135	1109
query71	353	267	286	267
query72	7157	4246	4044	4044
query73	793	357	350	350
query74	9522	9005	8945	8945
query75	3524	2681	2672	2672
query76	3166	919	937	919
query77	605	298	294	294
query78	10527	9660	9537	9537
query79	3655	613	585	585
query80	2389	470	505	470
query81	597	244	246	244
query82	694	144	142	142
query83	294	141	149	141
query84	282	78	75	75
query85	1260	302	303	302
query86	375	304	265	265
query87	4566	4371	4430	4371
query88	4393	2448	2436	2436
query89	414	289	302	289
query90	1852	194	192	192
query91	163	113	111	111
query92	64	49	49	49
query93	2725	549	552	549
query94	760	301	297	297
query95	348	260	248	248
query96	652	291	286	286
query97	3298	3107	3159	3107
query98	216	201	196	196
query99	1567	1317	1299	1299
Total cold run time: 299431 ms
Total hot run time: 192586 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.7 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 168d9f5ffe30eebbf32de73e9a5f15e98ac1204b, data reload: false

query1	0.05	0.04	0.05
query2	0.07	0.02	0.03
query3	0.25	0.09	0.07
query4	1.60	0.10	0.10
query5	0.50	0.51	0.51
query6	1.13	0.73	0.72
query7	0.02	0.01	0.02
query8	0.03	0.03	0.02
query9	0.60	0.49	0.50
query10	0.54	0.58	0.56
query11	0.14	0.11	0.10
query12	0.13	0.12	0.11
query13	0.61	0.60	0.59
query14	2.81	2.84	2.77
query15	0.89	0.83	0.83
query16	0.41	0.39	0.39
query17	0.99	0.97	1.02
query18	0.20	0.20	0.19
query19	1.98	1.86	1.96
query20	0.01	0.01	0.01
query21	15.36	0.59	0.57
query22	2.50	2.38	2.04
query23	16.92	1.07	0.88
query24	3.51	1.42	0.59
query25	0.11	0.05	0.18
query26	0.63	0.15	0.14
query27	0.05	0.04	0.04
query28	10.33	1.11	1.10
query29	12.54	3.28	3.29
query30	0.25	0.06	0.06
query31	2.88	0.38	0.39
query32	3.26	0.46	0.47
query33	2.97	3.04	3.02
query34	17.01	4.46	4.51
query35	4.48	4.54	4.48
query36	0.68	0.50	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.02	0.02
Total cold run time: 106.91 s
Total hot run time: 32.7 s

@zhiqiang-hhhh zhiqiang-hhhh marked this pull request as ready for review September 30, 2024 00:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants