[Enhancement](audit log) Add print audit log sesssion variable #38419

Yukang-Lian · 2024-07-26T09:53:15Z

Proposed changes

For the insert into statements during group commit load via JDBC. Printing audit logs can severely impact performance. Therefore, we have introduced a session variable to control whether to print audit logs. It is recommended to turn off audit logs only during group commit load via JDBC.

enable_prepared_stmt_audit_log=false

doris-robot · 2024-07-26T09:53:19Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Yukang-Lian · 2024-07-26T09:53:23Z

run buildall

doris-robot · 2024-07-26T10:24:04Z

TPC-H: Total hot run time: 39606 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5474a47492c314a589b84e59fe7db6384ab2ba10, data reload: false

------ Round 1 ----------------------------------
q1	17918	5381	4411	4411
q2	2228	206	191	191
q3	10451	1229	1124	1124
q4	10142	768	746	746
q5	7622	2718	2711	2711
q6	223	139	137	137
q7	957	596	597	596
q8	9213	1940	1915	1915
q9	8807	6524	6543	6524
q10	8703	3797	3817	3797
q11	443	249	249	249
q12	385	225	222	222
q13	18812	2995	2999	2995
q14	268	246	246	246
q15	526	480	494	480
q16	481	392	386	386
q17	966	708	781	708
q18	8211	7527	7383	7383
q19	6819	1048	1007	1007
q20	681	336	333	333
q21	4976	3923	3159	3159
q22	354	288	286	286
Total cold run time: 119186 ms
Total hot run time: 39606 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4454	4323	4249	4249
q2	387	263	260	260
q3	3020	2748	2726	2726
q4	1842	1569	1563	1563
q5	5299	5303	5297	5297
q6	221	129	131	129
q7	2133	1709	1731	1709
q8	3193	3356	3318	3318
q9	8456	8387	8422	8387
q10	3908	3629	3653	3629
q11	592	490	489	489
q12	783	609	590	590
q13	17234	2996	2951	2951
q14	309	268	271	268
q15	514	475	479	475
q16	458	413	420	413
q17	1766	1510	1490	1490
q18	7614	7390	7321	7321
q19	1690	1506	1588	1506
q20	2008	1766	1780	1766
q21	4918	4691	4594	4594
q22	581	529	485	485
Total cold run time: 71380 ms
Total hot run time: 53615 ms

doris-robot · 2024-07-26T10:35:17Z

TPC-DS: Total hot run time: 171242 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5474a47492c314a589b84e59fe7db6384ab2ba10, data reload: false

query1	928	386	368	368
query2	6458	2032	1839	1839
query3	6652	205	213	205
query4	27749	17578	17448	17448
query5	4204	502	472	472
query6	292	170	166	166
query7	4523	285	292	285
query8	243	207	197	197
query9	8165	2469	2454	2454
query10	429	296	273	273
query11	12609	10064	10131	10064
query12	134	91	86	86
query13	1547	385	364	364
query14	10187	6969	6861	6861
query15	226	167	165	165
query16	7698	490	465	465
query17	1373	561	537	537
query18	1948	281	277	277
query19	192	141	141	141
query20	88	84	80	80
query21	215	96	98	96
query22	4452	4037	4022	4022
query23	33949	33135	34835	33135
query24	12247	2931	2856	2856
query25	515	370	373	370
query26	1125	146	148	146
query27	2961	273	277	273
query28	7671	2016	1993	1993
query29	644	410	426	410
query30	286	148	148	148
query31	961	733	739	733
query32	91	51	54	51
query33	762	321	331	321
query34	861	470	475	470
query35	848	731	726	726
query36	1078	912	913	912
query37	212	79	79	79
query38	2845	2744	2772	2744
query39	866	820	807	807
query40	266	112	112	112
query41	46	48	45	45
query42	122	96	98	96
query43	498	465	463	463
query44	1201	724	719	719
query45	206	177	179	177
query46	1105	742	721	721
query47	1849	1762	1751	1751
query48	359	290	295	290
query49	1190	426	435	426
query50	799	405	396	396
query51	6892	6722	6672	6672
query52	94	88	90	88
query53	253	181	180	180
query54	798	449	444	444
query55	78	73	74	73
query56	296	271	285	271
query57	1179	1015	1055	1015
query58	277	260	269	260
query59	2898	2802	2561	2561
query60	309	319	287	287
query61	96	93	96	93
query62	814	628	661	628
query63	216	186	181	181
query64	10420	2257	1723	1723
query65	3158	3080	3105	3080
query66	1209	338	343	338
query67	15670	14745	14939	14745
query68	4873	529	546	529
query69	444	305	297	297
query70	1165	1117	1068	1068
query71	457	264	260	260
query72	6737	6004	5328	5328
query73	775	328	328	328
query74	6038	5778	5661	5661
query75	3918	2689	2624	2624
query76	2808	939	932	932
query77	573	303	303	303
query78	9563	10319	8893	8893
query79	2443	527	511	511
query80	1853	486	486	486
query81	569	216	214	214
query82	891	133	141	133
query83	286	176	172	172
query84	274	140	78	78
query85	2019	316	301	301
query86	495	302	277	277
query87	3270	3076	3067	3067
query88	4448	2486	2466	2466
query89	390	279	284	279
query90	1985	192	197	192
query91	127	101	101	101
query92	67	48	49	48
query93	2818	521	533	521
query94	1056	294	298	294
query95	347	262	261	261
query96	612	273	272	272
query97	3180	3027	2997	2997
query98	225	197	199	197
query99	1681	1278	1297	1278
Total cold run time: 286919 ms
Total hot run time: 171242 ms

doris-robot · 2024-07-26T10:40:48Z

ClickBench: Total hot run time: 30.6 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5474a47492c314a589b84e59fe7db6384ab2ba10, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.22	0.06	0.05
query4	1.67	0.10	0.08
query5	0.50	0.47	0.47
query6	1.13	0.72	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.49	0.49
query10	0.54	0.55	0.53
query11	0.15	0.11	0.12
query12	0.15	0.12	0.12
query13	0.60	0.60	0.59
query14	0.75	0.78	0.77
query15	0.86	0.80	0.83
query16	0.37	0.34	0.36
query17	1.00	0.98	0.97
query18	0.24	0.22	0.22
query19	1.77	1.66	1.67
query20	0.01	0.01	0.01
query21	15.42	0.76	0.65
query22	3.72	7.65	1.87
query23	18.30	1.39	1.25
query24	2.13	0.23	0.22
query25	0.16	0.09	0.09
query26	0.30	0.22	0.21
query27	0.46	0.25	0.22
query28	13.26	1.02	1.01
query29	12.57	3.30	3.28
query30	0.26	0.05	0.06
query31	2.86	0.38	0.39
query32	3.26	0.48	0.48
query33	2.90	2.95	3.01
query34	17.14	4.33	4.34
query35	4.40	4.48	4.50
query36	0.65	0.50	0.48
query37	0.18	0.17	0.16
query38	0.16	0.15	0.15
query39	0.04	0.03	0.04
query40	0.15	0.13	0.12
query41	0.09	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.2 s
Total hot run time: 30.6 s

Yukang-Lian · 2024-07-29T05:10:17Z

run buildall

Yukang-Lian · 2024-07-29T05:12:51Z

run buildall

doris-robot · 2024-07-29T05:55:03Z

TPC-H: Total hot run time: 41486 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 404c727eb24bf98c1f2a040b576a8778b21dd134, data reload: false

------ Round 1 ----------------------------------
q1	17622	4064	4211	4064
q2	2019	203	207	203
q3	10451	1309	1333	1309
q4	10171	857	954	857
q5	7655	2898	2955	2898
q6	216	136	139	136
q7	1021	609	609	609
q8	9426	1862	1937	1862
q9	8493	6589	6565	6565
q10	8696	3799	3838	3799
q11	437	262	255	255
q12	410	231	229	229
q13	17755	2966	2947	2947
q14	270	242	245	242
q15	522	476	470	470
q16	519	390	389	389
q17	957	901	882	882
q18	8026	7311	7244	7244
q19	1861	1160	1202	1160
q20	557	343	321	321
q21	5317	4822	4762	4762
q22	359	283	300	283
Total cold run time: 112760 ms
Total hot run time: 41486 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4040	3995	4005	3995
q2	330	226	223	223
q3	2969	3007	3135	3007
q4	1980	2003	1983	1983
q5	5578	5458	5421	5421
q6	218	133	135	133
q7	2132	1770	1828	1770
q8	3312	3376	3381	3376
q9	8697	8666	8772	8666
q10	4000	4040	3985	3985
q11	536	457	454	454
q12	768	588	640	588
q13	16380	3148	3149	3148
q14	300	287	273	273
q15	529	507	492	492
q16	456	433	429	429
q17	1749	1722	1691	1691
q18	8310	7791	7594	7594
q19	1974	1706	1696	1696
q20	2062	1897	1816	1816
q21	5760	5562	5465	5465
q22	505	465	459	459
Total cold run time: 72585 ms
Total hot run time: 56664 ms

doris-robot · 2024-07-29T06:05:52Z

TPC-DS: Total hot run time: 170695 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 404c727eb24bf98c1f2a040b576a8778b21dd134, data reload: false

query1	917	369	365	365
query2	6475	1674	1709	1674
query3	6655	209	220	209
query4	20118	17419	17400	17400
query5	3678	508	504	504
query6	285	166	162	162
query7	4590	287	292	287
query8	258	197	188	188
query9	8515	2404	2378	2378
query10	441	275	263	263
query11	10528	10033	10125	10033
query12	117	91	90	90
query13	1657	377	360	360
query14	9629	8233	7795	7795
query15	207	164	161	161
query16	6766	471	484	471
query17	940	540	533	533
query18	1887	278	295	278
query19	191	147	139	139
query20	89	85	86	85
query21	206	113	99	99
query22	4136	4129	4052	4052
query23	33827	33873	33578	33578
query24	10400	3110	3135	3110
query25	694	453	398	398
query26	1716	156	148	148
query27	2992	291	297	291
query28	7311	2056	2014	2014
query29	1262	430	427	427
query30	235	152	155	152
query31	960	749	755	749
query32	101	56	57	56
query33	685	325	334	325
query34	950	496	513	496
query35	863	771	777	771
query36	1057	873	927	873
query37	278	79	82	79
query38	2891	2795	2758	2758
query39	859	793	838	793
query40	253	112	109	109
query41	45	44	43	43
query42	113	105	102	102
query43	475	435	432	432
query44	1175	715	716	715
query45	207	173	172	172
query46	1095	814	808	808
query47	1789	1769	1692	1692
query48	375	290	299	290
query49	952	426	424	424
query50	912	424	439	424
query51	6730	6718	6690	6690
query52	105	89	91	89
query53	259	178	172	172
query54	625	467	456	456
query55	79	73	72	72
query56	278	248	261	248
query57	1160	1046	1053	1046
query58	265	259	264	259
query59	2759	2387	2337	2337
query60	294	285	311	285
query61	100	100	100	100
query62	891	643	668	643
query63	209	178	178	178
query64	5690	1920	1889	1889
query65	3332	3112	3083	3083
query66	1317	327	328	327
query67	15471	14835	14786	14786
query68	6010	575	587	575
query69	727	391	314	314
query70	1164	1085	1009	1009
query71	462	279	276	276
query72	8249	2738	2533	2533
query73	922	330	331	330
query74	6093	5611	5649	5611
query75	3660	2730	2695	2695
query76	3303	1365	1399	1365
query77	565	305	300	300
query78	9415	8922	8882	8882
query79	2348	535	583	535
query80	1279	505	498	498
query81	538	228	228	228
query82	779	133	141	133
query83	192	167	171	167
query84	263	80	89	80
query85	1346	308	311	308
query86	466	321	327	321
query87	3255	3127	3089	3089
query88	3646	2483	2477	2477
query89	390	294	285	285
query90	1783	193	187	187
query91	129	102	101	101
query92	58	50	51	50
query93	2079	619	616	616
query94	757	296	273	273
query95	383	273	274	273
query96	595	338	280	280
query97	3224	3029	3046	3029
query98	238	198	202	198
query99	1657	1296	1262	1262
Total cold run time: 268296 ms
Total hot run time: 170695 ms

doris-robot · 2024-07-29T06:11:22Z

ClickBench: Total hot run time: 30.14 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 404c727eb24bf98c1f2a040b576a8778b21dd134, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.05
query3	0.22	0.04	0.04
query4	1.69	0.08	0.07
query5	0.50	0.49	0.49
query6	1.13	0.72	0.72
query7	0.02	0.01	0.01
query8	0.06	0.04	0.05
query9	0.58	0.51	0.51
query10	0.57	0.56	0.56
query11	0.16	0.12	0.13
query12	0.16	0.13	0.12
query13	0.61	0.60	0.59
query14	0.78	0.80	0.80
query15	0.91	0.86	0.87
query16	0.35	0.35	0.35
query17	0.99	1.02	1.00
query18	0.22	0.22	0.21
query19	1.85	1.75	1.75
query20	0.02	0.01	0.01
query21	15.38	0.77	0.65
query22	3.72	7.83	1.40
query23	17.97	1.23	1.26
query24	2.28	0.22	0.21
query25	0.19	0.08	0.08
query26	0.31	0.22	0.21
query27	0.46	0.24	0.23
query28	13.15	0.99	0.95
query29	12.56	3.36	3.32
query30	0.26	0.06	0.05
query31	2.87	0.41	0.40
query32	3.25	0.50	0.49
query33	2.92	2.94	2.96
query34	15.42	4.25	4.26
query35	4.30	4.31	4.32
query36	0.67	0.49	0.48
query37	0.19	0.16	0.16
query38	0.16	0.16	0.15
query39	0.04	0.04	0.04
query40	0.16	0.14	0.14
query41	0.10	0.04	0.04
query42	0.05	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 107.4 s
Total hot run time: 30.14 s

Yukang-Lian · 2024-07-29T06:15:31Z

run buildall

doris-robot · 2024-07-29T06:32:55Z

TPC-H: Total hot run time: 41625 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c9ea6aaf9dca357b0c66d5b4c0d0367ebeedbdd2, data reload: false

------ Round 1 ----------------------------------
q1	18196	4233	4133	4133
q2	2343	210	215	210
q3	11456	1271	1351	1271
q4	10314	832	961	832
q5	8138	2952	3028	2952
q6	225	136	138	136
q7	1059	614	625	614
q8	9431	1791	1940	1791
q9	8477	6640	6597	6597
q10	8685	3818	3816	3816
q11	418	252	248	248
q12	410	220	217	217
q13	17772	2942	2935	2935
q14	278	249	244	244
q15	518	487	496	487
q16	482	396	385	385
q17	961	915	950	915
q18	8004	7328	7244	7244
q19	1387	1202	1202	1202
q20	563	326	328	326
q21	5302	4811	4783	4783
q22	350	287	295	287
Total cold run time: 114769 ms
Total hot run time: 41625 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4032	4021	3983	3983
q2	329	226	223	223
q3	2990	3000	2995	2995
q4	1870	1869	1856	1856
q5	5228	5232	5249	5232
q6	219	129	128	128
q7	2089	1690	1727	1690
q8	3217	3294	3253	3253
q9	8351	8315	8326	8315
q10	3711	3853	3828	3828
q11	534	456	450	450
q12	718	581	537	537
q13	14316	2958	2974	2958
q14	281	254	256	254
q15	507	479	473	473
q16	450	398	399	398
q17	1753	1708	1661	1661
q18	7629	7438	7265	7265
q19	1653	1671	1674	1671
q20	1960	1754	1756	1754
q21	5436	5063	5234	5063
q22	518	458	491	458
Total cold run time: 67791 ms
Total hot run time: 54445 ms

github-actions · 2024-07-29T06:43:20Z

PR approved by anyone and no changes requested.

doris-robot · 2024-07-29T06:43:34Z

TPC-DS: Total hot run time: 169106 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c9ea6aaf9dca357b0c66d5b4c0d0367ebeedbdd2, data reload: false

query1	913	377	363	363
query2	6491	1743	1707	1707
query3	6667	210	220	210
query4	20125	17415	17397	17397
query5	4326	522	523	522
query6	306	191	175	175
query7	4623	292	313	292
query8	258	201	194	194
query9	8492	2394	2386	2386
query10	437	305	278	278
query11	10571	10174	10020	10020
query12	141	93	92	92
query13	1645	385	368	368
query14	9651	8492	6922	6922
query15	233	165	160	160
query16	7094	440	440	440
query17	934	579	549	549
query18	1905	283	280	280
query19	206	141	139	139
query20	88	86	82	82
query21	201	103	107	103
query22	4395	4065	4007	4007
query23	33153	32958	33053	32958
query24	10333	3072	3008	3008
query25	695	379	378	378
query26	1745	149	145	145
query27	2925	277	274	274
query28	6933	1981	1968	1968
query29	1311	416	411	411
query30	279	153	146	146
query31	920	767	751	751
query32	96	58	54	54
query33	700	304	331	304
query34	915	481	488	481
query35	854	728	722	722
query36	1002	864	873	864
query37	292	76	75	75
query38	2855	2796	2774	2774
query39	876	818	807	807
query40	280	113	110	110
query41	46	43	45	43
query42	131	98	100	98
query43	467	410	432	410
query44	1189	715	719	715
query45	203	178	176	176
query46	1083	803	790	790
query47	1798	1706	1700	1700
query48	361	296	286	286
query49	1168	430	410	410
query50	907	437	433	433
query51	6749	6682	6620	6620
query52	114	92	89	89
query53	265	183	173	173
query54	633	465	466	465
query55	77	75	75	75
query56	318	257	249	249
query57	1172	1057	1021	1021
query58	272	275	260	260
query59	2672	2347	2296	2296
query60	294	274	273	273
query61	97	95	96	95
query62	940	662	679	662
query63	208	181	180	180
query64	5899	1940	1898	1898
query65	3149	3097	3092	3092
query66	1449	342	334	334
query67	15117	14976	14790	14790
query68	4351	569	599	569
query69	448	302	297	297
query70	1107	1044	1059	1044
query71	421	276	285	276
query72	7137	2663	2481	2481
query73	760	328	332	328
query74	6065	5713	5697	5697
query75	3435	2737	2767	2737
query76	2645	1337	1422	1337
query77	441	311	313	311
query78	9366	8956	8908	8908
query79	1412	531	532	531
query80	1160	530	534	530
query81	580	224	226	224
query82	1196	134	133	133
query83	247	173	178	173
query84	276	85	85	85
query85	1341	369	368	368
query86	398	292	298	292
query87	3289	3116	3135	3116
query88	3031	2480	2491	2480
query89	400	310	291	291
query90	1829	198	192	192
query91	137	112	112	112
query92	65	53	52	52
query93	1416	631	625	625
query94	897	307	302	302
query95	406	288	279	279
query96	599	285	279	279
query97	3189	3034	3069	3034
query98	224	206	193	193
query99	1632	1304	1281	1281
Total cold run time: 262544 ms
Total hot run time: 169106 ms

doris-robot · 2024-07-29T06:49:04Z

ClickBench: Total hot run time: 30.14 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c9ea6aaf9dca357b0c66d5b4c0d0367ebeedbdd2, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.70	0.07	0.07
query5	0.48	0.48	0.50
query6	1.16	0.72	0.71
query7	0.02	0.02	0.02
query8	0.05	0.04	0.05
query9	0.57	0.51	0.51
query10	0.57	0.57	0.57
query11	0.15	0.12	0.12
query12	0.15	0.12	0.12
query13	0.62	0.60	0.59
query14	0.76	0.79	0.81
query15	0.91	0.86	0.86
query16	0.36	0.34	0.35
query17	1.01	1.00	1.00
query18	0.23	0.22	0.22
query19	1.80	1.76	1.70
query20	0.02	0.01	0.01
query21	15.40	0.78	0.66
query22	4.12	7.97	1.27
query23	18.06	1.38	1.35
query24	2.24	0.23	0.22
query25	0.19	0.09	0.09
query26	0.31	0.21	0.22
query27	0.45	0.24	0.24
query28	13.16	0.99	0.97
query29	12.54	3.37	3.33
query30	0.25	0.06	0.05
query31	2.87	0.41	0.40
query32	3.24	0.48	0.48
query33	2.94	2.98	2.96
query34	15.46	4.26	4.27
query35	4.29	4.26	4.27
query36	0.68	0.48	0.48
query37	0.19	0.16	0.16
query38	0.18	0.16	0.16
query39	0.04	0.04	0.04
query40	0.15	0.14	0.14
query41	0.11	0.05	0.06
query42	0.06	0.06	0.05
query43	0.04	0.04	0.04
Total cold run time: 107.86 s
Total hot run time: 30.14 s

Yukang-Lian · 2024-07-29T09:08:16Z

run buildall

doris-robot · 2024-07-29T09:45:41Z

TPC-H: Total hot run time: 41070 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 736ad17b7677a5057acd589007ed0a244611df09, data reload: false

------ Round 1 ----------------------------------
q1	17602	4049	4025	4025
q2	2015	208	206	206
q3	10441	1253	1319	1253
q4	10195	836	880	836
q5	7636	2871	2941	2871
q6	220	141	137	137
q7	1027	619	610	610
q8	9424	1707	1891	1707
q9	8514	6595	6615	6595
q10	8774	3834	3838	3834
q11	427	249	251	249
q12	435	226	231	226
q13	17754	2945	2929	2929
q14	263	247	242	242
q15	516	480	474	474
q16	514	384	377	377
q17	952	890	913	890
q18	7948	7209	7146	7146
q19	1449	1214	1204	1204
q20	551	316	344	316
q21	5256	4662	4681	4662
q22	351	281	293	281
Total cold run time: 112264 ms
Total hot run time: 41070 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4041	3981	3992	3981
q2	327	214	214	214
q3	2968	3011	3038	3011
q4	1979	1961	2037	1961
q5	5512	5560	5478	5478
q6	219	131	145	131
q7	2131	1775	1738	1738
q8	3310	3363	3319	3319
q9	8617	8650	8675	8650
q10	4000	3999	4067	3999
q11	548	458	455	455
q12	743	567	582	567
q13	15668	3170	3158	3158
q14	306	265	264	264
q15	546	494	493	493
q16	472	431	420	420
q17	1759	1694	1694	1694
q18	8148	7763	7652	7652
q19	1739	1712	1727	1712
q20	2057	1831	1891	1831
q21	5711	5404	5430	5404
q22	533	461	468	461
Total cold run time: 71334 ms
Total hot run time: 56593 ms

doris-robot · 2024-07-29T09:56:28Z

TPC-DS: Total hot run time: 169577 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 736ad17b7677a5057acd589007ed0a244611df09, data reload: false

query1	918	387	366	366
query2	6456	1712	1741	1712
query3	6657	210	220	210
query4	20017	17342	17242	17242
query5	3690	504	526	504
query6	275	170	160	160
query7	4588	318	292	292
query8	255	189	201	189
query9	8494	2393	2388	2388
query10	439	305	276	276
query11	10469	10023	9868	9868
query12	122	89	86	86
query13	1641	387	392	387
query14	9690	7090	7097	7090
query15	213	165	172	165
query16	6836	477	454	454
query17	954	602	586	586
query18	1939	311	293	293
query19	206	152	153	152
query20	93	89	90	89
query21	210	105	104	104
query22	4193	4055	3891	3891
query23	33662	33725	33483	33483
query24	10198	3158	3051	3051
query25	718	464	434	434
query26	1809	162	156	156
query27	2905	287	292	287
query28	7606	2042	2029	2029
query29	1347	476	459	459
query30	290	159	152	152
query31	1026	781	760	760
query32	103	57	54	54
query33	680	319	316	316
query34	904	525	502	502
query35	865	778	744	744
query36	1046	909	897	897
query37	298	84	82	82
query38	2948	2877	2797	2797
query39	904	834	819	819
query40	254	111	114	111
query41	45	44	44	44
query42	123	96	96	96
query43	473	419	422	419
query44	1183	718	719	718
query45	209	172	182	172
query46	1093	807	796	796
query47	1774	1706	1709	1706
query48	370	303	293	293
query49	933	420	409	409
query50	906	440	437	437
query51	6850	6712	6633	6633
query52	97	93	87	87
query53	251	176	180	176
query54	640	455	460	455
query55	73	73	76	73
query56	272	259	262	259
query57	1146	1035	1027	1027
query58	280	305	281	281
query59	2551	2331	2363	2331
query60	298	299	278	278
query61	117	98	98	98
query62	898	680	642	642
query63	212	177	186	177
query64	5592	1908	1914	1908
query65	3181	3121	3097	3097
query66	1323	330	335	330
query67	15374	15047	14779	14779
query68	4738	567	582	567
query69	517	300	300	300
query70	1134	1139	1047	1047
query71	536	274	282	274
query72	7948	2686	2506	2506
query73	752	327	343	327
query74	6040	5620	5607	5607
query75	3835	2758	2744	2744
query76	3241	1299	1411	1299
query77	578	301	309	301
query78	9429	8897	8894	8894
query79	2426	546	528	528
query80	1377	516	494	494
query81	554	225	239	225
query82	1035	136	127	127
query83	353	167	168	167
query84	265	83	88	83
query85	1612	311	340	311
query86	477	269	312	269
query87	3233	3081	3137	3081
query88	3889	2487	2481	2481
query89	395	300	285	285
query90	1991	199	195	195
query91	126	104	100	100
query92	60	50	50	50
query93	2260	638	629	629
query94	932	284	292	284
query95	377	274	278	274
query96	607	290	282	282
query97	3193	2989	3049	2989
query98	215	201	198	198
query99	1590	1312	1301	1301
Total cold run time: 267897 ms
Total hot run time: 169577 ms

doris-robot · 2024-07-29T10:01:58Z

ClickBench: Total hot run time: 30.16 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 736ad17b7677a5057acd589007ed0a244611df09, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.04
query3	0.22	0.04	0.04
query4	1.66	0.07	0.07
query5	0.49	0.49	0.49
query6	1.17	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.05	0.05
query9	0.56	0.51	0.52
query10	0.57	0.56	0.56
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.61	0.60	0.60
query14	0.78	0.78	0.80
query15	0.89	0.87	0.85
query16	0.35	0.36	0.35
query17	1.01	0.98	0.99
query18	0.22	0.21	0.22
query19	1.83	1.74	1.84
query20	0.01	0.01	0.01
query21	15.40	0.75	0.66
query22	3.47	8.02	1.35
query23	17.66	1.34	1.28
query24	2.29	0.24	0.23
query25	0.18	0.10	0.08
query26	0.33	0.21	0.20
query27	0.46	0.23	0.23
query28	13.17	0.99	0.98
query29	12.52	3.35	3.38
query30	0.26	0.07	0.05
query31	2.83	0.41	0.40
query32	3.25	0.50	0.48
query33	2.93	2.97	2.96
query34	15.78	4.28	4.26
query35	4.29	4.29	4.31
query36	0.69	0.48	0.49
query37	0.19	0.17	0.16
query38	0.16	0.16	0.14
query39	0.04	0.04	0.04
query40	0.15	0.13	0.13
query41	0.11	0.05	0.05
query42	0.06	0.04	0.06
query43	0.05	0.05	0.04
Total cold run time: 107.12 s
Total hot run time: 30.16 s

dataroaring

LGTM

github-actions · 2024-07-29T14:08:31Z

PR approved by at least one committer and no changes requested.

## Proposed changes For the `insert into` statements during group commit load via JDBC. Printing audit logs can severely impact performance. Therefore, we have introduced a session variable to control whether to print audit logs. It is recommended to turn off audit logs only during group commit load via JDBC.

…e#38419) ## Proposed changes For the `insert into` statements during group commit load via JDBC. Printing audit logs can severely impact performance. Therefore, we have introduced a session variable to control whether to print audit logs. It is recommended to turn off audit logs only during group commit load via JDBC.

…dit log sesssion variable #38419" (#38624) ## Proposed changes  Pick #38419

…e#38419) ## Proposed changes For the `insert into` statements during group commit load via JDBC. Printing audit logs can severely impact performance. Therefore, we have introduced a session variable to control whether to print audit logs. It is recommended to turn off audit logs only during group commit load via JDBC.

…t value to false (#38865) ## Proposed changes In #38419, we introduced a new variable `enable_prepared_stmt_audit_log` to make group commit faster. Here we set this session variable default value to false.

…t value to false (apache#38865) ## Proposed changes In apache#38419, we introduced a new variable `enable_prepared_stmt_audit_log` to make group commit faster. Here we set this session variable default value to false.

…e#38419) ## Proposed changes For the `insert into` statements during group commit load via JDBC. Printing audit logs can severely impact performance. Therefore, we have introduced a session variable to control whether to print audit logs. It is recommended to turn off audit logs only during group commit load via JDBC.

…t value to false (#38865) ## Proposed changes In #38419, we introduced a new variable `enable_prepared_stmt_audit_log` to make group commit faster. Here we set this session variable default value to false.

1

5474a47

2

96e0073

3

404c727

4

c9ea6aa

mymeiyi approved these changes Jul 29, 2024

View reviewed changes

github-actions bot added the reviewed label Jul 29, 2024

5

736ad17

dataroaring approved these changes Jul 29, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 29, 2024

dataroaring added the dev/2.1.x label Jul 29, 2024

wm1581066 added the usercase Important user case type label label Jul 30, 2024

dataroaring merged commit faaa24c into apache:master Jul 31, 2024
27 of 28 checks passed

dataroaring added the dev/3.0.1-merged label Jul 31, 2024

Yukang-Lian mentioned this pull request Jul 31, 2024

[Cherry-pick](branch-2.1) Pick "[Enhancement](audit log) Add print audit log sesssion variable #38419" #38624

Merged

yiguolei pushed a commit that referenced this pull request Aug 1, 2024

[Cherry-pick](branch-2.1) Pick "[Enhancement](audit log) Add print au…

9f1e41c

…dit log sesssion variable #38419" (#38624) ## Proposed changes  Pick #38419

yiguolei added dev/2.1.6-merged and removed dev/2.1.x labels Aug 1, 2024

Yukang-Lian mentioned this pull request Aug 5, 2024

[Enhancement](audit log) Set print audit log sesssion variable default value to false #38865

Merged

gavinchou mentioned this pull request Aug 19, 2024

Release Note 3.0.1 #39570

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Enhancement](audit log) Add print audit log sesssion variable #38419

[Enhancement](audit log) Add print audit log sesssion variable #38419

Yukang-Lian commented Jul 26, 2024 •

edited

Loading

doris-robot commented Jul 26, 2024

Yukang-Lian commented Jul 26, 2024

doris-robot commented Jul 26, 2024

doris-robot commented Jul 26, 2024

doris-robot commented Jul 26, 2024

Yukang-Lian commented Jul 29, 2024

Yukang-Lian commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

Yukang-Lian commented Jul 29, 2024

doris-robot commented Jul 29, 2024

github-actions bot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

Yukang-Lian commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

dataroaring left a comment

github-actions bot commented Jul 29, 2024

[Enhancement](audit log) Add print audit log sesssion variable #38419

[Enhancement](audit log) Add print audit log sesssion variable #38419

Conversation

Yukang-Lian commented Jul 26, 2024 • edited Loading

Proposed changes

doris-robot commented Jul 26, 2024

Yukang-Lian commented Jul 26, 2024

doris-robot commented Jul 26, 2024

doris-robot commented Jul 26, 2024

doris-robot commented Jul 26, 2024

Yukang-Lian commented Jul 29, 2024

Yukang-Lian commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

Yukang-Lian commented Jul 29, 2024

doris-robot commented Jul 29, 2024

github-actions bot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

Yukang-Lian commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

doris-robot commented Jul 29, 2024

dataroaring left a comment

Choose a reason for hiding this comment

github-actions bot commented Jul 29, 2024

Yukang-Lian commented Jul 26, 2024 •

edited

Loading