Skip to content

[feature] (nereids) generate sql digest for nereids prased stmt #56256

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
starocean999 merged 1 commit into from
Oct 14, 2025
Merged

[feature] (nereids) generate sql digest for nereids prased stmt #56256

starocean999 merged 1 commit into from
Oct 14, 2025

Conversation

@HonestManXin
Copy link
Contributor

@HonestManXin HonestManXin commented Sep 20, 2025

The stmt generated by the old parser has a toDigest method, so that auditlog can use the generated digest to generate SQL fingerprints, facilitating the troubleshooting of issues such as slow SQL

@Thearas
Copy link
Contributor

Thearas commented Sep 20, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Sep 20, 2025

run buildall

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Sep 20, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 20, 2025

FE UT Coverage Report

Increment line coverage 71.88% (294/409) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 20, 2025

FE Regression Coverage Report

Increment line coverage 2.69% (11/409) 🎉
Increment coverage report
Complete coverage report

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Sep 20, 2025

run buildall

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Sep 20, 2025

run performance

@doris-robot
Copy link

doris-robot commented Sep 20, 2025

TPC-H: Total hot run time: 1512 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c7981970b50525d5dc34bbddf66a7722e82ac688, data reload: false

------ Round 1 ----------------------------------
q1	6646	27	19	19
q2	581	25	25	25
q3	886	18	15	15
q4	940	16	15	15
q5	2209	15	15	15
q6	229	13	12	12
q7	902	22	20	20
q8	1155	15	12	12
q9	11566	18	11	11
q10	4795	14	12	12
q11	447	25	21	21
q12	313	13	12	12
q13	17650	13	11	11
q14	262	12	11	11
q15	621	12	11	11
q16	986	993	951	951
q17	541	14	12	12
q18	7661	19	11	11
q19	1602	13	11	11
q20	351	388	273	273
q21	3706	20	20	20
q22	1064	12	12	12
Total cold run time: 65113 ms
Total hot run time: 1512 ms

----- Round 2, with runtime_filter_mode=off -----
q1	11	11	11	11
q2	19	20	21	20
q3	12	11	11	11
q4	13	11	10	10
q5	11	10	10	10
q6	11	12	10	10
q7	19	18	18	18
q8	11	10	10	10
q9	10	10	11	10
q10	10	9	11	9
q11	19	19	18	18
q12	10	10	10	10
q13	10	10	10	10
q14	10	11	11	11
q15	10	10	10	10
q16	1069	1082	1024	1024
q17	11	10	10	10
q18	11	10	9	9
q19	10	10	11	10
q20	1876	1937	1900	1900
q21	20	19	19	19
q22	11	10	10	10
Total cold run time: 3194 ms
Total hot run time: 3160 ms

@doris-robot
Copy link

doris-robot commented Sep 20, 2025

TPC-DS: Total hot run time: 2776 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c7981970b50525d5dc34bbddf66a7722e82ac688, data reload: false

query1	1075	19	11	11
query2	7138	17	14	14
query3	7640	13	10	10
query4	26891	13	12	12
query5	4409	15	12	12
query6	391	12	11	11
query7	5429	11	11	11
query8	342	20	18	18
query9	9241	11	9	9
query10	727	11	11	11
query11	15297	11	12	11
query12	178	13	11	11
query13	1715	11	11	11
query14	11746	15	14	14
query15	424	13	12	12
query16	7842	12	11	11
query17	2154	12	12	12
query18	2950	12	11	11
query19	264	11	9	9
query20	142	12	10	10
query21	227	11	9	9
query22	4135	10	10	10
query23	34139	23	14	14
query24	10873	13	10	10
query25	752	11	9	9
query26	1802	10	9	9
query27	3415	10	9	9
query28	6206	11	10	10
query29	1732	10	10	10
query30	637	10	9	9
query31	1726	10	11	10
query32	117	10	9	9
query33	1339	11	10	10
query34	1633	833	534	534
query35	1025	10	10	10
query36	995	10	8	8
query37	255	10	9	9
query38	3541	9	9	9
query39	1500	751	749	749
query40	359	10	10	10
query41	86	11	10	10
query42	143	11	8	8
query43	498	10	10	10
query44	1328	9	8	8
query45	377	10	9	9
query46	1162	9	8	8
query47	1820	9	8	8
query48	413	10	8	8
query49	1300	11	10	10
query50	761	10	9	9
query51	4067	9	8	8
query52	117	10	10	10
query53	242	10	9	9
query54	760	9	10	9
query55	96	9	8	8
query56	361	12	9	9
query57	1244	9	9	9
query58	376	10	9	9
query59	2739	9	9	9
query60	391	10	9	9
query61	186	9	8	8
query62	839	10	9	9
query63	265	11	11	11
query64	5420	11	9	9
query65	4179	13	8	8
query66	1585	12	11	11
query67	16971	19	12	12
query68	3629	11	9	9
query69	516	10	8	8
query70	1399	10	9	9
query71	523	348	321	321
query72	7238	11	10	10
query73	773	11	9	9
query74	9454	9	9	9
query75	3404	9	7	7
query76	3219	9	8	8
query77	1095	11	10	10
query78	9795	36	11	11
query79	1018	9	11	9
query80	727	13	11	11
query81	630	9	8	8
query82	295	10	7	7
query83	340	12	10	10
query84	270	10	9	9
query85	1047	10	10	10
query86	436	10	9	9
query87	3949	11	11	11
query88	2964	14	11	11
query89	435	12	11	11
query90	2362	11	10	10
query91	206	12	9	9
query92	99	11	10	10
query93	1071	10	10	10
query94	822	10	9	9
query95	551	10	10	10
query96	463	9	9	9
query97	3149	9	8	8
query98	247	243	249	243
query99	1498	9	8	8
Total cold run time: 293753 ms
Total hot run time: 2776 ms

@doris-robot
Copy link

doris-robot commented Sep 20, 2025

ClickBench: Total hot run time: 0.04 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c7981970b50525d5dc34bbddf66a7722e82ac688, data reload: false

query1	0.06	0.02	0.01
query2	0.10	0.01	0.00
query3	0.26	0.00	0.01
query4	1.75	0.00	0.01
query5	0.29	0.01	0.01
query6	1.65	0.00	0.00
query7	0.05	0.00	0.01
query8	0.06	0.01	0.01
query9	0.62	0.01	0.00
query10	0.59	0.01	0.00
query11	0.18	0.01	0.00
query12	0.16	0.00	0.01
query13	0.63	0.00	0.01
query14	1.05	0.02	0.00
query15	0.89	0.00	0.00
query16	0.40	0.01	0.00
query17	1.08	0.00	0.00
query18	0.23	0.01	0.00
query19	1.98	0.01	0.00
query20	0.02	0.00	0.00
query21	15.36	0.00	0.00
query22	5.87	0.00	0.01
query23	16.76	0.00	0.00
query24	1.49	0.00	0.00
query25	0.22	0.00	0.00
query26	0.18	0.01	0.00
query27	0.12	0.01	0.00
query28	1.33	0.01	0.00
query29	13.18	0.00	0.01
query30	0.32	0.00	0.00
query31	2.34	0.00	0.01
query32	5.93	0.00	0.00
query33	4.33	0.00	0.01
query34	7.31	0.01	0.01
query35	6.33	0.00	0.00
query36	0.70	0.00	0.00
query37	0.11	0.01	0.00
query38	0.08	0.01	0.00
query39	0.04	0.00	0.00
query40	0.19	0.00	0.01
query41	0.10	0.00	0.00
query42	0.06	0.00	0.00
query43	0.05	0.00	0.00
Total cold run time: 94.45 s
Total hot run time: 0.04 s

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Sep 20, 2025

run p0

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Sep 21, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 21, 2025

FE UT Coverage Report

Increment line coverage 71.88% (294/409) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Sep 21, 2025

FE Regression Coverage Report

Increment line coverage 2.69% (11/409) 🎉
Increment coverage report
Complete coverage report

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Sep 21, 2025

run performance

@doris-robot
Copy link

doris-robot commented Sep 21, 2025

TPC-H: Total hot run time: 1495 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4ae6d0696988e11356ec94744345a6a38d73ff4c, data reload: false

------ Round 1 ----------------------------------
q1	6738	28	19	19
q2	573	26	26	26
q3	880	22	16	16
q4	931	16	14	14
q5	2211	15	14	14
q6	213	15	13	13
q7	898	22	21	21
q8	1157	13	12	12
q9	11304	12	11	11
q10	4751	13	12	12
q11	438	22	20	20
q12	313	12	11	11
q13	17629	13	11	11
q14	244	13	11	11
q15	614	11	10	10
q16	991	985	950	950
q17	550	13	10	10
q18	7737	13	11	11
q19	1100	13	12	12
q20	345	383	260	260
q21	3754	20	20	20
q22	1091	12	11	11
Total cold run time: 64462 ms
Total hot run time: 1495 ms

----- Round 2, with runtime_filter_mode=off -----
q1	11	11	11	11
q2	19	19	19	19
q3	10	10	10	10
q4	12	11	10	10
q5	10	9	11	9
q6	10	10	10	10
q7	19	18	17	17
q8	10	10	10	10
q9	9	10	10	10
q10	10	10	9	9
q11	19	18	18	18
q12	10	10	11	10
q13	10	9	14	9
q14	14	11	11	11
q15	10	10	10	10
q16	1043	1061	1040	1040
q17	12	11	10	10
q18	9	10	9	9
q19	11	10	10	10
q20	1887	1956	1838	1838
q21	22	18	19	18
q22	10	9	10	9
Total cold run time: 3177 ms
Total hot run time: 3107 ms

@doris-robot
Copy link

doris-robot commented Sep 21, 2025

TPC-DS: Total hot run time: 2737 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4ae6d0696988e11356ec94744345a6a38d73ff4c, data reload: false

query1	1050	19	11	11
query2	7157	16	14	14
query3	7637	11	11	11
query4	26710	11	11	11
query5	4456	11	11	11
query6	371	11	10	10
query7	5442	11	12	11
query8	357	20	19	19
query9	9256	12	9	9
query10	724	16	10	10
query11	15518	11	10	10
query12	177	12	10	10
query13	1733	11	10	10
query14	11127	16	15	15
query15	414	14	11	11
query16	7761	11	11	11
query17	2167	10	9	9
query18	2970	11	11	11
query19	252	11	9	9
query20	135	11	10	10
query21	221	10	9	9
query22	4380	10	9	9
query23	33752	17	13	13
query24	10863	13	12	12
query25	774	11	10	10
query26	1818	12	10	10
query27	3418	11	10	10
query28	6234	12	10	10
query29	1742	11	9	9
query30	655	10	10	10
query31	1734	12	10	10
query32	122	10	9	9
query33	1328	10	10	10
query34	1634	836	525	525
query35	1030	11	10	10
query36	971	10	9	9
query37	248	10	9	9
query38	3517	8	8	8
query39	1481	746	713	713
query40	315	10	16	10
query41	83	11	10	10
query42	153	10	9	9
query43	486	11	12	11
query44	1300	10	10	10
query45	390	10	10	10
query46	1173	10	9	9
query47	1803	9	8	8
query48	400	10	10	10
query49	1292	10	11	10
query50	837	10	10	10
query51	3930	18	8	8
query52	124	9	9	9
query53	239	10	10	10
query54	754	10	10	10
query55	96	10	9	9
query56	342	12	10	10
query57	1237	10	10	10
query58	372	11	9	9
query59	2630	10	8	8
query60	378	10	9	9
query61	181	10	9	9
query62	855	9	9	9
query63	269	12	11	11
query64	5503	11	9	9
query65	4164	11	10	10
query66	1668	11	10	10
query67	16546	25	12	12
query68	3534	13	11	11
query69	1151	10	10	10
query70	1407	9	9	9
query71	490	349	330	330
query72	6657	10	10	10
query73	540	10	9	9
query74	9852	10	9	9
query75	3412	10	10	10
query76	3228	11	9	9
query77	906	10	10	10
query78	9678	10	9	9
query79	1111	10	11	10
query80	786	11	10	10
query81	943	9	8	8
query82	286	12	11	11
query83	314	11	9	9
query84	334	10	8	8
query85	1097	10	8	8
query86	608	8	8	8
query87	3915	9	9	9
query88	2849	15	12	12
query89	498	12	11	11
query90	2927	10	8	8
query91	184	9	9	9
query92	104	9	9	9
query93	1064	10	9	9
query94	1514	11	10	10
query95	584	9	8	8
query96	463	9	9	9
query97	3085	10	9	9
query98	253	239	231	231
query99	1524	9	8	8
Total cold run time: 294154 ms
Total hot run time: 2737 ms

@doris-robot
Copy link

doris-robot commented Sep 21, 2025

ClickBench: Total hot run time: 0.09 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4ae6d0696988e11356ec94744345a6a38d73ff4c, data reload: false

query1	0.06	0.01	0.01
query2	0.10	0.00	0.00
query3	0.27	0.01	0.01
query4	1.76	0.01	0.01
query5	0.27	0.01	0.01
query6	1.67	0.00	0.01
query7	0.06	0.01	0.01
query8	0.07	0.00	0.01
query9	0.63	0.00	0.00
query10	0.59	0.00	0.01
query11	0.17	0.00	0.01
query12	0.16	0.00	0.00
query13	0.64	0.01	0.00
query14	1.05	0.01	0.00
query15	0.87	0.00	0.01
query16	0.42	0.01	0.00
query17	1.08	0.00	0.01
query18	0.22	0.00	0.00
query19	1.89	0.01	0.00
query20	0.02	0.01	0.01
query21	15.36	0.00	0.00
query22	6.25	0.01	0.00
query23	16.30	0.00	0.01
query24	1.23	0.01	0.00
query25	0.21	0.00	0.00
query26	0.18	0.00	0.00
query27	0.11	0.00	0.00
query28	1.24	0.00	0.01
query29	13.02	0.00	0.00
query30	0.30	0.00	0.00
query31	2.38	0.00	0.00
query32	5.94	0.01	0.01
query33	4.33	0.01	0.00
query34	7.70	0.00	0.00
query35	6.30	0.00	0.00
query36	0.71	0.00	0.01
query37	0.11	0.00	0.01
query38	0.08	0.01	0.00
query39	0.05	0.01	0.01
query40	0.20	0.00	0.01
query41	0.09	0.00	0.00
query42	0.06	0.00	0.00
query43	0.05	0.01	0.01
Total cold run time: 94.2 s
Total hot run time: 0.09 s

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Oct 11, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Oct 11, 2025

TPC-DS: Total hot run time: 190295 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 42a75f9c51375d3cc6b5523fa8ca4b3be8374797, data reload: false

query1	1073	448	408	408
query2	6566	1715	1702	1702
query3	6747	234	239	234
query4	26127	23492	23021	23021
query5	5127	672	502	502
query6	333	240	213	213
query7	4646	497	305	305
query8	310	278	224	224
query9	8713	2568	2594	2568
query10	504	362	290	290
query11	15291	15108	14860	14860
query12	187	116	117	116
query13	1692	537	429	429
query14	11472	9169	9176	9169
query15	205	186	216	186
query16	7668	676	527	527
query17	1480	754	607	607
query18	2022	417	320	320
query19	216	244	225	225
query20	149	139	128	128
query21	268	141	120	120
query22	4697	5067	4963	4963
query23	35597	34057	33715	33715
query24	8860	2523	2720	2523
query25	621	574	492	492
query26	1248	287	166	166
query27	2775	544	379	379
query28	4407	2277	2210	2210
query29	811	832	494	494
query30	316	236	206	206
query31	959	839	804	804
query32	96	71	72	71
query33	588	390	375	375
query34	841	897	534	534
query35	830	871	777	777
query36	1027	1041	976	976
query37	132	114	88	88
query38	3561	3614	3493	3493
query39	1475	1433	1425	1425
query40	219	126	117	117
query41	59	68	63	63
query42	122	113	107	107
query43	489	487	451	451
query44	1310	834	818	818
query45	178	181	173	173
query46	837	1012	650	650
query47	1794	1820	1741	1741
query48	405	410	312	312
query49	761	504	406	406
query50	667	686	411	411
query51	3968	3889	3850	3850
query52	105	111	102	102
query53	234	272	207	207
query54	588	577	531	531
query55	92	84	90	84
query56	313	330	308	308
query57	1163	1213	1143	1143
query58	285	282	282	282
query59	2604	2677	2570	2570
query60	348	333	331	331
query61	157	153	155	153
query62	806	723	685	685
query63	229	194	187	187
query64	4344	1190	818	818
query65	4033	3972	3949	3949
query66	1078	431	332	332
query67	15479	15294	15175	15175
query68	8021	934	598	598
query69	505	322	289	289
query70	1404	1301	1331	1301
query71	512	337	318	318
query72	5847	4950	4850	4850
query73	689	591	364	364
query74	9171	9303	8897	8897
query75	4049	3370	2872	2872
query76	3779	1152	723	723
query77	802	413	332	332
query78	9634	9738	8794	8794
query79	2027	845	599	599
query80	635	631	484	484
query81	504	263	229	229
query82	445	166	127	127
query83	271	269	253	253
query84	247	116	88	88
query85	898	454	411	411
query86	355	310	292	292
query87	3774	3757	3721	3721
query88	3408	2247	2250	2247
query89	391	425	296	296
query90	2082	218	213	213
query91	162	159	130	130
query92	82	74	65	65
query93	1329	987	642	642
query94	702	445	341	341
query95	406	333	314	314
query96	486	582	279	279
query97	2938	2968	2901	2901
query98	257	214	214	214
query99	1492	1439	1310	1310
Total cold run time: 279608 ms
Total hot run time: 190295 ms

@doris-robot
Copy link

doris-robot commented Oct 11, 2025

ClickBench: Total hot run time: 30.52 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 42a75f9c51375d3cc6b5523fa8ca4b3be8374797, data reload: false

query1	0.06	0.04	0.05
query2	0.09	0.05	0.05
query3	0.25	0.08	0.08
query4	1.60	0.11	0.12
query5	0.27	0.26	0.26
query6	1.18	0.65	0.66
query7	0.03	0.03	0.03
query8	0.06	0.04	0.05
query9	0.62	0.53	0.54
query10	0.58	0.56	0.58
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.65	0.61	0.60
query14	1.03	1.05	1.03
query15	0.89	0.84	0.89
query16	0.40	0.39	0.40
query17	1.06	1.07	1.01
query18	0.21	0.20	0.20
query19	1.97	1.86	1.85
query20	0.02	0.01	0.01
query21	15.43	0.94	0.58
query22	0.76	1.21	0.72
query23	14.82	1.39	0.60
query24	7.07	1.65	0.73
query25	0.49	0.09	0.08
query26	0.72	0.16	0.13
query27	0.06	0.06	0.06
query28	9.20	1.35	0.93
query29	12.56	3.96	3.35
query30	0.27	0.13	0.12
query31	2.83	0.60	0.38
query32	3.24	0.55	0.48
query33	3.12	3.15	3.18
query34	16.15	5.50	4.88
query35	4.94	4.96	4.93
query36	0.72	0.53	0.51
query37	0.10	0.08	0.08
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.18	0.14	0.15
query41	0.09	0.03	0.03
query42	0.04	0.04	0.03
query43	0.04	0.04	0.03
Total cold run time: 104.21 s
Total hot run time: 30.52 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 11, 2025

FE UT Coverage Report

Increment line coverage 72.22% (299/414) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 11, 2025

FE Regression Coverage Report

Increment line coverage 2.66% (11/414) 🎉
Increment coverage report
Complete coverage report

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Oct 12, 2025

run cloud_p0

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 12, 2025

FE Regression Coverage Report

Increment line coverage 2.66% (11/414) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 13, 2025

FE Regression Coverage Report

Increment line coverage 6.48% (28/432) 🎉
Increment coverage report
Complete coverage report

1 similar comment
@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 13, 2025

FE Regression Coverage Report

Increment line coverage 6.48% (28/432) 🎉
Increment coverage report
Complete coverage report

@HonestManXin
Copy link
Contributor Author

HonestManXin commented Oct 14, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Oct 14, 2025

TPC-DS: Total hot run time: 190561 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dd4b8db87086fedb32057e88526b2fc825c5405c, data reload: false

query1	1081	435	417	417
query2	6580	1695	1680	1680
query3	6757	222	234	222
query4	26225	23246	23498	23246
query5	4881	624	477	477
query6	354	237	217	217
query7	4667	500	292	292
query8	305	259	264	259
query9	8716	2573	2560	2560
query10	475	335	294	294
query11	15703	15358	14926	14926
query12	176	144	109	109
query13	1678	569	424	424
query14	11182	9157	9262	9157
query15	208	186	185	185
query16	7618	678	546	546
query17	1190	758	640	640
query18	2022	418	328	328
query19	235	253	228	228
query20	167	150	140	140
query21	222	147	123	123
query22	4855	4794	4706	4706
query23	34953	34415	33929	33929
query24	8652	2587	2542	2542
query25	657	574	507	507
query26	1258	302	173	173
query27	3058	545	382	382
query28	4459	2237	2217	2217
query29	832	685	582	582
query30	311	254	203	203
query31	935	877	782	782
query32	96	76	90	76
query33	619	369	335	335
query34	799	841	517	517
query35	848	832	748	748
query36	981	1021	919	919
query37	112	114	89	89
query38	3514	3461	3495	3461
query39	1466	1434	1426	1426
query40	211	125	118	118
query41	66	58	58	58
query42	120	111	115	111
query43	491	498	470	470
query44	1347	836	829	829
query45	180	177	175	175
query46	843	986	635	635
query47	1807	1832	1730	1730
query48	396	434	315	315
query49	776	487	425	425
query50	637	687	401	401
query51	3896	3949	3995	3949
query52	111	108	101	101
query53	232	262	200	200
query54	615	611	526	526
query55	93	84	84	84
query56	323	348	310	310
query57	1201	1186	1131	1131
query58	288	278	280	278
query59	2517	2663	2585	2585
query60	352	343	328	328
query61	169	148	158	148
query62	814	727	652	652
query63	238	204	201	201
query64	4475	1225	852	852
query65	4039	3999	3972	3972
query66	1103	424	352	352
query67	15701	15433	15154	15154
query68	9304	956	600	600
query69	489	326	278	278
query70	1451	1296	1340	1296
query71	487	347	314	314
query72	5756	4835	4613	4613
query73	710	557	357	357
query74	9058	9136	8814	8814
query75	4504	3317	2898	2898
query76	5052	1170	743	743
query77	1003	406	391	391
query78	9657	9774	8917	8917
query79	6022	835	586	586
query80	744	572	516	516
query81	506	262	230	230
query82	403	159	129	129
query83	308	275	254	254
query84	297	112	87	87
query85	869	486	426	426
query86	343	330	312	312
query87	3861	3766	3711	3711
query88	2907	2282	2237	2237
query89	449	330	293	293
query90	2164	223	216	216
query91	165	169	135	135
query92	95	67	70	67
query93	3707	1011	636	636
query94	691	451	340	340
query95	405	323	317	317
query96	483	566	281	281
query97	2940	2983	2899	2899
query98	229	224	218	218
query99	1461	1404	1296	1296
Total cold run time: 288408 ms
Total hot run time: 190561 ms

@doris-robot
Copy link

doris-robot commented Oct 14, 2025

ClickBench: Total hot run time: 30.37 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dd4b8db87086fedb32057e88526b2fc825c5405c, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.06	0.06
query3	0.25	0.08	0.08
query4	1.60	0.11	0.11
query5	0.27	0.26	0.25
query6	1.21	0.66	0.67
query7	0.04	0.03	0.03
query8	0.06	0.04	0.04
query9	0.63	0.52	0.53
query10	0.59	0.59	0.57
query11	0.17	0.11	0.12
query12	0.15	0.12	0.12
query13	0.64	0.61	0.61
query14	1.02	1.05	1.04
query15	0.87	0.88	0.85
query16	0.39	0.40	0.40
query17	1.02	1.03	1.10
query18	0.21	0.21	0.20
query19	1.91	1.82	1.84
query20	0.01	0.01	0.02
query21	15.44	0.95	0.58
query22	0.77	1.25	0.68
query23	14.84	1.32	0.63
query24	6.87	1.45	0.66
query25	0.52	0.29	0.09
query26	0.54	0.16	0.13
query27	0.06	0.06	0.05
query28	9.33	1.34	0.92
query29	12.56	4.00	3.39
query30	0.28	0.13	0.12
query31	2.84	0.59	0.39
query32	3.22	0.56	0.48
query33	3.11	3.14	3.10
query34	16.24	5.52	4.88
query35	4.97	4.84	4.92
query36	0.68	0.51	0.50
query37	0.09	0.07	0.07
query38	0.07	0.05	0.04
query39	0.04	0.02	0.03
query40	0.18	0.16	0.15
query41	0.09	0.04	0.03
query42	0.04	0.04	0.03
query43	0.05	0.04	0.03
Total cold run time: 104.02 s
Total hot run time: 30.37 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Oct 14, 2025

FE Regression Coverage Report

Increment line coverage 6.48% (28/432) 🎉
Increment coverage report
Complete coverage report

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 14, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Oct 14, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Oct 14, 2025

PR approved by anyone and no changes requested.

@starocean999 starocean999 merged commit 4971c1d into apache:master Oct 14, 2025
27 of 28 checks passed
github-actions bot pushed a commit that referenced this pull request Nov 7, 2025
@HonestManXin
[feature] (nereids) generate sql digest for nereids prased stmt (#56256)
a4dec00 
The stmt generated by the old parser has a toDigest method, so that
auditlog can use the generated digest to generate SQL fingerprints,
facilitating the troubleshooting of issues such as slow SQL
@github-actions github-actions bot mentioned this pull request Nov 7, 2025
Merged
yiguolei pushed a commit that referenced this pull request Nov 11, 2025
@github-actions @HonestManXin
branch-4.0: [feature] (nereids) generate sql digest for nereids prase…
0024b07 
…d stmt #56256 (#57818)

Cherry-picked from #56256

Co-authored-by: HonestManXin <HonestManXin@gmail.com>
@HonestManXin HonestManXin deleted the digest branch November 24, 2025 06:36
@yiguolei yiguolei added usercase Important user case type label dev/3.1.x labels Dec 19, 2025
@morrySnow morrySnow mentioned this pull request Dec 22, 2025
Merged
morrySnow pushed a commit that referenced this pull request Dec 22, 2025
@HonestManXin
branch-3.1: [feature] (nereids) generate sql digest for nereids prase…
02827c5 
…d stmt #56256 (#59215)

picked from #56256
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@englefly englefly englefly approved these changes

@starocean999 starocean999 starocean999 approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.4-merged dev/4.0.2-merged reviewed usercase Important user case type label

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

8 participants

@HonestManXin @Thearas @hello-stephen @doris-robot @englefly @starocean999 @yiguolei @morrySnow