Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](Nereids) fixed the limit offset error #39316

Merged
merged 2 commits into from
Oct 15, 2024
Merged

[fix](Nereids) fixed the limit offset error #39316

merged 2 commits into from
Oct 15, 2024

Conversation

felixwluo
Copy link
Contributor

Proposed changes

Issue Number: close #36699

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@felixwluo
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added the doing label Aug 13, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 39866 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7502935222d90d23aea9f2cb4a17638a87cf24ed, data reload: false

------ Round 1 ----------------------------------
q1	17907	4505	4348	4348
q2	2325	178	176	176
q3	10515	1141	1091	1091
q4	10144	673	717	673
q5	7727	2797	2777	2777
q6	222	136	141	136
q7	969	597	591	591
q8	9321	2013	2006	2006
q9	8723	6570	6550	6550
q10	7030	2207	2157	2157
q11	445	249	251	249
q12	396	223	226	223
q13	18900	2962	2992	2962
q14	271	234	232	232
q15	526	498	494	494
q16	503	398	393	393
q17	963	641	674	641
q18	7975	7572	7512	7512
q19	4370	975	1017	975
q20	706	334	315	315
q21	5674	4582	4351	4351
q22	1096	1018	1014	1014
Total cold run time: 116708 ms
Total hot run time: 39866 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4481	4245	4246	4245
q2	372	263	263	263
q3	2793	2608	2642	2608
q4	1918	1616	1636	1616
q5	5335	5410	5334	5334
q6	224	130	132	130
q7	2023	1667	1692	1667
q8	3162	3319	3298	3298
q9	8387	8294	8306	8294
q10	3383	3137	3181	3137
q11	593	494	513	494
q12	786	628	586	586
q13	17484	3011	3013	3011
q14	302	265	270	265
q15	514	477	477	477
q16	472	424	407	407
q17	1764	1481	1468	1468
q18	7601	7407	7538	7407
q19	1673	1471	1615	1471
q20	2062	1804	1838	1804
q21	5231	5173	5001	5001
q22	1101	1038	994	994
Total cold run time: 71661 ms
Total hot run time: 53977 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184409 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7502935222d90d23aea9f2cb4a17638a87cf24ed, data reload: false

query1	927	375	364	364
query2	6454	1873	1896	1873
query3	6652	210	217	210
query4	34162	23210	23030	23030
query5	4196	501	497	497
query6	270	171	187	171
query7	4596	297	288	288
query8	241	199	198	198
query9	8508	2441	2434	2434
query10	431	274	255	255
query11	17833	14902	14922	14902
query12	146	124	98	98
query13	1617	351	369	351
query14	9703	7137	7476	7137
query15	218	165	164	164
query16	7616	443	459	443
query17	1557	556	542	542
query18	1843	275	286	275
query19	185	143	136	136
query20	111	121	103	103
query21	201	101	95	95
query22	4315	4055	3967	3967
query23	33743	33096	33321	33096
query24	11599	2847	2752	2752
query25	622	372	407	372
query26	1642	156	157	156
query27	2861	266	274	266
query28	7393	2044	2039	2039
query29	997	437	405	405
query30	283	145	142	142
query31	953	727	740	727
query32	94	54	53	53
query33	747	284	273	273
query34	969	455	461	455
query35	802	749	702	702
query36	1075	927	943	927
query37	153	81	78	78
query38	3910	3833	3768	3768
query39	1464	1352	1416	1352
query40	276	114	109	109
query41	48	50	45	45
query42	113	93	101	93
query43	490	443	456	443
query44	1261	724	732	724
query45	200	163	165	163
query46	1114	741	736	736
query47	1864	1777	1757	1757
query48	352	285	290	285
query49	1162	408	417	408
query50	802	407	411	407
query51	6833	6756	6601	6601
query52	101	86	93	86
query53	251	182	186	182
query54	997	447	449	447
query55	76	73	75	73
query56	258	248	267	248
query57	1127	1062	1052	1052
query58	249	245	234	234
query59	2930	2833	2696	2696
query60	283	263	261	261
query61	99	94	107	94
query62	812	626	642	626
query63	213	182	181	181
query64	10667	2324	1743	1743
query65	3242	3146	3125	3125
query66	1385	330	330	330
query67	15255	14849	14769	14769
query68	4651	539	555	539
query69	406	272	259	259
query70	1166	1129	1168	1129
query71	411	273	268	268
query72	7205	2228	1996	1996
query73	743	333	327	327
query74	9051	8771	8689	8689
query75	3399	2698	2698	2698
query76	2827	946	967	946
query77	488	304	299	299
query78	9732	9057	8960	8960
query79	2180	525	538	525
query80	1364	506	519	506
query81	574	226	233	226
query82	776	138	139	138
query83	227	157	151	151
query84	256	80	80	80
query85	1983	334	324	324
query86	482	297	312	297
query87	4406	4248	4177	4177
query88	4418	2419	2400	2400
query89	398	293	292	292
query90	1861	201	197	197
query91	132	104	105	104
query92	76	50	50	50
query93	2280	536	529	529
query94	1032	321	289	289
query95	353	258	260	258
query96	605	272	276	272
query97	3162	3013	3065	3013
query98	215	199	204	199
query99	1527	1308	1258	1258
Total cold run time: 301935 ms
Total hot run time: 184409 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.74 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7502935222d90d23aea9f2cb4a17638a87cf24ed, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.05
query3	0.21	0.05	0.05
query4	1.67	0.08	0.07
query5	0.48	0.48	0.48
query6	1.14	0.73	0.72
query7	0.02	0.01	0.01
query8	0.04	0.04	0.04
query9	0.53	0.48	0.48
query10	0.55	0.55	0.54
query11	0.15	0.12	0.11
query12	0.16	0.12	0.12
query13	0.60	0.62	0.59
query14	0.76	0.77	0.76
query15	0.85	0.80	0.81
query16	0.35	0.37	0.37
query17	0.98	1.01	1.03
query18	0.23	0.21	0.22
query19	1.74	1.72	1.67
query20	0.02	0.00	0.00
query21	15.40	0.76	0.65
query22	4.09	7.24	2.03
query23	18.25	1.29	1.31
query24	2.14	0.23	0.22
query25	0.16	0.09	0.08
query26	0.29	0.21	0.21
query27	0.45	0.23	0.23
query28	13.25	1.04	1.01
query29	12.60	3.32	3.27
query30	0.24	0.05	0.04
query31	2.88	0.40	0.39
query32	3.28	0.49	0.47
query33	2.90	2.98	2.98
query34	16.93	4.39	4.33
query35	4.45	4.39	4.39
query36	0.65	0.47	0.48
query37	0.19	0.16	0.17
query38	0.16	0.14	0.15
query39	0.04	0.03	0.04
query40	0.14	0.12	0.12
query41	0.09	0.05	0.04
query42	0.06	0.04	0.04
query43	0.05	0.05	0.04
Total cold run time: 109.3 s
Total hot run time: 30.74 s

@felixwluo
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39716 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cdb162c667dae739c0d64e2edf15073cad501cd3, data reload: false

------ Round 1 ----------------------------------
q1	17615	4402	4334	4334
q2	2023	178	173	173
q3	11839	1023	1147	1023
q4	10508	796	702	702
q5	7813	2851	2865	2851
q6	227	140	137	137
q7	957	589	591	589
q8	9336	2060	2087	2060
q9	8660	6582	6602	6582
q10	7075	2176	2193	2176
q11	450	256	249	249
q12	397	227	217	217
q13	18926	3013	3006	3006
q14	275	231	244	231
q15	528	485	493	485
q16	503	411	388	388
q17	999	651	663	651
q18	8108	7450	7396	7396
q19	5477	910	969	910
q20	688	328	344	328
q21	5345	4231	4649	4231
q22	1136	1044	997	997
Total cold run time: 118885 ms
Total hot run time: 39716 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4442	4329	4308	4308
q2	383	283	270	270
q3	2895	2776	2842	2776
q4	2062	1763	1746	1746
q5	5668	5643	5610	5610
q6	227	133	130	130
q7	2222	1754	1766	1754
q8	3326	3488	3452	3452
q9	8787	8943	8805	8805
q10	3557	3191	3328	3191
q11	631	509	522	509
q12	848	673	691	673
q13	15812	3178	3189	3178
q14	316	296	290	290
q15	540	482	526	482
q16	474	454	445	445
q17	1839	1522	1519	1519
q18	8165	8110	7939	7939
q19	1851	1462	1580	1462
q20	2302	1911	1874	1874
q21	8762	5215	5310	5215
q22	1178	1085	1065	1065
Total cold run time: 76287 ms
Total hot run time: 56693 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191240 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cdb162c667dae739c0d64e2edf15073cad501cd3, data reload: false

query1	1245	910	859	859
query2	6358	2018	1872	1872
query3	10730	3998	3850	3850
query4	59334	25302	23565	23565
query5	5578	489	467	467
query6	463	156	157	156
query7	6339	288	286	286
query8	294	207	202	202
query9	8772	2447	2409	2409
query10	478	260	256	256
query11	18091	15068	15337	15068
query12	157	103	99	99
query13	1525	390	376	376
query14	11500	7897	7784	7784
query15	262	180	165	165
query16	7724	514	470	470
query17	1135	589	576	576
query18	1984	305	305	305
query19	289	156	157	156
query20	119	117	117	117
query21	211	111	107	107
query22	4682	4551	4381	4381
query23	34320	33580	33387	33387
query24	5736	2853	2788	2788
query25	543	397	418	397
query26	687	162	158	158
query27	1790	277	274	274
query28	3801	2074	2075	2074
query29	698	434	431	431
query30	239	153	147	147
query31	930	766	696	696
query32	86	53	58	53
query33	476	290	288	288
query34	863	466	476	466
query35	826	761	713	713
query36	1017	921	894	894
query37	135	78	82	78
query38	4033	3759	3827	3759
query39	1440	1527	1364	1364
query40	198	117	117	117
query41	47	45	45	45
query42	116	98	92	92
query43	511	467	472	467
query44	1076	734	729	729
query45	203	167	167	167
query46	1099	719	714	714
query47	1884	1776	1805	1776
query48	383	294	299	294
query49	762	427	434	427
query50	815	405	402	402
query51	6859	6651	6704	6651
query52	104	91	88	88
query53	254	188	183	183
query54	564	551	434	434
query55	76	73	71	71
query56	255	238	237	237
query57	1156	1072	1077	1072
query58	217	219	246	219
query59	3008	2729	2850	2729
query60	291	266	256	256
query61	93	93	93	93
query62	760	641	653	641
query63	215	175	181	175
query64	3230	1699	1725	1699
query65	3205	3134	3150	3134
query66	676	322	322	322
query67	15579	15052	15080	15052
query68	4769	544	538	538
query69	547	274	265	265
query70	1085	1120	1124	1120
query71	520	315	272	272
query72	7969	2289	2024	2024
query73	785	323	326	323
query74	9178	8787	8705	8705
query75	4905	2682	2730	2682
query76	3427	1034	1042	1034
query77	731	294	301	294
query78	9752	9048	9071	9048
query79	5354	522	530	522
query80	1216	482	479	479
query81	580	223	226	223
query82	1025	138	138	138
query83	337	150	146	146
query84	275	76	76	76
query85	1620	270	295	270
query86	425	295	293	293
query87	4444	4282	4121	4121
query88	5401	2397	2441	2397
query89	408	285	289	285
query90	1928	192	189	189
query91	121	92	93	92
query92	57	49	47	47
query93	5739	552	535	535
query94	912	305	305	305
query95	349	261	264	261
query96	617	279	270	270
query97	3218	3051	3033	3033
query98	229	207	198	198
query99	1628	1276	1279	1276
Total cold run time: 328077 ms
Total hot run time: 191240 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.16 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cdb162c667dae739c0d64e2edf15073cad501cd3, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.05
query3	0.22	0.05	0.05
query4	1.68	0.07	0.07
query5	0.50	0.49	0.48
query6	1.14	0.72	0.73
query7	0.02	0.01	0.01
query8	0.05	0.05	0.04
query9	0.54	0.48	0.49
query10	0.55	0.55	0.54
query11	0.15	0.12	0.11
query12	0.14	0.12	0.11
query13	0.60	0.60	0.59
query14	0.76	0.78	0.79
query15	0.84	0.80	0.81
query16	0.36	0.37	0.37
query17	0.95	0.95	0.97
query18	0.23	0.23	0.22
query19	1.81	1.74	1.66
query20	0.01	0.01	0.01
query21	15.41	0.76	0.65
query22	4.39	7.51	1.49
query23	18.28	1.36	1.26
query24	2.07	0.23	0.23
query25	0.14	0.08	0.09
query26	0.32	0.21	0.20
query27	0.46	0.23	0.22
query28	13.21	1.01	0.99
query29	12.60	3.40	3.33
query30	0.23	0.05	0.05
query31	2.94	0.40	0.40
query32	3.23	0.49	0.46
query33	2.94	3.00	2.98
query34	17.08	4.34	4.41
query35	4.44	4.39	4.42
query36	0.65	0.46	0.46
query37	0.18	0.16	0.17
query38	0.15	0.14	0.15
query39	0.04	0.04	0.03
query40	0.16	0.11	0.12
query41	0.08	0.04	0.04
query42	0.06	0.04	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.79 s
Total hot run time: 30.16 s

@felixwluo
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37791 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f84a21fee51a50ab6c39d7437e6f949fb209c9e9, data reload: false

------ Round 1 ----------------------------------
q1	17620	4347	4325	4325
q2	2020	185	176	176
q3	11903	997	1188	997
q4	10508	759	776	759
q5	7735	2809	2751	2751
q6	230	141	142	141
q7	964	596	589	589
q8	9534	2054	2066	2054
q9	8057	6591	6595	6591
q10	7065	2222	2166	2166
q11	462	246	243	243
q12	395	223	219	219
q13	17754	2988	3016	2988
q14	283	247	249	247
q15	514	486	490	486
q16	503	382	387	382
q17	966	652	664	652
q18	7306	6990	6743	6743
q19	7312	1126	1043	1043
q20	663	330	333	330
q21	3885	2890	2992	2890
q22	1123	1019	1044	1019
Total cold run time: 116802 ms
Total hot run time: 37791 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4510	4289	4299	4289
q2	376	276	268	268
q3	2877	2645	2636	2636
q4	2028	1721	1786	1721
q5	5661	5726	5601	5601
q6	242	133	134	133
q7	2149	1706	1730	1706
q8	3323	3503	3417	3417
q9	8748	8732	8831	8732
q10	3600	3275	3292	3275
q11	604	516	513	513
q12	808	641	614	614
q13	17190	3215	3152	3152
q14	329	295	296	295
q15	530	486	513	486
q16	485	452	447	447
q17	1816	1561	1539	1539
q18	8020	7976	7821	7821
q19	1725	1612	1600	1600
q20	2104	1862	1924	1862
q21	5618	5366	5462	5366
q22	1112	1046	1006	1006
Total cold run time: 73855 ms
Total hot run time: 56479 ms

@felixwluo
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37663 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d5d1ccc0fd0fe9566f91b1027c6ff2c5ca816369, data reload: false

------ Round 1 ----------------------------------
q1	17812	5200	4404	4404
q2	2209	176	171	171
q3	10499	1158	1068	1068
q4	10154	687	748	687
q5	7717	2793	2777	2777
q6	222	136	137	136
q7	951	599	590	590
q8	9321	2025	2061	2025
q9	7253	6494	6540	6494
q10	7018	2239	2187	2187
q11	455	236	241	236
q12	388	220	224	220
q13	17772	2998	2983	2983
q14	285	230	247	230
q15	510	483	485	483
q16	485	390	378	378
q17	954	683	690	683
q18	7775	6874	6752	6752
q19	7496	1035	1066	1035
q20	700	328	313	313
q21	3790	2908	2819	2819
q22	1063	1000	992	992
Total cold run time: 114829 ms
Total hot run time: 37663 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4490	4274	4231	4231
q2	367	267	275	267
q3	2838	2627	2586	2586
q4	1866	1565	1595	1565
q5	5315	5399	5359	5359
q6	216	130	132	130
q7	2041	1655	1667	1655
q8	3139	3351	3328	3328
q9	8399	8368	8331	8331
q10	3398	3149	3154	3149
q11	600	487	494	487
q12	755	612	578	578
q13	16717	2953	2991	2953
q14	300	285	272	272
q15	519	480	468	468
q16	474	425	437	425
q17	1782	1485	1486	1485
q18	7727	7355	7467	7355
q19	1625	1550	1572	1550
q20	2039	1800	1765	1765
q21	5230	5151	5098	5098
q22	1113	1035	978	978
Total cold run time: 70950 ms
Total hot run time: 54015 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184204 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d5d1ccc0fd0fe9566f91b1027c6ff2c5ca816369, data reload: false

query1	905	370	358	358
query2	6456	1989	1940	1940
query3	6642	203	211	203
query4	34056	23271	23283	23271
query5	4180	483	474	474
query6	272	165	165	165
query7	4601	292	284	284
query8	244	207	191	191
query9	8520	2433	2399	2399
query10	430	269	256	256
query11	17664	14975	14897	14897
query12	162	100	99	99
query13	1631	358	348	348
query14	9497	6520	6432	6432
query15	231	164	162	162
query16	7361	480	463	463
query17	1140	558	529	529
query18	1771	277	273	273
query19	187	145	150	145
query20	112	105	106	105
query21	212	105	96	96
query22	4435	4037	3924	3924
query23	33886	33223	33439	33223
query24	12411	2778	2785	2778
query25	673	367	367	367
query26	1771	156	150	150
query27	2902	266	274	266
query28	7424	2041	2016	2016
query29	1091	395	388	388
query30	301	150	152	150
query31	965	758	752	752
query32	96	54	54	54
query33	769	277	268	268
query34	992	452	459	452
query35	843	739	717	717
query36	1070	914	902	902
query37	154	81	84	81
query38	3933	3880	3786	3786
query39	1419	1396	1354	1354
query40	281	112	116	112
query41	46	45	45	45
query42	111	96	96	96
query43	525	485	479	479
query44	1229	718	723	718
query45	194	161	163	161
query46	1084	739	716	716
query47	1892	1787	1761	1761
query48	356	285	288	285
query49	1171	411	421	411
query50	796	393	409	393
query51	6744	6770	6652	6652
query52	103	89	88	88
query53	248	184	177	177
query54	1011	479	439	439
query55	72	76	73	73
query56	268	246	244	244
query57	1164	1061	1062	1061
query58	237	219	216	216
query59	3133	2796	2866	2796
query60	298	257	277	257
query61	99	95	95	95
query62	831	636	657	636
query63	217	185	180	180
query64	6401	2287	1742	1742
query65	3213	3143	3150	3143
query66	1379	326	328	326
query67	15517	14863	15130	14863
query68	4644	529	525	525
query69	405	267	268	267
query70	1174	1107	1162	1107
query71	414	270	267	267
query72	6528	2259	1957	1957
query73	762	322	317	317
query74	9087	8754	8719	8719
query75	3463	2686	2693	2686
query76	2675	1055	980	980
query77	493	307	312	307
query78	9540	9052	8997	8997
query79	2055	530	540	530
query80	1396	554	494	494
query81	577	224	223	223
query82	722	136	132	132
query83	215	142	143	142
query84	238	73	76	73
query85	2065	274	272	272
query86	493	293	289	289
query87	4422	4358	4253	4253
query88	3919	2321	2321	2321
query89	395	294	286	286
query90	1854	201	195	195
query91	122	95	94	94
query92	114	50	48	48
query93	2488	522	528	522
query94	947	277	297	277
query95	357	252	254	252
query96	596	275	268	268
query97	3230	3081	3052	3052
query98	229	206	203	203
query99	1720	1266	1272	1266
Total cold run time: 297368 ms
Total hot run time: 184204 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.53 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d5d1ccc0fd0fe9566f91b1027c6ff2c5ca816369, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.24	0.05	0.04
query4	1.75	0.08	0.10
query5	0.49	0.50	0.49
query6	1.12	0.73	0.74
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.48	0.49
query10	0.54	0.53	0.54
query11	0.16	0.12	0.11
query12	0.15	0.12	0.13
query13	0.59	0.60	0.59
query14	0.78	1.07	0.92
query15	0.84	0.82	0.81
query16	0.38	0.37	0.37
query17	1.05	0.99	1.01
query18	0.23	0.22	0.22
query19	1.94	1.79	1.86
query20	0.02	0.01	0.01
query21	15.33	0.68	0.67
query22	4.14	6.96	2.52
query23	18.34	1.32	1.24
query24	2.05	0.22	0.25
query25	0.15	0.08	0.08
query26	0.29	0.21	0.22
query27	0.44	0.22	0.22
query28	13.20	1.01	1.00
query29	12.59	3.41	3.40
query30	0.23	0.06	0.05
query31	2.90	0.39	0.38
query32	3.27	0.51	0.47
query33	2.95	2.99	2.92
query34	16.97	4.31	4.30
query35	4.40	4.40	4.42
query36	0.65	0.47	0.46
query37	0.18	0.15	0.16
query38	0.16	0.15	0.15
query39	0.05	0.04	0.03
query40	0.16	0.14	0.12
query41	0.10	0.05	0.05
query42	0.05	0.05	0.05
query43	0.05	0.04	0.03
Total cold run time: 109.67 s
Total hot run time: 31.53 s

@felixwluo
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37445 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6f59230998662282b1214467cd3459ed7847f502, data reload: false

------ Round 1 ----------------------------------
q1	17607	4380	4250	4250
q2	2009	179	175	175
q3	11963	1022	1126	1022
q4	10513	720	771	720
q5	7753	2773	2775	2773
q6	225	141	139	139
q7	953	595	593	593
q8	9528	2016	2057	2016
q9	8736	6512	6531	6512
q10	7013	2181	2177	2177
q11	455	245	245	245
q12	395	219	225	219
q13	18739	2977	3013	2977
q14	278	255	243	243
q15	521	488	493	488
q16	500	409	387	387
q17	981	679	744	679
q18	7372	6694	6738	6694
q19	6947	1064	1003	1003
q20	718	327	342	327
q21	3975	2797	2827	2797
q22	1100	1009	1033	1009
Total cold run time: 118281 ms
Total hot run time: 37445 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4454	4259	4282	4259
q2	382	268	269	268
q3	2861	2636	2616	2616
q4	2027	1798	1731	1731
q5	5626	5695	5544	5544
q6	226	136	135	135
q7	2139	1719	1754	1719
q8	3333	3451	3457	3451
q9	8743	8638	8766	8638
q10	3540	3273	3325	3273
q11	622	501	519	501
q12	789	636	594	594
q13	16409	3204	3181	3181
q14	328	281	282	281
q15	532	515	509	509
q16	506	463	450	450
q17	1856	1571	1497	1497
q18	8157	7840	7816	7816
q19	1732	1654	1573	1573
q20	2183	1910	1874	1874
q21	5694	5419	5374	5374
q22	1134	1048	1030	1030
Total cold run time: 73273 ms
Total hot run time: 56314 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189937 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6f59230998662282b1214467cd3459ed7847f502, data reload: false

query1	1251	913	863	863
query2	6443	1856	1832	1832
query3	10696	3912	3703	3703
query4	59599	23781	23263	23263
query5	5962	490	482	482
query6	513	152	158	152
query7	6520	291	295	291
query8	315	213	195	195
query9	9075	2471	2439	2439
query10	529	265	281	265
query11	18445	14956	15099	14956
query12	162	102	98	98
query13	1609	378	391	378
query14	11538	7002	7123	7002
query15	252	175	172	172
query16	7702	512	542	512
query17	1166	597	570	570
query18	2072	307	299	299
query19	288	149	149	149
query20	121	110	109	109
query21	218	106	104	104
query22	4461	4353	4282	4282
query23	34204	33277	33152	33152
query24	5598	2863	2840	2840
query25	554	395	396	395
query26	708	159	160	159
query27	1812	271	274	271
query28	3631	2087	2059	2059
query29	722	427	417	417
query30	233	152	145	145
query31	934	768	754	754
query32	107	54	56	54
query33	508	296	292	292
query34	841	454	471	454
query35	805	714	731	714
query36	1027	942	922	922
query37	137	80	80	80
query38	4061	3800	3804	3800
query39	1460	1408	1405	1405
query40	201	116	122	116
query41	51	46	46	46
query42	122	99	95	95
query43	491	470	465	465
query44	1101	722	728	722
query45	192	167	164	164
query46	1077	707	737	707
query47	1881	1786	1794	1786
query48	360	293	295	293
query49	758	424	435	424
query50	796	405	400	400
query51	6790	6681	6644	6644
query52	99	93	88	88
query53	256	182	176	176
query54	596	550	445	445
query55	75	71	74	71
query56	263	253	241	241
query57	1175	1089	1121	1089
query58	235	230	248	230
query59	3180	3238	2930	2930
query60	281	264	265	264
query61	94	95	94	94
query62	769	643	642	642
query63	206	182	177	177
query64	4374	2261	1703	1703
query65	3214	3160	3134	3134
query66	697	327	325	325
query67	15356	15237	14960	14960
query68	8524	554	563	554
query69	664	373	309	309
query70	1505	1178	1104	1104
query71	562	273	273	273
query72	7036	2263	2029	2029
query73	2635	320	323	320
query74	9108	8802	8755	8755
query75	5095	2722	2743	2722
query76	5108	1014	1001	1001
query77	729	310	311	310
query78	9795	9354	9076	9076
query79	9895	543	532	532
query80	1784	485	496	485
query81	565	226	222	222
query82	661	146	137	137
query83	287	149	148	148
query84	267	73	77	73
query85	884	286	270	270
query86	336	264	288	264
query87	4452	4144	4429	4144
query88	3810	2318	2286	2286
query89	507	285	284	284
query90	2273	188	192	188
query91	122	97	94	94
query92	60	52	52	52
query93	5348	526	530	526
query94	1075	291	288	288
query95	359	257	259	257
query96	605	271	265	265
query97	3196	3073	3063	3063
query98	229	208	199	199
query99	1746	1247	1269	1247
Total cold run time: 340191 ms
Total hot run time: 189937 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.56 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6f59230998662282b1214467cd3459ed7847f502, data reload: false

query1	0.04	0.05	0.04
query2	0.08	0.04	0.04
query3	0.22	0.04	0.05
query4	1.68	0.06	0.07
query5	0.51	0.49	0.48
query6	1.12	0.74	0.73
query7	0.01	0.01	0.02
query8	0.05	0.05	0.05
query9	0.53	0.51	0.49
query10	0.55	0.55	0.56
query11	0.15	0.11	0.11
query12	0.15	0.12	0.13
query13	0.61	0.60	0.61
query14	0.76	0.77	0.79
query15	0.85	0.81	0.82
query16	0.39	0.34	0.37
query17	0.97	1.05	0.98
query18	0.22	0.22	0.20
query19	1.80	1.78	1.76
query20	0.01	0.01	0.01
query21	15.41	0.73	0.65
query22	4.18	5.86	2.80
query23	18.29	1.47	1.26
query24	2.05	0.22	0.23
query25	0.16	0.08	0.08
query26	0.30	0.21	0.22
query27	0.46	0.23	0.23
query28	13.32	1.06	1.02
query29	12.91	3.27	3.28
query30	0.24	0.05	0.05
query31	2.89	0.40	0.40
query32	3.25	0.49	0.48
query33	2.95	2.92	2.95
query34	17.21	4.37	4.43
query35	4.41	4.37	4.44
query36	0.67	0.46	0.48
query37	0.18	0.15	0.16
query38	0.16	0.15	0.15
query39	0.04	0.03	0.03
query40	0.15	0.12	0.12
query41	0.09	0.05	0.05
query42	0.06	0.04	0.05
query43	0.04	0.04	0.04
Total cold run time: 110.12 s
Total hot run time: 31.56 s

@felixwluo
Copy link
Contributor Author

run compile

@felixwluo
Copy link
Contributor Author

run p0

@felixwluo
Copy link
Contributor Author

run cloud_p0

@felixwluo
Copy link
Contributor Author

run cloud_p1

1 similar comment
@felixwluo
Copy link
Contributor Author

run cloud_p1

@felixwluo felixwluo requested a review from morrySnow August 16, 2024 06:07
@924060929 924060929 merged commit bbbc660 into apache:master Oct 15, 2024
27 of 29 checks passed
@felixwluo felixwluo mentioned this pull request Oct 15, 2024
Merged
@felixwluo felixwluo mentioned this pull request Oct 16, 2024
Merged
@dtkavin dtkavin mentioned this pull request Oct 16, 2024
Merged
morrySnow pushed a commit that referenced this pull request Oct 17, 2024
@felixwluo
[fix](Nereids) fixed the limit offset error (#39316) (#41936)
633f531 
cherry-pick from master #39316
morrySnow pushed a commit that referenced this pull request Oct 17, 2024
@dtkavin
[fix](Nereids) fixed the limit offset error (#39316) (#41967)
4ce294f 
cherry-pick from master #39316
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Oct 28, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit
c45ee1e 
intro by apache#39316. it want to fix a problem intro by apache#36699.
but forgot to remove all wrong code in apache#36699.

after apache#39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
@morrySnow morrySnow mentioned this pull request Oct 28, 2024
Merged
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Oct 28, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
474084a 
…apache#42576)

pick from master apache#42576

intro by apache#39316. it want to fix a problem intro by apache#36699.
but forgot to remove all wrong code in apache#36699.

after apache#39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Oct 28, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit
b782c46 
intro by apache#39316. it want to fix a problem intro by apache#36699.
but forgot to remove all wrong code in apache#36699.

after apache#39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Oct 28, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
caa0933 
…apache#42576)

pick from master apache#42576

intro by apache#39316. it want to fix a problem intro by apache#36699.
but forgot to remove all wrong code in apache#36699.

after apache#39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
@morrySnow morrySnow mentioned this pull request Oct 28, 2024
Merged
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Oct 28, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
0c6afcd 
…apache#42576)

pick from master apache#42576

intro by apache#39316. it want to fix a problem intro by apache#36699.
but forgot to remove all wrong code in apache#36699.

after apache#39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Oct 28, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
42b1970 
…apache#42576)

pick from master apache#42576

intro by apache#39316. it want to fix a problem intro by apache#36699.
but forgot to remove all wrong code in apache#36699.

after apache#39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
@morrySnow morrySnow mentioned this pull request Oct 28, 2024
Merged
morrySnow added a commit that referenced this pull request Oct 28, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
45d0e01 
…#42576)

intro by #39316. it want to fix a problem intro by #36699. but forgot to
remove all wrong code in #36699.

after #39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Oct 28, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
469b8e8 
…apache#42576)

pick from master apache#42576

intro by apache#39316. it want to fix a problem intro by apache#36699.
but forgot to remove all wrong code in apache#36699.

after apache#39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
morrySnow added a commit that referenced this pull request Oct 28, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
0baca54 
…#42576) (#42577)

pick from master #42576

intro by #39316. it want to fix a problem intro by #36699. but forgot to
remove all wrong code in #36699.

after #39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
@morrySnow morrySnow mentioned this pull request Oct 29, 2024
Merged
morrySnow added a commit that referenced this pull request Oct 29, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
3dd0b03 
…#42576) (#42682)

pick from master #42576

intro by #39316. it want to fix a problem intro by #36699. but forgot to
remove all wrong code in #36699.

after #39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Oct 29, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
2569ed4 
…apache#42576)

pick from master apache#42576

intro by apache#39316. it want to fix a problem intro by apache#36699.
but forgot to remove all wrong code in apache#36699.

after apache#39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
morrySnow added a commit that referenced this pull request Oct 29, 2024
@morrySnow
[fix](Nereids) offset do more than once when have shuffle after limit (…
cbb97f8 
…#42576) (#42583)

pick from master #42576

intro by #39316. it want to fix a problem intro by #36699. but forgot to
remove all wrong code in #36699.

after #39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lide-reed lide-reed lide-reed left review comments

@morrySnow morrySnow morrySnow approved these changes

@starocean999 starocean999 starocean999 approved these changes

@924060929 924060929 924060929 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.16-merged dev/2.1.7-merged dev/3.0.3-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Bug] 使用开窗函数count(1) over()，当where后有limit...offset...时查询结果为空
7 participants
@felixwluo @doris-robot @morrySnow @lide-reed @924060929 @starocean999 @cambyzju