Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Exec)(cache) add element count in LRU cache #41199

Merged
merged 1 commit into from
Sep 25, 2024
Merged

Conversation

HappenLee
Copy link
Contributor

Proposed changes

add element_count() in LRU cache

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@HappenLee
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41703 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 81849a10a85c66a54e5a86615f33b21dfebd3c29, data reload: false

------ Round 1 ----------------------------------
q1	17575	7380	7302	7302
q2	2052	289	296	289
q3	12245	1100	1212	1100
q4	10581	724	686	686
q5	7743	3087	3069	3069
q6	239	152	147	147
q7	1028	625	587	587
q8	9428	2049	2040	2040
q9	6829	6407	6372	6372
q10	7033	2306	2293	2293
q11	430	254	245	245
q12	410	217	216	216
q13	17795	3008	2980	2980
q14	245	219	217	217
q15	583	533	536	533
q16	681	606	612	606
q17	978	801	848	801
q18	7248	6767	6756	6756
q19	1397	950	1092	950
q20	597	304	287	287
q21	4355	3336	3218	3218
q22	1120	1012	1009	1009
Total cold run time: 110592 ms
Total hot run time: 41703 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7259	7269	7273	7269
q2	338	241	243	241
q3	3071	2984	2956	2956
q4	2121	1858	1768	1768
q5	5628	5591	5740	5591
q6	229	145	146	145
q7	2174	1788	1763	1763
q8	3320	3521	3433	3433
q9	8788	8795	8781	8781
q10	3456	3513	3517	3513
q11	580	469	471	469
q12	824	594	582	582
q13	10796	3129	3163	3129
q14	313	282	274	274
q15	574	532	506	506
q16	702	661	656	656
q17	1826	1655	1577	1577
q18	8284	7794	7925	7794
q19	1727	1606	1454	1454
q20	2085	1862	1917	1862
q21	5361	5427	5383	5383
q22	1168	1058	1076	1058
Total cold run time: 70624 ms
Total hot run time: 60204 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.27% (9607/25777)
Line Coverage: 28.69% (79514/277194)
Region Coverage: 28.13% (41132/146196)
Branch Coverage: 24.78% (20971/84626)
Coverage Report: http://coverage.selectdb-in.cc/coverage/81849a10a85c66a54e5a86615f33b21dfebd3c29_81849a10a85c66a54e5a86615f33b21dfebd3c29/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 192219 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 81849a10a85c66a54e5a86615f33b21dfebd3c29, data reload: false

query1	953	388	412	388
query2	6359	2041	2069	2041
query3	8695	193	200	193
query4	34062	23850	23463	23463
query5	4084	481	488	481
query6	287	168	157	157
query7	4194	295	296	295
query8	286	217	229	217
query9	9367	2720	2737	2720
query10	464	282	272	272
query11	18160	15414	15105	15105
query12	144	99	96	96
query13	1534	429	404	404
query14	9980	7285	7422	7285
query15	247	172	179	172
query16	7407	468	497	468
query17	1614	608	591	591
query18	1994	332	328	328
query19	291	158	162	158
query20	125	119	112	112
query21	206	106	109	106
query22	4787	4595	4654	4595
query23	35321	34465	34444	34444
query24	11141	2937	2941	2937
query25	607	413	428	413
query26	1005	162	159	159
query27	2195	286	282	282
query28	7555	2486	2482	2482
query29	755	461	427	427
query30	256	157	161	157
query31	995	800	797	797
query32	103	54	58	54
query33	762	304	302	302
query34	908	496	487	487
query35	886	743	719	719
query36	1089	965	966	965
query37	145	92	84	84
query38	4030	3925	3893	3893
query39	1500	1564	1429	1429
query40	216	100	108	100
query41	52	48	47	47
query42	122	98	95	95
query43	520	490	465	465
query44	1197	825	817	817
query45	195	163	166	163
query46	1140	759	738	738
query47	1907	1815	1874	1815
query48	482	367	375	367
query49	911	425	409	409
query50	828	421	396	396
query51	7009	6974	6895	6895
query52	101	91	88	88
query53	253	186	196	186
query54	1264	471	461	461
query55	85	75	74	74
query56	297	271	255	255
query57	1198	1120	1105	1105
query58	231	239	222	222
query59	3037	2891	2801	2801
query60	307	266	267	266
query61	108	108	107	107
query62	820	649	678	649
query63	219	180	181	180
query64	4017	662	656	656
query65	3268	3182	3233	3182
query66	778	300	328	300
query67	16079	15610	15706	15610
query68	4636	588	564	564
query69	534	293	306	293
query70	1173	1126	1134	1126
query71	372	264	274	264
query72	7560	3999	4039	3999
query73	765	329	327	327
query74	10281	9046	9031	9031
query75	3448	2656	2669	2656
query76	3389	956	910	910
query77	656	298	289	289
query78	10000	9275	10582	9275
query79	1696	550	541	541
query80	937	440	440	440
query81	557	241	241	241
query82	367	145	142	142
query83	359	148	135	135
query84	278	81	84	81
query85	1486	299	285	285
query86	438	303	303	303
query87	4499	4244	4304	4244
query88	2996	2350	2337	2337
query89	388	291	289	289
query90	1979	185	184	184
query91	184	143	144	143
query92	64	48	50	48
query93	1092	538	538	538
query94	969	289	306	289
query95	355	255	253	253
query96	606	274	286	274
query97	3232	3125	3104	3104
query98	218	198	202	198
query99	1512	1331	1289	1289
Total cold run time: 298160 ms
Total hot run time: 192219 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.12 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 81849a10a85c66a54e5a86615f33b21dfebd3c29, data reload: false

query1	0.05	0.04	0.04
query2	0.06	0.03	0.02
query3	0.22	0.06	0.06
query4	1.66	0.10	0.10
query5	0.51	0.50	0.52
query6	1.14	0.73	0.73
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.57	0.52	0.50
query10	0.53	0.56	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.61	0.60
query14	3.07	2.96	3.02
query15	0.90	0.82	0.82
query16	0.39	0.39	0.38
query17	1.09	1.07	1.08
query18	0.19	0.19	0.20
query19	1.98	1.84	2.03
query20	0.01	0.00	0.01
query21	15.36	0.59	0.57
query22	3.30	1.77	1.85
query23	17.14	0.80	0.77
query24	2.83	1.40	1.47
query25	0.23	0.09	0.14
query26	0.52	0.13	0.14
query27	0.05	0.03	0.04
query28	9.96	1.11	1.07
query29	12.58	3.25	3.28
query30	0.25	0.06	0.07
query31	2.87	0.36	0.38
query32	3.28	0.49	0.46
query33	2.97	3.02	2.99
query34	16.97	4.40	4.38
query35	4.41	4.43	4.40
query36	0.65	0.48	0.50
query37	0.08	0.06	0.06
query38	0.05	0.03	0.04
query39	0.02	0.02	0.03
query40	0.15	0.12	0.12
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.02	0.02
Total cold run time: 107.13 s
Total hot run time: 33.12 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 24, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@HappenLee HappenLee merged commit c687481 into apache:master Sep 25, 2024
23 of 29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants