Skip to content

Conversation

@zddr
Copy link
Contributor

@zddr zddr commented Jan 9, 2025

…mon table as an unpartitioned table (#46641)

pick: #46641

…mon table as an unpartitioned table (apache#46641)

When retrieving data of type Paimon Date in version 0.9 from the system
table, the value is an integer and cannot be converted to type Date.

This issue has been fixed in Paimon's latest code.

This PR downgrades this situation without affecting user data queries
@Thearas
Copy link
Contributor

Thearas commented Jan 9, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@zddr
Copy link
Contributor Author

zddr commented Jan 9, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40913 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 97ccad2c8ec74a81ca80f0db90353385941d0f85, data reload: false

------ Round 1 ----------------------------------
q1	17581	7324	7208	7208
q2	2069	166	162	162
q3	10563	1115	1177	1115
q4	10269	771	676	676
q5	8172	2886	2890	2886
q6	236	149	149	149
q7	982	607	614	607
q8	9709	2007	2044	2007
q9	6724	6507	6487	6487
q10	8135	2333	2330	2330
q11	449	260	268	260
q12	402	214	204	204
q13	17750	2981	2995	2981
q14	242	219	221	219
q15	576	523	521	521
q16	676	631	616	616
q17	955	551	549	549
q18	7310	6627	6682	6627
q19	1397	1113	1121	1113
q20	484	196	192	192
q21	4092	3266	3025	3025
q22	1087	979	1003	979
Total cold run time: 109860 ms
Total hot run time: 40913 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7224	7177	7183	7177
q2	324	232	233	232
q3	2948	3012	2998	2998
q4	2074	1802	1806	1802
q5	5697	5667	5701	5667
q6	217	134	135	134
q7	2210	1848	1728	1728
q8	3357	3511	3442	3442
q9	8832	8880	8853	8853
q10	3550	3577	3535	3535
q11	595	495	519	495
q12	816	585	598	585
q13	6954	3170	3021	3021
q14	284	257	259	257
q15	578	517	503	503
q16	688	671	636	636
q17	1753	1560	1549	1549
q18	7881	7525	7339	7339
q19	1615	1511	1452	1452
q20	2019	1775	1791	1775
q21	5316	5162	5050	5050
q22	1103	1024	994	994
Total cold run time: 66035 ms
Total hot run time: 59224 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191028 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 97ccad2c8ec74a81ca80f0db90353385941d0f85, data reload: false

query1	996	383	352	352
query2	6727	2151	2036	2036
query3	6707	213	215	213
query4	33715	23390	23274	23274
query5	4327	450	450	450
query6	272	185	191	185
query7	4623	302	302	302
query8	279	226	235	226
query9	9399	2672	2656	2656
query10	500	251	263	251
query11	18405	15133	15146	15133
query12	156	100	103	100
query13	1637	432	408	408
query14	10189	7479	7166	7166
query15	312	169	181	169
query16	8135	467	492	467
query17	1742	584	569	569
query18	2159	306	302	302
query19	388	157	153	153
query20	113	109	108	108
query21	203	102	105	102
query22	4477	4325	4137	4137
query23	34563	33906	34148	33906
query24	11173	2742	2774	2742
query25	651	384	387	384
query26	1245	167	162	162
query27	2513	352	346	346
query28	7751	2427	2443	2427
query29	846	436	408	408
query30	325	164	154	154
query31	1025	795	799	795
query32	96	56	54	54
query33	776	300	295	295
query34	940	504	528	504
query35	868	713	702	702
query36	1094	946	946	946
query37	125	71	76	71
query38	4118	3950	3793	3793
query39	1491	1421	1500	1421
query40	203	97	97	97
query41	50	48	49	48
query42	116	101	97	97
query43	536	491	491	491
query44	1186	806	822	806
query45	180	166	165	165
query46	1135	717	691	691
query47	1954	1820	1829	1820
query48	466	373	381	373
query49	1173	394	379	379
query50	822	402	400	400
query51	7263	7140	7056	7056
query52	104	91	90	90
query53	260	179	182	179
query54	1287	458	458	458
query55	77	76	73	73
query56	254	237	257	237
query57	1221	1115	1117	1115
query58	233	203	213	203
query59	3286	3191	3017	3017
query60	305	249	258	249
query61	111	107	108	107
query62	860	679	700	679
query63	225	185	186	185
query64	4247	679	643	643
query65	3259	3184	3191	3184
query66	1450	312	324	312
query67	16001	15731	15358	15358
query68	3119	582	586	582
query69	410	259	263	259
query70	1185	1163	1065	1065
query71	355	254	262	254
query72	6124	4267	4147	4147
query73	759	358	346	346
query74	9506	9016	9029	9016
query75	3388	2653	2613	2613
query76	2016	1103	1123	1103
query77	393	283	272	272
query78	10428	9647	9563	9563
query79	1374	611	596	596
query80	1083	475	410	410
query81	554	238	239	238
query82	1171	131	123	123
query83	218	142	143	142
query84	233	80	79	79
query85	1300	304	289	289
query86	379	311	279	279
query87	4388	4218	4298	4218
query88	3311	2373	2333	2333
query89	400	287	300	287
query90	1994	182	183	182
query91	186	153	150	150
query92	61	51	49	49
query93	1048	542	543	542
query94	967	299	299	299
query95	356	251	250	250
query96	606	277	276	276
query97	3339	3186	3190	3186
query98	207	204	195	195
query99	1535	1304	1311	1304
Total cold run time: 295718 ms
Total hot run time: 191028 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.21 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 97ccad2c8ec74a81ca80f0db90353385941d0f85, data reload: false

query1	0.03	0.03	0.02
query2	0.07	0.03	0.02
query3	0.22	0.07	0.07
query4	1.64	0.11	0.10
query5	0.52	0.52	0.49
query6	1.13	0.72	0.72
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.49	0.50
query10	0.56	0.55	0.56
query11	0.14	0.11	0.11
query12	0.13	0.11	0.11
query13	0.60	0.59	0.59
query14	2.90	2.92	2.93
query15	0.89	0.83	0.83
query16	0.38	0.39	0.38
query17	1.04	1.06	1.05
query18	0.23	0.22	0.21
query19	1.90	1.81	1.91
query20	0.01	0.02	0.01
query21	15.35	0.57	0.54
query22	2.49	2.72	1.83
query23	16.94	1.03	0.80
query24	2.91	1.27	1.51
query25	0.15	0.13	0.10
query26	0.57	0.13	0.14
query27	0.07	0.04	0.04
query28	10.04	1.11	1.07
query29	12.53	3.20	3.18
query30	0.28	0.06	0.06
query31	2.90	0.38	0.41
query32	3.22	0.44	0.46
query33	2.97	3.01	3.00
query34	16.80	4.55	4.51
query35	4.54	4.52	4.57
query36	0.68	0.51	0.51
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 105.93 s
Total hot run time: 33.21 s

@morrySnow morrySnow merged commit 172b859 into apache:branch-3.0 Jan 9, 2025
21 of 22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants