Skip to content

Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) #49958

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morningman merged 2 commits into from
Apr 18, 2025
Merged

Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) #49958

morningman merged 2 commits into from
Apr 18, 2025

Conversation

@hubgeter
Copy link
Contributor

@hubgeter hubgeter commented Apr 10, 2025

This reverts commit fa51185.

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hubgeter
Copy link
Contributor Author

hubgeter commented Apr 10, 2025

run buildall

@hello-stephen
Copy link
Contributor

hello-stephen commented Apr 10, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@doris-robot
Copy link

doris-robot commented Apr 10, 2025

TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311)
Line Coverage: 66.05% (18156/27489)
Region Coverage: 65.49% (8944/13657)
Branch Coverage: 55.32% (4817/8708)
Coverage Report: http://coverage.selectdb-in.cc/coverage/129657ff6063033e6147db3dce0f53c1e0c3bade_129657ff6063033e6147db3dce0f53c1e0c3bade_cloud/report/index.html

@doris-robot
Copy link

doris-robot commented Apr 10, 2025

TPC-H: Total hot run time: 34497 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 129657ff6063033e6147db3dce0f53c1e0c3bade, data reload: false

------ Round 1 ----------------------------------
q1	26294	5100	5178	5100
q2	2078	300	201	201
q3	10586	1304	725	725
q4	10277	1032	525	525
q5	7913	2480	2375	2375
q6	205	164	130	130
q7	912	739	594	594
q8	9316	1369	1134	1134
q9	6893	5155	5157	5155
q10	6810	2335	1888	1888
q11	499	288	266	266
q12	346	361	217	217
q13	17783	3675	3081	3081
q14	225	232	205	205
q15	536	484	490	484
q16	626	630	578	578
q17	634	886	393	393
q18	7701	7264	7167	7167
q19	1658	982	562	562
q20	344	344	240	240
q21	4516	3418	2508	2508
q22	1065	1032	969	969
Total cold run time: 117217 ms
Total hot run time: 34497 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5212	5158	5157	5157
q2	245	335	235	235
q3	2162	2672	2289	2289
q4	1463	1867	1423	1423
q5	4252	4177	4127	4127
q6	211	163	122	122
q7	1865	1812	1622	1622
q8	2515	2455	2557	2455
q9	6939	6834	6804	6804
q10	2900	3093	2656	2656
q11	579	495	476	476
q12	646	720	579	579
q13	3320	3709	3076	3076
q14	273	281	255	255
q15	515	465	469	465
q16	648	684	629	629
q17	1122	1590	1312	1312
q18	7382	7073	6983	6983
q19	803	817	1014	817
q20	1930	1964	1819	1819
q21	5179	4749	4544	4544
q22	1048	1035	975	975
Total cold run time: 51209 ms
Total hot run time: 48820 ms

@doris-robot
Copy link

doris-robot commented Apr 10, 2025

TPC-DS: Total hot run time: 186629 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 129657ff6063033e6147db3dce0f53c1e0c3bade, data reload: false

query1	1017	480	474	474
query2	6538	1968	1940	1940
query3	6772	224	224	224
query4	26203	23257	23072	23072
query5	4355	637	464	464
query6	293	199	193	193
query7	4618	483	304	304
query8	288	250	230	230
query9	8625	2588	2574	2574
query10	478	317	258	258
query11	15328	15066	15025	15025
query12	170	115	116	115
query13	1656	505	379	379
query14	10073	6134	6227	6134
query15	201	183	165	165
query16	7626	608	494	494
query17	1190	712	546	546
query18	2017	409	292	292
query19	188	179	152	152
query20	121	153	118	118
query21	212	121	103	103
query22	4141	4191	4161	4161
query23	33855	33039	33133	33039
query24	8314	2357	2355	2355
query25	529	445	396	396
query26	1243	272	154	154
query27	2733	493	338	338
query28	4357	2395	2382	2382
query29	718	563	438	438
query30	290	227	196	196
query31	990	864	806	806
query32	78	68	66	66
query33	571	376	326	326
query34	809	869	513	513
query35	796	827	750	750
query36	944	1004	880	880
query37	119	106	80	80
query38	4135	4215	4073	4073
query39	1437	1441	1386	1386
query40	215	128	112	112
query41	62	60	58	58
query42	126	105	107	105
query43	512	519	491	491
query44	1315	801	815	801
query45	176	176	177	176
query46	845	1046	631	631
query47	1820	1820	1752	1752
query48	375	417	298	298
query49	782	537	414	414
query50	651	678	394	394
query51	4177	4167	4158	4158
query52	106	102	95	95
query53	225	251	187	187
query54	573	562	518	518
query55	79	81	85	81
query56	301	294	277	277
query57	1121	1156	1103	1103
query58	258	254	241	241
query59	2646	2799	2571	2571
query60	335	317	306	306
query61	176	127	127	127
query62	786	757	666	666
query63	226	182	188	182
query64	4230	1003	674	674
query65	4379	4271	4317	4271
query66	1088	414	314	314
query67	16155	15472	15341	15341
query68	8803	881	519	519
query69	458	302	268	268
query70	1206	1164	1023	1023
query71	467	319	287	287
query72	5181	4710	4698	4698
query73	681	576	341	341
query74	9000	8942	8978	8942
query75	4234	3215	2699	2699
query76	3693	1210	755	755
query77	800	378	287	287
query78	10121	10114	9261	9261
query79	1935	873	584	584
query80	621	511	453	453
query81	464	255	221	221
query82	455	124	104	104
query83	284	249	238	238
query84	305	104	86	86
query85	812	363	308	308
query86	333	302	293	293
query87	4539	4530	4347	4347
query88	3431	2226	2245	2226
query89	386	319	278	278
query90	1940	206	215	206
query91	138	141	121	121
query92	81	60	59	59
query93	1515	973	582	582
query94	673	414	307	307
query95	384	290	284	284
query96	494	571	279	279
query97	3173	3204	3179	3179
query98	233	204	201	201
query99	1433	1425	1254	1254
Total cold run time: 276041 ms
Total hot run time: 186629 ms

@doris-robot
Copy link

doris-robot commented Apr 10, 2025

ClickBench: Total hot run time: 30.8 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 129657ff6063033e6147db3dce0f53c1e0c3bade, data reload: false

query1	0.03	0.04	0.03
query2	0.12	0.10	0.11
query3	0.25	0.20	0.20
query4	1.58	0.19	0.11
query5	0.55	0.55	0.55
query6	1.20	0.70	0.70
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.52	0.52
query10	0.61	0.59	0.58
query11	0.16	0.10	0.11
query12	0.14	0.11	0.12
query13	0.61	0.60	0.61
query14	2.82	2.69	2.72
query15	0.91	0.84	0.84
query16	0.38	0.38	0.37
query17	1.04	1.03	1.02
query18	0.22	0.20	0.20
query19	2.02	1.89	1.85
query20	0.01	0.01	0.01
query21	15.35	0.88	0.54
query22	0.75	1.06	0.63
query23	15.08	1.39	0.63
query24	7.32	1.69	0.48
query25	0.51	0.37	0.08
query26	0.47	0.16	0.14
query27	0.06	0.05	0.05
query28	9.79	0.90	0.43
query29	12.61	4.07	3.41
query30	0.25	0.09	0.06
query31	2.83	0.59	0.37
query32	3.23	0.56	0.46
query33	3.07	3.09	3.06
query34	15.94	5.07	4.53
query35	4.52	4.50	4.50
query36	0.68	0.50	0.48
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.23 s
Total hot run time: 30.8 s

@hubgeter hubgeter force-pushed the rev_rev_hive_json_serde branch from 129657f to 2ea63cd Compare April 11, 2025 03:30
@hubgeter
Copy link
Contributor Author

hubgeter commented Apr 11, 2025

run external

@hubgeter
Copy link
Contributor Author

hubgeter commented Apr 11, 2025

run buildall

@hubgeter hubgeter force-pushed the rev_rev_hive_json_serde branch from 9f29b89 to 9f90798 Compare April 11, 2025 07:29
@hubgeter
Copy link
Contributor Author

hubgeter commented Apr 11, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Apr 11, 2025

TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311)
Line Coverage: 66.10% (18170/27489)
Region Coverage: 65.53% (8950/13657)
Branch Coverage: 55.40% (4824/8708)
Coverage Report: http://coverage.selectdb-in.cc/coverage/9f9079846d169698cdfd684ab14638827fae02b8_9f9079846d169698cdfd684ab14638827fae02b8_cloud/report/index.html

@doris-robot
Copy link

doris-robot commented Apr 11, 2025

TPC-H: Total hot run time: 34850 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9f9079846d169698cdfd684ab14638827fae02b8, data reload: false

------ Round 1 ----------------------------------
q1	26428	5060	5205	5060
q2	2088	283	190	190
q3	10474	1270	691	691
q4	10234	1003	546	546
q5	7604	2462	2338	2338
q6	188	162	131	131
q7	933	726	608	608
q8	9330	1291	1077	1077
q9	6875	5152	5134	5134
q10	6796	2294	1869	1869
q11	479	282	267	267
q12	353	355	217	217
q13	17793	3665	3083	3083
q14	224	224	207	207
q15	536	501	486	486
q16	615	626	578	578
q17	599	862	369	369
q18	7600	7230	7116	7116
q19	1836	979	569	569
q20	324	343	231	231
q21	4063	3363	3135	3135
q22	1049	1025	948	948
Total cold run time: 116421 ms
Total hot run time: 34850 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5187	5053	5112	5053
q2	234	329	232	232
q3	2173	2680	2266	2266
q4	1396	1903	1496	1496
q5	4582	4455	4384	4384
q6	213	174	126	126
q7	1934	1866	1739	1739
q8	2606	2544	2563	2544
q9	7187	7144	7161	7144
q10	2945	3245	2730	2730
q11	566	501	484	484
q12	694	761	604	604
q13	3519	3835	3263	3263
q14	293	307	261	261
q15	537	482	471	471
q16	660	681	636	636
q17	1166	1526	1386	1386
q18	7807	7580	7509	7509
q19	792	847	829	829
q20	1967	2054	1883	1883
q21	5250	4694	4682	4682
q22	1072	1049	995	995
Total cold run time: 52780 ms
Total hot run time: 50717 ms

@doris-robot
Copy link

doris-robot commented Apr 11, 2025

TPC-DS: Total hot run time: 186425 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9f9079846d169698cdfd684ab14638827fae02b8, data reload: false

query1	995	475	462	462
query2	6559	1951	1920	1920
query3	6770	225	219	219
query4	25896	23847	23123	23123
query5	4400	678	467	467
query6	321	209	205	205
query7	4618	528	278	278
query8	300	246	240	240
query9	8665	2597	2592	2592
query10	463	332	256	256
query11	15875	15076	14875	14875
query12	172	116	106	106
query13	1633	526	384	384
query14	9770	6075	6087	6075
query15	199	189	168	168
query16	7637	681	471	471
query17	1192	722	552	552
query18	2005	416	325	325
query19	187	186	162	162
query20	120	119	113	113
query21	204	126	102	102
query22	4221	4130	4085	4085
query23	33878	33048	33057	33048
query24	8545	2362	2376	2362
query25	535	456	391	391
query26	1240	270	150	150
query27	2771	519	326	326
query28	4339	2421	2425	2421
query29	726	593	443	443
query30	301	225	199	199
query31	943	846	768	768
query32	73	65	65	65
query33	571	408	302	302
query34	813	911	505	505
query35	813	841	754	754
query36	1005	981	859	859
query37	119	105	80	80
query38	4187	4204	4090	4090
query39	1450	1400	1396	1396
query40	213	121	107	107
query41	58	79	54	54
query42	117	110	107	107
query43	495	505	479	479
query44	1346	809	798	798
query45	178	173	169	169
query46	880	1062	626	626
query47	1739	1795	1734	1734
query48	370	423	301	301
query49	792	528	425	425
query50	683	726	393	393
query51	4140	4217	4096	4096
query52	109	109	94	94
query53	230	262	187	187
query54	584	585	510	510
query55	86	84	85	84
query56	287	296	287	287
query57	1112	1154	1060	1060
query58	268	292	256	256
query59	2571	2657	2621	2621
query60	363	345	324	324
query61	161	162	151	151
query62	792	754	673	673
query63	225	195	188	188
query64	4438	1126	795	795
query65	4370	4284	4328	4284
query66	1111	435	303	303
query67	15968	15573	15206	15206
query68	8569	916	514	514
query69	471	304	272	272
query70	1174	1131	1060	1060
query71	469	323	300	300
query72	5553	4783	4595	4595
query73	692	580	347	347
query74	8907	9099	8879	8879
query75	4016	3224	2647	2647
query76	3708	1297	772	772
query77	816	394	367	367
query78	10002	10093	9270	9270
query79	2778	862	590	590
query80	657	530	454	454
query81	470	258	228	228
query82	459	136	100	100
query83	302	263	245	245
query84	294	111	85	85
query85	783	363	317	317
query86	341	310	290	290
query87	4466	4497	4390	4390
query88	3346	2269	2275	2269
query89	422	316	281	281
query90	1963	223	236	223
query91	143	207	117	117
query92	84	65	62	62
query93	2140	943	584	584
query94	688	443	302	302
query95	379	300	297	297
query96	492	627	284	284
query97	3146	3266	3130	3130
query98	228	206	201	201
query99	1437	1420	1302	1302
Total cold run time: 277592 ms
Total hot run time: 186425 ms

@doris-robot
Copy link

doris-robot commented Apr 11, 2025

ClickBench: Total hot run time: 31.51 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9f9079846d169698cdfd684ab14638827fae02b8, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.10
query3	0.24	0.19	0.19
query4	1.58	0.20	0.20
query5	0.58	0.57	0.56
query6	1.18	0.72	0.72
query7	0.03	0.02	0.01
query8	0.04	0.03	0.04
query9	0.58	0.51	0.51
query10	0.60	0.59	0.59
query11	0.16	0.11	0.10
query12	0.15	0.12	0.11
query13	0.61	0.59	0.60
query14	2.67	2.67	2.81
query15	0.92	0.85	0.86
query16	0.40	0.38	0.39
query17	1.03	1.08	1.04
query18	0.21	0.20	0.19
query19	1.99	1.85	1.86
query20	0.01	0.01	0.01
query21	15.35	0.86	0.55
query22	0.76	1.37	0.77
query23	14.77	1.37	0.61
query24	7.19	1.10	0.99
query25	0.52	0.18	0.06
query26	0.71	0.16	0.14
query27	0.05	0.05	0.06
query28	9.52	0.87	0.44
query29	12.56	4.05	3.36
query30	0.25	0.09	0.07
query31	2.83	0.58	0.39
query32	3.23	0.55	0.47
query33	3.03	3.01	3.10
query34	15.58	5.13	4.56
query35	4.56	4.52	4.56
query36	0.65	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.03	0.02
query40	0.18	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.21 s
Total hot run time: 31.51 s

morningman
morningman approved these changes Apr 11, 2025
View reviewed changes
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 11, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Apr 11, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Apr 11, 2025

PR approved by anyone and no changes requested.

@morningman morningman force-pushed the rev_rev_hive_json_serde branch from 9f90798 to 185fe99 Compare April 14, 2025 01:18
@morningman
Copy link
Contributor

morningman commented Apr 14, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Apr 14, 2025

TeamCity cloud ut coverage result:
Function Coverage: 83.07% (1089/1311)
Line Coverage: 66.05% (18156/27489)
Region Coverage: 65.50% (8945/13657)
Branch Coverage: 55.36% (4821/8708)
Coverage Report: http://coverage.selectdb-in.cc/coverage/185fe999cbb402e3301a2b9a518e2ef0c18b5282_185fe999cbb402e3301a2b9a518e2ef0c18b5282_cloud/report/index.html

@doris-robot
Copy link

doris-robot commented Apr 14, 2025

TPC-H: Total hot run time: 34481 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 185fe999cbb402e3301a2b9a518e2ef0c18b5282, data reload: false

------ Round 1 ----------------------------------
q1	26281	5096	5111	5096
q2	2084	275	181	181
q3	10554	1262	712	712
q4	10233	1012	537	537
q5	7604	2450	2389	2389
q6	185	161	132	132
q7	944	726	633	633
q8	9311	1238	1089	1089
q9	6986	5221	5153	5153
q10	6986	2320	1895	1895
q11	498	278	282	278
q12	364	380	231	231
q13	17811	3746	3179	3179
q14	239	226	213	213
q15	543	482	489	482
q16	630	640	575	575
q17	592	861	353	353
q18	7668	7178	7166	7166
q19	2162	1008	563	563
q20	328	340	221	221
q21	3901	2644	2446	2446
q22	1057	1020	957	957
Total cold run time: 116961 ms
Total hot run time: 34481 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5281	5096	5091	5091
q2	247	332	238	238
q3	2152	2647	2280	2280
q4	1447	1809	1445	1445
q5	4473	4451	4414	4414
q6	225	173	131	131
q7	1988	1934	1740	1740
q8	2614	2563	2647	2563
q9	7236	7100	7142	7100
q10	3019	3199	2728	2728
q11	594	501	482	482
q12	691	780	595	595
q13	3597	3959	3351	3351
q14	307	299	271	271
q15	520	479	478	478
q16	638	682	660	660
q17	1156	1552	1430	1430
q18	7781	7529	7397	7397
q19	854	825	870	825
q20	2017	2026	1808	1808
q21	5387	4964	4913	4913
q22	1127	1040	1001	1001
Total cold run time: 53351 ms
Total hot run time: 50941 ms

@doris-robot
Copy link

doris-robot commented Apr 14, 2025

TPC-DS: Total hot run time: 193652 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 185fe999cbb402e3301a2b9a518e2ef0c18b5282, data reload: false

query1	1413	1072	1069	1069
query2	6003	1959	1977	1959
query3	11144	4625	4661	4625
query4	25476	23657	23903	23657
query5	5740	662	472	472
query6	313	196	204	196
query7	3993	479	285	285
query8	286	238	236	236
query9	8546	2588	2597	2588
query10	549	319	271	271
query11	15560	15085	14793	14793
query12	158	112	107	107
query13	1567	544	390	390
query14	9138	6176	6132	6132
query15	221	193	166	166
query16	7368	652	496	496
query17	1182	776	625	625
query18	2211	427	350	350
query19	199	189	185	185
query20	142	137	129	129
query21	210	136	123	123
query22	4433	4527	4305	4305
query23	34471	33880	33335	33335
query24	8353	2422	2486	2422
query25	548	477	417	417
query26	796	294	154	154
query27	2921	499	337	337
query28	4772	2441	2432	2432
query29	647	565	435	435
query30	300	221	190	190
query31	932	882	800	800
query32	73	67	66	66
query33	544	366	323	323
query34	784	885	536	536
query35	799	834	749	749
query36	978	992	887	887
query37	121	102	91	91
query38	4214	4342	4242	4242
query39	1483	1424	1433	1424
query40	213	117	115	115
query41	58	57	50	50
query42	126	108	110	108
query43	522	543	488	488
query44	1366	844	849	844
query45	190	173	167	167
query46	827	1019	664	664
query47	1811	1857	1793	1793
query48	386	424	312	312
query49	716	507	450	450
query50	669	711	410	410
query51	4270	4264	4179	4179
query52	109	109	101	101
query53	233	273	190	190
query54	599	605	522	522
query55	85	83	88	83
query56	335	302	291	291
query57	1197	1230	1125	1125
query58	272	272	269	269
query59	2723	2847	2727	2727
query60	349	313	298	298
query61	156	127	129	127
query62	747	757	690	690
query63	233	193	199	193
query64	3229	1105	729	729
query65	4463	4384	4312	4312
query66	794	424	326	326
query67	16146	15581	15452	15452
query68	8963	881	510	510
query69	523	300	298	298
query70	1219	1111	1027	1027
query71	490	330	298	298
query72	5282	4703	4627	4627
query73	713	565	349	349
query74	8966	9094	8700	8700
query75	4304	3208	2672	2672
query76	3788	1177	759	759
query77	782	392	293	293
query78	9946	10273	9361	9361
query79	2280	813	585	585
query80	607	518	444	444
query81	495	258	222	222
query82	444	128	97	97
query83	280	251	242	242
query84	292	114	85	85
query85	746	363	390	363
query86	333	302	284	284
query87	4600	4526	4456	4456
query88	3206	2238	2225	2225
query89	410	312	287	287
query90	1928	220	224	220
query91	146	146	113	113
query92	83	59	56	56
query93	1115	931	574	574
query94	661	440	309	309
query95	370	292	293	292
query96	493	569	276	276
query97	3187	3274	3127	3127
query98	223	210	196	196
query99	1421	1400	1291	1291
Total cold run time: 279708 ms
Total hot run time: 193652 ms

@doris-robot
Copy link

doris-robot commented Apr 14, 2025

ClickBench: Total hot run time: 31.89 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 185fe999cbb402e3301a2b9a518e2ef0c18b5282, data reload: false

query1	0.03	0.03	0.03
query2	0.15	0.11	0.10
query3	0.34	0.21	0.21
query4	1.60	0.20	0.21
query5	0.62	0.62	0.63
query6	1.18	0.74	0.72
query7	0.02	0.02	0.02
query8	0.06	0.04	0.04
query9	0.61	0.53	0.53
query10	0.60	0.60	0.58
query11	0.26	0.13	0.13
query12	0.26	0.13	0.13
query13	0.64	0.62	0.62
query14	2.79	2.75	2.72
query15	1.01	0.88	0.87
query16	0.38	0.38	0.37
query17	1.05	1.04	1.03
query18	0.18	0.19	0.18
query19	1.94	2.07	1.79
query20	0.02	0.01	0.02
query21	15.37	0.96	0.66
query22	0.93	1.02	0.76
query23	14.68	1.48	0.74
query24	5.24	0.60	0.30
query25	0.16	0.09	0.09
query26	0.55	0.22	0.18
query27	0.09	0.08	0.08
query28	11.04	1.14	0.58
query29	12.56	4.08	3.43
query30	0.27	0.08	0.06
query31	2.83	0.64	0.43
query32	3.26	0.61	0.50
query33	3.06	3.11	3.10
query34	16.57	5.21	4.40
query35	4.51	4.51	4.50
query36	0.64	0.52	0.50
query37	0.20	0.17	0.17
query38	0.17	0.16	0.16
query39	0.05	0.04	0.05
query40	0.21	0.16	0.16
query41	0.11	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.05	0.05
Total cold run time: 106.35 s
Total hot run time: 31.89 s

@doris-robot
Copy link

doris-robot commented Apr 14, 2025

BE UT Coverage Report

Increment line coverage 0.00% (0/27) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.46% (14104/26884)
Line Coverage 41.25% (121891/295499)
Region Coverage 40.01% (62076/155162)
Branch Coverage 34.66% (31077/89672)

@morningman morningman merged commit 0d09cfe into apache:master Apr 18, 2025
23 of 25 checks passed
hubgeter added a commit to hubgeter/doris that referenced this pull request Apr 25, 2025
@hubgeter
[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.…
1765c33 
…JsonSerDe (apache#49958)

pick apache#49958
@hubgeter hubgeter mentioned this pull request Apr 25, 2025
Merged
@morningman morningman added the usercase Important user case type label label Apr 28, 2025
dataroaring pushed a commit that referenced this pull request Apr 29, 2025
@hubgeter
[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.…
3152752 
…JsonSerDe (#49958) (#50412)

pick #49958
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
@hubgeter @koarz
Reapply "[enhancement](hive)Initial support for Hive org.openx.data.j…
bd3ba9b 
…sonserde.JsonSerDe" (apache#49928) (apache#49958)

This reverts commit fa51185.
@gavinchou gavinchou mentioned this pull request Jun 11, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morningman morningman morningman approved these changes

@zy-kkk zy-kkk zy-kkk approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.6-merged reviewed usercase Important user case type label

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@hubgeter @hello-stephen @doris-robot @morningman @zy-kkk @dataroaring