Skip to content

Conversation

@morningman
Copy link
Contributor

@morningman morningman commented Mar 23, 2025

What problem does this PR solve?

Followup #49371

Problem Summary:

The jindofs-core and jindofs-sdk jars will be installed in fe/lib and be/lib/java_extensions/preload-extensions.
So that user don't need to install these jars to access aliyun oss-hdfs manually.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morningman
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34117 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c6216ea3c877ad328b7c8f7dfa75b607c61bf4e1, data reload: false

------ Round 1 ----------------------------------
q1	24331	5033	5025	5025
q2	2051	296	215	215
q3	10357	1216	679	679
q4	10226	1004	531	531
q5	7537	2341	2385	2341
q6	185	169	136	136
q7	905	722	603	603
q8	9308	1247	1118	1118
q9	6850	5171	5144	5144
q10	6797	2301	1905	1905
q11	475	273	260	260
q12	354	358	218	218
q13	17772	3743	3081	3081
q14	233	222	214	214
q15	534	479	475	475
q16	640	627	599	599
q17	583	852	345	345
q18	7439	7256	7022	7022
q19	1516	934	567	567
q20	314	330	200	200
q21	3900	3485	2486	2486
q22	1059	1050	953	953
Total cold run time: 113366 ms
Total hot run time: 34117 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5194	5135	5166	5135
q2	241	329	236	236
q3	2195	2732	2417	2417
q4	1478	1905	1476	1476
q5	4475	4375	4438	4375
q6	215	174	127	127
q7	2064	1929	1797	1797
q8	2623	2587	2611	2587
q9	7363	7226	6913	6913
q10	3049	3204	2789	2789
q11	562	510	495	495
q12	728	760	619	619
q13	3583	3960	3459	3459
q14	278	321	284	284
q15	532	493	491	491
q16	655	695	657	657
q17	1169	1635	1399	1399
q18	7953	7864	7438	7438
q19	793	789	881	789
q20	1992	1965	1845	1845
q21	5409	4956	4852	4852
q22	1123	1036	1017	1017
Total cold run time: 53674 ms
Total hot run time: 51197 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193626 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c6216ea3c877ad328b7c8f7dfa75b607c61bf4e1, data reload: false

query1	1423	1081	1024	1024
query2	6210	1906	1875	1875
query3	11128	4581	4595	4581
query4	54385	24444	23001	23001
query5	4991	634	484	484
query6	344	209	188	188
query7	4903	501	278	278
query8	316	246	246	246
query9	5698	2599	2617	2599
query10	421	320	257	257
query11	15132	15073	14909	14909
query12	162	110	106	106
query13	1062	509	403	403
query14	11958	6604	7263	6604
query15	210	201	177	177
query16	7104	664	491	491
query17	1086	722	595	595
query18	1557	410	329	329
query19	206	198	171	171
query20	138	128	121	121
query21	210	136	158	136
query22	4428	4547	4286	4286
query23	33813	33356	33333	33333
query24	5892	2446	2413	2413
query25	458	465	396	396
query26	719	265	143	143
query27	2015	498	323	323
query28	2870	2494	2476	2476
query29	582	574	445	445
query30	277	217	196	196
query31	896	863	795	795
query32	74	66	63	63
query33	454	394	312	312
query34	751	848	519	519
query35	789	841	754	754
query36	959	1007	914	914
query37	117	108	76	76
query38	4302	4186	4096	4096
query39	1494	1427	1445	1427
query40	208	120	109	109
query41	57	56	54	54
query42	115	105	108	105
query43	506	519	469	469
query44	1315	816	813	813
query45	185	186	168	168
query46	862	1044	676	676
query47	1858	1857	1809	1809
query48	381	435	315	315
query49	701	500	427	427
query50	715	753	449	449
query51	4292	4315	4273	4273
query52	103	112	99	99
query53	229	256	182	182
query54	486	516	429	429
query55	86	101	84	84
query56	294	270	244	244
query57	1170	1195	1148	1148
query58	248	256	254	254
query59	2678	2822	2676	2676
query60	280	277	267	267
query61	131	128	137	128
query62	752	760	674	674
query63	232	186	190	186
query64	1908	1061	734	734
query65	4525	4443	4469	4443
query66	791	396	302	302
query67	15890	15750	15418	15418
query68	7085	827	507	507
query69	537	297	264	264
query70	1159	1117	1076	1076
query71	519	296	263	263
query72	5871	5299	5348	5299
query73	1435	718	346	346
query74	9199	9092	8834	8834
query75	3999	3235	2698	2698
query76	4345	1219	774	774
query77	680	377	293	293
query78	9888	10043	9220	9220
query79	3348	828	550	550
query80	723	522	437	437
query81	493	269	216	216
query82	656	123	94	94
query83	306	172	152	152
query84	281	103	75	75
query85	762	357	310	310
query86	333	296	282	282
query87	4361	4472	4353	4353
query88	2816	2256	2242	2242
query89	434	318	279	279
query90	2086	206	211	206
query91	146	150	115	115
query92	74	58	55	55
query93	2089	1052	582	582
query94	678	422	302	302
query95	362	278	260	260
query96	484	564	273	273
query97	3361	3378	3299	3299
query98	219	211	194	194
query99	1450	1393	1299	1299
Total cold run time: 300711 ms
Total hot run time: 193626 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c6216ea3c877ad328b7c8f7dfa75b607c61bf4e1, data reload: false

query1	0.04	0.03	0.04
query2	0.14	0.10	0.10
query3	0.25	0.19	0.18
query4	1.59	0.19	0.19
query5	0.59	0.59	0.60
query6	1.37	0.72	0.73
query7	0.03	0.01	0.02
query8	0.04	0.03	0.03
query9	0.57	0.52	0.55
query10	0.59	0.58	0.58
query11	0.16	0.11	0.11
query12	0.15	0.11	0.12
query13	0.62	0.61	0.60
query14	2.82	2.68	2.69
query15	0.92	0.85	0.85
query16	0.40	0.38	0.37
query17	1.01	1.04	1.00
query18	0.21	0.19	0.20
query19	1.90	1.94	1.81
query20	0.02	0.01	0.01
query21	15.41	0.92	0.55
query22	0.77	1.21	0.74
query23	14.83	1.39	0.64
query24	6.96	2.17	0.59
query25	0.50	0.21	0.15
query26	0.53	0.16	0.14
query27	0.05	0.05	0.06
query28	9.77	0.89	0.43
query29	12.57	4.01	3.40
query30	0.25	0.09	0.06
query31	2.83	0.59	0.39
query32	3.22	0.54	0.49
query33	3.00	3.04	3.03
query34	15.67	5.16	4.54
query35	4.57	4.56	4.54
query36	0.68	0.49	0.50
query37	0.08	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.03	0.02
query40	0.16	0.13	0.13
query41	0.07	0.03	0.03
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 105.47 s
Total hot run time: 31.23 s

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Mar 24, 2025
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morningman morningman merged commit 118ec7c into apache:master Mar 24, 2025
36 of 38 checks passed
morningman added a commit to morningman/doris that referenced this pull request Apr 21, 2025
…#49374)

Followup apache#49371

Problem Summary:

The `jindofs-core` and `jindofs-sdk` jars will be installed in `fe/lib`
and `be/lib/java_extensions/preload-extensions`.
So that user don't need to install these jars to access aliyun oss-hdfs
manually.
morningman added a commit to morningman/doris that referenced this pull request Apr 22, 2025
…#49374)

Followup apache#49371

Problem Summary:

The `jindofs-core` and `jindofs-sdk` jars will be installed in `fe/lib`
and `be/lib/java_extensions/preload-extensions`.
So that user don't need to install these jars to access aliyun oss-hdfs
manually.
dataroaring pushed a commit that referenced this pull request Apr 23, 2025
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
…#49374)

### What problem does this PR solve?

Followup apache#49371

Problem Summary:

The `jindofs-core` and `jindofs-sdk` jars will be installed in `fe/lib`
and `be/lib/java_extensions/preload-extensions`.
So that user don't need to install these jars to access aliyun oss-hdfs
manually.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.6-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants