Skip to content

[fix](maxcompute)fix maxcompute catalog international user can not access. #55256

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morningman merged 2 commits into from
Sep 2, 2025
Merged

[fix](maxcompute)fix maxcompute catalog international user can not access. #55256

morningman merged 2 commits into from
Sep 2, 2025

Conversation

@hubgeter
Copy link
Contributor

@hubgeter hubgeter commented Aug 25, 2025 •
edited by morningman
Loading

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx
Problem Summary:

fix : maxcompute catalog

mysql> show databases;
ERROR 1105 (HY000): errCode = 2, detailMessage = ODPS-0420061: Invalid parameter in HTTP request - user 'RAM$xxxxxx:xxxxx' is not a valid aliyun account.

The account systems for Alibaba Cloud China and International are different. If the primary account is an International user, specify mc.account_format as id. Otherwise, specify name.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

hello-stephen commented Aug 25, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@hubgeter
Copy link
Contributor Author

hubgeter commented Aug 28, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Aug 28, 2025

TPC-H: Total hot run time: 34021 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f260bf4b971f891b9597a739b91834eb29ca97c1, data reload: false

------ Round 1 ----------------------------------
q1	17604	5207	5089	5089
q2	1997	350	221	221
q3	10213	1285	736	736
q4	10232	1018	542	542
q5	7544	2482	2335	2335
q6	188	166	135	135
q7	908	761	626	626
q8	9345	1360	1117	1117
q9	6899	5100	5084	5084
q10	6949	2391	1960	1960
q11	473	311	272	272
q12	344	396	235	235
q13	17798	3677	3026	3026
q14	229	250	216	216
q15	572	507	502	502
q16	440	426	388	388
q17	599	852	361	361
q18	7334	6987	7072	6987
q19	1747	953	572	572
q20	333	336	231	231
q21	4239	2548	2384	2384
q22	1058	1026	1002	1002
Total cold run time: 107045 ms
Total hot run time: 34021 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5236	5105	5208	5105
q2	248	335	219	219
q3	2157	2726	2328	2328
q4	1354	1794	1371	1371
q5	4195	4399	4572	4399
q6	235	175	133	133
q7	2024	2008	1815	1815
q8	2667	2721	2589	2589
q9	7446	7351	7297	7297
q10	3055	3295	2917	2917
q11	585	516	504	504
q12	725	777	611	611
q13	3566	4034	3290	3290
q14	294	298	270	270
q15	528	491	486	486
q16	468	529	445	445
q17	1187	1573	1664	1573
q18	7765	7754	7473	7473
q19	847	805	859	805
q20	2074	2255	1928	1928
q21	4964	4249	4250	4249
q22	1110	1043	1019	1019
Total cold run time: 52730 ms
Total hot run time: 50826 ms

@doris-robot
Copy link

doris-robot commented Aug 28, 2025

TPC-DS: Total hot run time: 187360 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f260bf4b971f891b9597a739b91834eb29ca97c1, data reload: false

query1	1055	468	402	402
query2	6551	1757	1833	1757
query3	6754	229	221	221
query4	26406	23343	23408	23343
query5	4333	647	510	510
query6	343	236	236	236
query7	4640	538	329	329
query8	286	249	237	237
query9	8665	2915	2838	2838
query10	507	328	300	300
query11	15749	15167	14883	14883
query12	172	123	118	118
query13	1677	558	426	426
query14	9270	5901	5886	5886
query15	214	194	171	171
query16	7328	671	473	473
query17	1248	773	643	643
query18	2034	446	348	348
query19	215	202	176	176
query20	134	129	123	123
query21	225	135	117	117
query22	4118	4133	3968	3968
query23	33737	32947	32969	32947
query24	8156	2423	2421	2421
query25	585	520	447	447
query26	1240	280	169	169
query27	2741	520	364	364
query28	4336	2237	2215	2215
query29	793	603	496	496
query30	290	241	211	211
query31	908	813	730	730
query32	91	77	80	77
query33	566	390	401	390
query34	805	854	529	529
query35	804	845	758	758
query36	946	1005	971	971
query37	126	109	93	93
query38	4074	4195	4000	4000
query39	1481	1439	1439	1439
query40	233	135	131	131
query41	77	65	66	65
query42	128	113	117	113
query43	534	525	482	482
query44	1362	858	857	857
query45	183	173	175	173
query46	874	1012	648	648
query47	1766	1819	1718	1718
query48	384	438	351	351
query49	749	517	411	411
query50	668	688	393	393
query51	4094	4179	4125	4125
query52	121	116	105	105
query53	246	280	211	211
query54	614	606	550	550
query55	105	98	87	87
query56	344	343	320	320
query57	1196	1215	1114	1114
query58	295	273	300	273
query59	2592	2779	2648	2648
query60	354	362	353	353
query61	193	155	158	155
query62	805	771	675	675
query63	235	196	193	193
query64	4474	1135	820	820
query65	4354	4184	4188	4184
query66	1158	442	354	354
query67	15531	15421	15216	15216
query68	7972	945	587	587
query69	503	356	291	291
query70	1234	1170	1090	1090
query71	476	337	335	335
query72	6027	4992	5094	4992
query73	732	657	364	364
query74	9191	9019	9143	9019
query75	3800	3076	2651	2651
query76	3701	1154	748	748
query77	797	417	333	333
query78	9470	9573	8873	8873
query79	2478	843	614	614
query80	631	587	548	548
query81	501	261	229	229
query82	459	139	117	117
query83	271	263	262	262
query84	261	132	93	93
query85	894	483	539	483
query86	403	343	324	324
query87	4282	4296	4217	4217
query88	3717	2232	2237	2232
query89	439	345	300	300
query90	1848	242	235	235
query91	164	164	131	131
query92	93	77	75	75
query93	1908	1015	642	642
query94	690	427	323	323
query95	416	338	322	322
query96	493	577	280	280
query97	2650	2660	2607	2607
query98	256	231	217	217
query99	1415	1426	1339	1339
Total cold run time: 275444 ms
Total hot run time: 187360 ms

@doris-robot
Copy link

doris-robot commented Aug 28, 2025

ClickBench: Total hot run time: 32.84 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f260bf4b971f891b9597a739b91834eb29ca97c1, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.05	0.06
query3	0.26	0.08	0.09
query4	1.61	0.12	0.12
query5	0.48	0.43	0.40
query6	1.18	0.65	0.64
query7	0.03	0.03	0.02
query8	0.06	0.04	0.04
query9	0.61	0.54	0.52
query10	0.58	0.58	0.57
query11	0.18	0.11	0.11
query12	0.16	0.12	0.12
query13	0.63	0.64	0.62
query14	0.79	0.84	0.85
query15	0.90	0.85	0.87
query16	0.40	0.41	0.39
query17	1.05	1.04	1.02
query18	0.22	0.23	0.20
query19	1.94	1.87	1.83
query20	0.02	0.01	0.02
query21	15.40	0.97	0.59
query22	0.79	1.35	0.90
query23	14.74	1.42	0.62
query24	6.75	1.94	0.70
query25	0.50	0.31	0.08
query26	0.51	0.19	0.15
query27	0.07	0.06	0.05
query28	10.03	0.94	0.44
query29	12.65	4.05	3.34
query30	3.07	2.99	3.02
query31	2.83	0.59	0.39
query32	3.26	0.57	0.47
query33	3.07	3.05	3.14
query34	16.09	5.49	4.85
query35	4.92	4.95	4.88
query36	0.71	0.52	0.49
query37	0.10	0.08	0.08
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.19	0.16	0.14
query41	0.09	0.03	0.02
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 107.19 s
Total hot run time: 32.84 s

@hubgeter hubgeter marked this pull request as ready for review September 1, 2025 02:30
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 1, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Sep 1, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Sep 1, 2025

PR approved by anyone and no changes requested.

wm1581066
wm1581066 approved these changes Sep 1, 2025
View reviewed changes
Copy link
Collaborator

@wm1581066 wm1581066 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@morningman morningman merged commit bc25b4d into apache:master Sep 2, 2025
30 of 32 checks passed
github-actions bot pushed a commit that referenced this pull request Sep 2, 2025
@hubgeter
[fix](maxcompute)fix maxcompute catalog international user can not ac…
da37819 
…cess. (#55256)

### What problem does this PR solve?
Problem Summary:

fix : maxcompute catalog 
```
mysql> show databases;
ERROR 1105 (HY000): errCode = 2, detailMessage = ODPS-0420061: Invalid parameter in HTTP request - user 'RAM$xxxxxx:xxxxx' is not a valid aliyun account.
```

The account systems for Alibaba Cloud China and International are
different. If the primary account is an International user, specify
`mc.account_format` as `id`. Otherwise, specify `name`.
@github-actions github-actions bot mentioned this pull request Sep 2, 2025
Merged
github-actions bot pushed a commit that referenced this pull request Sep 2, 2025
@hubgeter
[fix](maxcompute)fix maxcompute catalog international user can not ac…
2de298b 
…cess. (#55256)

### What problem does this PR solve?
Problem Summary:

fix : maxcompute catalog 
```
mysql> show databases;
ERROR 1105 (HY000): errCode = 2, detailMessage = ODPS-0420061: Invalid parameter in HTTP request - user 'RAM$xxxxxx:xxxxx' is not a valid aliyun account.
```

The account systems for Alibaba Cloud China and International are
different. If the primary account is an International user, specify
`mc.account_format` as `id`. Otherwise, specify `name`.
@github-actions github-actions bot mentioned this pull request Sep 2, 2025
Merged
morrySnow pushed a commit that referenced this pull request Sep 4, 2025
@github-actions @hubgeter
branch-3.1: [fix](maxcompute)fix maxcompute catalog international use…
e3a7644 
…r can not access. #55256 (#55560)

Cherry-picked from #55256

Co-authored-by: daidai <changyuwei@selectdb.com>
dataroaring pushed a commit that referenced this pull request Sep 5, 2025
@github-actions @hubgeter
branch-3.0: [fix](maxcompute)fix maxcompute catalog international use…
1b68a0f 
…r can not access. #55256 (#55559)

Cherry-picked from #55256

Co-authored-by: daidai <changyuwei@selectdb.com>
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morningman morningman morningman approved these changes

+1 more reviewer

@wm1581066 wm1581066 wm1581066 approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.9-merged dev/3.1.1-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@hubgeter @hello-stephen @doris-robot @morningman @wm1581066 @dataroaring @morrySnow