branch-3.1: [opt](nereids) optimize parallel of insert command when olap table have auto partitions #54983

[github-actions]

Cherry-picked from #54983

[Thearas]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?

[Thearas]

run buildall

[doris-robot]

TPC-H: Total hot run time: 32618 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 31d57c73ad85e2d6c9a2b24b878df08a28845aad, data reload: false

------ Round 1 ----------------------------------
q1	17575	5506	5446	5446
q2	2014	398	278	278
q3	12214	1240	740	740
q4	10577	880	456	456
q5	9567	2389	2124	2124
q6	190	163	136	136
q7	919	748	616	616
q8	9346	1443	1134	1134
q9	5202	5047	4914	4914
q10	6782	2291	1841	1841
q11	496	279	256	256
q12	340	356	213	213
q13	17791	3557	2987	2987
q14	239	234	210	210
q15	549	468	478	468
q16	444	431	381	381
q17	599	865	368	368
q18	6861	6485	6357	6357
q19	1258	948	546	546
q20	325	331	202	202
q21	2809	2199	1949	1949
q22	1045	1014	996	996
Total cold run time: 107142 ms
Total hot run time: 32618 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5530	5497	5863	5497
q2	237	331	236	236
q3	2252	2607	2302	2302
q4	1321	1806	1351	1351
q5	4389	5038	4992	4992
q6	167	165	129	129
q7	2273	2010	1825	1825
q8	2666	2874	2692	2692
q9	7257	7237	7187	7187
q10	3052	3258	2749	2749
q11	579	508	492	492
q12	681	814	635	635
q13	3400	3799	3180	3180
q14	279	297	265	265
q15	518	485	476	476
q16	433	475	454	454
q17	1253	1743	1262	1262
q18	7657	7449	7175	7175
q19	793	1100	1122	1100
q20	2014	2063	1898	1898
q21	5380	4894	4529	4529
q22	1062	1066	1028	1028
Total cold run time: 53193 ms
Total hot run time: 51454 ms

[doris-robot]

TPC-DS: Total hot run time: 192079 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 31d57c73ad85e2d6c9a2b24b878df08a28845aad, data reload: false

query1	947	393	406	393
query2	6188	1994	1940	1940
query3	8682	204	194	194
query4	33772	24147	23568	23568
query5	4217	602	451	451
query6	299	195	189	189
query7	4208	498	310	310
query8	300	245	237	237
query9	9330	2553	2562	2553
query10	470	306	260	260
query11	18160	15328	15566	15328
query12	155	112	105	105
query13	1551	549	410	410
query14	8930	8084	6661	6661
query15	230	195	181	181
query16	8088	682	538	538
query17	1574	771	578	578
query18	2166	447	316	316
query19	231	194	162	162
query20	126	122	123	122
query21	226	130	111	111
query22	4603	4706	4383	4383
query23	35170	33941	33968	33941
query24	7368	2767	2743	2743
query25	560	509	441	441
query26	831	291	177	177
query27	1956	488	371	371
query28	5567	2189	2184	2184
query29	711	608	472	472
query30	240	195	167	167
query31	1008	930	844	844
query32	95	61	64	61
query33	500	374	330	330
query34	769	866	536	536
query35	839	830	728	728
query36	1023	1103	981	981
query37	107	98	70	70
query38	4086	4097	3925	3925
query39	1560	1472	1665	1472
query40	213	122	110	110
query41	55	50	48	48
query42	125	109	107	107
query43	534	546	519	519
query44	1305	815	846	815
query45	203	191	176	176
query46	910	1071	668	668
query47	1957	2029	1962	1962
query48	416	431	348	348
query49	735	503	420	420
query50	671	706	441	441
query51	7346	7277	7253	7253
query52	101	111	94	94
query53	232	267	194	194
query54	537	555	480	480
query55	80	77	78	77
query56	275	267	260	260
query57	1294	1305	1229	1229
query58	228	221	218	218
query59	3175	3306	3120	3120
query60	297	272	267	267
query61	120	121	111	111
query62	780	725	698	698
query63	232	193	195	193
query64	3822	1020	691	691
query65	3371	3337	3279	3279
query66	795	416	304	304
query67	16262	15795	15488	15488
query68	7652	824	536	536
query69	487	302	265	265
query70	1216	1070	1178	1070
query71	419	289	267	267
query72	5173	3723	3818	3723
query73	641	744	347	347
query74	10209	9171	9181	9171
query75	3922	3151	2670	2670
query76	3532	1152	772	772
query77	779	361	276	276
query78	10347	10306	9502	9502
query79	3439	895	600	600
query80	760	521	433	433
query81	496	254	219	219
query82	596	124	88	88
query83	165	166	147	147
query84	285	102	77	77
query85	784	353	306	306
query86	361	299	296	296
query87	4404	4308	4215	4215
query88	3483	2410	2397	2397
query89	440	332	291	291
query90	1910	190	201	190
query91	135	144	112	112
query92	67	66	50	50
query93	2081	869	530	530
query94	660	411	305	305
query95	336	274	263	263
query96	496	615	285	285
query97	3201	3270	3158	3158
query98	223	208	204	204
query99	1570	1427	1311	1311
Total cold run time: 293183 ms
Total hot run time: 192079 ms

[doris-robot]

ClickBench: Total hot run time: 28.98 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 31d57c73ad85e2d6c9a2b24b878df08a28845aad, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.61	0.11	0.10
query5	0.54	0.51	0.53
query6	1.14	0.73	0.72
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.56	0.50	0.49
query10	0.56	0.55	0.55
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.61	0.59
query14	0.79	0.83	0.79
query15	0.85	0.84	0.84
query16	0.38	0.40	0.40
query17	1.03	0.99	0.99
query18	0.24	0.22	0.24
query19	1.83	1.77	1.89
query20	0.02	0.01	0.01
query21	15.41	0.94	0.58
query22	0.75	0.77	0.66
query23	15.11	1.43	0.55
query24	3.27	1.10	1.05
query25	0.16	0.16	0.12
query26	0.22	0.14	0.15
query27	0.04	0.05	0.05
query28	13.90	1.05	0.44
query29	12.61	3.97	3.24
query30	0.25	0.09	0.07
query31	2.83	0.62	0.38
query32	3.22	0.54	0.47
query33	2.99	3.01	3.07
query34	16.54	5.17	4.50
query35	4.57	4.60	4.56
query36	0.63	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.07	0.02	0.03
query42	0.03	0.02	0.03
query43	0.04	0.03	0.02
Total cold run time: 103.83 s
Total hot run time: 28.98 s

[hello-stephen]

FE UT Coverage Report

Increment line coverage 100.00% (1/1) 🎉
Increment coverage report
Complete coverage report