Issue for arctic

[Aireed]

Fatal

• [Improvement]: Optimize can't stop when the change store only has eq-delete files and the base store has no files apache/amoro#814
• [Bug]: Table-size shows 0 while flink continuously writing apache/amoro#823
• [Bug]: Arctic Keyed Table keeps Minor Optimizing but cannot commit any data to BaseStore apache/amoro#846
• [ARCTIC-846] Fix checking conflict commit with the legacy TransactionId before Minor Optimize commit apache/amoro#848
• [ARCTIC-871] [ARCTIC-756] Fix pending optimizing after change optimizer group and handle table load error apache/amoro#872
• [ARCTIC-877] Fix Orphan files clean delete files unexpected apache/amoro#878
• [ARCTIC-890][AMS] Fix the data loss when the minor optimize in progress and restart the ams at the same time apache/amoro#892
• [ARCTIC-877] fix OrphanFilesCleanService get metadata files with recursive=false apache/amoro#893
• [ARCTIC-890] Improve PR #892 apache/amoro#894
• [ARCTIC-920][Optimize] Fix the problem of data inconsistency after minor optimize apache/amoro#921
• [ARCTIC-922] Catch found new position delete ValidationException apache/amoro#923
• [ARCTIC-938][Optimize] Deleting invalid data files when the major optimize commit throw ValidationException apache/amoro#939
• [ARCTIC-925] Introduce SpillableMap to avoid OOM for optimizing and merge-on-read apache/amoro#949
• [ARCTIC-955][ARCTIC-916] Load sequence number once in optimize plan apache/amoro#963
• [ARCTIC-967] Fix change files exceeding TTL deleted by mistake apache/amoro#968
• [ARCTIC-985] Introduce Table Blocker to implement concurrency controll between Writing and Optimizing apache/amoro#986
• [ARCTIC-946][AMS] Add balanced schedule policy for optimizer apache/amoro#993
• [ARCTIC-994] Introduce design of TransactionId generation to resolving data conflicts apache/amoro#1010
• [ARCTIC-1018][AMS] Avoiding concurrent operations by tasksLock apache/amoro#1022
• [ARCTIC-1016] Moving files will fail if the target parent directory doesn't exist in HDFS apache/amoro#1046
• [ARCTIC-994] fix read legacy transaction id when MOR apache/amoro#1058
• [ARCTIC-985] remove the useless expiration process of table_transaction_meta apache/amoro#1064
• [ARCTIC-994] fix listTableMetas from sysdb not return the currentTxId apache/amoro#1071
• [ARCTIC-994] fix serialization for target files of hive support table apache/amoro#1072
• [ARCTIC-1075][AMS]When use native iceberg, update catalog properties does not take effect in terminal apache/amoro#1076
• [AMS][Improvement]: Support set login user and login password in config yaml file apache/amoro#1086
• [ARCTIC-985] avoid NoSuchObjectException when renew blocker apache/amoro#1087
• [ARCTIC-1062][AMS]Terminal support config spark properties in the local model apache/amoro#1094
• [ARCTIC-1090][AMS]Terminal support add hadoop conf into sparkConf apache/amoro#1099
• [ARCTIC-1095][AMS] Add the sequence number for the native iceberg table when the major optimizing commit apache/amoro#1101
• [ARCTIC-1103][AMS] Clear the optimizing tasks when the optimizing commit failed apache/amoro#1104
• [ARCTIC-1105][AMS] Fix snapshot expire and orphan clean misdelete the DataFiles  apache/amoro#1122
• [ARTIC-1903] fix Minor Optimizing scans files with iceberg sequence and add more test cases for hive support table apache/amoro#1125
• [ARCTIC-1057][AMS] Only load self-optimizing enabled tables into cache apache/amoro#1145
• [ARCTIC-1150] Minor optimizing with many small files and TransactionId not in order apache/amoro#1151
• [ARCTIC-1153][Optimize] Put task back into the queue if polling tasks failed apache/amoro#1156
• [Arctic-1103][AMS] fix the condition of checking the tasks whether they can be clear (improve #1104) apache/amoro#1168
• [ARCTIC-930][AMS] Snapshot expire service should not expire snapshot with the lastest checkpoint id apache/amoro#1178
• [ARCTIC-915][AMS] Orphan files clean service should not delete flink temporary metadata files apache/amoro#1181
• [ARCTIC-1190][AMS] Table expire service should not expire snapshot which optimizing planned with apache/amoro#1193
• [ARCTIC-725] [optimizer,ams]FlinkOptimizer automatically retries after failover  apache/amoro#1248
• [ARCTIC-1242][ams] Optimizing plan thread should only plan tables in pending status apache/amoro#1284
• [ARCTIC-1057][AMS] Avoid memory leak in OptimizeService apache/amoro#1292
• [ARCTIC-1288][ams] limit the total files size bytes for Optimizing apache/amoro#1294
• [ARCTIC-1295] fix writing into an empty KeyedTable with flink/spark 0.3.x/0.4.0 and AMS 0.4.1 apache/amoro#1296
• [ARCTIC-1319] [ams] Major Self-Optimizing should not delete pos-delete files apache/amoro#1320
• [ARCTIC-1319] [ams] fix 0.3.x Major Self-Optimizing should not delete pos-delete files apache/amoro#1324

minor

• [Bug]: Table-size shows 0 while flink continuously writing apache/amoro#823
• [BUG] local optimizer cannot print logs apache/amoro#825
• [Bug]: Some bugs in local test for version 0.4.0 bug apache/amoro#837
• [BUG]Fix terminal change catalog throw namespace not found apache/amoro#909
• [Arctic-1266][AMS]: Use ArcticSparkSessionCatalog for terminal apache/amoro#1264

deprecated

• [Improvement][Core]: ams tracer should report snapshot information even if no new file is submitted apache/amoro#1014
• [ARCTIC-1093] Self-Optimizing scan files from metadata instead of from file info cache apache/amoro#1100