Release-0.6.1 roadmap

[zhoujinsong]

This issue will track the roadmap of Amoro 0.6.1

Feature Development

Improvement

• [Improvement]: Improve optimizer's compaction performance in large delete scenarios #2266
• [Subtask]: Store max transaction id on the snapshot level for Mixed Format Table #1720
• [Improvement]: Reduce triggering of optimizating evaluation for native iceberg format #2350
• [Improvement]: The mixed hive should be allowed to be dropped when the hive table has already been dropped #2286
• [AMORO-2415] Print GC date stamps  #2416
• [AMORO-2418] Exclude kryo dependency from flink-optimizer #2437

Bug Tracking

• [Bug]: Data lost after optimizing in Mixed format #2253
• [Bug]: After disabed self-optimizing, the table status is not updated to idle #2250
• [Bug]: Optimizing status blocked at minor/major when restarting AMS #2279
• [Bug]: Exception happen when using Flink DataStream API to write data into arctic table #2271
• [Bug]: Failure when creating a table and immediately retrieving Blocker.  #2289
• [hotfix] Fix deleting Puffin files when cleaning orphan files #2320
• [Bug]: There is a not daemon thread exists when spark job finished #2336
• [Bug]: com.netease.arctic.utils.ArcticDataFiles.readHoursData use SimpleDateFormat Parsing errors will occur under multi-threading #2324
• [Bug]: Iceberg mixed partition table, amoro UI display and merged write directory error #1863
• [hot-fix] Fix the NullPointerException when modifying the self-optimizing.enabled #2388
• [Bug]: TableController set partition to string value “null” when getting file list for a non-partitioned table #2407
• [HotFix] Fix loading the optimizing snapshot id of change store for Mixed Format KeyedTable #2430
• [Bug]: Batch deletion of Change Store files did not take effect for the Mixed Format KeyedTable #2440
• [Bug]: Fix File format is required when scanning file entries if no file format is specified in the file name #2441
• [Bug]: Mixed Hive table mistakenly deletes hive files during expiring snapshots #2404
• [Bug]: Using the wrong database name when switching to another Catalog #2413
• [AMORO-1720] Fix Mixed Format KeyedTable expiring all the snapshots with optimized sequence #2394
• [BugFix][Spark]: Add default value of table-filters in spark scan builder to avoid NPE when comparing the table scan. #2313
• [Bug]: Failed to get table properties when base store contain property watermark.base #2295
• [Bug]: Show create table return incorrect sql with spark sql #2272
• [Bug]: The catalog cannot be used properly when querying based on Amoro0.6.0+Kyuubi1.8.1+Flink #2373
• [Bug]: AMS will repeat trigger the same minor optimize when the bucket > self-optimizing.minor.trigger.file-count #2464
• [Bug]: org.apache.iceberg.exceptions.ValidationException: Missing required files to delete #2454
• [Bug]: Periodic snapshots expiring tasks will be scheduled redundantly #2453

Document Improvement

• fix the optimizer-job.jar path error in the document #2283
• [Doc] Fix a download jump url error on the Deploy page. #2300
• [AMORO-2352] Fix some typo in markdown docs #2353