[Unified checkpoint] PR cherry-picks

[DesmonDay]

PR types

Others

PR changes

Others

Description

1. update async_save info.
2. support expert_parallel.
3. update async_save done files directory.
4. fix async_save hang.
5. support save generation_config in uc.

[paddle-bot]

Thanks for your contribution!

[wawltor]

LGTM

[codecov]

Codecov Report

Attention: Patch coverage is 11.21076% with 198 lines in your changes missing coverage. Please review.

Project coverage is 52.95%. Comparing base (73f1a20) to head (8f6e88b).
Report is 51 commits behind head on release/3.0-beta2.

Files with missing lines	Patch %	Lines
paddlenlp/trainer/plugins/unified_checkpoint.py	5.64%	167 Missing ⚠️
paddlenlp/trainer/trainer.py	24.32%	28 Missing ⚠️
paddlenlp/trainer/trainer_utils.py	25.00%	3 Missing ⚠️

Additional details and impacted files

@@                  Coverage Diff                  @@
##           release/3.0-beta2    #9277      +/-   ##
=====================================================
- Coverage              53.02%   52.95%   -0.08%     
=====================================================
  Files                    656      656              
  Lines                 106153   106312     +159     
=====================================================
+ Hits                   56288    56295       +7     
- Misses                 49865    50017     +152     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.