Support resuming of deepspeed + Lora + offloading#29015

Closed

thepowerfuldeez wants to merge 5 commits intohuggingface:mainfrom thepowerfuldeez:main

+27

Commits on Jul 30, 2023

Add lr_scheduler checkpointing when deepspeed does not support the lr_scheduler type
kazemf78
committed

Commits on Jul 31, 2023

Fix an issue with missing keys of state_dict in loading Lora model
kazemf78
committed

Commits on Feb 13, 2024

Merge remote-tracking branch 'ext/main'
thepowerfuldeez
committed

Commits on Feb 14, 2024

merge external branch
thepowerfuldeez
committed

Commits on Feb 15, 2024

revert load_module_strict in deepspeed integration and set to False in trainer
thepowerfuldeez
committed