Sharded state dicts save correctly when save_weights_only=True
#12436
| Job | Run time |
|---|---|
| 18m 9s | |
| 10m 29s | |
| 13m 31s | |
| 20m 40s | |
| 12m 3s | |
| 14m 30s | |
| 20m 33s | |
| 12m 23s | |
| 14m 19s | |
| 22m 53s | |
| 12m 3s | |
| 14m 25s | |
| 18m 59s | |
| 12m 20s | |
| 14m 7s | |
| 19m 47s | |
| 10m 39s | |
| 13m 11s | |
| 19m 3s | |
| 10m 55s | |
| 12m 39s | |
| 5h 17m 38s |