add sharded loading for safetensors in AutoTP#4854

Merged

mrwyattii merged 3 commits intodeepspeedai:masterfrom

sywangyi:safetensor_autoTP

Jan 5, 2024

Commits on Jan 1, 2024

add sharded loading for safetensors in AutoTP
sywangyi
committed

Commits on Jan 2, 2024

Merge branch 'master' into safetensor_autoTP
loadams
authored

Commits on Jan 5, 2024

Merge branch 'master' into safetensor_autoTP
mrwyattii
authored