Skip to content

Fix llama meta tensor loading in AutoTP and kernel injected inference#3608

Merged
lekurile merged 16 commits intodeepspeedai:masterfrom
zeyugao:master
Sep 20, 2023
Merged

Fix llama meta tensor loading in AutoTP and kernel injected inference#3608
lekurile merged 16 commits intodeepspeedai:masterfrom
zeyugao:master

Commits

Commits on May 30, 2023

Commits on Jun 12, 2023

Commits on Jul 26, 2023

Commits on Aug 16, 2023

Commits on Sep 20, 2023