Skip to content

support baichuan model#14

Merged
delock merged 1 commit intodelock:gma/run-opt-branchfrom
baodii:baodi/support_baichuan
Sep 27, 2023
Merged

support baichuan model#14
delock merged 1 commit intodelock:gma/run-opt-branchfrom
baodii:baodi/support_baichuan

Conversation

@baodii
Copy link

@baodii baodii commented Sep 27, 2023

add RMSNorm for baichuan model to avoid meda tensor copy.

@baodii
Copy link
Author

baodii commented Sep 27, 2023

@delock

@delock
Copy link
Owner

delock commented Sep 27, 2023

@delock

Got it, please also submit a PR to upstream. Use clear title i.e. "[AutoTP] support baichuan model"

@delock
Copy link
Owner

delock commented Sep 27, 2023

LGTM

@delock delock merged commit f0ef3ea into delock:gma/run-opt-branch Sep 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants