New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable gemma model #68

Open

hzjane wants to merge 6 commits into analytics-zoo:0.6.2 from hzjane:add_logits_attn_softcap

hzjane commented Dec 18, 2024 •

edited

Loading

Only enable gemma-2-9b.
Need to set dtype=float32, and only can run batch 1 if run gemma-2-27b.

hzjane added 6 commits

December 18, 2024 13:36


          enable gemma model

538a32a


          update

7a1d8b5


          update


          update not use gqa

def9901


          update

c065bb1


          update for gemma-27b not use

250fde8

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet