Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ gemma] Adds support for Gemma 💎 #29167

Merged
merged 142 commits into from
Feb 21, 2024
Merged

[ gemma] Adds support for Gemma 💎 #29167

merged 142 commits into from
Feb 21, 2024

Commits on Jan 21, 2024

  1. inital commit

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    7434ea2 View commit details
    Browse the repository at this point in the history

  2. update

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    6165925 View commit details
    Browse the repository at this point in the history

  3. update conversion checkpoint

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    69006fa View commit details
    Browse the repository at this point in the history

  4. update conversion script

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    cb80199 View commit details
    Browse the repository at this point in the history

  5. nits

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    08252ce View commit details
    Browse the repository at this point in the history

  6. some fixes

    @younesbelkada
    younesbelkada committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    32ea5fb View commit details
    Browse the repository at this point in the history

  7. nits

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    888ab95 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'add-golden-gate' of https://github.com/huggingface/new-… 

    …model-addition into add-golden-gate
    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    ce0aa57 View commit details
    Browse the repository at this point in the history

  9. merge

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    e303e48 View commit details
    Browse the repository at this point in the history

  10. fix permute

    @younesbelkada
    younesbelkada committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    aefc4bc View commit details
    Browse the repository at this point in the history

  11. nits

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    78de9f5 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'add-golden-gate' of https://github.com/huggingface/new-… 

    …model-addition into HEAD
    @younesbelkada
    younesbelkada committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    fb2917d View commit details
    Browse the repository at this point in the history

  13. fix

    @younesbelkada
    younesbelkada committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    f3ad1b8 View commit details
    Browse the repository at this point in the history

  14. nits

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    e3a0bbd View commit details
    Browse the repository at this point in the history

  15. nits

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    bbee069 View commit details
    Browse the repository at this point in the history

  16. nits

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    e0e0646 View commit details
    Browse the repository at this point in the history

  17. fix rope

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    5f63b4c View commit details
    Browse the repository at this point in the history

  18. fix both rope

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    4734805 View commit details
    Browse the repository at this point in the history

  19. merge

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    9b27edd View commit details
    Browse the repository at this point in the history

  20. nites

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    d20574d View commit details
    Browse the repository at this point in the history

  21. style

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    3f76b2f View commit details
    Browse the repository at this point in the history

  22. make sure flax works

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    3449b4b View commit details
    Browse the repository at this point in the history

  23. fix flax init code

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    fbbe149 View commit details
    Browse the repository at this point in the history

  24. fix foward

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    bf8ed52 View commit details
    Browse the repository at this point in the history

  25. nits

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    8273aa7 View commit details
    Browse the repository at this point in the history

  26. print flax generation out

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    cf6345c View commit details
    Browse the repository at this point in the history

  27. current code

    @ArthurZucker
    ArthurZucker committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    6f49e21 View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2024

  1. nits

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    e2b09ee View commit details
    Browse the repository at this point in the history

  2. SIIIIIIIIIIIIIIIIIII

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    94e1020 View commit details
    Browse the repository at this point in the history

  3. update

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    afd89e8 View commit details
    Browse the repository at this point in the history

  4. add new tokenizer

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    f21564b View commit details
    Browse the repository at this point in the history

  5. correct fast tokenizer

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    5c85aa3 View commit details
    Browse the repository at this point in the history

  6. fix conversion

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    342095b View commit details
    Browse the repository at this point in the history

  7. more comments

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    b6b6f35 View commit details
    Browse the repository at this point in the history

  8. fix modeling and conversion

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    f16f9b0 View commit details
    Browse the repository at this point in the history

  9. nits and nits

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    62077c3 View commit details
    Browse the repository at this point in the history

  10. nits testing

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    274aea7 View commit details
    Browse the repository at this point in the history

  11. add some tokenization tests

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    9e629dc View commit details
    Browse the repository at this point in the history

  12. add some edge cases

    @ArthurZucker
    ArthurZucker committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    b128ceb View commit details
    Browse the repository at this point in the history

  13. add slow tests and fix them

    @younesbelkada
    younesbelkada committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    7bec5c6 View commit details
    Browse the repository at this point in the history

  14. fixup

    @younesbelkada
    younesbelkada committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    51872ef View commit details
    Browse the repository at this point in the history

  15. fix copies for modeling

    @younesbelkada
    younesbelkada committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    c8f89d2 View commit details
    Browse the repository at this point in the history

  16. fix copies

    @younesbelkada
    younesbelkada committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    367cdcd View commit details
    Browse the repository at this point in the history

  17. add 7B slow tests

    @younesbelkada
    younesbelkada committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    9fc4fd8 View commit details
    Browse the repository at this point in the history

  18. fix

    @younesbelkada
    younesbelkada committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    ea24f25 View commit details
    Browse the repository at this point in the history

  19. fix

    @younesbelkada
    younesbelkada committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    e337cf2 View commit details
    Browse the repository at this point in the history

  20. fix tests

    @younesbelkada
    younesbelkada committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    b356561 View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2024

  1. make tokenizer cis go green

    @ArthurZucker
    ArthurZucker committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    423d0b1 View commit details
    Browse the repository at this point in the history

  2. styling

    @ArthurZucker
    ArthurZucker committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    ac8ee3d View commit details
    Browse the repository at this point in the history

  3. last tokenizer nits

    @ArthurZucker
    ArthurZucker committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    ee4eebf View commit details
    Browse the repository at this point in the history

  4. update jax tests

    @ArthurZucker
    ArthurZucker committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    06d3ff7 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. fix flax for 7b

    @ArthurZucker
    ArthurZucker committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    b7b31ca View commit details
    Browse the repository at this point in the history

  2. add jit testing 🤗

    @ArthurZucker
    ArthurZucker committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    7626e71 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. cleanups

    @ArthurZucker
    ArthurZucker committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    5db6ddc View commit details
    Browse the repository at this point in the history

  2. isolated nit, inv_freq for rotary_emb.inv_freq

    @ArthurZucker
    ArthurZucker committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    5123d3c View commit details
    Browse the repository at this point in the history

  3. propagate to jax

    @ArthurZucker
    ArthurZucker committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    ca75915 View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2024

  1. Apply suggestions from code review 

    Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com>
    @ArthurZucker @sanchit-gandhi
    ArthurZucker and sanchit-gandhi authored Jan 26, 2024
    Configuration menu
    Copy the full SHA
    36ecdc9 View commit details
    Browse the repository at this point in the history

  2. adjust test

    @younesbelkada
    younesbelkada committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    792dcf0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'add-golden-gate' of https://github.com/huggingface/new-… 

    …model-addition-golden-gate into HEAD
    @younesbelkada
    younesbelkada committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    d700211 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. fix conversion script

    @younesbelkada
    younesbelkada committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    dbc976e View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. change name

    @ArthurZucker
    ArthurZucker committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    10ace9f View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. correct file names

    @ArthurZucker
    ArthurZucker committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    6ff459c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad… 

    …dition-golden-gate into add-golden-gate
    @ArthurZucker
    ArthurZucker committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    a5bb7a2 View commit details
    Browse the repository at this point in the history

  3. update conversion script

    @ArthurZucker
    ArthurZucker committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    2126d1c View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2024

  1. Fix bos and eos token ids in the model configuration (#3)

    @pcuenca
    pcuenca authored Feb 13, 2024
    Configuration menu
    Copy the full SHA
    ac7ac87 View commit details
    Browse the repository at this point in the history

  2. update modelling

    @ArthurZucker
    ArthurZucker committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    bd2a760 View commit details
    Browse the repository at this point in the history

  3. update conversion script

    @ArthurZucker
    ArthurZucker committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    123d72c View commit details
    Browse the repository at this point in the history

  4. merge

    @ArthurZucker
    ArthurZucker committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    aab3110 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'gg/main' into HEAD

    @younesbelkada
    younesbelkada committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    0d2acff View commit details
    Browse the repository at this point in the history

  6. add static cache for gemma

    @younesbelkada
    younesbelkada committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    4e08dd9 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2024

  1. fix sdpa generate

    @younesbelkada
    younesbelkada committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    6976cab View commit details
    Browse the repository at this point in the history

  2. fix batched

    @younesbelkada
    younesbelkada committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    92c7a7f View commit details
    Browse the repository at this point in the history

  3. multiple fixes

    @younesbelkada
    younesbelkada committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    f453a42 View commit details
    Browse the repository at this point in the history

  4. fix FA2

    @younesbelkada
    younesbelkada committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    491ea9f View commit details
    Browse the repository at this point in the history

  5. final fix

    @younesbelkada
    younesbelkada committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    4b4b621 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. Rename a few missing strings and filenames (#4)

    @pcuenca
    pcuenca authored Feb 15, 2024
    Configuration menu
    Copy the full SHA
    e9d36be View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2024

  1. Merge branch 'main' into add-golden-gate

    @younesbelkada
    younesbelkada authored Feb 19, 2024
    Configuration menu
    Copy the full SHA
    cdf9333 View commit details
    Browse the repository at this point in the history

  2. merge with upstream main

    @younesbelkada
    younesbelkada committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    51a7d9f View commit details
    Browse the repository at this point in the history

  3. fix copies

    @younesbelkada
    younesbelkada committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    89384e8 View commit details
    Browse the repository at this point in the history

  4. fix copies

    @younesbelkada
    younesbelkada committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    648ef04 View commit details
    Browse the repository at this point in the history

  5. fix fixup

    @younesbelkada
    younesbelkada committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    fd35d32 View commit details
    Browse the repository at this point in the history

  6. fix fixup

    @younesbelkada
    younesbelkada committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    58d7146 View commit details
    Browse the repository at this point in the history

  7. fix

    @younesbelkada
    younesbelkada committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    14d0f54 View commit details
    Browse the repository at this point in the history

  8. fix

    @younesbelkada
    younesbelkada committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    3822c4c View commit details
    Browse the repository at this point in the history

  9. final tests

    @younesbelkada
    younesbelkada committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    e50721d View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. fix fx gemma tests

    @sanchit-gandhi
    sanchit-gandhi committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    a764543 View commit details
    Browse the repository at this point in the history

  2. fix fx bf16/fp16 tests

    @sanchit-gandhi
    sanchit-gandhi committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    32a0492 View commit details
    Browse the repository at this point in the history

  3. update slow fx tests

    @sanchit-gandhi
    sanchit-gandhi committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    069b8b5 View commit details
    Browse the repository at this point in the history

  4. fx slow tests: one logits, one generation

    @sanchit-gandhi
    sanchit-gandhi committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    154e1df View commit details
    Browse the repository at this point in the history

  5. move jit test standalone

    @sanchit-gandhi
    sanchit-gandhi committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    a4074b0 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. Merge commit '0996a10077219de0556281511fc02f3ab68002d5' into add-gold… 

    …en-gate
    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    d7c2eb2 View commit details
    Browse the repository at this point in the history

  2. Apply suggestions from code review

    @ArthurZucker
    ArthurZucker authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    fc6ac3b View commit details
    Browse the repository at this point in the history

  3. nits

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    a259c04 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad… 

    …dition-golden-gate into add-golden-gate
    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    c590a9a View commit details
    Browse the repository at this point in the history

  5. tokenizer updates

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    b8d8edb View commit details
    Browse the repository at this point in the history

  6. more tokenization updates: custom GemmaSentencepieceExtrator

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    dc9ecf6 View commit details
    Browse the repository at this point in the history

  7. style

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    1a381bd View commit details
    Browse the repository at this point in the history

  8. Update src/transformers/cache_utils.py

    @ArthurZucker
    ArthurZucker authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    f7496a4 View commit details
    Browse the repository at this point in the history

  9. Update src/transformers/models/gemma/__init__.py

    @ArthurZucker
    ArthurZucker authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    170832a View commit details
    Browse the repository at this point in the history

  10. Update tests/models/gemma/test_modeling_flax_gemma.py

    @ArthurZucker
    ArthurZucker authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    b32adc0 View commit details
    Browse the repository at this point in the history

  11. small nits

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    24d5191 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad… 

    …dition-golden-gate into add-golden-gate
    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    6d5a2fe View commit details
    Browse the repository at this point in the history

  13. style

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    403c796 View commit details
    Browse the repository at this point in the history

  14. update tokenization test

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    3633bb0 View commit details
    Browse the repository at this point in the history

  15. fix the rotary embedding

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    df86580 View commit details
    Browse the repository at this point in the history

  16. with style

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    565028a View commit details
    Browse the repository at this point in the history

  17. fix slow tests

    @younesbelkada
    younesbelkada committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    362d2cd View commit details
    Browse the repository at this point in the history

  18. WARNING this commit might be very important for precisions

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    fb87315 View commit details
    Browse the repository at this point in the history

  19. Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad… 

    …dition-golden-gate into add-golden-gate
    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    b63d2e0 View commit details
    Browse the repository at this point in the history

  20. Update tests/models/gemma/test_modeling_flax_gemma.py

    @ArthurZucker
    ArthurZucker authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    9b834f7 View commit details
    Browse the repository at this point in the history

  21. Update src/transformers/models/gemma/configuration_gemma.py 

    Co-authored-by: Lysandre Debut <hi@lysand.re>
    @ArthurZucker @LysandreJik
    ArthurZucker and LysandreJik authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    e33fb3d View commit details
    Browse the repository at this point in the history

  22. Update src/transformers/models/gemma/modeling_flax_gemma.py 

    Co-authored-by: Lysandre Debut <hi@lysand.re>
    @ArthurZucker @LysandreJik
    ArthurZucker and LysandreJik authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    0aa94f1 View commit details
    Browse the repository at this point in the history

  23. small nits here and there!

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    e06809c View commit details
    Browse the repository at this point in the history

  24. Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad… 

    …dition-golden-gate into add-golden-gate
    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    eb2c69d View commit details
    Browse the repository at this point in the history

  25. forgotten nit

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    db63274 View commit details
    Browse the repository at this point in the history

  26. remove on the fly computation of inv_freq

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    275ee4a View commit details
    Browse the repository at this point in the history

  27. revert previous change, let's be safe and for now re-compute freq cis… 

    … to make sure it's in float
    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    6d81a99 View commit details
    Browse the repository at this point in the history

  28. Apply suggestions from code review 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    c9a4d86 View commit details
    Browse the repository at this point in the history

  29. Update src/transformers/models/gemma/convert_gemma_weights_to_hf.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    1c42d4a View commit details
    Browse the repository at this point in the history

  30. Update src/transformers/models/gemma/convert_gemma_weights_to_hf.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    9c4d439 View commit details
    Browse the repository at this point in the history

  31. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    a56f555 View commit details
    Browse the repository at this point in the history

  32. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    03c8e8f View commit details
    Browse the repository at this point in the history

  33. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    f37f517 View commit details
    Browse the repository at this point in the history

  34. Update tests/models/gemma/test_modeling_flax_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    e5bfdd0 View commit details
    Browse the repository at this point in the history

  35. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    d83e098 View commit details
    Browse the repository at this point in the history

  36. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    09717b6 View commit details
    Browse the repository at this point in the history

  37. Update tests/models/gemma/test_tokenization_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    cce69c0 View commit details
    Browse the repository at this point in the history

  38. Update tests/models/gemma/test_tokenization_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    dde30a5 View commit details
    Browse the repository at this point in the history

  39. Update tests/models/gemma/test_tokenization_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    02a2d38 View commit details
    Browse the repository at this point in the history

  40. Update tests/models/gemma/test_tokenization_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    c975dae View commit details
    Browse the repository at this point in the history

  41. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    5cf4da3 View commit details
    Browse the repository at this point in the history

  42. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    f198015 View commit details
    Browse the repository at this point in the history

  43. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    ac82e00 View commit details
    Browse the repository at this point in the history

  44. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    7253c9f View commit details
    Browse the repository at this point in the history

  45. Update tests/models/gemma/test_modeling_gemma.py 

    Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
    @younesbelkada @pcuenca
    younesbelkada and pcuenca authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    bc7ebaf View commit details
    Browse the repository at this point in the history

  46. nit conversion script link

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    4ad0d52 View commit details
    Browse the repository at this point in the history

  47. fix some tests

    @younesbelkada
    younesbelkada committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    7db13fa View commit details
    Browse the repository at this point in the history

  48. add not doctest and pr doctest

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    60f8ba6 View commit details
    Browse the repository at this point in the history

  49. Merge branch 'add-golden-gate' of github.com:huggingface/transformers… 

    … into add-golden-gate
    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    1bf51b3 View commit details
    Browse the repository at this point in the history

  50. repo consistency

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    2a4d326 View commit details
    Browse the repository at this point in the history

  51. fix last CIs 🚀

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    ea9eb10 View commit details
    Browse the repository at this point in the history

  52. update all readmes

    @ArthurZucker
    ArthurZucker committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    556f743 View commit details
    Browse the repository at this point in the history