Code

Gemma capping#34282

Code

Merged

ArthurZucker merged 58 commits intomainhuggingface/transformers:mainfrom gemma-cappinghuggingface/transformers:gemma-cappingCopy head branch name to clipboardNov 19, 2024

+426-536

Commits

Commits on Oct 21, 2024

• softcapping

  ArthurZucker

  committed
  85d549a

  Copy full SHA for 85d549a

• soft cap before the mask

  ArthurZucker

  committed
  eba5191

  Copy full SHA for eba5191

• style

  ArthurZucker

  committed
  b9e4a54

  Copy full SHA for b9e4a54

• ...

  ArthurZucker

  committed
  514a839

  Copy full SHA for 514a839

• super nit

  ArthurZucker

  committed
  7544feb

  Copy full SHA for 7544feb

• update

  ArthurZucker

  committed
  be1b8c3

  Copy full SHA for be1b8c3

• fixes

  ArthurZucker

  committed
  0e0511f

  Copy full SHA for 0e0511f

• update

  ArthurZucker

  committed
  03ccc22

  Copy full SHA for 03ccc22

• small issue with modular

  ArthurZucker

  committed
  bdda724

  Copy full SHA for bdda724

• fix modular imports

  ArthurZucker

  committed
  a2b6b12

  Copy full SHA for a2b6b12

• update

  ArthurZucker

  committed
  9365c1b

  Copy full SHA for 9365c1b

• fixup

  ArthurZucker

  committed
  2108ee3

  Copy full SHA for 2108ee3

• simplify a hell lot

  ArthurZucker

  committed
  520120a

  Copy full SHA for 520120a

Commits on Oct 22, 2024

• simplify cleaning imports

  ArthurZucker

  committed
  314ed1f

  Copy full SHA for 314ed1f

• finish fixing

  ArthurZucker

  committed
  8830473

  Copy full SHA for 8830473

• update our design

  ArthurZucker

  committed
  e4c19d7

  Copy full SHA for e4c19d7

• nits

  ArthurZucker

  committed
  7922210

  Copy full SHA for 7922210

Commits on Nov 1, 2024

• Merge branch 'main' of github.com:huggingface/transformers into gemma-capping

  ArthurZucker

  committed
  fa1319d

  Copy full SHA for fa1319d

• use a deprecation cycle

  ArthurZucker

  committed
  43c68f6

  Copy full SHA for 43c68f6

• updates

  ArthurZucker

  committed
  1aec944

  Copy full SHA for 1aec944

• Fix modular (recursive deps need to always be computed after merges!)

  Cyrilvallez

  committed
  93b53ef

  Copy full SHA for 93b53ef

• Merge branch 'gemma-capping' of github.com:huggingface/transformers into gemma-capping

  ArthurZucker

  committed
  6f3cabb

  Copy full SHA for 6f3cabb

• push

  ArthurZucker

  committed
  a79c4a9

  Copy full SHA for a79c4a9

• fix

  ArthurZucker

  committed
  4c6d299

  Copy full SHA for 4c6d299

• update

  ArthurZucker

  committed
  607c45d

  Copy full SHA for 607c45d

• fix modular order

  Cyrilvallez

  committed
  4598bba

  Copy full SHA for 4598bba

• make fix-copies

  ArthurZucker

  committed
  5727270

  Copy full SHA for 5727270

• updates

  ArthurZucker

  committed
  198b4c4

  Copy full SHA for 198b4c4

• update

  ArthurZucker

  committed
  3d35151

  Copy full SHA for 3d35151

• ?

  ArthurZucker

  committed
  da050cd

  Copy full SHA for da050cd

• don't compile for now

  ArthurZucker

  committed
  e02078c

  Copy full SHA for e02078c

Commits on Nov 4, 2024

• ?

  ArthurZucker

  committed
  5861bbf

  Copy full SHA for 5861bbf

• fix some stuff

  ArthurZucker

  committed
  8c47da2

  Copy full SHA for 8c47da2

• donc!

  ArthurZucker

  committed
  09a88d9

  Copy full SHA for 09a88d9

• fix copies

  ArthurZucker

  committed
  c06b530

  Copy full SHA for c06b530

• update

  ArthurZucker

  committed
  89e6f85

  Copy full SHA for 89e6f85

• fixup

  ArthurZucker

  committed
  152e0b7

  Copy full SHA for 152e0b7

• Merge branch 'main' of github.com:huggingface/transformers into gemma-capping

  ArthurZucker

  committed
  46d8fa7

  Copy full SHA for 46d8fa7

• ?

  ArthurZucker

  committed
  006e869

  Copy full SHA for 006e869

• fix two tests

  ArthurZucker

  committed
  159c65a

  Copy full SHA for 159c65a

• fix?

  ArthurZucker

  committed
  56ea5b9

  Copy full SHA for 56ea5b9

• for now, don't use head info

  ArthurZucker

  committed
  4c3deb9

  Copy full SHA for 4c3deb9

• eager when output attentoin and sdpa or flash as it's the simplest behaviour (for our tests as well :))

  ArthurZucker

  committed
  9e3609d

  Copy full SHA for 9e3609d

• fix-copies

  ArthurZucker

  committed
  21edaed

  Copy full SHA for 21edaed

• revert sdpa check

  ArthurZucker

  committed
  b5d9819

  Copy full SHA for b5d9819

Commits on Nov 6, 2024

• Apply suggestions from code review

  Show description for 5a3dade
  

  ArthurZucker

  and

  Cyrilvallez

  authored
  5a3dade

  Copy full SHA for 5a3dade

• Merge branch 'main' of github.com:huggingface/transformers into gemma-capping

  ArthurZucker

  committed
  faf433b

  Copy full SHA for faf433b

• rebase, fix-copies and push

  ArthurZucker

  committed
  1da75e1

  Copy full SHA for 1da75e1

• add a slow integration test

  ArthurZucker

  committed
  aca9120

  Copy full SHA for aca9120

Commits on Nov 19, 2024

• update the test

  ArthurZucker

  committed
  8f1fc5e

  Copy full SHA for 8f1fc5e

• fix left padding issue

  ArthurZucker

  committed
  5be3bab

  Copy full SHA for 5be3bab

• fix test

  ArthurZucker

  committed
  3e5b87a

  Copy full SHA for 3e5b87a

• remove duplicate scaling

  ArthurZucker

  committed
  0513aff

  Copy full SHA for 0513aff

• quality

  ArthurZucker

  committed
  480aff8

  Copy full SHA for 480aff8

• Merge branch 'main' into gemma-capping

  ArthurZucker

  authored
  603fce8

  Copy full SHA for 603fce8

• add a small test and make sure it works

  ArthurZucker

  committed
  2a765d6

  Copy full SHA for 2a765d6

• Merge branch 'gemma-capping' of github.com:huggingface/transformers into gemma-capping

  ArthurZucker

  committed
  fb184be

  Copy full SHA for fb184be

• 2b

  ArthurZucker

  committed
  6aba68c

  Copy full SHA for 6aba68c