Code

Fix: Jamba batched generation#32914

Code

Merged

ArthurZucker merged 5 commits intohuggingface:mainhuggingface/transformers:mainfrom vasqu:jamba-batched-gen-fixvasqu/transformers:jamba-batched-gen-fixCopy head branch name to clipboardAug 28, 2024

+50-56

Commits

Commits on Aug 23, 2024

• init fix

  vasqu

  committed
  c02bf38

• fix mask during cached forward, move mask related stuff to own function

  vasqu

  committed
  fcd6d20

• adjust tests as left padding does not change logits as much anymore + batch gen (with todo on logits comp)

  vasqu

  committed
  e2c2341

• revert overwriting new integration tests

  vasqu

  committed
  e81eee2

Commits on Aug 27, 2024

• move some comments to docstring

  vasqu

  committed
  43e08dd