Code

Cache: standardize cache interface#29005

Code

Closed

gante wants to merge 30 commits intohuggingface:mainhuggingface/transformers:mainfrom gante:standardize_cache_apigante/transformers:standardize_cache_apiCopy head branch name to clipboard

+370-302

Commits

Commits on Feb 15, 2024

• wow I was scared!

  

  ArthurZucker

  authored and

  gante

  committed
  c518ee3

  Copy full SHA for c518ee3

• fix everything

  

  ArthurZucker

  authored and

  gante

  committed
  0b20058

  Copy full SHA for 0b20058

• nits

  

  ArthurZucker

  authored and

  gante

  committed
  1c5b2c0

  Copy full SHA for 1c5b2c0

• make it BC?

  

  ArthurZucker

  authored and

  gante

  committed
  1acc62f

  Copy full SHA for 1acc62f

• nits

  

  ArthurZucker

  authored and

  gante

  committed
  bd93ac7

  Copy full SHA for bd93ac7

• is_tracing should still be used to pass tracing tests

  

  ArthurZucker

  authored and

  gante

  committed
  9ef722f

  Copy full SHA for 9ef722f

• nits

  

  ArthurZucker

  authored and

  gante

  committed
  5078b37

  Copy full SHA for 5078b37

• some nits to make sure genration works with static cache uncompiled

  

  ArthurZucker

  authored and

  gante

  committed
  10cc68f

  Copy full SHA for 10cc68f

• fix FA2 for both static and dynamic in a better way?

  

  ArthurZucker

  authored and

  gante

  committed
  f83592e

  Copy full SHA for f83592e

• fix sequential beam searcg

  

  ArthurZucker

  authored and

  gante

  committed
  87631c8

  Copy full SHA for 87631c8

• style

  

  ArthurZucker

  authored and

  gante

  committed
  c3f3c0b

  Copy full SHA for c3f3c0b

• use keys_to_ignore

  

  ArthurZucker

  authored and

  gante

  committed
  561fa32

  Copy full SHA for 561fa32

• nit

  

  ArthurZucker

  authored and

  gante

  committed
  ed11a75

  Copy full SHA for ed11a75

• correct dtype inference when init

  

  ArthurZucker

  authored and

  gante

  committed
  d623190

  Copy full SHA for d623190

• :( the fix for FA2 is still not optimal to investigate!

  

  ArthurZucker

  authored and

  gante

  committed
  c51cc75

  Copy full SHA for c51cc75

• styling

  

  ArthurZucker

  authored and

  gante

  committed
  8d9e9f4

  Copy full SHA for 8d9e9f4

• nits

  

  ArthurZucker

  authored and

  gante

  committed
  4176694

  Copy full SHA for 4176694

• nit

  

  ArthurZucker

  authored and

  gante

  committed
  1936cf8

  Copy full SHA for 1936cf8

• this might work better

  

  ArthurZucker

  authored and

  gante

  committed
  c476ad3

  Copy full SHA for c476ad3

• add comment

  

  ArthurZucker

  authored and

  gante

  committed
  cfbcf6a

  Copy full SHA for cfbcf6a

• Update src/transformers/models/llama/modeling_llama.py

  

  ArthurZucker

  authored and

  gante

  committed
  3a2a785

  Copy full SHA for 3a2a785

• tmp commit

  gante

  committed
  ed6c60d

  Copy full SHA for ed6c60d

• wip

  gante

  committed
  3f0f207

  Copy full SHA for 3f0f207

• tmp commit

  gante

  committed
  93c9e2e

  Copy full SHA for 93c9e2e

• tmp

  gante

  committed
  e69eec2

  Copy full SHA for e69eec2

• merge errors

  gante

  committed
  5b38bf7

  Copy full SHA for 5b38bf7

• reduce diff

  gante

  committed
  bc84704

  Copy full SHA for bc84704

• smaller llama diff

  gante

  committed
  958875e

  Copy full SHA for 958875e

• make fixup

  gante

  committed
  104b208

  Copy full SHA for 104b208

• nearly all tests passing

  gante

  committed
  425c6ed

  Copy full SHA for 425c6ed