Code

Kvcache e2e#1001

Code

Closed

horheynm wants to merge 6 commits intomainvllm-project/llm-compressor:mainfrom kvcache-e2evllm-project/llm-compressor:kvcache-e2eCopy head branch name to clipboard

+249-128

Commits

Commits on Dec 17, 2024

• okwinds-fix

  horheynm

  committed
  d6c23a8

Commits on Dec 20, 2024

• Replace tokenizer with processor (#955)

  Show description for fae81c6
  

  2 peopleauthored and

  horheynm

  committed
  fae81c6

• Revert "KV Cache, E2E Tests (#742)" (#989)

  Show description for 21a0d24
  

  dsikka

  authored and

  horheynm

  committed
  21a0d24

• Fix SmoothQuant offload bug (#978)

  Show description for d3e75be
  

  dsikka

  authored and

  horheynm

  committed
  d3e75be

• Add LM Eval Configs (#980)

  

  dsikka

  authored and

  horheynm

  committed
  2235c9f

• kv-cache e2e

  horheynm

  committed
  d3bacc5