Code

[Core]Add Ascend Quantize#7

Code

Merged

wangxiyuan merged 22 commits intovllm-project:developvllm-project/vllm-ascend:developfrom Angazenn:mainAngazenn/vllm-ascend:mainCopy head branch name to clipboardFeb 11, 2025

+442-1

Commits

Commits on Feb 7, 2025

• add ascend quantize

  Show description for bafc5f5
  

  angazenn

  committed
  bafc5f5

  Copy full SHA for bafc5f5

• add license

  Show description for a4aaea4
  

  angazenn

  committed
  a4aaea4

  Copy full SHA for a4aaea4

• fix quantization import bugs

  Show description for 43b9f70
  

  angazenn

  committed
  43b9f70

  Copy full SHA for 43b9f70

• support skipping unquantized layers

  Show description for 46b7ca2
  

  angazenn

  committed
  46b7ca2

  Copy full SHA for 46b7ca2

• fix ci

  Show description for 5b1b34d
  

  angazenn

  committed
  5b1b34d

  Copy full SHA for 5b1b34d

• remove unnecessary params

  Show description for 7a41f8f
  

  angazenn

  committed
  7a41f8f

  Copy full SHA for 7a41f8f

• fix import errors

  Show description for d332351
  

  angazenn

  committed
  d332351

  Copy full SHA for d332351

• avoid import check

  Show description for 37c4543
  

  angazenn

  committed
  37c4543

  Copy full SHA for 37c4543

• add ascend quantization ut

  Show description for 7e230f0
  

  angazenn

  committed
  7e230f0

  Copy full SHA for 7e230f0

• fix quant description bugs

  Show description for 1bfb206
  

  angazenn

  committed
  1bfb206

  Copy full SHA for 1bfb206

• fix ut bugs

  Show description for 9bbc77c
  

  angazenn

  committed
  9bbc77c

  Copy full SHA for 9bbc77c

• move quantizer initialization to linear method

  Show description for b5d4bf6
  

  angazenn

  committed
  b5d4bf6

  Copy full SHA for b5d4bf6

• fix bugs

  Show description for d3dd745
  

  angazenn

  committed
  d3dd745

  Copy full SHA for d3dd745

Commits on Feb 8, 2025

• narrow down the codes that try-catch structure covers when importing quantizer

  Show description for b809659
  

  angazenn

  committed
  b809659

  Copy full SHA for b809659

• move packages imported to the head

  Show description for 7f4b41c
  

  angazenn

  committed
  7f4b41c

  Copy full SHA for 7f4b41c

• fix import bugs

  Show description for a553906
  

  angazenn

  committed
  a553906

  Copy full SHA for a553906

• fix import bugs

  Show description for 3b94a9f
  

  angazenn

  committed
  3b94a9f

  Copy full SHA for 3b94a9f

• remove anti-outlier conditions from vllm_ascend

  Show description for 210e6dc
  

  angazenn

  committed
  210e6dc

  Copy full SHA for 210e6dc

• remove unnecessary spaces

  Show description for 639b602
  

  angazenn

  committed
  639b602

  Copy full SHA for 639b602

• add example quantization codes to ut

  Show description for a92d9fe
  

  angazenn

  committed
  a92d9fe

  Copy full SHA for a92d9fe

Commits on Feb 10, 2025

• fix bugs

  Show description for 44737f9
  

  angazenn

  committed
  44737f9

  Copy full SHA for 44737f9

• move importation of AscendQuantConfig

  Show description for f1e9556
  

  angazenn

  committed
  f1e9556

  Copy full SHA for f1e9556