Code

FEAT: Support Ctransformers#289

Code

Merged

UranusSeven merged 61 commits intoxorbitsai:mainxorbitsai/inference:mainfrom RayJi01:FEAT/C_TransformRayJi01/Xprobe_inference:FEAT/C_TransformCopy head branch name to clipboardAug 11, 2023

+660-3

Commits

Commits on Aug 8, 2023

• fix rebase

  RayJi01

  committed
  77d4954

• small edit

  RayJi01

  committed
  3822252

• fix lint

  RayJi01

  committed
  09d9e8e

• fix model family match

  RayJi01

  committed
  f218a7d

• fix model family match

  RayJi01

  committed
  99b6117

• small edit on ctransformer.py

  RayJi01

  committed
  c4cf3b9

• small edit on ctransformer.py

  RayJi01

  committed
  721a540

• add model-type list

  RayJi01

  committed
  87333ef

• edit llama cpp

  RayJi01

  committed
  115db12

• edit llama cpp

  RayJi01

  committed
  e291cb1

• edit llama cpp

  RayJi01

  committed
  9b33537

• edit ctransformer cpp

  RayJi01

  committed
  2b1159f

• edit ctransformer cpp

  RayJi01

  committed
  9346de1

• edit ctransformer cpp

  RayJi01

  committed
  2edc687

• edit ctransformer cpp

  RayJi01

  committed
  8189c23

• edit ctransformer cpp

  RayJi01

  committed
  153ae6c

• edit ctransformer cpp

  RayJi01

  committed
  ff93f98

• edit ctransformer util

  RayJi01

  committed
  86335c4

• edit ctransformer util

  RayJi01

  committed
  ce6bb78

• edit ctransformer util

  RayJi01

  committed
  3db942b

• edit ctransformer util

  RayJi01

  committed
  72a77f3

• Ctransformer Pipeline is clear and ready to serve

  RayJi01

  committed
  fef3a69

• fix rebase

  RayJi01

  committed
  2345dae

• fix setup issue2.

  RayJi01

  committed
  ae6e5db

• fix setup issue3

  RayJi01

  committed
  4db685b

• fix import CI checking

  RayJi01

  committed
  5ae9ec7

• fix import CI checking 2

  RayJi01

  committed
  6330d95

• fix import CI checking 3

  RayJi01

  committed
  fd6b70a

• fix import CI checking 4

  RayJi01

  committed
  22ce526

• fix import CI checking 5

  RayJi01

  committed
  e1711d5

• add test to c-transformers

  RayJi01

  committed
  ae04adb

• fix test typing issue from importing Ctransforemrs

  RayJi01

  committed
  7641b30

• add pytest-mock to setup.cfg

  RayJi01

  committed
  30575ed

• fix ctransformers import issue1

  RayJi01

  committed
  4b508a0

• fix ctransformers import by add ctransformers to dev

  RayJi01

  committed
  98669fd

• fix ctransformers test issue2

  RayJi01

  committed
  31c4054

• fix ctransformers test issue2

  RayJi01

  committed
  6472c84

• refactor toward suggestions.

  RayJi01

  committed
  5b7d837

• fix test dependency

  RayJi01

  committed
  ac2799c

• update logger error

  RayJi01

  committed
  1c7ae94

• update logger error

  RayJi01

  committed
  58ca677

• update logger error

  RayJi01

  committed
  8955272

• update logger error

  RayJi01

  committed
  f909238

• fix issue in ctransformersutil and delete redundant logger.

  RayJi01

  committed
  e76c576

Commits on Aug 9, 2023

• refactor toward suggestions.

  RayJi01

  committed
  cfb267e

• fix part of issues from suggestions.

  RayJi01

  committed
  9bca70c

Commits on Aug 10, 2023

• fix part of issues from suggestions.

  RayJi01

  committed
  cb66cd3

• fix test issue by remove mock autoconfig.

  RayJi01

  committed
  5ffa5fe

• refactor toward suggestions.

  RayJi01

  committed
  f019ace

• remove parameterize in test, only test for q4_0

  RayJi01

  committed
  4f962f1

• try smaller gpt-2 model for test ctransformer

  RayJi01

  committed
  973685b

• add CTRANSFORME_SUPPORT_MODEL constant (can be expanded)

  RayJi01

  committed
  e09350d

• fix cuda branch error.

  RayJi01

  committed
  016c318

• fix test cuda error.

  RayJi01

  committed
  2524747

Commits on Aug 11, 2023

• add GPU check to make sure only supported model can initialize Cuda.

  RayJi01

  committed
  740f31a

• add GPU check to make sure only supported model can initialize Cuda.

  RayJi01

  committed
  25d3dd4

• try adding mpt model.

  RayJi01

  committed
  a9e3006

• remove mpt for this pr.

  RayJi01

  committed
  ef9a84d

• refactor toward suggestions.

  RayJi01

  committed
  0f05689

• fix lint issue.

  RayJi01

  committed
  360f7e7

• remove prompt style for generate model.

  RayJi01

  committed
  bfecc8a