Code

ENH: qwen switch to llama cpp#778

Code

Merged

aresnow1 merged 14 commits intoxorbitsai:mainxorbitsai/inference:mainfrom codingl2k1:feat/qwen_llama_cppcodingl2k1/inference:feat/qwen_llama_cppCopy head branch name to clipboardDec 21, 2023

+44-582

Commits

Commits on Dec 18, 2023

• dev

  codingl2k1

  committed
  d206b26

• Update model

  codingl2k1

  committed
  8bd2413

• Update llama-cpp-python to 0.2.23

  codingl2k1

  committed
  ba6f23a

Commits on Dec 19, 2023

• Fix

  codingl2k1

  committed
  21c12dd

• Fix

  codingl2k1

  committed
  b5a3725

• Add debug log

  codingl2k1

  committed
  8bf4f77

• Refine debug log

  codingl2k1

  committed
  09bfacb

• Refine logs

  codingl2k1

  committed
  4308703

• qwen ggufv2 does not need qwen.tiktoken

  codingl2k1

  committed
  c84d46b

• Remove qwen.tiktoken

  codingl2k1

  committed
  1d0c440

• Remove obsolated tests

  codingl2k1

  committed
  e5f6f1f

• Add qwen chat ggufv2 modelscope spec

  codingl2k1

  committed
  37c9fce

• qwen ggufv2 support tool calls

  codingl2k1

  committed
  7fb0dad

• Add debug log

  codingl2k1

  committed
  ffee285