Code

[Grammar] Integrate with XGrammar#635

Code

Merged

tqchen merged 10 commits intomlc-ai:mainmlc-ai/web-llm:mainfrom CharlieFRuan:pr-1112-xgrammarCharlieFRuan/web-llm:pr-1112-xgrammarCopy head branch name to clipboardNov 22, 2024

+467-301

Commits

Commits on Nov 22, 2024

• [Grammar] Integrate with web-xgrammar

  CharlieFRuan

  committed
  8d530cd

  Copy full SHA for 8d530cd

• Rebase to new xgrammar, use tokenizerInfo and add full bitmask size

  CharlieFRuan

  committed
  2715813

  Copy full SHA for 2715813

• Allow grammar response format, on top of schema

  CharlieFRuan

  committed
  308660a

  Copy full SHA for 308660a

• Add metrics for grammar overhead, overlap grammar init

  CharlieFRuan

  committed
  8a987f3

  Copy full SHA for 8a987f3

• Trivial

  CharlieFRuan

  committed
  81ce64c

  Copy full SHA for 81ce64c

• Add TTFT and TPOT to usage extra

  CharlieFRuan

  committed
  deb5a26

  Copy full SHA for deb5a26

• Trivial, use root instead of main in ebnf

  CharlieFRuan

  committed
  6480f52

  Copy full SHA for 6480f52

• Add metric E2E latency to usage extra

  CharlieFRuan

  committed
  a63a534

  Copy full SHA for a63a534

• Support ignore_eos

  CharlieFRuan

  committed
  6e23f5d

  Copy full SHA for 6e23f5d

• Update to new XGrammar pre-release APIs

  CharlieFRuan

  committed
  2fed3e8

  Copy full SHA for 2fed3e8