Code

speculative : add grammar support#2991

Code

Merged

ggerganov merged 9 commits intomasterggerganov/llama.cpp:masterfrom speculative-grammarggerganov/llama.cpp:speculative-grammarCopy head branch name to clipboardSep 5, 2023

+126-13

Commits

Commits on Sep 4, 2023

• speculative : add grammar support

  ggerganov

  committed
  69f2faf

  Copy full SHA for 69f2faf

• grammars : add json_arr.gbnf

  ggerganov

  committed
  e0a8658

  Copy full SHA for e0a8658

• grammar : add comments to new grammar file

  ggerganov

  committed
  2d89da4

  Copy full SHA for 2d89da4

• grammar : remove one nested level

  ggerganov

  committed
  0134578

  Copy full SHA for 0134578

• common : warm-up with 2 tokens - seems to work better

  ggerganov

  committed
  ebe41d4

  Copy full SHA for ebe41d4

• speculative : print draft token pieces

  ggerganov

  committed
  6c150d7

  Copy full SHA for 6c150d7

• speculative : reuse grammar parser + better logs and comments

  ggerganov

  committed
  e7dc5b0

  Copy full SHA for e7dc5b0

• speculative : avoid grammar_mem

  ggerganov

  committed
  2db2471

  Copy full SHA for 2db2471

• make : fix speculative build

  ggerganov

  committed
  c79d130

  Copy full SHA for c79d130