Code

Feat/ctx size#194

Code

Merged

jmbejar merged 4 commits intomoxin-org:devmoxin-org/moly:devfrom L-jasmine:feat/ctx-sizeL-jasmine/moxin:feat/ctx-sizeCopy head branch name to clipboardAug 6, 2024

+42-9

Commits

Commits on Aug 6, 2024

• [Backend] Support frontend change ctx_size & batch_size

  Show description for 4e22cbc
  L-jasmine

  committed
  4e22cbc

• [Backend] let the system decide api-server.wasm port

  Show description for 9efb754
  L-jasmine

  committed
  9efb754

• Fix chat without stream error

  Show description for fd6fc34
  L-jasmine

  committed
  fd6fc34

• [Backend] change LoadModelOptions.n_ctx from u32 to Option<u32>

  Show description for ecb4cb0
  L-jasmine

  committed
  ecb4cb0