Code

feat: Add new wrapper defaults#656

Code

Merged

sarahwooders merged 14 commits intomainletta-ai/letta:mainfrom test-mixtralletta-ai/letta:test-mixtralCopy head branch name to clipboardDec 21, 2023

+457-11

Commits

Commits on Dec 20, 2023

• added additional stop token based on experience w/ dolphin-mixtral

  cpacker

  committed
  6d6eb95

  Copy full SHA for 6d6eb95

• added a new chatml wrapper, trying to max performance w/ dolphin mixtral

  cpacker

  committed
  4501b9a

  Copy full SHA for 4501b9a

• updated default config to use chatml

  cpacker

  committed
  556d2ab

  Copy full SHA for 556d2ab

• indent the function return strings (TODO maybe simplify this a bit since it's a lot of noise for send_message)

  cpacker

  committed
  d51d8c3

  Copy full SHA for d51d8c3

• refactor and cleanup

  cpacker

  committed
  54e1fbd

  Copy full SHA for 54e1fbd

• modified func return prefix

  cpacker

  committed
  bc361b7

  Copy full SHA for bc361b7

• extra stop token to prevent run-on multi json

  cpacker

  committed
  2b3eabf

  Copy full SHA for 2b3eabf

• refactor

  cpacker

  committed
  4d569b6

  Copy full SHA for 4d569b6

• allow passing through first_message into prompt formatter, which enables the prompt formatter to force a specific function call

  cpacker

  committed
  66a15ef

  Copy full SHA for 66a15ef

• note about how this can be done with forced functions instead

  cpacker

  committed
  ebe1bd7

  Copy full SHA for ebe1bd7

• patch bug with trailing space on time str

  cpacker

  committed
  f996871

  Copy full SHA for f996871

Commits on Dec 21, 2023

• added new no-function-forcing variant of the chatml wrapper

  cpacker

  committed
  3d91b68

  Copy full SHA for 3d91b68

• some todo comments

  cpacker

  committed
  1e66f2b

  Copy full SHA for 1e66f2b

• unrelated bug in memory where we weren't throwing an error on empty string for old_content

  cpacker

  committed
  7c882a2

  Copy full SHA for 7c882a2