Skip to content

How to use special prompts with Koboldcpp? #1089

Answered by jabberjabberjabber
FlyToha asked this question in Q&A
Discussion options

You must be logged in to vote

For the first three of those, we will go 1,2,3 for each system tag, user tag, and assistant tag

<|im_start|>system
or: 
<s>[INST] 
^note space after [INST]
or:
<|system|>\n

<|im_end|>\n<|im_start|>user\n
or:
  [/INST] </s>[INST] 
^note space before and after [/INST] and after [INST]
or:
\n<|user|>\n

<|im_end|>\n<|im_start|>assistant\n
or:
  [/INST]
^note space before [/INST]
or:
\n<|assistant|>\n

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by LostRuins
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants