You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am using the vicuna model with the DAN prompt, it works well but it sometimes stops mid sentence for example it would say: "example senten" then stop talking why does this happen?
here is my run.bat script:
I am using the vicuna model with the DAN prompt, it works well but it sometimes stops mid sentence for example it would say: "example senten" then stop talking why does this happen?
here is my run.bat script:
title Vicuna!(;
:start
main -i -f prompts/DAN.txt --memory_f32 --interactive-first -r "### Human:" --temp 0 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct --color -m ggml-vicuna-7b-4bit.bin -n 128
pause
goto start
The text was updated successfully, but these errors were encountered: