Allow reusing results from llama_token_to_piece when sampling grammars#4213
Closed
MarcusDunn wants to merge 6 commits intoggerganov:masterfrom MarcusDunn:grammar_cache_tokens
+30-6
Commits
Commits on Nov 25, 2023
- committed
- authored
- committed
- committed
- committed
- committed
