Skip to content
This repository has been archived by the owner on Sep 12, 2024. It is now read-only.

Use custom tokenizer #105

Open
linonetwo opened this issue Jul 19, 2023 · 0 comments
Open

Use custom tokenizer #105

linonetwo opened this issue Jul 19, 2023 · 0 comments

Comments

@linonetwo
Copy link

To fix #104 , I think I should use https://github.com/belladoreai/llama-tokenizer-js , but currently there is no such an API to passing vector to createCompletion
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@linonetwo