Add token count to --list-chats #314
Remowylliams
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi I've run into a few situations where I'm using chatGPT-3.5 and I'd get a failure and it appears that it's because I've exceeded the 4k context size.
When I changed to using the chatGPT-3.5-16k
The problem went away and that is how I came to believe it was just sending too much session data.
Would it be difficult to add a token count to each session in the --list-chats output and does it make sense to do so?
If I'm wrong about the reason I can try to provide more debug info.
I'm using this on a 22.04 Linux system.
Thanks for making this tool. It's been great when I need a quick lookup with some intelligence behind it.
Beta Was this translation helpful? Give feedback.
All reactions