-
-
Notifications
You must be signed in to change notification settings - Fork 305
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove an API call for drawing within chats #423
Labels
Comments
Kav-K
added
help wanted
Extra attention is needed
good first issue
Good for newcomers
high-prio
labels
Nov 17, 2023
Kav-K
changed the title
Make drawing functionality in gpt converse optional
Remove an API call for drawing within chats
Nov 17, 2023
I've made drawing off by default, we still should remove the api call |
@Kav-K Can I work on this issue? |
@StatKumar yeah! thank you!! |
Thank you @Kav-K for providing this opportunity |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Currently if you converse with gpt vision, it will always interpret if you want to draw something or not using a separate API call, this is a second API call and they're costly so we want to be able to turn it off, but better yet, we want to be able to just remove the second API call
I was a bit (lot) stupid when designing this initially, we can avoid the second api call by just putting some instructions in the system pretext that ask it to use some sort of special syntax to denote a drawing prompt when it responds to a user if it picks up on intent to draw, and then we would just kick off the drawing from there onward, removing the api call entirely. This also increases conversation speed.
All the scaffolding for drawing is already in the code, what needs to be done is:
This drawing syntax pretext would have to be appended programmatically and not just in the main text of the pretext because it should work for other openers too. There should be some sort of recurring system message every X messages that acts as a reminder to do this identification of drawing intent, and in the future we can expand our agent's capabilities further on this basis
There are some drawbacks to this, the independent evaluator system should theoretically be more accurate, as it is more focused without the entire conversation context.
The text was updated successfully, but these errors were encountered: