Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Previous messages should be included as context #53

Closed
kisamoto opened this issue May 19, 2024 · 1 comment · Fixed by #59
Closed

Previous messages should be included as context #53

kisamoto opened this issue May 19, 2024 · 1 comment · Fixed by #59

Comments

@kisamoto
Copy link
Contributor

  • Adapt context length based on prompt
  • Backend may adjust context based on system prompt

Future:

  • Client side RAG with Orama vector search
@kisamoto
Copy link
Contributor Author

Context uses the messages from the state to be constructed and sent. This is a bit of limiting factor so add #58 to improve this.
Increase the page size to 100 messages for now to get a decent sized history.

@kisamoto kisamoto linked a pull request May 20, 2024 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant