Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use workspace LLM to create thread name #2701

Closed

Conversation

scottybo
Copy link

@scottybo scottybo commented Nov 22, 2024

Pull Request Type

  • ✨ feat
  • πŸ› fix
  • ♻️ refactor
  • πŸ’„ style
  • πŸ”¨ chore
  • πŸ“ docs

Relevant Issues

resolves #2699

What is in this change?

Uses the workspace's chosen LLM to rename the thread title to something more descriptive, rather than the first sentence of the conversation.

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

@scottybo scottybo changed the title Add thread renaming functionality Use workspace LLM to create thread name Nov 22, 2024
@timothycarambat
Copy link
Member

#2262 (comment)

The above comment is the primary reason why we dont support this. We offer an application on many various devices and not all of them are capable of concurrent generation or have the resources to do so - which is why the naming is static now since the latency could be high for low-end machines and the UX is not worth it considering that use-case.

Perhaps this could be something that could be done via a system toggle for appearance? This PR in its current form though does not enable that and should not make use of the APIChatHandler as while that works, is a different system that shouldn't be used for text generation in the backend

@scottybo
Copy link
Author

Ah - which handler should I be using? Still getting to grips with the code base!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEAT]: AI generated thread titles
2 participants