Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Offer sample system messages and user prompts in the Dev UI #658

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

jmartisk
Copy link
Collaborator

@jmartisk jmartisk commented Jun 5, 2024

Just a very rough draft for now, to continue the discussion. Added one sample where the LLM summarizes a git diff that I took from this repository. Maybe the samples should be moved to separate file(s) but I'd have to figure out how. Also, I'm not sure if we can limit the size of the text areas, they grow very big after selecting a long system+user message.

@jmartisk jmartisk requested a review from phillip-kruger June 5, 2024 12:57
@iocanel
Copy link
Collaborator

iocanel commented Jun 6, 2024

Why provide a hard coded list of message and not collect the system messages defined by the application ?

@geoand
Copy link
Collaborator

geoand commented Jun 6, 2024

What I had in mind when opening the issue was for us to leverage the awesome prompt library available in https://github.com/danielmiessler/fabric/tree/main/patterns

@geoand
Copy link
Collaborator

geoand commented Jul 10, 2024

@jmartisk what's the status of this one?

@jmartisk
Copy link
Collaborator Author

The status is that I would like somebody to chime in and say if this is worth pursuing further this way, or some other way, or not at all :)

@jmartisk
Copy link
Collaborator Author

jmartisk commented Jul 10, 2024

Oh and yeah, regarding https://github.com/danielmiessler/fabric/tree/main/patterns
The problem is that the prompts contain placeholders. In the UI, it's not very pleasant to work with, as one has to read the prompt and manually replace all placeholders, so I'm not super excited about that :(

@jmartisk
Copy link
Collaborator Author

jmartisk commented Jul 10, 2024

Unless we also come up with a way to allow pleasantly defining values for placeholders, it doesn't seem very useful.

There's also the question of whether pre-defined prompts from some kind of library really make sense in this context, while the main point of the UI page is to allow easy testing of RAG and tools of the application. It's for working with the application, not experimenting with a library of prompts that have no relation to the app.

@geoand
Copy link
Collaborator

geoand commented Jul 10, 2024

I am not saying that we must have those prompts in this screen, but there should somewhere that we surface those prompts to users as they are super helpful

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Dev UI: provide some kind of library of prepared system messages
3 participants