-
Notifications
You must be signed in to change notification settings - Fork 3.9k
Closed
Labels
kind:enhancementIndicates a new feature request, imrovement, or extensionIndicates a new feature request, imrovement, or extension
Description
Our product is very annoying to use if too slow.
As I have ideas abt prompt engineering, I'll drop here.
- Note that length of prompt DOES NOT affect completion time, all that matters is the number of tokens that are outputted by the model. So good to write nice preamble.
- One idea: check line-by-line or function-by-func and ask "Does this need to be edited? If so, output the edited version, if not output 'No edit needed'."
- Make sure you can get it to output a format that can be reliably parsed. I often use the triple-tick to indicate code, but JSON or XML or custom also an option.
Metadata
Metadata
Assignees
Labels
kind:enhancementIndicates a new feature request, imrovement, or extensionIndicates a new feature request, imrovement, or extension