Dynamic system prompt

[ErikBjare]

• Current date & training cutoff (model-dependent): Set current date & training cutoff in system prompt #137
  • This seems easy to do, just looks for a date/cutoff-block in the system prompt and replace it if present on each call.
• Tool selection
  • Currently, we load default tools or those set by --tools, but it only impacts the system prompt on the first run.
  • We could change --tools to only be valid for new conversations (lame?)
    • Would still need us to figure out which tools the conversation was using when loaded.
  • We could store the loaded tools for the conversation somewhere, so that we can at least resume with the correct toolset.
  • We could let the user override --tools and have it modify the system prompt.

Vaguely related to (similar issues around mutability of conversations): #150

[kennethreitz]

Curious to see how this develops.