[Roadmap] UX Improvements to incentivise token savings

[ffrappo]

Why
The current UI both in mobile and desktop hides away the previous chats and it's not so immediate to create new chats. This leads to an increased incentive for the user to remain in the same thread. This goes at the cost of token spend and context exhaustion.

Concise description
I propose the chat history is always visible on the left, with a "New conversation" button at the top, and "Start new chat" shortcut is placed near the message send area. On mobile, a button on the top right could do the job.
As a reinforcement, a "system notice" every 10 messages in the chat area could educate the users about the benefit of starting a new chat, perhaps using the summarisation feature.

Requirements
Not sure

[enricoros]

I like the general tone and direction of this idea. While a new UI is in the plan (#201 #203 ), I like the idea of having specialized effort to save tokens.

In addition to a better UX to start chats, how about we add an economy mode?

E.g. features on the Economy mode:

• Cost prediction (given the precise token estimation and the llm cost per token) of the current prompt (range showing $input... $input+max_Output)
• Every 10 messages a reminder to start a new chat (or something similar, given messages can be of different sizes..)
• button to auto-hide messages (sliding window approach) past the Half or Quarter of the context window
• ...?

What do you think @ffrappo ?

[ffrappo]

That would be brilliant. But perhaps maintaining a new mode would be harder than adding a couple of defaults. Also Big Agi already does a lot and has tons of customisations, could become harder to pickup for new users if you add more settings and variants.

[enricoros]

See also #341