Skip to content

Python console application designed to provide an engaging and visually appealing LLM chat experience on Unix-like consoles or Terminals.

License

Notifications You must be signed in to change notification settings

qnixsynapse/rich-chat

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

31 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Rich Chat: A Console App for Interactive Chatting with LLMs using Rich Text

Rich Chat is a Python console application designed to provide an engaging and visually appealing chat experience on Unix-like consoles or Terminals. This app utilizes the rich text library to render attractive text, creating a chat interface reminiscent of instant messaging applications. Rich Chat offers an interactive console experience with a visually appealing chat interface using the rich text library.

Installation

To use Rich Chat, first install the required dependencies:

pip install -r requirements.txt

Usage

Run the program with the following command line options:

python source/rich-chat.py [options] 

Commandline Options

  • --help or -h: Show this help message and exit.
  • --server SERVER: Set the OpenAI compatible server chat endpoint, e.g., chat.example.com.
  • --model-frame-color MODEL_FRAME_COLOR: Frame color of Large language Model (default: blue).
  • --topk TOPK: Set the top_k value to sample the top N number of tokens, where N is an integer.
  • --topp TOPP: Set the top_p value.
  • --temperature TEMPERATURE: Controls the randomness of text generation (default: 0.5).
  • --n-predict N_PREDICT: Define how many tokens to predict by the model (default: infinity until [stop] token).

These options are currently inexhaustible. More will be added later.

Roadmap

  • Expand the options

  • Proper RAG support(Both internet and documents)

  • Multimodal

Please stay tuned for updates. Contributions are surely welcome!!

About

Python console application designed to provide an engaging and visually appealing LLM chat experience on Unix-like consoles or Terminals.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages