This is an LLM Chat module using the for CodeProject.AI Server. The actual module itself is downloadable via the CodeProject.AI Server's dashboard.
-
Clone the main server repo into a directory such as
CodeProject/CodeProject.AI-Server
-
Clone this LlamaChat repo into a separate folder
CodeProject/CodeProject.AI-Modules
You should now have
CodeProject - CodeProject.AI-Server - demos - src - ... etc - CodeProject.AI-Modules - CodeProject.AI-LlamaChat (this repo)
-
If you have NOT run dev setup on the server Run the server dev setup scripts by opening a terminal in
CodeProject.AI-Server/src/
then, for Windows, runsetup.bat
, or for Linux/macOS runbash setup.sh
.
This will setup the server, and will also setup this module as long as this module sits under a folder namedCodeProject.AI-Modules
, withCodeProject.AI-Modules
being at the same folder level asCodeProject.AI-Server
.If you have already setup the server You can run the setup for just this module running the setup script from a terminal opened in this folder
REM For Windows ..\..\CodeProject.AI-Server\src\setup.bat
# For Linux/macOS bash ../../CodeProject.AI-Server/src/setup.sh
-
Open the server repo in Visual Studio Code (or Visual Studio) and build and launch the server (Build and Launch server in the Run and Debug menu in VS Code). This will start the server, which in turn will load the settings file from this module.
You can start this module directly from the CodeProject.AI Server dashboard, or you can run this module as a separate process via the 'Launch LlamaChat' Debug and Run option in VS Code.
Assuming the folder structure outlined above, run
REM For Windows
..\..\CodeProject.AI-Server\devops\build\create_packages.bat
# For Linux/macOS
bash ../../CodeProject.AI-Server/devops/build/create_packages.sh