Skip to content

Latest commit

 

History

History
57 lines (42 loc) · 1.37 KB

README.md

File metadata and controls

57 lines (42 loc) · 1.37 KB
Raw

🎬 Get Started

📝 Prerequisites

  • CPU >= 4 cores
  • RAM >= 16 GB
  • Disk >= 50 GB
  • Docker >= 24.0.0 & Docker Compose >= v2.26.1

    If you have not installed Docker on your local machine (Windows, Mac, or Linux), see Install Docker Engine.

🚀 Start up the server

  1. Clone the repo:

    $ git clone https://github.com/FLock-io/ragchat-morpheus.git

  2. Build the pre-built Docker images and start up the server:

    $ cd ragchat-morpheus
$ docker compose up

    The core image is about 16 GB in size and may take a while to load.

  3. Check the server status after having the server up and running:

    The following output confirms a successful launch of the system:

     * Running on all addresses (0.0.0.0)
 * Running on http://127.0.0.1:8000
 * Running on http://x.x.x.x:8000
 INFO:werkzeug:Press CTRL+C to quit

  4. Run your openai script.

from openai import OpenAI

client = OpenAI(
    api_key="fake-api-key",
    base_url="http://127.0.0.1:8000" # If it's not local, replace it with your url
)
stream = client.chat.completions.create(
    model="morpheus-model",
    messages=[{"role": "user", "content": "what is mor?"}
              ]
)
print(stream.choices[0].message.content)

It may take a while to download the model on your first visit.