wikipedia-api

0. Clone the repository

git clone --recurse-submodules https://github.com/Datata1/wikipedia-api

1. Create a virtual environment

python -m venv .venv

2. Activate the virtual environment

source .venv/bin/activate

3. Install the dependencies

pip install -r requirements.txt

4. Download the model

wget -P ./llama.cpp/models https://huggingface.co/bartowski/Llama-3.2-1B-Instruct-GGUF/resolve/main/Llama-3.2-1B-Instruct-Q5_K_M.gguf

5. build Llama.cpp

cd llama.cpp
cmake -B build
cmake --build build --config Release

6. start uvicorn (from the root directory)

uvicorn main:app --reload

7. Open the browser and go to http://127.0.0.1:8000