Skip to content

Latest commit

 

History

History
32 lines (27 loc) · 834 Bytes

README.md

File metadata and controls

32 lines (27 loc) · 834 Bytes

Local RAG with Ollama models and pdf support

❗️ Forked and modified from: https://github.com/pixegami/rag-tutorial-v2

  1. Download and install ollama and pull models:

    ollama pull llama3
    ollama pull mxbai-embed-large
    
  2. Create and activate enviroment:

    python -m venv .venv
    source .venv/bin/activate
    
  3. Install dependencies:

    pip install requirements.txt
    
  4. Add pdf files to data folder

  5. Run streamlit app:

    streamlit run app.py
    

    If there is another streamlit installed you can run streamlit from specified enviroment:

    .venv/bin/python -m streamlit run app.py
    
  6. Press Load button for getting embeddings of pdf-file(s)

  7. Ask model about content