Llama2 Exploration

This is a set up note for using LlaMa2 Model locally.

Quick Start

Set up conda environment

conda create --name llmplay -c conda-forge python=3.11

Install llama-cpp-python

conda env list
conda activate llmplay
pip install llama-cpp-python

Run llama2 model locally

python run_model.py

Install langChain

pip install langchain