This Chatbot is built with Zephyr 7B Beta as its LLM and for embeddings , it uses HuggingFaceBgeEmbeddings which is again open source. I had to download a specific version of Zephyr 7B model and could not upload it due to its huge size but it is available for free under Zephyr in HuggingFace website and its name is "zephyr-7b-beta.Q5_K_S.gguf".
There are two versions of the app available: one which uses the locally available pdf (by default its kept-Bangalore_trip) and uses Gradio for UI implementation (files used app.py and ingest.py). The second version helps the user by allowing them to upload the file and then ask questions based upon it.It uses files app2.py and ingest2.py and uses streamlit for UI implementation.
Overall it takes 5-6 minutes to run on a CPU .
