AkimfromParis / RAG-Japanese Public

Notifications You must be signed in to change notification settings
Fork 3
Star 6

Open source RAG with Llama Index for Japanese LLM in low resource settting

6 stars 3 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
LICENSE		LICENSE
OpenSource_RAG_LLM_JAP_at_4_Bits.ipynb		OpenSource_RAG_LLM_JAP_at_4_Bits.ipynb
README.md		README.md

Repository files navigation

Open-source RAG for Japanese LLM in low-resource settings

Llama-Index as a data framework
Embeddings from Multi-lingual E5 from Microsoft
Elyza as LLM based on LlaMA 2 (Facebook/Meta)
4Bits quantized by Bitsandbytes (served by Hugging Face Accelerate)
CJKPDFReader loader for Japanese PDF files
Open source Vector database (Postgres + PGVector)
Vanilla hybrid search
Ngrok for TCP tunneling
Q&A test
Conclusion

About

Open source RAG with Llama Index for Japanese LLM in low resource settting

nlp japanese ngrok llm llama-index pgvector bitsandbytes elyza

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%