This RAG project was built using Langchain
This is a rag which doloads all any documentation online, given the link
Steps :
- Download all documentations
- Make reasonable Chunks
- Tricky bit was segregating code part of documentation, and providing adequate semantic meaning to it, for retrival of code
- First version didnt have
- The concept of perpozitionizer was used to add semantics to the purpose of the code
- Improve Chunk Calrity using : https://arxiv.org/abs/2312.06648
- Perform Embedding
- Save in Chorma DB
- Create Retrive using :
- Generate Response