Skip to content

Commit

Permalink
introduce langchain-localai, spin off langchain-ai#22399
Browse files Browse the repository at this point in the history
  • Loading branch information
mkhludnev committed Dec 16, 2024
1 parent 8f5e72d commit 3c2bf6f
Show file tree
Hide file tree
Showing 2 changed files with 19 additions and 0 deletions.
16 changes: 16 additions & 0 deletions docs/docs/integrations/text_embedding/localai.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -136,6 +136,22 @@
"# if you are behind an explicit proxy, you can use the OPENAI_PROXY environment variable to pass through\n",
"os.environ[\"OPENAI_PROXY\"] = \"http://proxy.yourcompany.com:8080\""
]
},
{
"cell_type": "markdown",
"id": "4a824a90",
"metadata": {},
"source": [
"## Limitations \n",
"\n",
"`langchain_community.embeddings.LocalAIEmbeddings` has two issues: \n",
" - it depends on Open AI SDK v0, which is outdated\n",
" - and it requests document embeddings one by one in `embed_documents` without bulking them into the single request. \n",
"\n",
" `langchain-localai` is the separate integration package provided for resolving these issues: \n",
" - the distribution: https://pypi.org/project/langchain-localai/ \n",
" - the source code: https://github.com/mkhludnev/langchain-localai"
]
}
],
"metadata": {
Expand Down
3 changes: 3 additions & 0 deletions libs/packages.yml
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,9 @@ packages:
- name: langchain-ibm
repo: langchain-ai/langchain-ibm
path: libs/ibm
- name: langchain-localai
repo: mkhludnev/langchain-localai
path: libs/localai
- name: langchain-milvus
repo: langchain-ai/langchain-milvus
path: libs/milvus
Expand Down

0 comments on commit 3c2bf6f

Please sign in to comment.