Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add Elasticsearch VectorStore Component with Ingest and Advanced Search Capabilities #3899

Merged

Conversation

joaoguilhermeS
Copy link
Collaborator

This PR introduces a new Elasticsearch VectorStore component that enables data ingestion and search functionalities within Langflow.

Related to #3735

Key features include:

  • Authentication capability using Elastic Cloud and Self-hosted (docker) Deployments.

  • Authentication and SSL Certificate Support: Configurable options for secure connections, including username/password authentication and SSL certificate verification.

  • Data Ingestion: Ability to ingest documents into the Elasticsearch vector store, converting data objects into LangChain documents.

  • Search Capabilities: Supports both similarity and Maximal Marginal Relevance (MMR) search types with configurable parameters like the number of results and score thresholds.

  • Error Handling and Logging: Enhanced error messages and logging for easier troubleshooting and debugging.

@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Sep 24, 2024
Copy link
Contributor

autofix-ci bot commented Sep 24, 2024

Hi! I'm autofix logoautofix.ci, a bot that automatically fixes trivial issues such as code formatting in pull requests.

I would like to apply some automated changes to this pull request, but it looks like I don't have the necessary permissions to do so. To get this pull request into a mergeable state, please do one of the following two things:

  1. Allow edits by maintainers for your pull request, and then re-trigger CI (for example by pushing a new commit).
  2. Manually fix the issues identified for your pull request (see the GitHub Actions output for details on what I would like to change).

@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Sep 24, 2024
Copy link

This pull request is automatically being deployed by Amplify Hosting (learn more).

Access this pull request here: https://pr-3899.dmtpw4p5recq1.amplifyapp.com

@joaoguilhermeS joaoguilhermeS force-pushed the elasticsearch-vectorstore-component branch from c9e6c66 to d34752c Compare September 24, 2024 14:05
Copy link
Contributor

@ogabrielluiz ogabrielluiz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wow. This is a big one.

LGTM

Thanks @joaoguilhermeS !

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Sep 30, 2024
…nd error handling

- Consolidated import statements and removed unused imports.
- Reformatted long strings for better readability.
- Enhanced error messages with variable assignment for clarity.
- Removed redundant else clause in search_documents method.
@ogabrielluiz ogabrielluiz enabled auto-merge (squash) October 3, 2024 15:33
@ogabrielluiz ogabrielluiz merged commit 75ffe0b into langflow-ai:main Oct 3, 2024
29 checks passed
diogocabral pushed a commit to headlinevc/langflow that referenced this pull request Nov 26, 2024
…d Search Capabilities (langflow-ai#3899)

* feat: adding Elasticsearch  VectorStore component code

* update: adding langchain-elasticsearch dependency

* update: adding langchain-elasticsearch dependency (ruff format fix)

* Add `langchain-elasticsearch` dependency to pyproject.toml

* Refactor type hints to use PEP 585 syntax in Elasticsearch vector store component

* Refactor ElasticsearchVectorStoreComponent for improved readability and error handling

- Consolidated import statements and removed unused imports.
- Reformatted long strings for better readability.
- Enhanced error messages with variable assignment for clarity.
- Removed redundant else clause in search_documents method.

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants