Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA]: Create Haystack LLM Node #1182

Open
2 tasks done
mdemoret-nv opened this issue Sep 8, 2023 · 0 comments · May be fixed by #1420
Open
2 tasks done

[FEA]: Create Haystack LLM Node #1182

mdemoret-nv opened this issue Sep 8, 2023 · 0 comments · May be fixed by #1420
Assignees
Labels
feature request New feature or request sherlock Issues/PRs related to Sherlock workflows and components

Comments

@mdemoret-nv
Copy link
Contributor

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Critical (currently preventing usage)

Please provide a clear description of problem this feature solves

To support using Haystack functionality directly in the the LLM Engine from #1178, a Haystack Prompt Generator should be created. This will allow quick prototyping with LLMs in Morpheus by supporting existing complex functionality from the Haystack library. The focus here is on ease of use and not performance.

Describe your ideal solution

This Prompt Generator will directly wrap components from the Haystack library. Its primary functionality will be translating between Morpheus and Haystack concepts.

Describe any alternatives you have considered

No response

Additional context

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
  • I have searched the open feature requests and have found no duplicates for this feature request
@mdemoret-nv mdemoret-nv added feature request New feature or request sherlock Issues/PRs related to Sherlock workflows and components labels Sep 8, 2023
@mdemoret-nv mdemoret-nv added this to the 23.11 - Sherlock milestone Sep 8, 2023
@mdemoret-nv mdemoret-nv changed the title [FEA]: Create Haystack Prompt Generator [FEA]: Create Haystack LLM Node Oct 20, 2023
@mdemoret-nv mdemoret-nv removed this from the 23.11 - Sherlock milestone Dec 7, 2023
@bsuryadevara bsuryadevara moved this from Todo to In Progress in Morpheus Boards Dec 8, 2023
@bsuryadevara bsuryadevara linked a pull request Dec 11, 2023 that will close this issue
@bsuryadevara bsuryadevara moved this from In Progress to Review - Ready for Review in Morpheus Boards Dec 12, 2023
@mdemoret-nv mdemoret-nv removed this from the 24.03 - Sherlock Improvements milestone Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request sherlock Issues/PRs related to Sherlock workflows and components
Projects
Status: Review - Ready for Review
2 participants