Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA]: Create Llamaindex LLM Node #1181

Open
2 tasks done
mdemoret-nv opened this issue Sep 8, 2023 · 0 comments
Open
2 tasks done

[FEA]: Create Llamaindex LLM Node #1181

mdemoret-nv opened this issue Sep 8, 2023 · 0 comments
Assignees
Labels
feature request New feature or request sherlock Issues/PRs related to Sherlock workflows and components

Comments

@mdemoret-nv
Copy link
Contributor

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Critical (currently preventing usage)

Please provide a clear description of problem this feature solves

To support using Llamaindex functionality directly in the the LLM Engine from #1178, a Llamaindex Prompt Generator should be created. This will allow quick prototyping with LLMs in Morpheus by supporting existing complex functionality from the Lamaindex library. The focus here is on ease of use and not performance.

Describe your ideal solution

This Prompt Generator will directly wrap components from the Llamaindex library. Its primary functionality will be translating between Morpheus and Llamaindex concepts.

Describe any alternatives you have considered

No response

Additional context

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
  • I have searched the open feature requests and have found no duplicates for this feature request
@mdemoret-nv mdemoret-nv added feature request New feature or request sherlock Issues/PRs related to Sherlock workflows and components labels Sep 8, 2023
@mdemoret-nv mdemoret-nv added this to the 23.11 - Sherlock milestone Sep 8, 2023
@mdemoret-nv mdemoret-nv removed this from the 23.11 - Sherlock milestone Dec 7, 2023
@mdemoret-nv mdemoret-nv changed the title [FEA]: Create Llamaindex Prompt Generator [FEA]: Create Llamaindex LLM Node Dec 7, 2023
@bsuryadevara bsuryadevara moved this from Todo to In Progress in Morpheus Boards Dec 15, 2023
@mdemoret-nv mdemoret-nv removed this from the 24.03 - Sherlock Improvements milestone Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request sherlock Issues/PRs related to Sherlock workflows and components
Projects
Status: In Progress
Development

When branches are created from issues, their pull requests are automatically linked.

2 participants