Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Relates to:
Risks
Low risk/impact
Background
What does this PR do?
This PR will add support for the RedPill API to gain access to top LLM providers without having an account for each service. This PR aims to support the text generation support in the first implementation.
What kind of change is this?
Features (non-breaking change which adds functionality)
Why are we doing this? Any context or related work?
Reason to support RedPill is to reduce the management of multiple LLM API accounts and allow for a seamless approach to use top LLMs interchangeably with a shared memory state.
Documentation changes needed?
Documentation changes would be adding RedPill to the list of Model Providers available to use.
Testing
Executed in developer environment with
pnpm dev
.Where should a reviewer start?
Reviewer can start by requesting a RedPill API Key from me or the Phala Network team. Which is all that is needed before testing.
Detailed testing steps
./core/src/core/models.ts
pnpm dev