Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add RedPill API Support #198

Merged
merged 2 commits into from
Nov 5, 2024
Merged

Add RedPill API Support #198

merged 2 commits into from
Nov 5, 2024

Conversation

HashWarlock
Copy link
Collaborator

Relates to:

Risks

Low risk/impact

Background

What does this PR do?

This PR will add support for the RedPill API to gain access to top LLM providers without having an account for each service. This PR aims to support the text generation support in the first implementation.

What kind of change is this?

Features (non-breaking change which adds functionality)

Why are we doing this? Any context or related work?

Reason to support RedPill is to reduce the management of multiple LLM API accounts and allow for a seamless approach to use top LLMs interchangeably with a shared memory state.

Documentation changes needed?

Documentation changes would be adding RedPill to the list of Model Providers available to use.

Testing

Executed in developer environment with pnpm dev.

Where should a reviewer start?

Reviewer can start by requesting a RedPill API Key from me or the Phala Network team. Which is all that is needed before testing.

Detailed testing steps

  • Add the RedPill API Key to secret variable
  • Add other environment variables for enabled features
  • Set the models to use in ./core/src/core/models.ts
  • Spin up agent to test live pnpm dev

@lalalune
Copy link
Member

lalalune commented Nov 4, 2024

love this.

@HashWarlock
Copy link
Collaborator Author

love this.

Whenever RedPill has support for image and voice generation, I'll add those features. One part i didn't end up changing was the image inspection that uses gpt-4o-mini. The serverUrl uses the openai API & key by default, but if it uses red-pill API, it will also work. I didn't want to break anything unintentionally there, so I didn't put a fix there.

@lalalune lalalune merged commit cae6a5c into elizaOS:main Nov 5, 2024
@lalalune
Copy link
Member

lalalune commented Nov 5, 2024

We don't have a good image provider abstraction yet-- badly needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants