Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: groq image vision provider #2342

Merged

Conversation

rferrari
Copy link
Contributor

Relates to

Action: DESCRIBE_IMAGE

Risks

Low

Modified the core/runtime.ts and plugin-node/service/image.ts files.
As it is core files, maybe it can affect others plugins.

Background

What does this PR do?

This PR includes the "class GroqImageProvider implements ImageProvider"
that is used to describe images using the llama-3.2-90b-vision-preview Model.

What kind of change is this?

Improvements (now image description works with Groq)

Why are we doing this? Any context or related work?

This feature is to use an Vision Image Provider supported by Groq llama vision models that i`m working with.

Documentation changes needed?

My changes do not require a change to the project documentation.

Testing

configure Groq as Model provider
Send an image asking to agent describe it.

Before new feature After new feature
groq-error-image-vision-provider groq-success-image-visiion-provider

Where should a reviewer start?

packages/plugin-node/src/services/image.ts LN:193
packages/core/src/runtime.ts LN:352

Detailed testing steps

Discord username

vaipraonde

Copy link
Collaborator

@monilpat monilpat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM :)

@monilpat monilpat merged commit 15b5d25 into elizaOS:develop Jan 16, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants