feat: groq image vision provider #2342
Merged
+56
−2
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Relates to
Action: DESCRIBE_IMAGE
Risks
Low
Modified the core/runtime.ts and plugin-node/service/image.ts files.
As it is core files, maybe it can affect others plugins.
Background
What does this PR do?
This PR includes the "class GroqImageProvider implements ImageProvider"
that is used to describe images using the llama-3.2-90b-vision-preview Model.
What kind of change is this?
Improvements (now image description works with Groq)
Why are we doing this? Any context or related work?
This feature is to use an Vision Image Provider supported by Groq llama vision models that i`m working with.
Documentation changes needed?
My changes do not require a change to the project documentation.
Testing
configure Groq as Model provider
Send an image asking to agent describe it.
Where should a reviewer start?
packages/plugin-node/src/services/image.ts LN:193
packages/core/src/runtime.ts LN:352
Detailed testing steps
Discord username
vaipraonde