Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Support Groq AI Provider #355

Merged
merged 2 commits into from
Sep 30, 2024
Merged

feat: Support Groq AI Provider #355

merged 2 commits into from
Sep 30, 2024

Conversation

miurla
Copy link
Owner

@miurla miurla commented Sep 30, 2024

Until now, Groq was only applied to the Writer agent, but it has been made selectable as a provider option.
Only models compatible with tool use are available.
Set the following environment variables:

# GROQ_API_KEY=[YOUR_GROQ_API_KEY]
# GROQ_API_MODEL=[YOUR_GROQ_API_MODEL] # e.g. llama3-groq-8b-8192-tool-use-preview

Along with this change, the writer agent and SPECIFIC_API_xxx have been removed.

Copy link

vercel bot commented Sep 30, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
morphic ✅ Ready (Inspect) Visit Preview 💬 Add feedback Sep 30, 2024 9:08am

@miurla miurla changed the base branch from main to refactor-workflow September 30, 2024 09:20
Base automatically changed from refactor-workflow to main September 30, 2024 09:21
@miurla miurla merged commit e73a537 into main Sep 30, 2024
2 checks passed
@miurla miurla deleted the support-groq branch September 30, 2024 09:21
This was referenced Sep 30, 2024
@freedomtrain
Copy link

Thanks for all of you work !!!
If we use this in env.local do we also need to continue to use the openAI key and ChatGPT ?

GROQ_API_KEY=[YOUR_GROQ_API_KEY]

GROQ_API_MODEL=[YOUR_GROQ_API_MODEL] # e.g. llama3-groq-8b-8192-tool-use-preview

Can you please also please help with an env.local example of what needs to be added to have groq be used instead of OpenAI

@miurla
Copy link
Owner Author

miurla commented Nov 17, 2024

If we use this in env.local do we also need to continue to use the openAI key and ChatGPT ?

The latest version allows you to select models in the UI: #371. You only need to set the keys for the providers you need. If you don't need OpenAI, you don't need to set it.

Can you please also please help with an env.local example of what needs to be added to have groq be used instead of OpenAI

Just set the API key: https://github.com/miurla/morphic/blob/main/.env.local.example#L48

If you want to add another model, please edit this file: https://github.com/miurla/morphic/blob/0a0498e290dfa19352418ee3e5a33a1107eb6101/lib/types/models.ts#L39C1-L44C5

Only models compatible with tool use are available.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants