Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add chatapi.akash.network to available list of model providers (FREE LLAMA API ACCESS!) #1131

Merged
merged 2 commits into from
Dec 16, 2024

Conversation

MbBrainz
Copy link
Contributor

Relates to: -

No Tickets

Risks

Low, new model added

Background

Most developers don't have in-house hardware to run models like LLAMA3.1-405B and so they'll have some sort of server setup. This usually costs money, however there exists a free option today: chatapi.akash.network. This is an openAI api compatible api that runs standard LLMs like llama3.1-405B and llama3.3-70B for free!

The official announcement of the public release: https://x.com/akashnet_/status/1814018478845616362
You can get your api key here: https://chatapi.akash.network

What does this PR do?

Adds a new model provider to the list of model providers

What kind of change is this?

Features

Why are we doing this? Any context or related work?

Im a big fan of the work of akash.network and I've been using this service myself for a while now. Its great to have access to bigger models for testing without risking huge token spends on your personal creditcard

Documentation changes needed?

My changes do not require a change to the project documentation. The env variables are added in the .env.example including the relevant links to where to get the key and how it works.

Testing

I tested it by following the steps below and got the following result:
Screenshot 2024-12-16 at 3 35 14 PM

Where should a reviewer start?

Follow the test steps below (should be really easy!)

Detailed testing steps

Easiest way to test is to do the following:

  1. clone repo
  2. Go to https://chatapi.akash.network and request a new api key (no email required, optional)
  3. run cp .env.example .env in the root and set the api key here
    https://github.com/MbBrainz/eliza/blob/de87bfaa308091ff14ff488f5a446cf72b8904c4/.env.example#L234C1-L238C73
  4. change the model provider in ./packages/core/src/defaultCharacter.ts to modelProvider: ModelProviderName.AKASH_CHAT_API,
  5. run pnpm build & pnpm start
  6. send a msg and verify if the model is akash_chat_api and if it responds
    7 ✅

Discord username

MbBrainz

@MbBrainz MbBrainz changed the base branch from main to develop December 16, 2024 09:01
Copy link
Collaborator

@monilpat monilpat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - amazing that it is free thanks for doing this!

@monilpat monilpat merged commit d0ea220 into elizaOS:develop Dec 16, 2024
2 of 3 checks passed
@MbBrainz
Copy link
Contributor Author

You're more than welcome! Looking forward to contribute more.

@odilitime odilitime changed the title Add chatapi.akash.network to available list of model providers (FREE LLAMA API ACCESS!) feat: Add chatapi.akash.network to available list of model providers (FREE LLAMA API ACCESS!) Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants