Skip to content

docs: add uniform token pricing providers to best use cases #348

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Tarquinen merged 2 commits into from
Feb 4, 2026
Merged

docs: add uniform token pricing providers to best use cases #348

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
4e43419
docs: add uniform token pricing providers to best use cases
azais-corentin Feb 4, 2026
1e211d4
Merge branch 'dev' into patch-1
Tarquinen Feb 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,6 +54,11 @@ LLM providers like Anthropic and OpenAI cache prompts based on exact prefix matc

**Best use case:** Providers that count usage in requests, such as Github Copilot and Google Antigravity, have no negative price impact.

**Best use cases:**

- **Request-based billing** — Providers that count usage in requests, such as Github Copilot and Google Antigravity, have no negative price impact.
- **Uniform token pricing** — Providers that bill cached tokens at the same rate as regular input tokens, such as Cerebras, see pure savings with no cache-miss penalty.

**Claude Subscriptions:** Anthropic subscription users (who receive "free" caching) may experience faster limit depletion than hit-rate ratios suggest due to the higher relative cost of cache misses. See [Claude Cache Limits](https://she-llac.com/claude-limits) for details.

## Configuration
Expand Down