Anthropic + Cohere

[lumpidu]

Just wanted to add, that for some languages, Anthropic as LLM (i.e. Sonnet 3.5) + Cohere as embedding model gives much superior results to either OpenAI or any other Open Source embedding model.

I don't know how much effort it woud be to integrate their API's, but this would be a dramatic improvement for non-English texts. The multilingual Cohere Embeddings make it possible to search related documents among several languages at once.

[nickthecook]

Good to know, @lumpidu. We should integrate Anthropic at some point.

Sounds like their prompt caching makes a certain type of chunk contextualization faster and cheaper as well.