[Bug]: The Anthropic provider does not support vision

[amanape]

Is there an existing issue for the same bug?

• I have checked the troubleshooting document at https://docs.all-hands.dev/modules/usage/troubleshooting
• I have checked the existing issues.

Describe the bug

The current model ID's used are incorrect and do not support vision.

Current OpenHands version

0.9.2

Installation and Configuration

N/A

Model and Agent

Anthropic models

Operating System

osx

Reproduction Steps

1. Select Anthropic provider
2. A model that is supposed to support vision
3. Upload images
4. Try to send

Logs, Errors, Screenshots, and Additional Context

No response

[amanape]

#3773 (comment)

[enyst]

I'll test for openAI in a bit. FWIW I am not sure FE should change this, it feels like the right thing to try as best as we can to standardize with provider. More like, this pattern could be added to liteLLM's list, since it supports it, it just doesn't know it has vision if we write it this way, but it does know if we write it without "anthropic/"... hah. Maybe we can fix it somehow first, though, pending theirs.

[ColeMurray]

Looking at the list of prices, this would be broken for OpenAI as well:
https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json

All OAI models do not have a provider/ prefix.

I think it would make sense to request the additions within the litellm repo to standardize and prevent the need to maintaining a mapping within this repo.

Created an issue here: BerriAI/litellm#5608

[ColeMurray]

I've made a pull request in litellm that will resolve this:
BerriAI/litellm#5688

[amanape]

@ColeMurray That is awesome! Thanks a lot

[tobitege]

That's really super, hopefully it'll get the ✅ soon. Thanks @ColeMurray !