Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] AWS ChatBedrock/Tool agent error #3513

Open
jorge-henao opened this issue Nov 14, 2024 · 1 comment · May be fixed by #3517
Open

[BUG] AWS ChatBedrock/Tool agent error #3513

jorge-henao opened this issue Nov 14, 2024 · 1 comment · May be fixed by #3517
Labels
bug Something isn't working

Comments

@jorge-henao
Copy link

Describe the bug

AWS ChatBedrock throws error "output values have 1 keys, you must specify an output key or pass only 1 key as output" or "Unsupported message content format" error.

image image image

To Reproduce
Steps to reproduce the behavior:

Connect Tool Agent to AWS ChatBedrock
Setup AWS credentials with access to Anthropic Bedrock models
Select a supported model from cross-region inference profiles (https://docs.aws.amazon.com/bedrock/latest/userguide/inference-profiles-support.html) .

Note: if you choose an Anthropic model model from the drop down it throws another error: Failed to access underlying url 'bedrock-runtime.us-east-1.amazonaws.com': got 400 Bad Request: {"message":"Invocation of model ID anthropic.claude-3-5-sonnet-20241022-v2:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model."}
image

Expected behavior
The proper model dialog response and function calling

Screenshots
image
image
image
Flow
If applicable, add exported flow in order to help replicating the problem.

Setup

Flowise 2.1.3.

Additional context
Add any other context about the problem here.

@HenryHengZJ
Copy link
Contributor

Will be fixed in the next upgrade: #3517

@HenryHengZJ HenryHengZJ linked a pull request Nov 15, 2024 that will close this issue
@HenryHengZJ HenryHengZJ added the bug Something isn't working label Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants