Skip to content

[BUG] Bedrock Custom ARNs to have "Enable Reasoning" checkbox #10040

@ronyblum

Description

@ronyblum

Problem (one or two sentences)

In Bedrock API Provider, some models have a checkbox "Enable reasoning". For custom ARN, the checkbox doesn't exist, sending reasoning flag by default, which is not supported by part of the models and returning error

Context (who is affected and when)

In Bedrock API Provider, some models have a checkbox "Enable reasoning". For custom ARN, the checkbox doesn't exist, sending reasoning flag by default, which is not supported by part of the models and returning error. For example nova lite custom arn return "Error: Unknown Error: The model returned the following errors: Malformed input request: #: extraneous key [thinking] is not permitted, please reformat your input and try again." without any option to disable the flag

Reproduction steps

  1. Select Bedrock API Provider
  2. For model, select Nova custom arn, for example arn:aws:bedrock:us-east-1:<ACCOUNT_ID>:inference-profile/us.amazon.nova-2-lite-v1:0

Expected result

Checkbox to disable reasoning, not sending the thinking flag to the models

Actual result

Error: Unknown Error: The model returned the following errors: Malformed input request: #: extraneous key [thinking] is not permitted, please reformat your input and try again.

Variations tried (optional)

No response

App Version

3.36.2

API Provider (optional)

Amazon Bedrock

Model Used (optional)

No response

Roo Code Task Links (optional)

No response

Relevant logs or errors (optional)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Issue/PR - TriageNew issue. Needs quick review to confirm validity and assign labels.bugSomething isn't working

    Type

    No type

    Projects

    Status

    Triage

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions