Skip to content

Conversation

@ferenci84
Copy link
Contributor

Description

Adds reasoning and reasoningBudgetTokens params to config schemas and docs.

Issue: #4918

Checklist

  • The relevant docs, if any, have been updated or created
  • The relevant tests, if any, have been updated or created

@ferenci84 ferenci84 requested a review from a team as a code owner April 8, 2025 09:20
@ferenci84 ferenci84 requested review from tomasz-stefaniak and removed request for a team April 8, 2025 09:20
@netlify
Copy link

netlify bot commented Apr 8, 2025

Deploy Preview for continuedev ready!

Name Link
🔨 Latest commit ff204ef
🔍 Latest deploy log https://app.netlify.com/sites/continuedev/deploys/680506ab47a1920008864d8e
😎 Deploy Preview https://deploy-preview-5041--continuedev.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@RomneyDa
Copy link
Collaborator

RomneyDa commented Apr 8, 2025

@ferenci84 nice
@sestinj will require config yaml bump

Also before we merge would this potentially conflict with a UI that would allow users to adjust reasoning tokens ad hoc in the future? I know either @FallDownTheSystem or @ferenci84 did a PR with this at some point. Something to consider

@ferenci84
Copy link
Contributor Author

@RomneyDa Not sure if you think of bumping the version number of the @continuedev/config-yaml, but if so, I think it should be set when the merging is done, because any change I do now, will soon become obsolete.

I didn't find any other modifications related to reasoning. Also verified that adding reasoning and reasoningBudgetTokens works with a yaml config like this:

  - name: Claude 3.7 Sonnet (thinking)
    provider: anthropic
    model: claude-3-7-sonnet-latest
    apiKey: YOUR-API-KEY
    roles:
      - chat
    chatOptions:
      baseSystemMessage: |
        You are intelligent, helpful and an expert developer, who always gives the correct answer and follow instructions.
    defaultCompletionOptions:
      contextLength: 200000
      maxTokens: 32000
      reasoning: true
      reasoningBudgetTokens: 1024

Before this modification, I was not able to get reasoning to work with the yaml config, although it was working with the json.

@chezsmithy
Copy link
Contributor

I opened a similar PR but also included prompt caching.

We have migrated to yaml and then immediately noticed this regression.

#5202

@tomasz-stefaniak tomasz-stefaniak merged commit d0c063a into continuedev:main Apr 29, 2025
31 checks passed
@tomasz-stefaniak
Copy link
Contributor

Thank you @ferenci84 !

@sestinj
Copy link
Contributor

sestinj commented May 15, 2025

Hi @ferenci84, yesterday we shared some updates with our contributors about how we're aiming to improve the contribution process. Part of this included the addition of a Contributor License Agreement (CLA) to protect both contributors and the project.

I figure there's a good chance you'll open another PR since you've been contributing a lot of great code lately, but still wanted to send this message right away.

Could you please take a moment to sign, or if you have any questions send me a message? (either here or nate@continue.dev would work)

To do so, you just need to post a comment below with the following text:

I have read the CLA Document and I hereby sign the CLA

❤️ Thank you for the work you've done on Continue, and let me know if you have any suggestions on how we can make the project even better!

@github-actions
Copy link


Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.


I have read the CLA Document and I hereby sign the CLA


You can retrigger this bot by commenting recheck in this Pull Request. Posted by the CLA Assistant Lite bot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants