Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MRG] fix ollama output without json format #198

Merged
merged 1 commit into from
Sep 9, 2024

Conversation

JasonRD
Copy link
Contributor

@JasonRD JasonRD commented Sep 9, 2024

As noted in #173, using the llama model may result in non-JSON formatted responses in certain scenarios.

What has been done to verify that this works as intended?

Why is this the best possible solution? Were any other approaches considered?

How does this change affect users? Describe intentional changes to behavior and behavior that could have accidentally been affected by code changes. In other words, what are the regression risks?

Do we need any specific form for testing your changes? If so, please attach one.

Does this change require updates to documentation? If so, please file an issue here and include the link below.

Before submitting this PR, please make sure you have:

  • [*] confirmed all checks still pass OR confirm CI build passes.
  • [*] verified that any code or assets from external sources are properly credited in comments and/or in
    the credit file.

@JasonRD JasonRD marked this pull request as ready for review September 9, 2024 11:28
@dosubot dosubot bot added size:XS This PR changes 0-9 lines, ignoring generated files. bug Something isn't working labels Sep 9, 2024
@leeeizhang
Copy link
Collaborator

many thanks! this contributions is very important!

@leeeizhang leeeizhang self-requested a review September 9, 2024 13:03
@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Sep 9, 2024
@huangyz0918 huangyz0918 changed the title fix ollama output without json format [MRG] fix ollama output without json format Sep 9, 2024
@huangyz0918 huangyz0918 merged commit 50bca75 into MLSysOps:main Sep 9, 2024
5 checks passed
@huangyz0918
Copy link
Contributor

Thank you for your contribution! @JasonRD 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working lgtm This PR has been approved by a maintainer size:XS This PR changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants