Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Structured JSON output with Pydantic integration #1565

Open
cebtenzzre opened this issue Oct 24, 2023 · 0 comments
Open

Structured JSON output with Pydantic integration #1565

cebtenzzre opened this issue Oct 24, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@cebtenzzre
Copy link
Member

Feature request

We could leverage the grammar-based sampling work introduced in ggerganov/llama.cpp#1773 to provide reliable JSON output via the python bindings.

Motivation

This would make the python bindings much more useful as a tool that can be used in a predictable manner for all kinds of tasks.

Your contribution

I intend to submit a PR implementing this feature.
@cebtenzzre cebtenzzre added the enhancement New feature or request label Oct 24, 2023
@manyoso manyoso added this to the current sprint milestone Oct 25, 2023
@cebtenzzre cebtenzzre moved this from Enhancements TODO to In Progress in (Archived) GPT4All 2024 Roadmap and Active Issues Oct 25, 2023
@cebtenzzre cebtenzzre moved this from In Progress to Enhancements TODO in (Archived) GPT4All 2024 Roadmap and Active Issues Nov 21, 2023
@cebtenzzre cebtenzzre removed their assignment Dec 5, 2023
@cebtenzzre cebtenzzre removed this from the current sprint milestone Feb 7, 2024
@cebtenzzre cebtenzzre mentioned this issue Feb 13, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@manyoso @cebtenzzre and others