Skip to content

Issues: noamgat/lm-format-enforcer

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

34 Open 81 Closed
34 Open 81 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Serializing ExLlamaV2TokenEnforcerFilter class
#149 opened Nov 13, 2024 by UTSAV-44
4
Token Count Tracking in VLLM with lmformatenforcer
#148 opened Nov 7, 2024 by wrench1997
Tokenizer tree creation is incompatible with BPE pretokenization used for Llama3. enhancement New feature or request help wanted Extra attention is needed
#146 opened Oct 9, 2024 by JoshC8C7
2
RAM UTILISATION IS INCREASING RAPIDLY
#145 opened Oct 1, 2024 by UTSAV-44
2
with the prefix and CharacterLevelParser parameters bug Something isn't working need more info More information is needed from the issue opener
#140 opened Sep 20, 2024 by roshan-gopalakrishnan
1
Now I use lm-format-forcer+vllm and it takes 10 seconds to generate a json. This speed is not feasible in my current business. Is there any accelerated solution, such as a paper, plan or pr?
#139 opened Sep 18, 2024 by lwdnxu
1
Add Trust Score to JSON Output for Quick Reliability Assessment
#137 opened Sep 2, 2024 by wrench1997
1
[Bug] exllamav2 integration outputs eos_token_id nonstop until max_new_token for json schema
#134 opened Aug 24, 2024 by Dan-wanna-M
1
[bug] CharacterLevelParserConfig gets ignored by tokenenforcer
#131 opened Aug 14, 2024 by laurens-gs
1
Supralinear complexity with UnionParser
#130 opened Aug 8, 2024 by amrothemich
1
Why are \n generated in the output
#128 opened Aug 1, 2024 by Cgrandjean
1
Reduced performance/bottleneck with concurrent requests and Llama-3.1
#127 opened Aug 1, 2024 by thigger
1
[Bug? Request?] Force StringParser to not split special tokens
#126 opened Jul 31, 2024 by aw632
1
[Request] Replicate outlines vLLM performance improvements
#125 opened Jul 29, 2024 by laurens-gs
TypeError: LogitsSaverManager.replace_logits_warper.<locals>.new_logits_warper() got an unexpected keyword argument 'device' bug Something isn't working
#122 opened Jul 19, 2024 by pr3stigous
1
How do I start enforcing schema only after a keyword is hit during inference?
#120 opened Jul 11, 2024 by accupham
3
Question about Source Code
#117 opened Jul 1, 2024 by Acatsama0871
2
Emojis unsupported (vLLM integration)
#116 opened Jun 27, 2024 by milesial
1
prefixItems keyword is not constraining output types enhancement New feature or request
#111 opened Jun 5, 2024 by cikkle
1
LM Enforcer cause hanged generation and what is the Sampler setting #486
#110 opened Jun 2, 2024 by remichu-ai
5
[Bug] Failing to output non-EN
#109 opened May 25, 2024 by NanoCode012
7
Token mis-manipulation for Chinese Characters
#108 opened May 24, 2024 by yytang220
4
JsonParser Fails to Inherit Reference Object Type
#106 opened May 20, 2024 by NJordan72
2
Generating Illegal Escape Tokens
#90 opened Apr 19, 2024 by jamesdborin
4
Models using GPT2 tokenizer can output invalid JSON
#89 opened Apr 16, 2024 by JoshC8C7
1
ProTip! Find all open issues with in progress development work with linked:pr.