Add More Grammars to `outlines.grammars`, Benchmark and Verify Their Integrity#587

Closed

lapp0 wants to merge 85 commits intodottxt-ai:mainfrom lapp0:benchmark-cfg-generation

+1,426-41

Commits on Feb 7, 2024

minimal grammars implementation
Andrew Lapp
committed
fixes + broken test case
Andrew Lapp
committed
standardize first state as well instead of hardcoded

benlipkin
authored and
Andrew Lapp
committed
fix cfg incomplete edge case; can now allow model to sample whether to extend current terminal vs transition to next

benlipkin
authored and
Andrew Lapp
committed
fix test case
Andrew Lapp
committed
move from outlines/lark -> outlines/grammars
Andrew Lapp
committed
update test comment
Andrew Lapp
committed
add docs
Andrew Lapp
committed
fix docs
Andrew Lapp
committed
add reference to available grammars
Andrew Lapp
committed
add smoketest example result to docs
Andrew Lapp
committed
read grammar files to a string, no path handling in CFGFSM
Andrew Lapp
committed
revert to old var pass
Andrew Lapp
committed
fix beam search and multiple concurrent sequences using token_id tuple cache key
Andrew Lapp
committed
include viktor-ferenczi refactor
Andrew Lapp
committed
fix tests
Andrew Lapp
committed
don't recurse, assume previous input was handled by logits processor
Andrew Lapp
committed
fixes + broken test case
Andrew Lapp
committed
add base benchmark suite
Andrew Lapp
committed
disable cache
Andrew Lapp
committed
update caching order
Andrew Lapp
committed
ensure numba is compiles so it doesn't skew benchmarks
Andrew Lapp
committed
add grammars and incomplete benchmark test
Andrew Lapp
committed
basic functioning CFGFSM tests
Andrew Lapp
committed
fix missing lark files
Andrew Lapp
committed
disable cache
Andrew Lapp
committed
update caching order
Andrew Lapp
committed
fix regex import issue in numba
Andrew Lapp
committed
add type hint
Andrew Lapp
committed
fixes + broken test case
Andrew Lapp
committed
refactor fsm final state; corrects regex incompleteness

benlipkin
authored and
Andrew Lapp
committed
fix test case
Andrew Lapp
committed
update test case to sample all examples in cfg_samples/
Andrew Lapp
committed
add 3 lark grammars
Andrew Lapp
committed
use source json sample
Andrew Lapp
committed
allow generation of %ignore terminals
Andrew Lapp
committed
revert to main
Andrew Lapp
committed
allow generation of %ignore terminals
Andrew Lapp
committed
fix ignore, add lark
Andrew Lapp
committed
add fixed RegexFSM union
Andrew Lapp
committed
fix escaped_string
Andrew Lapp
committed
remove context-sensitive grammars
Andrew Lapp
committed
use ESCAPED_STRING
Andrew Lapp
committed
remove context-sensitive grammars
Andrew Lapp
committed
revert
Andrew Lapp
committed
sql working
Andrew Lapp
committed
remove lisp
Andrew Lapp
committed
sort grammars by name
Andrew Lapp
committed
fix sql examples
Andrew Lapp
committed
revert RegexFSM changes
Andrew Lapp
committed
add creating_grammars.md
Andrew Lapp
committed
remove UNESCAPED_STRING from cerating grammars doc file
Andrew Lapp
committed
add fruity json tests
Andrew Lapp
committed
update docs, fix lark.lark
Andrew Lapp
committed
add deep arithmetic test
Andrew Lapp
committed
add simple arithmetic test example
Andrew Lapp
committed
disable component of test case failing due to LR0
Andrew Lapp
committed
ensure conforms to arithmetic rules
Andrew Lapp
committed
fix arithmetic
Andrew Lapp
committed
remove trailing newline in test file
Andrew Lapp
committed
suffix all test files with .test
Andrew Lapp
committed
don't force newline at end of CSV
Andrew Lapp
committed
add codeblocks
Andrew Lapp
committed
revert docs, codeblocks
Andrew Lapp
committed
revert bad rebase
Andrew Lapp
committed
better docs
Andrew Lapp
committed
Prevent UnexpectedToken if terminal is partially generated and misrecognized as being a different terminal
Andrew Lapp
committed
remove incomplete bash.lark
Andrew Lapp
committed
revert vllm changes from different branch
Andrew Lapp
committed
fix incorrect test name resulting from rebase
Andrew Lapp
committed
fix bad rebase
Andrew Lapp
committed
fix docstring
Andrew Lapp
committed
fix test_fsm.py
Andrew Lapp
committed
improve docs
Andrew Lapp
committed
provide
Andrew Lapp
committed
fix docs
Andrew Lapp
committed
fix test_fsm.py
Andrew Lapp
committed
Apply lru_cache to RegexFSM
Andrew Lapp
committed
Speed up CFGFSM By Incorporating FastLark
Andrew Lapp
committed
Merge branch 'use-fast-copy-lalr-parser' into benchmark-cfg-generation
Andrew Lapp
committed
correct lark.lexer.Token import path
Andrew Lapp
committed
Only Calculate TransformerTokenizer.__hash__ Once
Andrew Lapp
committed
Merge branch 'calculate-transsformers-tokenizer-hash-once' into benchmark-cfg-generation
Andrew Lapp
committed

Commits on Feb 8, 2024

add todo
Andrew Lapp
committed

Commits on Feb 14, 2024

don't reference non-existent grammar repo in docs
Andrew Lapp
committed