Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lexer tables are big for any non trivial grammar #4

Open
mingodad opened this issue Jul 29, 2022 · 0 comments
Open

Lexer tables are big for any non trivial grammar #4

mingodad opened this issue Jul 29, 2022 · 0 comments

Comments

@mingodad
Copy link

It seems that the lexer generator doesn't do a great job in reducing/minimizing the generated tables and for any non trivial grammar the lexer tables are big like for sql the final parser is around 800KB without managing case insensitive tokens if we make it case insensitive by adding rules like <CREATE: <['C','c']['R','r']['E','e']['A','a']['T','t']['E','e']> > then it becomes even bigger fast.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant