Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ModelStream should be a drop-in replacement for Model or their API differences should be documented #939

Open
hudson-ai opened this issue Jul 3, 2024 · 1 comment

Comments

@hudson-ai
Copy link
Collaborator

ModelStreams (returned from Model.stream()) seem to be drop-in replacements for Model objects, at least when it comes to appending grammars. But they do not support:

They should either be brought in line with ModelStream being a drop-in replacement, or additional documentation about the cases where this is not the case (and maybe warnings/exceptions should be raised?)

@peterwilli
Copy link

For the role blocks, I made a temporary workaround at #943 (I didn't see this issue was mentioned before, sorry!)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants