Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GGUF model support for Backend Cache #145

Open
Woukim opened this issue Aug 21, 2024 · 1 comment
Open

GGUF model support for Backend Cache #145

Woukim opened this issue Aug 21, 2024 · 1 comment

Comments

@Woukim
Copy link

Woukim commented Aug 21, 2024

Backend Cache does not support loading gguf models right now

@ltdrdata
Copy link
Owner

ltdrdata commented Aug 21, 2024

The backend cache node stores Python objects as-is.
It doesn't matter at all what the input is.

You need to verify that you are using the backend cache correctly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants