Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

look at my fp8 implementation #114

Open
moreAImore opened this issue Nov 26, 2024 · 0 comments
Open

look at my fp8 implementation #114

moreAImore opened this issue Nov 26, 2024 · 0 comments

Comments

@moreAImore
Copy link

Hi:
I made this fork that implement fp8 (https://github.com/moreAImore/ComfyUI-PuLID-Flux-Enhanced-FP8) (from another custom node)
it works. The problem is that first generation is very fast (17 seconds for me) then, NEXT generations:

ARE VERY SLOW.

It is caused because it uses even extra GPU , for some reason. (for me it goes to the top usage, max, it slows the machine)
I must be doing something wrong.
Could you look into the code to see if there is a solutions to have adn a way to implement it yourself
Maybe I am not releasing things or variables I have no idea. I tried to solve it I could not.

Maybe you can

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant