Some users can experience speedup by combining loading UNET as NF4 using the loader from this repo and load T5XXL as GGUF using the repo from https://github.com/city96/ComfyUI-GGUF
Now on the manager for easy installation. Make sure to select Channel:dev in the ComfyUI manager menu or install via git url.
You can find the checkpoints and UNET in the linked repositories on huggingface or by searching for NF4 on Civitai
Requires installing bitsandbytes.
Make sure your ComfyUI is updated.
The nodes are:
just plug it in your flux workflow instead of the regular ones.
Code adapted from the implementation by Illyasviel at Forge.