Skip to content

Nodes for loading both Checkpoints and UNET/Diffussion models quantized to bitsandbytes NF4 or FP4 format.

License

Notifications You must be signed in to change notification settings

silveroxides/ComfyUI_bnb_nf4_fp4_Loaders

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

NOTE: This is very likely Deprecated in favor of GGUF which seems to give better results

Some users can experience speedup by combining loading UNET as NF4 using the loader from this repo and load T5XXL as GGUF using the repo from https://github.com/city96/ComfyUI-GGUF

Now on the manager for easy installation. Make sure to select Channel:dev in the ComfyUI manager menu or install via git url.

You can find the checkpoints and UNET in the linked repositories on huggingface or by searching for NF4 on Civitai

Requires installing bitsandbytes.

Make sure your ComfyUI is updated.

The nodes are:

"CheckpointLoaderNF4": "Load NF4 Flux Checkpoint"

"UNETLoaderNF4": "Load NF4 Flux UNET"

just plug it in your flux workflow instead of the regular ones.

Code adapted from the implementation by Illyasviel at Forge.

About

Nodes for loading both Checkpoints and UNET/Diffussion models quantized to bitsandbytes NF4 or FP4 format.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%