Optimized run via Diffusers?

[tin2tin]

Quite surprisingly, did the built-in optimizations in Diffusers bring the VRAM requirements of CogVideoX-5b from 24+ GB to under 6 GB, and Flux Dev went from 24+ to 2 GB.

Could VEnhancer be made to run via Diffusers? https://github.com/huggingface/diffusers so it can benefit from things like that to ease up on the heavy VRAM needs?

[LearnedVector]

want to piggy back on this. Is this possible? I can take on the project and do a commit if so @hejingwenhejingwen

[hejingwenhejingwen]

want to piggy back on this. Is this possible? I can take on the project and do a commit if so @hejingwenhejingwen

So happy with that. Now our code is ready. You surely can take on the project if you are happy with this😄