Skip to content

0.12.0(Enable vm runtime as default)

Compare
Choose a tag to compare
@strint strint released this 12 Jan 07:07
85ace0c

onediff 0.12 (change image size will have no cost for most of the models now)

  • switch image size will not trigger re-compilation(i.e. no time cost);
  • faster to save and load a graph;
  • smaller static memory needed;
  • much easier to switch graphs;

Note

  1. After updating onediff to 0.12, oneflow also needs to be updated to the latest with https://github.com/siliconflow/onediff?tab=readme-ov-file#1-install-oneflow
  2. If you are using save/load graph. Please use this new version to save the graph again.
  3. For SVD(Stable Video Diffusion) onediff users, please use os.environ["VM_REBUILD_DYNAMIC_SHAPE"] = "1" to support DYNAMIC SHAPE with SVD. There has some re-compile cost, when enabling VM_REBUILD_DYNAMIC_SHAPE, so loading graph is needed. We will do more work on this.

OneDiff SDXL inference has been integrated into fal.ai playground

SDXL inference at the speed of thought: https://www.fal.ai/models/onediff-sdxl

And OneDiff ComfyUI nodes are in ComfyUI-Manager Now

img_v3_0271_db8b580c-89e2-49a3-8041-26d34d02549g