0.12.0(Enable vm runtime as default)
onediff 0.12 (change image size will have no cost for most of the models now)
- switch image size will not trigger re-compilation(i.e. no time cost);
- faster to save and load a graph;
- smaller static memory needed;
- much easier to switch graphs;
Note
- After updating onediff to 0.12, oneflow also needs to be updated to the latest with https://github.com/siliconflow/onediff?tab=readme-ov-file#1-install-oneflow
- If you are using save/load graph. Please use this new version to save the graph again.
- For SVD(Stable Video Diffusion) onediff users, please use os.environ["VM_REBUILD_DYNAMIC_SHAPE"] = "1" to support DYNAMIC SHAPE with SVD. There has some re-compile cost, when enabling VM_REBUILD_DYNAMIC_SHAPE, so loading graph is needed. We will do more work on this.
OneDiff SDXL inference has been integrated into fal.ai playground
SDXL inference at the speed of thought: https://www.fal.ai/models/onediff-sdxl