We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
要求: paddle:paddle版本2.6.0 ppdiffusers:https://github.com/PaddlePaddle/PaddleMIX/tree/upgrade_ppdiffusers0240/ppdiffusers paddlenlp: pip install https://paddlenlp.bj.bcebos.com/models/community/junnyu/wheels/paddlenlp-2.6.2-py3-none-any.whl 开始复现之前可对比已经转换后的2个pipeline文件,学习一下api的映射关系: * paddle:https://github.com/PaddlePaddle/PaddleMIX/blob/upgrade_ppdiffusers0240/ppdiffusers/ppdiffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py * torch:https://github.com/huggingface/diffusers/blob/v0.24.0/src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py 注意点: * 所有涉及到 device 的设置,均可以删除,因为paddle内部会设置全局的device。 * 所有 clip、bert、t5、xlm_roberta 均从 ppdiffusers.transformers 导入,而不是使用paddlenlp.transformers。 * enable_freeu 、disable_freeu、enable_vae_slicing、disable_vae_slicing、enable_vae_tiling、disable_vae_tiling均已经放到DiffusionPipeline里面了,因此无需在具体的pipeline里面添加该内容。 * 关于权重转换: * 现在基本上所有模型权重都与pytorch一样,只需要将特殊的层进行转置,比如:nn.Linear 层需要转置。 * clip、bert、t5、xlm_roberta类型的模型以及ppdiffusers/models目录下的等模型可使用 xxxx.from_pretrained(本地torch文件目录, from_diffusers=True) 进行权重转换。
The text was updated successfully, but these errors were encountered:
[PPDiffusers] StableDiffusion Pipeline 升级 (#390)
64bfe32
#377 完成1,2,3代码和单测,4和3单测相同 暂时测试可以,有其他问题再找时间修改 pytest test_stable_diffusion_img2img.py ![image](https://github.com/PaddlePaddle/PaddleMIX/assets/4617245/1e5bbbef-7090-43e4-b0ba-c2bfd13e98aa) pytest test_stable_diffusion_inpaint.py ![image](https://github.com/PaddlePaddle/PaddleMIX/assets/4617245/7ca9d9b8-620d-4090-b09c-5b8653ab0d64) pytest test_stable_diffusion_inpaint_legacy.py ![image](https://github.com/PaddlePaddle/PaddleMIX/assets/4617245/cd08e49f-6e90-4b7d-8c7a-6cffe7e22b90)
No branches or pull requests
StableDiffusion Pipeline 升级
任务描述
任务背景
完成步骤
提交内容:
The text was updated successfully, but these errors were encountered: