Open
Description
We have a couple of community pipelines that used StableDiffusionPipeline
as the base class instead of DiffusionPipeline
. Most of them are broken after we changed the signature of StableDiffusionPipeline
. see more details on the issue here #6969 (comment)
pipelines should not use StableDiffusionPipeline
as a base class. Is anyone interested in refactoring some of these community pipelines to inherit from DiffusionPipeline
instead? You will need to:
- update the base class to use
DiffusionPipeline
and any of the mixins needed e.g.
class CommunityPipeline(
DiffusionPipeline, TextualInversionLoaderMixin, LoraLoaderMixin, IPAdapterMixin, FromSingleFileMixin
):
- if the community pipeline use some of the methods in
StableDiffusionPipeline
- you need use#Copied from
statement to copy over methods to your community pipeline. Learn more about theCopied from
mechanism here https://huggingface.co/docs/diffusers/conceptual/contribution#copied-from-mechanism
Here is the list of pipelines that need to be refactored!
- Prompt2PromptPipeline(completed by @ihkap11 Prompt2Prompt: Inherit from DiffusionPipeline #7211 ): https://github.com/huggingface/diffusers/blob/main/examples/community/pipeline_prompt2prompt.py
- RegionalPromptingStableDiffusionPipeline (@pranjalks is working on it): https://github.com/huggingface/diffusers/blob/main/examples/community/regional_prompting_stable_diffusion.py
- StableDiffusionReferencePipeline ( completed by @StandardAI [
Refactor
]StableDiffusionReferencePipeline
inheriting fromDiffusionPipeline
#7071) - TensorRTStableDiffusionPipeline (@Bhavay-2001 is working on it): https://github.com/huggingface/diffusers/blob/main/examples/community/stable_diffusion_tensorrt_txt2img.py