cog-sd-webui

Cog template to deploy any SD models as an inference API endpoint with the capabilities of SD WebUI, such as:

• Hires. fix
• Samplers
• Scripts
• All compatible extensions (e.g. ADetailer, ControlNet)

Set up Cloud GPU instance and signin with SSL

follow this

Clone this repo

git clone https://github.com/AlphaByteInc/cog-sd-webui.git
cd cog-sd-webui

Download Checkpoints

Put the model file (ckpt, safetensors, pth, etc.) into the model directory. Make sure there is only one model file in the directory. For instance:

wget --content-disposition -P model https://civitai.com/api/download/models/176425

Install cog to VM on LambdaLabs

curl https://replicate.github.io/codespaces/scripts/install-cog.sh | bash
cog --version
# cog version 0.6.1 (built 2022-12-18T04:42:41+0000)

Create model on Replicate

from here

Build and Deploy

Execute the command below to deploy your model to Replicate.

sudo cog login
sudo cog push r8.im/alphabyteinc/${modelname}

If you prefer to deploy to other private Docker registry, run the following command to build the image:

cog build -t ${IMAGE_TAG_FOR_PRIVATE_REGISTRY}

Then run docker push to deploy.

Customize

Since the entire SD WebUI will be packaged into the image, you can utilize all functions provided by SD WebUI and it's extensions.

As you can see in cog.yaml file, we've built-in ADetailer in this repo, you can achieve the same thing by adding extra scripts to bundle embedings, Lora, extensions into your image.

Credits

• SD WebUI
• Cog