GreebleGenerator

A Blender add-on generates Greebles.

This is my Graduation Project.

Dependencies

• Stable Diffusion Web UI by Automatic1111 should be installed locally. (https://github.com/AUTOMATIC1111/stable-diffusion-webui)
• ContorlNet Extension for SD Web-UI should be installed via SD Web-UI -> Extensions -> Install from URL -> (https://github.com/Mikubill/sd-webui-controlnet)
• Blender(3.0 or higher; recommend 3.5)

Models

• Stable Diffusion 1.5 : sd-v1-5-pruned-noema-fp16.safetensors(https://huggingface.co/hollowstrawberry/stable-diffusion-guide/blob/main/models/sd-v1-5-pruned-noema-fp16.safetensors)
• Depth Map estimation model for ControlNet : (https://huggingface.co/lllyasviel/ControlNet/blob/main/models/control_sd15_depth.pth)
• LoRA trained model for Greeble Generator : Greeble_dataset-10.safetensors (in this repository->models)

Installation

1. Download this repository as zip file and open Blender.
2. Navigate to Edit->Preferences->Add-ons->Install and select zip file you downloaded.
3. Make sure "Greeble Generator" is enabled and restart Blender.
4. Navigate to Stable Diffusion Web UI installed folder and edit webui-user.bat.
5. Add "--api" to "COMMANDLINE_ARGS"
6. Navigate to stable-diffusion-webui -> models.
7. Put sd-v1-5-pruned-noema-fp16.safetensors into models/Stable-diffusion.
8. Put control_sd15_depth.pth into models/ControlNet.
9. Put Greeble_dataset-10.safetensors into models/Lora

Run

1. Navigate to Stable Diffusion Web UI installed folder and run webui-user.bat.
2. Open Blender in administrator mode.
3. Select desired face in face mode and press "Take Snapshot" in N Panel(Press N to activate).
4. Press "Apply Greeble Texture".
5. You can keep generate different textures by hitting "Apply Greeble Texture" multiple times.
6. After texture is successfully applied, press "Apply Depth Map".
7. You can adjust UV Map scale(experimental) and save textures&depthmap.

Credits and Licenses

• Stable Diffusion - https://github.com/CompVis/stable-diffusion, https://github.com/CompVis/taming-transformers
• Stable Diffusion Web UI by Automatic1111 - https://github.com/AUTOMATIC1111/stable-diffusion-webui
• Blender by Blender - https://github.com/blender/blender
• ControlNet for Stable Diffusion WebUI by Mikubill - https://github.com/Mikubill/sd-webui-controlnet