Youtube video by MakeTheBreak
Generate QR
You will first need a QR Code. To increase your chance of success, use a QR code that meets the following criteria.
- Use a high fault tolerance setting (30%).
- Have a white margin around the QR Code (the quiet zone).
- Use the most basic square fill with a black-and-white pattern.
- Avoid using generators that introduce a thin white line between black elements.
- Download code as png format
We will use this QR Code generator in this tutorial.
Stable Diffusion Settings
Image to Image
- Resize mode: Just resize
- Sampling method: DPM++2M Karras
- Sampling step: 20-50 (22 OK)
- CFG Scale: 7
Use ControlNet extension
Upload the QR code to ControlNet‘s image canvas.
*Upload it on ControlNet Unit 0 and ControlNet Unit 1
Use the following ControlNet Unit 0 settings:
- Enable: Yes
- Control Type: All
- Preprocessor: inpaint_global_harmonious
- Model: inpaint
- Control Weight: 0.35-0.6 (test between this values)
- Starting Control Step: 0.0
- Ending Control Step: 1
Use the following ControlNet Unit 1 settings:
- Enable: Yes
- Control Type: All
- Preprocessor: inpaint_global_harmonious
- Model: tile
- Control Weight: 0.5
- Starting Control Step: 0.35
- Ending Control Step: 0.7
Click Generate
Add your prompt and click generate.
You can improve your prompt in the following link:
https://huggingface.co/spaces/Gustavosta/MagicPrompt-Stable-Diffusion
Notes
QR codes with shorter text have a higher success rate because the patterns are simpler.
Not all QR codes work the same. Some could be marginally working and can only be read at a certain distance.
Some prompts blend more naturally with QR codes.
The working parameters can be different for different models and prompts. You must adjust the following parameter slightly to blend the QR Code and the prompt well.
- Denoising strength: Decrease to have the initial composition follows the QR code more. But you will only see the QR code if you reduce it too much. It is typically set higher than 0.7.
- Control Weight: Decrease to show the prompt more.
- Starting Control Step: Increase to show the prompt more.
- Ending Control Step: Decrease to stop the ControlNet earlier so that the QR code and the image can blend more naturally.
Results Examples
Promts ideas
Outdoor market
A photo-realistic rendering of a busy market, ((street vendors, fruits, vegetable, shops)), (Photorealistic:1.3), (Highly detailed:1.2), (Natural light:1.2), art inspired by Architectural Digest, Vogue Living, and Elle Decor
-ugly, disfigured, low quality, blurry, nsfw
- Denoising strength: 0.75
- Control weight: 0.87
- Starting Control Step: 0.23
- Ending Control Step: 0.9
Mechanical girl
mechanical girl,ultra realistic details, portrait, global illumination, shadows, octane render, 8k, ultra sharp,intricate, ornaments detailed, cold colors, metal, egypician detail, highly intricate details, realistic light, trending on cgsociety, glowing eyes, facing camera, neon details, machanical limbs,blood vessels connected to tubes,mechanical vertebra attaching to back,mechanical cervial attaching to neck,sitting,wires and cables connecting to head
-ugly, disfigured, low quality, blurry
- Denoising strength: 0.75
- Control weight: 1
- Starting Control Step: 0.23
- Ending Control Step: 0.7
Robot
light, futobot, cyborg, ((masterpiece),(best quality),(ultra-detailed), (full body:1.2), 1male, solo, hood up, upper body, mask, 1boy, male focus,white gloves, cloak, long sleeves, spaceship, lightning, hires
-ugly, disfigured, low quality, blurry
- Denoising strength: 0.75
- Control weight: 1
- Starting Control Step: 0.24
- Ending Control Step: 0.9.
– Examples created by stable-diffusion-art.com/qr-code/